Fatal trap 12: page fault while in kernel mode, vmcore.102 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #2 r353681M: Fri Oct 18 11:19:46 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33161969664 (31625 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 7 8 4 6 11 3 2 5 9 10 Timecounter "TSC-low" frequency 1750035000 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 000.000054 [4335] netmap_init netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff81078d90, 0) error 19 [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub5 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80003d5f800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 18 Oct 11:31:34 ntpdate[2053]: step time server 192.168.5.1 offset -0.248777 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff800049cfcc0 ufs (ufs) @ kern/vfs_mount.c:1603 2nd 0xfffff80007d31558 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1927 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2509 at lockmgr_lock_fast_path+0x179 #3 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cbe7e5 at _vn_lock+0x65 #5 0xffffffff80ecc1cd at softdep_flushworklist+0x5d #6 0xffffffff80eed236 at ffs_sync+0x406 #7 0xffffffff80ca2a33 at dounmount+0x463 #8 0xffffffff80ca2584 at sys_unmount+0x2a4 #9 0xffffffff81051534 at amd64_syscall+0x2d4 #10 0xffffffff81027c40 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 208 files, 18207 used, 1247200 free (192 frags, 155876 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Fri Oct 18 11:31 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Oct 18 11:31:58 mercat1 login[2335]: ROOT LOGIN (root) ON ttyu1 Last login: Fri Oct 18 10:15:44 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #2 r353681M: Fri Oct 18 11:19:46 CEST 2019 root@mercat1:~ # Oct 18 11:35:26 mercat1 su[2374]: pho to root on /dev/pts/0 Oct 18 12:16:07 mercat1 kernel: pid 31354 (swap), jid 0, uid 0, was killed: out of swap space 20191018 12:26:37 all (1/677): 1st.sh 20191018 12:26:39 all (2/677): 256m.sh 20191018 12:26:40 all (3/677): audit.sh 20191018 12:26:42 all (4/677): beneath2.sh 20191018 12:26:44 all (5/677): beneath3.sh 20191018 12:26:45 all (6/677): buildworld.sh 20191018 12:26:47 all (7/677): buildworld2.sh 20191018 12:26:48 all (8/677): cluster.sh 20191018 12:26:50 all (9/677): cpuset.sh 20191018 12:26:51 all (10/677): crossmp2.sh 20191018 12:26:53 all (11/677): crossmp6.sh 20191018 12:26:54 all (12/677): datagram2.sh 20191018 12:26:56 all (13/677): datagram3.sh 20191018 12:26:58 all (14/677): datamove.sh freework leak: 13/41. newblk leak: 5/15. 20191018 12:26:59 all (15/677): datamove3.sh freework leak: 1/42. newblk leak: 2/17. 20191018 12:27:01 all (16/677): devfs2.sh 20191018 12:27:02 all (17/677): devfs5.sh 20191018 12:27:04 all (18/677): dtrace_fault.sh 20191018 12:27:05 all (19/677): dumpfs.sh newblk leak: 295/312. 20191018 12:27:07 all (20/677): dup2.sh 20191018 12:27:08 all (21/677): execi386.sh 20191018 12:27:10 all (22/677): extattr_set_fd.sh 20191018 12:27:12 all (23/677): extattrctl.sh lock order reversal: 1st 0xfffff80666cb8c38 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff80570d892e0 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1718 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2b1d at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba36d5 at __lockmgr_args+0x605 #4 0xffffffff80eea353 at ffs_vgetf+0x163 #5 0xffffffff80efd0bb at ufs_root+0x1b #6 0xffffffff80caf5c7 at vfs_cache_root_fallback+0x117 #7 0xffffffff80caf362 at vfs_cache_root+0x1c2 #8 0xffffffff80ef550f at ufs_extattr_autostart+0x5f #9 0xffffffff80eec726 at ffs_mount+0x1c76 #10 0xffffffff80ca1728 at vfs_domount+0x818 #11 0xffffffff80ca00ad at vfs_donmount+0x88d #12 0xffffffff80c9f7e9 at sys_nmount+0x69 #13 0xffffffff81051534 at amd64_syscall+0x2d4 #14 0xffffffff81027c40 at fast_syscall_common+0x101 20191018 12:27:13 all (24/677): fifo.sh 20191018 12:27:15 all (25/677): forkbomb.sh 20191018 12:27:16 all (26/677): fsck2.sh 20191018 12:27:18 all (27/677): fsck3.sh 20191018 12:27:20 all (28/677): fsck4.sh 20191018 12:27:21 all (29/677): geomleak.sh 20191018 12:27:23 all (30/677): getrandom.sh 20191018 12:27:25 all (31/677): gnop3.sh 20191018 12:27:26 all (32/677): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20191018 12:27:28 all (33/677): holdcnt0.sh 20191018 12:27:30 all (34/677): holdcnt02.sh 20191018 12:27:31 all (35/677): holdcnt03.sh 20191018 12:27:32 all (36/677): holdcnt04.sh 20191018 12:27:34 all (37/677): isofs2.sh 20191018 12:27:36 all (38/677): jail.sh 20191018 12:27:37 all (39/677): jail2.sh 20191018 12:27:39 all (40/677): jail3.sh 20191018 12:27:40 all (41/677): jail4.sh 20191018 12:27:42 all (42/677): kern_umtx_inf_loop.sh 20191018 12:27:43 all (43/677): kevent10.sh 20191018 12:27:45 all (44/677): kevent3.sh 20191018 12:27:47 all (45/677): ldt.sh 20191018 12:27:48 all (46/677): ldt2.sh 20191018 12:27:50 all (47/677): libMicro.sh 20191018 12:27:51 all (48/677): linux.sh 20191018 12:27:53 all (49/677): lockd.sh 20191018 12:27:54 all (50/677): lockf.sh 20191018 12:27:56 all (51/677): lookup_shared.sh 20191018 12:27:57 all (52/677): mac.sh 20191018 12:27:59 all (53/677): mac_chkexec.sh 20191018 12:28:00 all (54/677): machipc.sh 20191018 12:28:02 all (55/677): machipc2.sh 20191018 12:28:03 all (56/677): maxmemdom.sh 20191018 12:28:05 all (57/677): maxproc.sh 20191018 12:28:06 all (58/677): md4.sh 20191018 12:28:08 all (59/677): md5.sh 20191018 12:28:09 all (60/677): md6.sh 20191018 12:28:11 all (61/677): mdconfig.sh 20191018 12:28:12 all (62/677): mdconfig3.sh 20191018 12:28:14 all (63/677): memguard4.sh 20191018 12:28:16 all (64/677): mkfifo5.sh 20191018 12:28:17 all (65/677): mkfifo7.sh mount leak: 16/47 20191018 12:28:19 all (66/677): mlockall5.sh 20191018 12:28:21 all (67/677): mmap.sh 20191018 12:28:22 all (68/677): mmap12.sh 20191018 12:28:24 all (69/677): mmap16.sh 20191018 12:28:25 all (70/677): mmap17.sh 20191018 12:28:27 all (71/677): mmap20.sh 20191018 12:28:28 all (72/677): mmap24.sh 20191018 12:28:30 all (73/677): mmap30.sh 20191018 12:28:32 all (74/677): mmap33.sh 20191018 12:28:33 all (75/677): mmap35.sh 20191018 12:28:35 all (76/677): mmap36.sh 20191018 12:28:36 all (77/677): mount.sh 20191018 12:28:38 all (78/677): mountro3.sh newblk leak: 1732/2044. 20191018 12:28:40 all (79/677): mprotect.sh 20191018 12:28:41 all (80/677): msdos2.sh 20191018 12:28:43 all (81/677): msdos3.sh 20191018 12:28:44 all (82/677): msdos7.sh lock order reversal: 1st 0xfffff804887bc2e0 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3424 2nd 0xfffff80735319068 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2509 at lockmgr_lock_fast_path+0x179 #3 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cbe7e5 at _vn_lock+0x65 #5 0xffffffff80a8f429 at msdosfs_fsync+0x49 #6 0xffffffff810ef288 at VOP_FSYNC_APV+0x88 #7 0xffffffff80cba369 at kern_fsync+0x199 #8 0xffffffff81051534 at amd64_syscall+0x2d4 #9 0xffffffff81027c40 at fast_syscall_common+0x101 20191018 12:28:46 all (83/677): msdos8.sh 20191018 12:28:47 all (84/677): msetdomain.sh 20191018 12:28:49 all (85/677): nanosleep.sh 20191018 12:28:51 all (86/677): nbufkv.sh 20191018 12:28:52 all (87/677): nfs.sh 20191018 12:28:53 all (88/677): nfs12.sh 20191018 12:28:55 all (89/677): nfs14.sh 20191018 12:28:56 all (90/677): nfs15.sh 20191018 12:28:58 all (91/677): nfs15lockd.sh 20191018 12:28:59 all (92/677): nfs15lockd3.sh 20191018 12:29:01 all (93/677): nfs3.sh 20191018 12:29:02 all (94/677): nfs4.sh 20191018 12:29:04 all (95/677): nfs7.sh 20191018 12:29:05 all (96/677): nfs8.sh 20191018 12:29:07 all (97/677): nfs9.sh 20191018 12:29:08 all (98/677): nfs_halfpage.sh 20191018 12:29:10 all (99/677): nfs_halfpage2.sh 20191018 12:29:11 all (100/677): nfsdelegation.sh 20191018 12:29:13 all (101/677): nfsdepth.sh 20191018 12:29:14 all (102/677): nfsrename.sh 20191018 12:29:16 all (103/677): nfssillyrename.sh 20191018 12:29:17 all (104/677): nullfs13.sh 20191018 12:29:19 all (105/677): nullfs14.sh 20191018 12:29:20 all (106/677): nullfs15.sh 20191018 12:29:22 all (107/677): nullfs21.sh 20191018 12:29:23 all (108/677): nullfs23.sh 20191018 12:29:25 all (109/677): nullfs4.sh 20191018 12:29:26 all (110/677): nullfs6.sh 20191018 12:29:28 all (111/677): nullfs7.sh 20191018 12:29:30 all (112/677): nullfs9.sh 20191018 12:29:31 all (113/677): numa.sh 20191018 12:29:33 all (114/677): oom.sh 20191018 12:29:34 all (115/677): open.sh 20191018 12:29:36 all (116/677): pagefault.sh 20191018 12:29:37 all (117/677): parallelmount2.sh 20191018 12:29:39 all (118/677): pathconf.sh 20191018 12:29:40 all (119/677): pathconf2.sh 20191018 12:29:42 all (120/677): pcatch.sh 20191018 12:29:43 all (121/677): pcatch2.sh 20191018 12:29:44 all (122/677): ping.sh 20191018 12:29:46 all (123/677): pkru.sh 20191018 12:29:47 all (124/677): pkru2.sh 20191018 12:29:49 all (125/677): pmc4.sh 20191018 12:29:51 all (126/677): pmc5.sh 20191018 12:29:52 all (127/677): poll.sh 20191018 12:29:54 all (128/677): posix_fadvise.sh 20191018 12:29:55 all (129/677): posix_fadvise2.sh 20191018 12:29:57 all (130/677): procfs5.sh 20191018 12:29:58 all (131/677): procfs6.sh 20191018 12:30:00 all (132/677): procstat.sh 20191018 12:30:01 all (133/677): pthread9.sh 20191018 12:30:03 all (134/677): ptrace.sh 20191018 12:30:04 all (135/677): ptrace3.sh 20191018 12:30:06 all (136/677): pts2.sh 20191018 12:30:07 all (137/677): quota5.sh 20191018 12:30:09 all (138/677): rename13.sh 20191018 12:30:10 all (139/677): rename4.sh 20191018 12:30:12 all (140/677): revoke.sh 20191018 12:30:14 all (141/677): routetbl.sh 20191018 12:30:15 all (142/677): ruby.sh 20191018 12:30:17 all (143/677): rwlock_ronly.sh 20191018 12:30:18 all (144/677): schedfuzz.sh 20191018 12:30:20 all (145/677): seekdir.sh 20191018 12:30:21 all (146/677): segnp.sh 20191018 12:30:23 all (147/677): segregs.sh 20191018 12:30:25 all (148/677): select3.sh 20191018 12:30:26 all (149/677): sendfile2.sh lock order reversal: 1st 0xfffff800076af040 filedesc structure (filedesc structure) @ kern/sys_generic.c:1516 2nd 0xfffff804884007d0 ufs (ufs) @ kern/vfs_vnops.c:1551 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2b1d at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba36d5 at __lockmgr_args+0x605 #4 0xffffffff80eeea8c at ffs_lock+0x7c #5 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cbe7e5 at _vn_lock+0x65 #7 0xffffffff80cbd28a at vn_poll+0x3a #8 0xffffffff80c43b79 at kern_poll+0x3d9 #9 0xffffffff80c43790 at sys_poll+0x50 #10 0xffffffff81051534 at amd64_syscall+0x2d4 #11 0xffffffff81027c40 at fast_syscall_common+0x101 20191018 12:30:54 all (150/677): sendfile4.sh 20191018 12:30:55 all (151/677): setuid.sh 20191018 12:30:57 all (152/677): shm_super.sh 20191018 12:30:59 all (153/677): sigaltstack.sh 20191018 12:31:00 all (154/677): sigreturn.sh 20191018 12:31:02 all (155/677): sigstop.sh 20191018 12:31:04 all (156/677): snap12.sh lock order reversal: 1st 0xfffff802f819d068 ufs (ufs) @ kern/vfs_mount.c:1603 2nd 0xfffff8000379f130 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2131 3rd 0xfffff8066c1a77d0 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:2132 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2b1d at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba36d5 at __lockmgr_args+0x605 #4 0xffffffff80ecab99 at ffs_snapshot_unmount+0x109 #5 0xffffffff80eea0b9 at ffs_flushfiles+0x79 #6 0xffffffff80ecc443 at softdep_flushfiles+0x73 #7 0xffffffff80eec927 at ffs_unmount+0xd7 #8 0xffffffff80ca2a22 at dounmount+0x452 #9 0xffffffff80ca2584 at sys_unmount+0x2a4 #10 0xffffffff81051534 at amd64_syscall+0x2d4 #11 0xffffffff81027c40 at fast_syscall_common+0x101 20191018 12:31:05 all (157/677): snap2-1.sh lock order reversal: 1st 0xfffffe0038ab6018 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 2nd 0xfffff8000379f130 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2326 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2b1d at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba36d5 at __lockmgr_args+0x605 #4 0xffffffff80ecb256 at ffs_copyonwrite+0x176 #5 0xffffffff80eedb0c at ffs_geom_strategy+0x8c #6 0xffffffff80f01293 at ufs_strategy+0x83 #7 0xffffffff810f09e0 at VOP_STRATEGY_APV+0x90 #8 0xffffffff80c85564 at bufstrategy+0x44 #9 0xffffffff80c853ed at bufwrite+0x24d #10 0xffffffff80eef92e at ffs_syncvnode+0x2be #11 0xffffffff80eee942 at ffs_fsync+0x22 #12 0xffffffff810ef288 at VOP_FSYNC_APV+0x88 #13 0xffffffff80efeecf at ufs_remove+0xdf #14 0xffffffff810ef42c at VOP_REMOVE_APV+0xac #15 0xffffffff80cb701f at kern_funlinkat+0x2bf #16 0xffffffff80cb6d58 at sys_unlink+0x28 #17 0xffffffff81051534 at amd64_syscall+0x2d4 20191018 12:31:07 all (158/677): snap2.sh 20191018 12:31:09 all (159/677): sndstat.sh 20191018 12:31:10 all (160/677): socketpair.sh 20191018 12:31:12 all (161/677): socketpair2.sh 20191018 12:31:13 all (162/677): suj2.sh 20191018 12:31:15 all (163/677): suj32.sh 20191018 12:31:17 all (164/677): suj35.sh lock order reversal: 1st 0xfffff804354eca48 ufs (ufs) @ kern/vfs_subr.c:2774 2nd 0xffffffff81802480 proctree (proctree) @ kern/subr_prf.c:182 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80bda1e8 at _sx_slock_int+0x68 #3 0xffffffff80c2050e at uprintf+0x5e #4 0xffffffff80ebc891 at ffs_valloc+0x541 #5 0xffffffff80f00597 at ufs_mkdir+0xc7 #6 0xffffffff810ef8fc at VOP_MKDIR_APV+0x8c #7 0xffffffOct 18 12:31:18 ff80cbaae3 at kern_mkdiramercat1 kernel: t+0x1b3 #8 0xffffffff81051534 apid 97741 (mkdirt amd64_syscall+0x2d4 #9 0xffffffff81027c40 at fast_syscall_common+0x101 ), uid 0 inumber 255 on /mnt: out of inodes 20191018 12:31:18 all (165/677): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20191018 12:31:20 all (166/677): suj8.sh Oct 18 12:31:21 mercat1 kernel: pid 97992 (dd), uid 0 inumber 4 on /mnt: filesystem full Oct 18 12:31:21 mercat1 kernel: pid 98008 (dd), uid 0 inumber 5 on /mnt: filesystem full 20191018 12:31:22 all (167/677): tar.sh 20191018 12:31:23 all (168/677): temp.sh 20191018 12:31:25 all (169/677): tmpfs15.sh 20191018 12:31:26 all (170/677): tmpfs18.sh 20191018 12:31:28 all (171/677): tmpfs4.sh 20191018 12:31:30 all (172/677): tmpfs6.sh 20191018 12:31:32 all (173/677): tmpfs7.sh 20191018 12:31:33 all (174/677): trim5.sh 20191018 12:31:35 all (175/677): trim6.sh 20191018 12:31:36 all (176/677): trim7.sh 20191018 12:31:38 all (177/677): trim8.sh 20191018 12:31:40 all (178/677): truncate4.sh 20191018 12:31:41 all (179/677): truncate6.sh 20191018 12:31:43 all (180/677): tvnlru.sh 20191018 12:31:44 all (181/677): ufssuspend.sh 20191018 12:31:46 all (182/677): uma_zalloc_arg.sh 20191018 12:31:47 all (183/677): unlink.sh 20191018 12:31:49 all (184/677): unload.sh 20191018 12:31:51 all (185/677): unload2.sh 20191018 12:31:52 all (186/677): vfork.sh 20191018 12:31:54 all (187/677): vmio.sh 20191018 12:31:55 all (188/677): watchman.sh 20191018 12:31:57 all (189/677): write.sh 20191018 12:31:58 all (190/677): datagram.sh 20191018 12:32:01 all (191/677): ext2fs3.sh 20191018 12:32:04 all (192/677): extattr.sh 20191018 12:32:07 all (193/677): fpclone2.sh 20191018 12:32:09 all (194/677): isofs.sh 20191018 12:32:12 all (195/677): killpg.sh 20191018 12:32:14 all (196/677): md9.sh 20191018 12:32:17 all (197/677): mmap25.sh 20191018 12:32:19 all (198/677): mmap26.sh 20191018 12:32:22 all (199/677): mmap28.sh Oct 18 12:32:25 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x4eb2000 to be written at offset 0x86e000 for process mmap28 20191018 12:32:25 all (200/677): mmap8.sh 20191018 12:32:27 all (201/677): mmap9.sh 20191018 12:32:30 all (202/677): mountro2.sh 20191018 12:32:32 all (203/677): nullfs10.sh 20191018 12:32:35 all (204/677): nullfs12.sh 20191018 12:32:37 all (205/677): nullfs16.sh 20191018 12:32:39 all (206/677): nullfs3.sh 20191018 12:32:42 all (207/677): openlock.sh 20191018 12:32:45 all (208/677): ptrace11.sh 20191018 12:32:47 all (209/677): ptrace8.sh 20191018 12:32:50 all (210/677): quota9.sh lock order reversal: 1st 0xfffff808151f5488 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffff8073594a000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80bae445 at __mtx_lock_flags+0x95 #3 0xffffffff80efbc7d at quotaoff_inchange+0xbd #4 0xffffffff80eea16d at ffs_flushfiles+0x12d #5 0xffffffff80ecc443 at softdep_flushfiles+0x73 #6 0xffffffff80eec927 at ffs_unmount+0xd7 #7 0xffffffff80ca2a22 at dounmount+0x452 #8 0xffffffff80ca2584 at sys_unmount+0x2a4 #9 0xffffffff81051534 at amd64_syscall+0x2d4 #10 0xffffffff81027c40 at fast_syscall_common+0x101 20191018 12:32:53 all (211/677): random.sh 20191018 12:32:55 all (212/677): rename6.sh 20191018 12:32:58 all (213/677): scp.sh 20191018 12:33:00 all (214/677): sendfile.sh 20191018 12:33:02 all (215/677): sendfile6.sh 20191018 12:33:04 all (216/677): snap.sh 20191018 12:33:06 all (217/677): snap10.sh 20191018 12:33:09 all (218/677): spin.sh 20191018 12:33:11 all (219/677): trim2.sh 20191018 12:33:13 all (220/677): umtx_suspend.sh 20191018 12:33:16 all (221/677): vm_fault_dontneed.sh 20191018 12:33:18 all (222/677): contigmalloc3.sh 20191018 12:33:20 all (223/677): contigmalloc2.sh 20191018 12:33:23 all (224/677): datamove4.sh 20191018 12:33:27 all (225/677): extattr3.sh 20191018 12:33:30 all (226/677): fcntl.sh 20191018 12:33:33 all (227/677): kevent2.sh 20191018 12:33:37 all (228/677): kevent8.sh 20191018 12:33:41 all (229/677): mlockall7.sh 20191018 12:33:44 all (230/677): mmap23.sh 20191018 12:33:48 all (231/677): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff804355ed278: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff808019af800 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff807f2f0d000 (pid 29286, mmap4, tid 102903) #0 0xffffffff80ba2ee2 at lockmgr_xlock_hard+0x432 #1 0xffffffff80ba36d5 at __lockmgr_args+0x605 #2 0xffffffff80eeea8c at ffs_lock+0x7c #3 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cbe7e5 at _vn_lock+0x65 #5 0xffffffff80cabdac at vputx+0x22c #6 0xffffffff80f1e2fc at vm_map_process_deferred+0x9c #7 0xffffffff80f240b6 at vm_map_remove+0xc6 #8 0xffffffff80f1ddb3 at vmspace_exit+0xd3 #9 0xffffffff80b8847d at exit1+0x59d #10 0xffffffff80b87edd at sys_sys_exit+0xd #11 0xffffffff81051534 at amd64_syscall+0x2d4 #12 0xffffffff81027c40 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=beea272b, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff804355ed278: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff808019af800 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff807f2f0d000 (pid 29286, mmap4, tid 102903) #0 0xffffffff80ba2ee2 at lockmgr_xlock_hard+0x432 #1 0xffffffff80ba36d5 at __lockmgr_args+0x605 #2 0xffffffff80eeea8c at ffs_lock+0x7c #3 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cbe7e5 at _vn_lock+0x65 #5 0xffffffff80cabdac at vputx+0x22c #6 0xffffffff80f1e2fc at vm_map_process_deferred+0x9c #7 0xffffffff80f240b6 at vm_map_remove+0xc6 #8 0xffffffff80f1ddb3 at vmspace_exit+0xd3 #9 0xffffffff80b8847d at exit1+0x59d #10 0xffffffff80b87edd at sys_sys_exit+0xd #11 0xffffffff81051534 at amd64_syscall+0x2d4 #12 0xffffffff81027c40 atOct 18 12:33:50 mercat1 kernel: fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=beea272b, uid=0, gid=0, flags=0x0 ino 4, on dev md10a pid 29286 (mmap4), uid 0 inumber 4 on /mnt: filesystem full vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff804355ed278: tag ufs, type VREG usecount 1, writecount 0, refcount 3203 flags (VI_ACTIVE) v_object 0xfffff808019af800 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8000750a5a0 (pid 29294, umount, tid 100209) #0 0xffffffff80ba2ee2 at lockmgr_xlock_hard+0x432 Oct 18 12:33:51 #1 0xffffffff80ba36d5 at __lockmgr_args+0x605 mercat1 kernel: #2 0xffffffff80eeea8c at ffs_lock+0x7c #pid 29294 (umoun3 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 t), uid 0 inumbe#4 0xffffffff80cbe7e5 at _vn_lock+0x65 r 4 on /mnt: fil#5 0xffffffff80cab2bb at vget_finish+0x8b esystem full #6 0xffffffff80cad73c at vfs_msync+0x7c #7 0xffffffff80ca29a2 at dounmount+0x3d2 #8 0xffffffff80ca2584 at sys_unmount+0x2a4 #9 0xffffffff81051534 at amd64_syscall+0x2d4 #10 0xffffffff81027c40 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=beea272b, uid=0, gid=0, flags=0x0 ino 4, on dev md10a 20191018 12:33:51 all (232/677): msdos9.sh 20191018 12:33:54 all (233/677): newfs5.sh 20191018 12:33:58 all (234/677): procfs2.sh 20191018 12:34:01 all (235/677): pthread.sh 20191018 12:34:05 all (236/677): tmpfs5.sh 20191018 12:34:09 all (237/677): truncate5.sh 20191018 12:34:12 all (238/677): udp.sh 20191018 12:34:15 all (239/677): unix_socket.sh 20191018 12:34:19 all (240/677): devfd.sh 20191018 12:34:23 all (241/677): dup.sh 20191018 12:34:27 all (242/677): mkfifo6.sh 20191018 12:34:32 all (243/677): mmap13.sh 20191018 12:34:37 all (244/677): mountro4.sh 20191018 12:34:42 all (245/677): growfs.sh g_access(997): provider ufsid/5da995431d879a52 has error 6 set g_access(997): provider ufsid/5da995431d879a52 has error 6 set g_access(997): provider ufsid/5da995431d879a52 has error 6 set g_access(997): provider gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda has error 6 set g_access(997): provider gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda has error 6 set g_access(997): provider gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5da995431d879a52, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5da995431d879a52, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/e5c1496e-f192-11e9-891e-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5da995431d879a52, error=17) GEOM leak: 14/87 20191018 12:34:47 all (246/677): procfs.sh 20191018 12:34:53 all (247/677): pshared.sh 20191018 12:34:59 all (248/677): ptrace2.sh 20191018 12:35:04 all (249/677): rename11.sh 20191018 12:35:10 all (250/677): symlink4.sh 20191018 12:35:15 all (251/677): tmpfs10.sh 20191018 12:35:21 all (252/677): truncate3.sh 20191018 12:35:27 all (253/677): truncate7.sh 20191018 12:35:31 all (254/677): datamove5.sh 20191018 12:35:38 all (255/677): fork.sh 20191018 12:35:45 all (256/677): linger3.sh 20191018 12:35:55 all (257/677): mlockall4.sh 20191018 12:36:02 all (258/677): ptrace9.sh 20191018 12:36:09 all (259/677): sparse.sh 20191018 12:36:13 all (260/677): linger2.sh Oct 18 12:36:17 mercat1 kernel: pid 79609 (linger2), uid 2007 inumber 888 on /mnt: filesystem full 20191018 12:36:20 all (261/677): linger4.sh Oct 18 12:36:25 mercat1 kernel: pid 80908 (linger4), uid 2007 inumber 47377 on /mnt: out of inodes 20191018 12:36:28 all (262/677): symlink2.sh 20191018 12:36:36 all (263/677): sysctl.sh 20191018 12:36:44 all (264/677): md8.sh 20191018 12:36:53 all (265/677): quota11.sh lock order reversal: 1st 0xfffff80738984a48 syncer (syncer) @ kern/vfs_subr.c:2345 2nd 0xfffff80736bee7d0 ufs (ufs) @ kern/vfs_subr.c:2774 stack backtrace: #0 0xffffffff80c3d603 at witness_debugger+0x73 #1 0xffffffff80c3d34e at witness_checkorder+0xa9e #2 0xffffffff80ba2b1d at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba36d5 at __lockmgr_args+0x605 #4 0xffffffff80eeea8c at ffs_lock+0x7c #5 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cbe7e5 at _vn_lock+0x65 #7 0xffffffff80cab2bb at vget_finish+0x8b #8 0xffffffff80efc679 at qsync+0x79 #9 0xffffffff80eed39c at ffs_sync+0x56c #10 0xffffffff80cb323e at sync_fsync+0x11e #11 0xffffffff810ef288 at VOP_FSYNC_APV+0x88 #12 0xffffffff80cb0ff4 at sched_sync+0x284 #13 0xffffffff80b8d8c4 at fork_exit+0x84 #14 0xffffffff8102835e at fork_trampoline+0xe 20191018 12:37:03 all (266/677): shm_open.sh 20191018 12:37:18 all (267/677): compare.sh 20191018 12:37:27 all (268/677): ffs_blkfree.sh newblk leak: 26641/28685. 20191018 12:37:37 all (269/677): procfs3.sh 20191018 12:37:47 all (270/677): tmpfs8.sh 20191018 12:38:00 all (271/677): execve.sh Oct 18 12:39:03 mercat1 kernel: pid 7333 (swap), jid 0, uid 0, was killed: out of swap space 20191018 12:41:15 all (272/677): rename8.sh 20191018 12:41:28 all (273/677): thr.sh witness_lock_list_get: witness exhausted 20191018 12:41:38 all (274/677): fsck5.sh 20191018 12:41:49 all (275/677): nfs15lockd2.sh 20191018 12:42:01 all (276/677): proccontrol.sh 20191018 12:42:12 all (277/677): rdgsbase.sh 20191018 12:42:23 all (278/677): rename9.sh 20191018 12:42:35 all (279/677): umountf4.sh freework leak: 155/197. 20191018 12:42:45 all (280/677): pmc7.sh 20191018 12:43:01 all (281/677): posix_fadvise3.sh 20191018 12:43:13 all (282/677): tmpfs14.sh 20191018 12:43:25 all (283/677): mprotect2.sh 20191018 12:47:12 all (284/677): pipe2.sh 20191018 12:47:25 all (285/677): umountf11.sh 20191018 12:47:39 all (286/677): umountf12.sh 20191018 12:47:54 all (287/677): umountf6.sh 20191018 12:48:07 all (288/677): radix.sh Oct 18 12:48:19 mercat1 kernel: pid 99795 (radix), jid 0, uid 0, was killed: out of swap space swp_pager_getswapspace(7): failed 20191018 12:48:24 all (289/677): recursiveflushes.sh 20191018 12:48:37 all (290/677): mountu.sh 20191018 12:48:55 all (291/677): suj10.sh 20191018 12:49:40 all (292/677): kevent6.sh 20191018 12:49:59 all (293/677): rdwr.sh 20191018 12:50:17 all (294/677): sem.sh 20191018 12:50:35 all (295/677): suj14.sh Oct 18 12:50:51 mercat1 kernel: pid 40935 (cp), uid 0 inumber 238038 on /mnt: filesystem full Oct 18 12:50:52 mercat1 kernel: pid 40935 (cp), uid 0 inumber 238074 on /mnt: filesystem full Oct 18 12:50:53 mercat1 kernel: pid 40966 (mkdir), uid 0 inumber 41507 on /mnt: filesystem full Oct 18 12:50:54 mercat1 kernel: pid 40999 (cp), uid 0 inumber 41508 on /mnt: filesystem full 20191018 12:50:57 all (296/677): mountro6.sh 20191018 12:51:19 all (297/677): multicast.sh 20191018 12:51:40 all (298/677): pdfork.sh 20191018 12:52:02 all (299/677): rename7.sh 20191018 12:52:23 all (300/677): core4.sh Oct 18 12:52:25 mercat1 kernel: Failed to write core file for process core4 (error 5) 20191018 12:52:46 all (301/677): tmpfs19.sh Oct 18 12:52:46 mercat1 syslogd: last message repeated 59 times swp_pager_getswapspace(3): failed 20191018 12:53:17 all (302/677): sendfile5.sh 20191018 12:53:41 all (303/677): mmap7.sh 20191018 12:54:07 all (304/677): tmpfs2.sh 20191018 12:54:33 all (305/677): f_offset.sh 20191018 12:54:57 all (306/677): pread.sh 20191018 12:55:23 all (307/677): sendmsg2.sh 20191018 12:55:50 all (308/677): sendfile3.sh 20191018 12:56:18 all (309/677): beneath.sh 20191018 12:56:53 all (310/677): namecache2.sh 20191018 12:57:24 all (311/677): mkfifo3.sh 20191018 12:57:55 all (312/677): mmap37.sh 20191018 12:58:27 all (313/677): split.sh 20191018 12:58:38 all (314/677): pthread5.sh 20191018 12:59:48 all (315/677): tcp4.sh Expensive timeout(9) function: 0xffffffff80e0a790(0xfffff805b43cdb70) 0.012372018 s Expensive timeout(9) function: 0xffffffff80e0b6f0(0xfffff80622488b70) 0.013321566 s 20191018 13:00:33 all (316/677): msdos5.sh GEOM leak: 19/106 20191018 13:07:32 all (317/677): nullfs22.sh 20191018 13:08:04 all (318/677): credleak.sh 20191018 13:08:35 all (319/677): core2.sh 20191018 13:09:07 all (320/677): rename3.sh 20191018 13:09:58 all (321/677): umountf5.sh Oct 18 13:10:08 mercat1 kernel: pid 85934 (creat), uid 0 inumber 768 on /mnt: out of inodes Oct 18 13:10:16 mercat1 kernel: pid 85960 (creat), uid 0 inumber 389 on /mnt: out of inodes Oct 18 13:10:18 mercat1 kernel: pid 85939 (creat), uid 0 inumber 1152 on /mnt: out of inodes Oct 18 13:10:21 mercat1 kernel: pid 85958 (creat), uid 0 inumber 771 on /mnt: out of inodes Oct 18 13:10:23 mercat1 kernel: pid 85939 (creat), uid 0 inumber 1152 on /mnt: out of inodes Oct 18 13:10:24 mercat1 kernel: pid 85958 (creat), uid 0 inumber 771 on /mnt: out of inodes Oct 18 13:10:26 mercat1 kernel: pid 85944 (creat), uid 0 inumber 4 on /mnt: out of inodes Oct 18 13:10:27 mercat1 kernel: pid 85947 (creat), uid 0 inumber 5 on /mnt: out of inodes Oct 18 13:10:28 mercat1 kernel: pid 85944 (creat), uid 0 inumber 4 on /mnt: out of inodes Oct 18 13:10:30 mercat1 kernel: pid 85934 (creat), uid 0 inumber 768 on /mnt: out of inodes Oct 18 13:10:31 mercat1 kernel: pid 85931 (creat), uid 0 inumber 773 on /mnt: out of inodes Oct 18 13:10:33 mercat1 kernel: pid 85958 (creat), uid 0 inumber 771 on /mnt: out of inodes Oct 18 13:10:35 mercat1 syslogd: last message repeated 1 times Oct 18 13:10:37 mercat1 kernel: pid 85944 (creat), uid 0 inumber 4 on /mnt: out of inodes Oct 18 13:10:39 mercat1 kernel: pid 85958 (creat), uid 0 inumber 771 on /mnt: out of inodes Oct 18 13:10:40 mercat1 kernel: pid 85943 (creat), uid 0 inumber 1153 on /mnt: out of inodes Oct 18 13:10:42 mercat1 kernel: pid 85937 (creat), uid 0 inumber 769 on /mnt: out of inodes Oct 18 13:10:43 mercat1 kernel: pid 85939 (creat), uid 0 inumber 1152 on /mnt: out of inodes Oct 18 13:10:44 mercat1 kernel: pid 85958 (creat), uid 0 inumber 771 on /mnt: out of inodes Oct 18 13:10:45 mercat1 syslogd: last message repeated 1 times Oct 18 13:10:46 mercat1 kernel: pid 85934 (creat), uid 0 inumber 768 on /mnt: out of inodes Oct 18 13:10:48 mercat1 kernel: pid 85931 (creat), uid 0 inumber 773 on /mnt: out of inodes Oct 18 13:10:49 mercat1 kernel: pid 85927 (swap), jid 0, uid 0, was killed: out of swap space 20191018 13:11:02 all (322/677): multicast2.sh Oct 18 13:11:06 mercat1 mDNSResponder[90695]: mDNSResponder (Engineering Build) (Jul 27 2019 06:17:54) starting Oct 18 13:11:06 mercat1 mDNSResponder[90695]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Oct 18 13:11:06 mercat1 mDNSResponder[90695]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 failed errno 51 (Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff80003d5f800 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 if_delmulti_locked: detaching ifnet instance 0xfffff8000387c000 Oct 18 13:12:11 mercat1 mDNSResponder[90695]: mDNSResponder (Engineering Build) (Jul 27 2019 06:17:54) stopping if_delmulti_locked: detaching ifnet instance 0xfffff80003d5f800 20191018 13:12:31 all (323/677): umountf.sh 20191018 13:13:23 all (324/677): vnodes.sh 20191018 13:14:07 all (325/677): sendfile_shm.sh 20191018 13:14:41 all (326/677): mmap5.sh 20191018 13:15:08 all (327/677): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Warning: memory type solaris leaked memory on destroy (4 allocations, 2112 bytes leaked). 20191018 13:16:06 all (328/677): quota8.sh newblk leak: 3/28688. 20191018 13:17:02 all (329/677): suj33.sh Oct 18 13:17:08 mercat1 kernel: pid 98627 (rw), uid 2007 inumber 36052 on /mnt: filesystem full fsync: giving up on dirty (error = 35) 0xfffff803b587d000: tag devfs, type VCHR usecount 1, writecount 0, refcount 144 rdev 0xfffff804887ea800 flags (VI_ACTIVE) v_object 0xfffff808157d1700 ref 0 pages 1539 cleanbuf 131 dirtybuf 11 lock type devfs: EXCL by thread 0xfffff80435c555a0 (pid 949, umount, tid 103994) #0 0xffffffff80ba2572 at lockmgr_lock_fast_path+0x1e2 #1 0xffffffff810f05a0 at VOP_LOCK1_APV+0x70 #2 0xffffffff80cbe7e5 at _vn_lock+0x65 #3 0xffffffff80ecc1cd at softdep_flushworklist+0x5d #4 0xffffffff80eed236 at ffs_sync+0x406 #5 0xffffffff80ca2a33 at dounmount+0x463 #6 0xffffffff80ca2584 at sys_unmount+0x2a4 #7 0xffffffff81051534 at amd64_syscall+0x2d4 #8 0xffffffff81027c40 at fast_syscall_common+0x101 dev md10a 20191018 13:17:43 all (330/677): fpu.sh 20191018 13:18:36 all (331/677): ufsbench.sh 20191018 13:19:30 all (332/677): nullfs11.sh 20191018 13:20:53 all (333/677): crossmp5.sh 20191018 13:21:46 all (334/677): fifo3.sh 20191018 13:22:34 all (335/677): posix_openpt.sh 20191018 13:23:32 all (336/677): jumbo.sh 20191018 13:24:34 all (337/677): advlock.sh 20191018 13:25:35 all (338/677): flock.sh 20191018 13:26:36 all (339/677): fsgs.sh 20191018 13:27:37 all (340/677): fts2.sh 20191018 13:28:39 all (341/677): fullpath.sh 20191018 13:29:40 all (342/677): mdconfig2.sh 20191018 13:30:41 all (343/677): midi2.sh 20191018 13:31:42 all (344/677): mknod.sh 20191018 13:32:43 all (345/677): mmap29.sh 20191018 13:33:45 all (346/677): pts3.sh 20191018 13:34:48 all (347/677): sem_wait.sh 20191018 13:35:49 all (348/677): shm.sh 20191018 13:36:51 all (349/677): sigstop2.sh 20191018 13:37:52 all (350/677): socketpair3.sh 20191018 13:38:53 all (351/677): bench.sh 20191018 13:40:03 all (352/677): crossmp8.sh 20191018 13:41:06 all (353/677): fsck.sh free inode /mnt11/1035 had 35184372088832000 blocks Oct 18 13:41:50 mercat1 kernel: pid 97865 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 97888 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 97911 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 97934 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 97957 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 97980 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98003 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98026 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98049 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98072 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98095 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98118 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98141 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98164 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98187 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98210 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98233 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98256 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98279 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98302 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98325 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98348 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98371 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98394 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98417 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98440 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98463 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:50 mercat1 kernel: pid 98486 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98509 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98532 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98555 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98578 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98601 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98624 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98647 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98670 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98693 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98716 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98739 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98790 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98813 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98836 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98859 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98882 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98905 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98928 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 98951 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99002 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99025 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99048 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99071 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99094 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99117 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99140 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99163 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:51 mercat1 kernel: pid 99186 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99209 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99232 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99255 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99278 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99301 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99324 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99347 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99370 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99393 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99416 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99439 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99462 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99485 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99508 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99531 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99554 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99577 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99600 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99623 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99646 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99669 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99692 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99715 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99738 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99761 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99784 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99807 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99830 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99853 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99876 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:52 mercat1 kernel: pid 99899 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 99922 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 99945 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 99968 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 99991 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 50 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 73 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 96 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 119 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 142 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 165 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 188 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 211 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 234 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 257 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 280 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 303 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 326 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 349 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 372 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 395 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 418 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 441 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 464 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 487 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 510 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 533 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 556 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 579 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 602 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 625 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:53 mercat1 kernel: pid 648 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 671 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 694 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 717 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 740 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 763 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 786 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 809 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 832 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 855 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 878 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 901 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 924 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 947 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 970 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 993 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1016 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1039 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1062 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1085 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1108 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1131 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1154 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1177 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1200 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1223 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1246 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1269 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1343 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:54 mercat1 kernel: pid 1366 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1389 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1412 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1435 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1458 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1509 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1532 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1555 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1578 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1601 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1624 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1647 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1670 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1693 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1716 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1739 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1762 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1785 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1808 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1831 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1854 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1877 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1900 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1924 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 1948 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 2001 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 2024 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 2048 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:55 mercat1 kernel: pid 2072 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2095 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2118 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2142 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2165 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2190 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2213 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2236 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2290 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2313 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2350 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2375 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2399 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2422 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2445 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2468 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2491 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2514 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2537 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2560 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2583 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2606 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2629 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2652 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2675 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2698 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2721 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2744 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2795 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:56 mercat1 kernel: pid 2818 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2841 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2864 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2887 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2910 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2933 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2956 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 2979 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3002 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3025 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3048 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3071 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3094 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3117 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3140 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3163 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3186 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3209 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3232 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3255 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3278 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3301 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3324 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3347 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3370 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3393 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3416 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3439 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3462 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3485 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:57 mercat1 kernel: pid 3508 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3531 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3554 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3577 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3600 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3623 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3646 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3669 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3697 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3720 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3743 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3766 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3789 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3812 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3835 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3858 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3881 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3904 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3927 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3950 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3973 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 3996 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4019 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4042 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4065 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4088 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4111 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4134 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4157 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4180 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4203 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:58 mercat1 kernel: pid 4226 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4249 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4272 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4295 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4322 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4345 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4416 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4511 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4606 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4700 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4793 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4888 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 4983 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5078 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5170 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5239 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5302 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5366 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5510 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5573 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5636 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5700 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5764 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5827 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5891 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5955 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 5986 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 6009 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 6032 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:41:59 mercat1 kernel: pid 6055 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6078 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6101 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6124 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6147 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6170 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6193 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6216 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6239 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6262 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6285 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6308 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6331 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6354 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6377 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6400 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6423 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6446 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6469 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6492 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6515 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6538 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6561 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6584 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6607 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6630 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6653 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6676 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6699 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6722 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6745 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:00 mercat1 kernel: pid 6768 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6791 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6814 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6837 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6860 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6911 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6934 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6957 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 6980 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7003 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7026 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7049 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7072 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7095 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7118 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7141 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7164 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7187 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7210 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7233 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7256 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7279 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7302 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7325 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7348 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7371 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7394 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7417 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7440 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:01 mercat1 kernel: pid 7463 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7486 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7509 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7532 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7555 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7578 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7601 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7624 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7647 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7670 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7693 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7716 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7739 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7762 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7785 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7808 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7831 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7854 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7877 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7900 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7923 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7946 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7969 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 7992 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8015 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8038 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8061 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8084 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8107 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8130 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8153 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8176 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:02 mercat1 kernel: pid 8199 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8222 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8245 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8268 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8291 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8314 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8337 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8360 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8383 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8406 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8429 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8452 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8475 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8498 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8549 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8572 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8595 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8646 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8669 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8692 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8743 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8766 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8789 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8812 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8835 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8858 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8881 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:03 mercat1 kernel: pid 8904 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 8927 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 8950 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 8973 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 8996 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9019 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9042 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9065 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9088 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9111 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9134 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9157 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9180 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9203 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9226 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9249 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9272 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9295 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9318 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9342 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9366 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9389 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9412 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9435 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9458 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9481 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9504 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9527 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9578 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:04 mercat1 kernel: pid 9601 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9624 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9647 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9670 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9693 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9716 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9739 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9790 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9813 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9836 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9859 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9882 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9905 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9928 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:05 mercat1 kernel: pid 9951 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 9974 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 9997 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10020 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10043 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10066 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10117 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10140 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10163 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10186 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10209 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10232 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10255 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10278 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10301 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10324 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10347 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10370 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10393 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10416 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10439 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10462 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10485 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10508 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10531 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10554 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10577 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10600 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10651 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:06 mercat1 kernel: pid 10674 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10697 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10720 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10743 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10766 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10789 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10812 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10835 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10858 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10881 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10904 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10927 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10950 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10973 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 10996 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11019 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11042 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11065 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11088 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11139 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11162 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11185 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11208 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11259 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11282 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11305 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11328 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11351 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:07 mercat1 kernel: pid 11374 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11425 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11448 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11471 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11494 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11517 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11540 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11563 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11586 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11609 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11632 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11655 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11678 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11729 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11752 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11775 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11798 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11821 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11844 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11867 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11890 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11913 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11936 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11959 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 11982 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 12005 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 12028 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 12051 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 12074 (touch), uid 0 inumber 2 on /mnt11: out of inodes Oct 18 13:42:08 mercat1 kernel: pid 12097 (touch), uid 0 inumber 2 on /mnt11: out of inodes 20191018 13:42:09 all (354/677): sendfile8.sh 20191018 13:43:11 all (355/677): sendfile9.sh 20191018 13:44:13 all (356/677): exlock.sh 20191018 13:45:20 all (357/677): tcp3.sh 20191018 13:46:22 all (358/677): rename10.sh 20191018 13:47:29 all (359/677): truss2.sh Oct 18 13:48:26 mercat1 kernel: pid 43624 (swap), jid 0, uid 0, was killed: out of swap space 20191018 13:48:36 all (360/677): suj6.sh 20191018 13:49:37 all (361/677): stack_guard_page.sh Oct 18 13:49:50 mercat1 kernel: pid 52917 (rw), uid 2007 inumber 71384 on /mnt: filesystem full 20191018 13:50:43 all (362/677): suj5.sh 20191018 13:51:51 all (363/677): vmstat.sh Fatal trap 12: page fault while in kernel mode cpuid = 10; apic id = 0a fault virtual address = 0x10 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80f134b3 stack pointer = 0x28:0xfffffe00e56c7450 frame pointer = 0x28:0xfffffe00e56c7490 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13145 (vmstat) trap number = 12 panic: page fault cpuid = 10 time = 1571399544 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e56c7100 vpanic() at vpanic+0x19d/frame 0xfffffe00e56c7150 panic() at panic+0x43/frame 0xfffffe00e56c71b0 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe00e56c7210 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e56c7270 trap() at trap+0x2bd/frame 0xfffffe00e56c7380 calltrap() at calltrap+0x8/frame 0xfffffe00e56c7380 --- trap 0xc, rip = 0xffffffff80f134b3, rsp = 0xfffffe00e56c7450, rbp = 0xfffffe00e56c7490 --- uma_vm_zone_stats() at uma_vm_zone_stats+0x1c3/frame 0xfffffe00e56c7490 sysctl_vm_zone_stats() at sysctl_vm_zone_stats+0x77e/frame 0xfffffe00e56c7680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x7b/frame 0xfffffe00e56c76c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e56c7740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e56c77f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e56c7940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e56c7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e56c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56c7ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- KDB: enter: panic [ thread pid 13145 tid 104197 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 13145 tid 104197 td 0xfffff80570f6a5a0 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00e56c7100 vpanic() at vpanic+0x1ba/frame 0xfffffe00e56c7150 panic() at panic+0x43/frame 0xfffffe00e56c71b0 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe00e56c7210 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e56c7270 trap() at trap+0x2bd/frame 0xfffffe00e56c7380 calltrap() at calltrap+0x8/frame 0xfffffe00e56c7380 --- trap 0xc, rip = 0xffffffff80f134b3, rsp = 0xfffffe00e56c7450, rbp = 0xfffffe00e56c7490 --- uma_vm_zone_stats() at uma_vm_zone_stats+0x1c3/frame 0xfffffe00e56c7490 sysctl_vm_zone_stats() at sysctl_vm_zone_stats+0x77e/frame 0xfffffe00e56c7680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x7b/frame 0xfffffe00e56c76c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e56c7740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e56c77f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e56c7940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e56c7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e56c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56c7ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- db:1:pho1> show allpcpu Current CPU: 10 cpuid = 0 dynamic pcpu = 0xb6c140 curthread = 0xfffff807e1442000: pid 62746 tid 100251 "sh" curpcb = 0xfffffe00e3f1ab80 fpcurthread = 0xfffff807e1442000: pid 62746 "sh" idlethread = 0xfffff800038bb000: tid 100003 "idle: cpu0" curpmap = 0xfffff80723163130 tssp = 0xffffffff81df2de0 commontssp = 0xffffffff81df2de0 rsp0 = 0xfffffe00e3f1ab80 gs32p = 0xffffffff81df9628 ldt = 0xffffffff81df9668 tss = 0xffffffff81df9658 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f1140 curthread = 0xfffff8073faaa000: pid 13155 tid 100676 "vmstat" curpcb = 0xfffffe00e5358b80 fpcurthread = 0xfffff8073faaa000: pid 13155 "vmstat" idlethread = 0xfffff800038bc5a0: tid 100004 "idle: cpu1" curpmap = 0xfffff807e327c130 tssp = 0xffffffff81df2e48 commontssp = 0xffffffff81df2e48 rsp0 = 0xfffffe00e5358b80 gs32p = 0xffffffff81df9690 ldt = 0xffffffff81df96d0 tss = 0xffffffff81df96c0 tlb gen = 10241945 curvnet = 0xfffff8000320b040 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7fd140 curthread = 0xfffff807f291c5a0: pid 62766 tid 102307 "thr1" curpcb = 0xfffffe00e7353b80 fpcurthread = 0xfffff807f291c5a0: pid 62766 "thr1" idlethread = 0xfffff800038bc000: tid 100005 "idle: cpu2" curpmap = 0xfffff804db0b4130 tssp = 0xffffffff81df2eb0 commontssp = 0xffffffff81df2eb0 rsp0 = 0xfffffe00e7353b80 gs32p = 0xffffffff81df96f8 ldt = 0xffffffff81df9738 tss = 0xffffffff81df9728 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc809140 curthread = 0xfffff8073f52e5a0: pid 13139 tid 100802 "vmstat" curpcb = 0xfffffe00e55d0b80 fpcurthread = 0xfffff8073f52e5a0: pid 13139 "vmstat" idlethread = 0xfffff800038bd5a0: tid 100006 "idle: cpu3" curpmap = 0xfffff8073a3b6130 tssp = 0xffffffff81df2f18 commontssp = 0xffffffff81df2f18 rsp0 = 0xfffffe00e55d0b80 gs32p = 0xffffffff81df9760 ldt = 0xffffffff81df97a0 tss = 0xffffffff81df9790 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc815140 curthread = 0xfffff807f22a65a0: pid 13148 tid 102480 "vmstat" curpcb = 0xfffffe00e76b8b80 fpcurthread = 0xfffff807f22a65a0: pid 13148 "vmstat" idlethread = 0xfffff800038bd000: tid 100007 "idle: cpu4" curpmap = 0xfffff80742848130 tssp = 0xffffffff81df2f80 commontssp = 0xffffffff81df2f80 rsp0 = 0xfffffe00e76b8b80 gs32p = 0xffffffff81df97c8 ldt = 0xffffffff81df9808 tss = 0xffffffff81df97f8 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc821140 curthread = 0xfffff808011825a0: pid 62765 tid 103399 "thr1" curpcb = 0xfffffe00e88bdb80 fpcurthread = 0xfffff808011825a0: pid 62765 "thr1" idlethread = 0xfffff800038be5a0: tid 100008 "idle: cpu5" curpmap = 0xfffff8073a575130 tssp = 0xffffffff81df2fe8 commontssp = 0xffffffff81df2fe8 rsp0 = 0xfffffe00e88bdb80 gs32p = 0xffffffff81df9830 ldt = 0xffffffff81df9870 tss = 0xffffffff81df9860 tlb gen = 10241944 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc82d140 curthread = 0xfffff804888715a0: pid 62740 tid 104520 "sh" curpcb = 0xfffffe033fe8bb80 fpcurthread = 0xfffff804888715a0: pid 62740 "sh" idlethread = 0xfffff800038be000: tid 100009 "idle: cpu6" curpmap = 0xfffff80317493130 tssp = 0xffffffff81df3050 commontssp = 0xffffffff81df3050 rsp0 = 0xfffffe033fe8bb80 gs32p = 0xffffffff81df9898 ldt = 0xffffffff81df98d8 tss = 0xffffffff81df98c8 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc839140 curthread = 0xfffff807f269b5a0: pid 13149 tid 102151 "vmstat" curpcb = 0xfffffe00e7045b80 fpcurthread = 0xfffff807f269b5a0: pid 13149 "vmstat" idlethread = 0xfffff800038a95a0: tid 100010 "idle: cpu7" curpmap = 0xfffff801c9254130 tssp = 0xffffffff81df30b8 commontssp = 0xffffffff81df30b8 rsp0 = 0xfffffe00e7045b80 gs32p = 0xffffffff81df9900 ldt = 0xffffffff81df9940 tss = 0xffffffff81df9930 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc845140 curthread = 0xfffff807f21fe5a0: pid 13157 tid 102677 "vmstat" curpcb = 0xfffffe00e7a95b80 fpcurthread = 0xfffff807f21fe5a0: pid 13157 "vmstat" idlethread = 0xfffff800038a9000: tid 100011 "idle: cpu8" curpmap = 0xfffff80611011130 tssp = 0xffffffff81df3120 commontssp = 0xffffffff81df3120 rsp0 = 0xfffffe00e7a95b80 gs32p = 0xffffffff81df9968 ldt = 0xffffffff81df99a8 tss = 0xffffffff81df9998 tlb gen = 10241945 curvnet = 0xfffff8000320b040 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc851140 curthread = 0xfffff800038aa5a0: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe00add93b80 fpcurthread = none idlethread = 0xfffff800038aa5a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff81da5950 tssp = 0xffffffff81df3188 commontssp = 0xffffffff81df3188 rsp0 = 0xfffffe00add93b80 gs32p = 0xffffffff81df99d0 ldt = 0xffffffff81df9a10 tss = 0xffffffff81df9a00 tlb gen = 10241945 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc85d140 curthread = 0xfffff80570f6a5a0: pid 13145 tid 104197 "vmstat" curpcb = 0xfffffe00e56c7b80 fpcurthread = 0xfffff80570f6a5a0: pid 13145 "vmstat" idlethread = 0xfffff800038aa000: tid 100013 "idle: cpu10" curpmap = 0xfffff8026e808130 tssp = 0xffffffff81df31f0 commontssp = 0xffffffff81df31f0 rsp0 = 0xfffffe00e56c7b80 gs32p = 0xffffffff81df9a38 ldt = 0xffffffff81df9a78 tss = 0xffffffff81df9a68 tlb gen = 10241945 curvnet = 0xfffff8000320b040 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc869140 curthread = 0xfffff807f2719000: pid 13150 tid 101668 "vmstat" curpcb = 0xfffffe00e66ccb80 fpcurthread = 0xfffff807f2719000: pid 13150 "vmstat" idlethread = 0xfffff800038ab5a0: tid 100014 "idle: cpu11" curpmap = 0xfffff80723973130 tssp = 0xffffffff81df3258 commontssp = 0xffffffff81df3258 rsp0 = 0xfffffe00e66ccb80 gs32p = 0xffffffff81df9aa0 ldt = 0xffffffff81df9ae0 tss = 0xffffffff81df9ad0 tlb gen = 10241945 curvnet = 0xfffff8000320b040 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffff800037e9000 /dev/gpt/work on / (ufs) 0xfffff800037e8000 devfs on /dev (devfs) 0xfffff802f86a5000 /dev/gpt/tmp on /tmp (ufs) 0xfffff803a9cf9000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 24 Buf domain 0 freebufs 15064 lofreebufs 219 hifreebufs 329 bufspace 1277952 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 8 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 57 (942080) dirtyq count 8 (233472) wakeup 0 lim 25 CPU 1, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, Locked buffers: 1 space 32768 Total buffers: 20709 space 1277952 Buf domain 1 freebufs 13779 lofreebufs 219 hifreebufs 329 bufspace 43655168 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 12 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1324 (42700800) dirtyq count 12 (393216) wakeup 0 lim 25 CPU 1, 2, 0, 1, 2, 3, 0, 6, 0, 1, 1, 1, Locked buffers: 0 space 0 Total buffers: 12803 space 43655168 Buf domain 2 freebufs 14993 lofreebufs 219 hifreebufs 329 bufspace 1183744 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 137 (1138688) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 1, 0, 1, 0, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 11121 space 1183744 Buf domain 3 freebufs 14954 lofreebufs 219 hifreebufs 329 bufspace 2297856 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 177 (2285568) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 11227 space 2297856 Buf domain 4 freebufs 15069 lofreebufs 219 hifreebufs 329 bufspace 868352 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 61 (823296) dirtyq count 2 (12288) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 19741 space 868352 Buf domain 5 freebufs 14489 lofreebufs 219 hifreebufs 329 bufspace 17367040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 643 (17338368) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 13189 space 17367040 Buf domain 6 freebufs 10313 lofreebufs 219 hifreebufs 329 bufspace 156078080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4807 (155680768) dirtyq count 3 (98304) wakeup 0 lim 25 CPU 0, 0, 0, 1, 0, 6, 0, 0, 0, 3, 0, 0, Locked buffers: 0 space 0 Total buffers: 17141 space 156078080 db:1:pho1> show page vm_cnt.v_free_count: 7504027 vm_cnt.v_inactive_count: 13239 vm_cnt.v_active_count: 5998 vm_cnt.v_laundry_count: 3961 vm_cnt.v_wire_count: 589963 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51259 vm_cnt.v_free_target: 173107 vm_cnt.v_inactive_target: 259660 db:1:pho1> show pageq pq_free 7504027 dom 0 page_cnt 8123546 free 7504027 pq_act 5998 pq_inact 13239 pq_laund 3961 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001386 | 000000 11 (008192K) | 000131 | 000000 10 (004096K) | 000241 | 000000 09 (002048K) | 000255 | 000000 08 (001024K) | 000740 | 000102 07 (000512K) | 001138 | 000236 06 (000256K) | 001900 | 000488 05 (000128K) | 003956 | 000053 04 (000064K) | 006827 | 000036 03 (000032K) | 016272 | 000171 02 (000016K) | 025952 | 000557 01 (000008K) | 038935 | 003867 00 (000004K) | 027201 | 000441 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree socket 904 51 939665 4491498 0 13 849503264 0 VM OBJECT 256 7902 613518 65881891 0 92 159083520 0 THREAD 1440 4483 63053 10248165 0 33 97251840 0 Files 80 148 941632 69142901 0 125 75342400 0 RADIX NODE 144 16900 459860 72338420 0 253 68653440 0 VNODE 632 1644 70614 25181842 0 46 45667056 0 512 512 5 69806 7947900 0 29 35743232 0 128 128 135572 86853 158799297 0 128 28470400 0 FFS2 dinode 256 1529 70786 19715074 0 80 18512640 0 mbuf_cluster 2048 7671 25 135443 0 5 15761408 0 BUF TRIE 144 649 105299 12331619 0 61 15256512 0 FFS inode 160 1529 70879 19716000 0 77 11585280 0 TURNSTILE 136 67537 383 67537 0 61 9237120 0 VMSPACE 2552 78 3357 5796294 0 7 8766120 0 256 Bucket 2048 1693 2132 1893113 0 253 7833600 0 256 256 5 29470 14754647 0 61 7545600 0 S VFS Cache 108 11399 57656 12970125 0 128 7457940 0 vmem btag 56 38498 85952 460376 0 253 6969200 0 SLEEPQUEUE 88 67537 322 67537 0 125 5971592 0 PROC 1328 112 3857 5808763 0 12 5270832 0 mbuf 256 6230 10013 182553394 0 253 4158208 0 swblk 136 0 26158 91243 0 61 3557488 0 256 256 55 12515 6112040 0 61 3217920 0 128 128 606 17126 10598700 0 125 2269696 0 32 32 67575 3353 25865033 0 253 2269696 0 128 Bucket 1024 1820 348 1063699 0 19 2220032 0 512 512 4003 64 4020 0 29 2082304 0 128 128 14697 307 10134067 0 125 1920512 0 32 Bucket 256 5872 832 1088690 0 61 1716224 0 64 64 22 26576 6753137 0 253 1702272 0 4096 4096 354 12 462053 0 1 1499136 0 64 Bucket 512 2195 374 570434 0 29 1315328 0 DIRHASH 1024 61 947 162150 0 13 1032192 0 MAP ENTRY 112 4993 3792 157670584 0 165 983920 0 UMA Slabs 112 8550 189 352533 0 0 978768 0 4096 4096 113 120 5808772 0 2 954368 0 pbuf 984 0 933 0 0 1 918072 0 256 256 1126 2204 22708994 0 63 852480 0 64 64 9605 3043 121130258 0 253 809472 0 g_bio 408 0 1971 56971463 0 88 804168 0 64 64 8615 3289 138142144 0 253 761856 0 32768 32768 9 13 860 0 1 720896 0 8192 8192 86 0 215463 0 1 704512 0 16384 16384 37 0 41 0 1 606208 0 32768 32768 13 5 25285 0 1 589824 0 128 128 17 4385 3265957 0 125 563456 0 128 128 2736 1511 8121093 0 125 543616 0 ksiginfo 112 3943 782 1108205 0 125 529200 0 65536 65536 3 5 2144 0 1 524288 0 NAMEI 1024 0 488 127649819 0 24 499712 0 16 Bucket 128 1034 2158 331164 0 125 408576 0 filedesc0 1104 110 259 5808764 0 11 407376 0 32768 32768 12 0 30 0 1 393216 0 mbuf_packet 256 16 1516 15204470 0 253 392192 0 1024 1024 215 133 3405773 0 13 356352 0 Mountpoints 3008 4 113 43650 0 3 351936 0 512 512 252 378 510128 0 29 322560 0 swpctrie 144 0 2214 8042 0 61 318816 0 256 256 443 742 3346599 0 61 303360 0 64 64 659 3805 8559421 0 253 285696 0 128 128 441 1512 1283002 0 126 249984 0 2048 2048 17 95 1192740 0 5 229376 0 64 64 754 2780 10354913 0 253 226176 0 16384 16384 13 0 2842 0 1 212992 0 32 32 3452 3120 223693 0 253 210304 0 selfd 64 678 2546 23986325 0 253 206336 0 2048 2048 96 4 848 0 5 204800 0 64 64 79 3083 1456398 0 253 202368 0 4096 4096 46 3 17325 0 1 200704 0 64 64 28 3072 2692881 0 253 198400 0 65536 65536 3 0 42 0 1 196608 0 65536 65536 1 2 145 0 1 196608 0 65536 65536 3 0 2158 0 1 196608 0 512 512 27 351 828084 0 29 193536 0 256 256 11 739 17124197 0 61 192000 0 rl_entry 40 2636 2116 2636 0 253 190080 0 256 256 63 672 310859 0 61 188160 0 64 64 32 2819 276170 0 253 182464 0 pipe 760 9 231 908823 0 13 182400 0 1024 1024 7 169 4273633 0 13 180224 0 8 Bucket 64 79 2586 460552 0 253 170560 0 32768 32768 1 4 307604 0 1 163840 0 UMA Zones 1968 83 0 31313 0 0 163344 0 fakepg 104 0 1520 6583 0 125 158080 0 4096 4096 15 21 1879630 0 1 147456 0 6 Bucket 48 31 3040 345650 0 253 147408 0 12 Bucket 96 41 1476 231433 0 125 145632 0 8192 8192 4 13 228291 0 1 139264 0 8192 8192 17 0 7355 0 1 139264 0 1024 1024 2 130 77953 0 13 135168 0 4 Bucket 32 257 3959 4979944 0 253 134912 0 65536 65536 2 0 14 0 1 131072 0 65536 65536 1 1 198 0 1 131072 0 512 512 19 233 56989 0 29 129024 0 8192 8192 12 3 9264 0 1 122880 0 16384 16384 2 5 888 0 1 114688 0 32 32 153 3319 614945 0 253 111104 0 256 256 54 366 19482960 0 61 107520 0 4096 4096 16 9 605766 0 1 102400 0 2048 2048 0 50 48555 0 5 102400 0 32768 32768 3 0 5 0 1 98304 0 1024 1024 5 91 502968 0 13 98304 0 16 16 2806 3170 5446361 0 253 95616 0 32 32 156 2820 167379 0 253 95232 0 8192 8192 6 5 31424 0 1 90112 0 ttyinq 160 330 222 5341 0 61 88320 0 32 32 113 2615 121675 0 253 87296 0 unpcb 256 19 311 4484376 0 61 84480 0 256 256 64 266 1269252 0 61 84480 0 16384 16384 5 0 519 0 1 81920 0 16384 16384 5 0 30784 0 1 81920 0 16 16 378 4602 2838055 0 253 79680 0 32 32 195 2285 4495058 0 253 79360 0 ttyoutq 256 173 127 2843 0 61 76800 0 clpbuf 984 0 78 1640395 94014 5 76752 0 udp_inpcb 488 20 116 915 0 29 66368 0 128 128 49 447 32441 0 125 63488 0 1024 1024 32 24 349270 0 13 57344 0 4096 4096 13 0 24 0 1 53248 0 16 16 28 3209 122 0 253 51792 0 cpuset 104 27 438 27 0 125 48360 0 16 16 124 2864 5514826 0 253 47808 0 512 512 29 62 7757103 0 29 46592 0 16 16 298 2441 25776 0 253 43824 0 32 32 35 1329 38585 0 253 43648 0 8192 8192 5 0 9 0 1 40960 0 16 16 43 2447 220366 0 253 39840 0 32 32 602 638 15055724 0 253 39680 0 64 pcpu 8 3018 1846 97134 0 253 38912 0 1024 1024 22 14 2143198 0 13 36864 0 16384 16384 2 0 4 0 1 32768 0 2048 2048 8 8 11796131 0 5 32768 0 mt_stats_zone 64 429 83 553 0 253 32768 0 udpcb 32 20 848 915 0 253 27776 0 2048 2048 6 6 4038084 0 5 24576 0 rtentry 208 12 102 18 0 61 23712 0 4096 4096 1 4 25654 0 1 20480 0 2048 2048 4 6 402656 0 5 20480 0 rentr 24 0 830 6760903 0 253 19920 0 16 16 471 774 6374387 0 253 19920 0 mt_zone 24 429 401 553 0 253 19920 0 128 128 3 152 64506 0 125 19840 0 tcpcb 976 9 11 6153 0 13 19520 0 KMAP ENTRY 112 8 164 74 0 125 19264 0 UMA Kegs 216 75 3 31305 0 0 16848 0 8192 8192 2 0 9 0 1 16384 0 1024 1024 7 9 50 0 13 16384 0 L VFS Cache 328 29 19 31342 0 29 15744 0 tcp_inpcb 488 9 23 6153 0 29 15616 0 MAP 232 2 65 2 0 61 15544 0 512 512 8 20 1055322 0 29 14336 0 int pcpu 4 468 2348 468 0 253 11264 0 512 512 11 10 19 0 29 10752 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 3 1 525 0 5 8192 0 16 16 13 485 22 0 253 7968 0 epoch_record pcpu 256 4 12 4 0 61 4096 0 4096 4096 1 0 1620661 0 1 4096 0 procdesc 136 1 28 884708 0 61 3944 0 hostcache 96 1 40 1 0 125 3936 0 ripcb 488 1 7 15 0 29 3904 0 UMA Hash 256 0 10 102 0 0 2560 0 vmem 1856 0 1 0 0 5 1856 0 FFS1 dinode 128 0 0 11 0 125 0 0 IPsec SA lft_c 16 0 0 0 0 253 0 0 udplite_inpcb 488 0 0 0 0 29 0 0 sctp_asconf_ack 48 0 0 0 0 253 0 0 sctp_asconf 40 0 0 0 0 253 0 0 sctp_stream_msg_out 112 0 0 0 0 125 0 0 sctp_readq 152 0 0 0 0 61 0 0 sctp_chunk 152 0 0 0 0 61 0 0 sctp_raddr 736 0 0 0 0 13 0 0 sctp_laddr 48 0 0 6 0 253 0 0 sctp_asoc 2408 0 0 0 0 3 0 0 sctp_ep 1280 0 0 0 0 9 0 0 tcp_log_node 120 0 0 0 0 125 0 0 tcp_log_bucket 144 0 0 0 0 61 0 0 tcp_log 408 0 0 0 0 29 0 0 tcpreass 48 0 0 15761 0 253 0 0 tfo_ccache_entries 80 0 0 0 0 125 0 0 tfo 4 0 0 0 0 253 0 0 sackhole 32 0 0 21285 0 253 0 0 syncache 168 0 0 1673 0 61 0 0 tcptw 88 0 0 402 0 125 0 0 ipq 56 0 0 0 0 253 0 0 KNOTE 160 0 0 8368959 0 61 0 0 itimer 352 0 0 0 0 29 0 0 AIOLIO 280 0 0 0 0 29 0 0 AIOCB 752 0 0 0 0 13 0 0 AIOP 32 0 0 0 0 253 0 0 AIO 208 0 0 0 0 61 0 0 NCLNODE 744 0 0 0 0 13 0 0 LTS VFS Cache 368 0 0 0 0 29 0 0 STS VFS Cache 148 0 0 0 0 61 0 0 VNODEPOLL 120 0 0 407 0 125 0 0 vtnet_tx_hdr 24 0 0 0 0 253 0 0 crypto_session 24 0 0 0 0 253 0 0 cryptodesc 120 0 0 0 0 125 0 0 cryptop 128 0 0 0 0 125 0 0 nvme_request 128 0 0 0 0 125 0 0 FPU_save_area 832 0 0 0 0 13 0 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 0 mbuf_extpgs 256 0 0 0 0 61 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 11368954 0 61 0 0 audit_record 1280 0 0 0 0 9 0 0 domainset 40 0 0 0 0 253 0 0 MAC labels 40 0 0 0 0 253 0 0 vnpbuf 984 0 0 2484 0 13 0 0 mdpbuf 984 0 0 85128 0 1 0 0 nfspbuf 984 0 0 0 0 5 0 0 swwbuf 984 0 0 54462 0 1 0 0 swrbuf 984 0 0 8052 0 5 0 0 umtx_shm 88 0 0 35 0 125 0 0 umtx pi 96 0 0 2 0 125 0 0 rangeset pctrie nodes 144 0 0 0 0 61 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 2 0 1 0 0 32768 32768 0 0 15 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 2324 0 1 0 0 16384 16384 0 0 64 0 1 0 0 16384 16384 0 0 0 0 1 0 0 2048 2048 0 0 0 0 5 0 0 1024 1024 0 0 0 0 13 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket kstack_cache 16384 4354 16 10248035 1 vm pgcache 104 429856 3124 120432094 253 vm pgcache 104 83962 3000 211947693 253 buf free cache 984 6103 98637 14280901 36 buffer arena-65 65536 4 4 280602 1 buffer arena-61 61440 0 0 280472 1 buffer arena-57 57344 0 0 280472 1 buffer arena-53 53248 0 0 280472 1 buffer arena-49 49152 0 0 280472 1 buffer arena-45 45056 0 0 280472 1 buffer arena-40 40960 0 0 280472 1 buffer arena-36 36864 0 0 280472 1 buffer arena-32 32768 142779 4681 4365394 14 buffer arena-28 28672 0 0 280472 1 buffer arena-24 24576 0 0 280472 1 buffer arena-20 20480 0 0 280472 1 buffer arena-16 16384 100532 10218 890943 10 buffer arena-12 12288 0 0 280472 1 buffer arena-81 8192 0 0 280472 1 buffer arena-40 4096 0 14 280505 1 db:0:pho> acttrace Tracing command vmstat pid 13157 tid 102677 td 0xfffff807f21fe5a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1c7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1c7e10 trap() at trap+0x46/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff80c1ca80, rsp = 0xfffffe00e7a95590, rbp = 0xfffffe00e7a955a0 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00e7a955a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e7a95630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e7a95680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e7a956c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e7a95740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e7a957f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e7a95940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e7a95980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7a95ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7a95ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13155 tid 100676 td 0xfffff8073faaa000 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e173df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e173e10 trap() at trap+0x46/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e5358590, rbp = 0xfffffe00e53585a0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e53585a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e5358630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e5358680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e53586c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e5358740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e53587f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e5358940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e5358980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5358ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5358ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13150 tid 101668 td 0xfffff807f2719000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1ebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1ebe10 trap() at trap+0x46/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e66cc590, rbp = 0xfffffe00e66cc5a0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e66cc5a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e66cc630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e66cc680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e66cc6c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e66cc740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e66cc7f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e66cc940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e66cc980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e66ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e66ccab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13149 tid 102151 td 0xfffff807f269b5a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1bbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1bbe10 trap() at trap+0x46/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e7045640, rbp = 0xfffffe00e7045650 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e7045650 _sx_xlock_hard() at _sx_xlock_hard+0x299/frame 0xfffffe00e7045700 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00e7045740 userland_sysctl() at userland_sysctl+0x117/frame 0xfffffe00e70457f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e7045940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e7045980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7045ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7045ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13148 tid 102480 td 0xfffff807f22a65a0 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e197df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e197e10 trap() at trap+0x46/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e76b8640, rbp = 0xfffffe00e76b8650 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e76b8650 _sx_xlock_hard() at _sx_xlock_hard+0x299/frame 0xfffffe00e76b8700 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00e76b8740 userland_sysctl() at userland_sysctl+0x117/frame 0xfffffe00e76b87f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e76b8940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e76b8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e76b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e76b8ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13145 tid 104197 td 0xfffff80570f6a5a0 (CPU 10) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00e56c7100 vpanic() at vpanic+0x1ba/frame 0xfffffe00e56c7150 panic() at panic+0x43/frame 0xfffffe00e56c71b0 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe00e56c7210 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e56c7270 trap() at trap+0x2bd/frame 0xfffffe00e56c7380 calltrap() at calltrap+0x8/frame 0xfffffe00e56c7380 --- trap 0xc, rip = 0xffffffff80f134b3, rsp = 0xfffffe00e56c7450, rbp = 0xfffffe00e56c7490 --- uma_vm_zone_stats() at uma_vm_zone_stats+0x1c3/frame 0xfffffe00e56c7490 sysctl_vm_zone_stats() at sysctl_vm_zone_stats+0x77e/frame 0xfffffe00e56c7680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x7b/frame 0xfffffe00e56c76c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e56c7740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e56c77f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e56c7940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e56c7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e56c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56c7ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13139 tid 100802 td 0xfffff8073f52e5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e18bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e18be10 trap() at trap+0x46/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e55d0640, rbp = 0xfffffe00e55d0650 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e55d0650 _sx_xlock_hard() at _sx_xlock_hard+0x299/frame 0xfffffe00e55d0700 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00e55d0740 userland_sysctl() at userland_sysctl+0x117/frame 0xfffffe00e55d07f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e55d0940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e55d0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e55d0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e55d0ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command thr1 pid 62766 tid 102307 td 0xfffff807f291c5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e17fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e17fe10 trap() at trap+0x46/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e73535b0, rbp = 0xfffffe00e73535c0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e73535c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e7353650 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e73536a0 uma_zalloc_arg() at uma_zalloc_arg+0x5b2/frame 0xfffffe00e7353820 vm_thread_new() at vm_thread_new+0x4d/frame 0xfffffe00e7353860 thread_alloc() at thread_alloc+0x3b/frame 0xfffffe00e7353880 thread_create() at thread_create+0x111/frame 0xfffffe00e73538f0 sys_thr_new() at sys_thr_new+0xd2/frame 0xfffffe00e7353980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7353ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7353ab0 --- syscall (455, FreeBSD ELF64, sys_thr_new), rip = 0x80031b66a, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdd00 --- Tracing command thr1 pid 62765 tid 103399 td 0xfffff808011825a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1a3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1a3e10 trap() at trap+0x46/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e88bd5b0, rbp = 0xfffffe00e88bd5c0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e88bd5c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e88bd650 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e88bd6a0 uma_zalloc_arg() at uma_zalloc_arg+0x8b9/frame 0xfffffe00e88bd820 vm_thread_new() at vm_thread_new+0x4d/frame 0xfffffe00e88bd860 thread_alloc() at thread_alloc+0x3b/frame 0xfffffe00e88bd880 thread_create() at thread_create+0x111/frame 0xfffffe00e88bd8f0 sys_thr_new() at sys_thr_new+0xd2/frame 0xfffffe00e88bd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e88bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e88bdab0 --- syscall (455, FreeBSD ELF64, sys_thr_new), rip = 0x80031b66a, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdd00 --- Tracing command sh pid 62746 tid 100251 td 0xfffff807e1442000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81d8bae0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81d8bb00 trap() at trap+0x46/frame 0xffffffff81d8bc10 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d8bc10 --- trap 0x13, rip = 0xffffffff80c1ca80, rsp = 0xfffffe00e3f1a440, rbp = 0xfffffe00e3f1a450 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00e3f1a450 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e3f1a4e0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e3f1a530 uma_zfree_arg() at uma_zfree_arg+0x3ee/frame 0xfffffe00e3f1a640 thread_reap() at thread_reap+0xd6/frame 0xfffffe00e3f1a660 proc_reap() at proc_reap+0x616/frame 0xfffffe00e3f1a6a0 proc_to_reap() at proc_to_reap+0x3ac/frame 0xfffffe00e3f1a6f0 kern_wait6() at kern_wait6+0x1ec/frame 0xfffffe00e3f1a790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3f1a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3f1aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f1aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62740 tid 104520 td 0xfffff804888715a0 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1afdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1afe10 trap() at trap+0x46/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff80c1ca80, rsp = 0xfffffe033fe8b440, rbp = 0xfffffe033fe8b450 --- lock_delay() at lock_delay+0x40/frame 0xfffffe033fe8b450 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe033fe8b4e0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe033fe8b530 uma_zfree_arg() at uma_zfree_arg+0x3ee/frame 0xfffffe033fe8b640 thread_reap() at thread_reap+0xd6/frame 0xfffffe033fe8b660 proc_reap() at proc_reap+0x616/frame 0xfffffe033fe8b6a0 proc_to_reap() at proc_to_reap+0x3ac/frame 0xfffffe033fe8b6f0 kern_wait6() at kern_wait6+0x1ec/frame 0xfffffe033fe8b790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe033fe8b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe033fe8bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fe8bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800038aa5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1d3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1d3e10 trap() at trap+0x46/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff810103c6, rsp = 0xfffffe00add93910, rbp = 0xfffffe00add93910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add93910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00add93960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00add93980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00add939a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00add93a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add93ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 13158 62752 41165 0 R+ sh 13157 62744 41165 0 R+ CPU 8 vmstat 13156 62753 41165 0 R+ sh 13155 62732 41165 0 R+ CPU 1 vmstat 13154 62734 41165 0 R+ sh 13153 62728 41165 0 R+ sh 13152 62736 41165 0 R+ sh 13150 62742 41165 0 R+ CPU 11 vmstat 13149 62730 41165 0 R+ CPU 7 vmstat 13148 62726 41165 0 R+ CPU 4 vmstat 13146 62725 41165 0 R+ vmstat 13145 62749 41165 0 R+ CPU 10 vmstat 13141 11016 43513 0 R egrep 13139 62738 41165 0 R+ CPU 3 vmstat 11016 43599 43513 0 S wait 0xfffff807f295b530 sh 62769 62750 41165 0 R+ (threaded) thr1 104240 S uwait 0xfffff808012af400 thr1 100224 RunQ thr1 100385 RunQ thr1 104050 RunQ thr1 104123 RunQ thr1 104186 RunQ thr1 104191 RunQ thr1 104206 RunQ thr1 104325 RunQ thr1 104361 RunQ thr1 104379 RunQ thr1 104397 RunQ thr1 104409 RunQ thr1 104424 RunQ thr1 104431 RunQ thr1 104438 RunQ thr1 104450 RunQ thr1 104455 RunQ thr1 104487 RunQ thr1 104489 RunQ thr1 104491 RunQ thr1 104492 RunQ thr1 104493 RunQ thr1 104495 RunQ thr1 104496 RunQ thr1 104500 RunQ thr1 104503 RunQ thr1 104510 RunQ thr1 104513 RunQ thr1 104531 RunQ thr1 104543 RunQ thr1 104552 RunQ thr1 104558 RunQ thr1 104562 RunQ thr1 104563 RunQ thr1 104564 RunQ thr1 104568 RunQ thr1 104571 RunQ thr1 104572 RunQ thr1 104573 RunQ thr1 104581 RunQ thr1 104623 RunQ thr1 104625 RunQ thr1 104628 RunQ thr1 104629 RunQ thr1 104631 RunQ thr1 104633 RunQ thr1 104634 RunQ thr1 104635 RunQ thr1 104638 RunQ thr1 104639 RunQ thr1 104640 RunQ thr1 104643 RunQ thr1 104646 RunQ thr1 104648 RunQ thr1 104649 RunQ thr1 104651 RunQ thr1 104655 RunQ thr1 104656 RunQ thr1 104657 RunQ thr1 104661 RunQ thr1 104669 RunQ thr1 104670 RunQ thr1 104677 RunQ thr1 104679 RunQ thr1 104685 RunQ thr1 104686 RunQ thr1 104692 RunQ thr1 104696 RunQ thr1 104704 RunQ thr1 104708 RunQ thr1 104713 RunQ thr1 104723 RunQ thr1 104734 RunQ thr1 104737 RunQ thr1 104746 RunQ thr1 104754 RunQ thr1 104768 RunQ thr1 104772 RunQ thr1 104775 RunQ thr1 104776 RunQ thr1 104791 RunQ thr1 104796 RunQ thr1 104801 RunQ thr1 104825 RunQ thr1 104831 RunQ thr1 104835 RunQ thr1 104846 RunQ thr1 104848 RunQ thr1 104857 RunQ thr1 104876 RunQ thr1 104882 RunQ thr1 104899 RunQ thr1 104956 RunQ thr1 104957 RunQ thr1 104978 RunQ thr1 104983 RunQ thr1 105001 RunQ thr1 105002 RunQ thr1 105004 RunQ thr1 105005 RunQ thr1 105010 RunQ thr1 105011 RunQ thr1 105012 RunQ thr1 105013 RunQ thr1 105016 RunQ thr1 105017 RunQ thr1 105018 RunQ thr1 105020 RunQ thr1 105026 RunQ thr1 105028 RunQ thr1 105029 RunQ thr1 105030 RunQ thr1 105036 RunQ thr1 105038 RunQ thr1 105039 RunQ thr1 105047 RunQ thr1 105055 RunQ thr1 105061 RunQ thr1 105062 RunQ thr1 105069 RunQ thr1 105077 RunQ thr1 105078 RunQ thr1 105090 RunQ thr1 105093 RunQ thr1 105103 RunQ thr1 105106 RunQ thr1 105108 RunQ thr1 105111 RunQ thr1 105112 RunQ thr1 105114 RunQ thr1 105115 RunQ thr1 105116 RunQ thr1 105118 RunQ thr1 105121 RunQ thr1 105122 RunQ thr1 105123 RunQ thr1 105124 RunQ thr1 105127 RunQ thr1 105128 RunQ thr1 105134 RunQ thr1 105136 RunQ thr1 105141 RunQ thr1 105143 RunQ thr1 105148 RunQ thr1 105162 RunQ thr1 62768 62750 41165 0 R+ (threaded) thr1 103144 RunQ thr1 105412 RunQ thr1 104366 RunQ thr1 104722 RunQ thr1 104774 RunQ thr1 104368 RunQ thr1 104369 RunQ thr1 104389 RunQ thr1 104390 RunQ thr1 104382 RunQ thr1 104214 RunQ thr1 104392 RunQ thr1 104332 RunQ thr1 104335 RunQ thr1 104338 RunQ thr1 104350 RunQ thr1 104402 RunQ thr1 104403 RunQ thr1 104964 RunQ thr1 104970 RunQ thr1 104979 RunQ thr1 104982 RunQ thr1 104482 RunQ thr1 104582 RunQ thr1 104585 RunQ thr1 104997 RunQ thr1 104998 RunQ thr1 62766 62750 41165 0 R+ (threaded) thr102307 Run CPU 2 thr1 104251 RunQ thr1 104507 RunQ thr1 105439 RunQ thr1 105440 RunQ thr1 104963 RunQ thr1 105054 RunQ thr1 105445 RunQ thr1 105334 RunQ thr1 104469 RunQ thr1 105337 RunQ thr1 105448 RunQ thr1 105450 RunQ thr1 104377 RunQ thr1 104600 RunQ thr1 104706 RunQ thr1 104714 RunQ thr1 104167 RunQ thr1 104105 RunQ thr1 105041 RunQ thr1 104728 RunQ thr1 104715 RunQ thr1 105452 RunQ thr1 105454 RunQ thr1 105456 RunQ thr1 105460 RunQ thr1 105462 RunQ thr1 105466 RunQ thr1 105468 RunQ thr1 105470 RunQ thr1 105474 RunQ thr1 105478 RunQ thr1 105480 RunQ thr1 105482 RunQ thr1 105486 RunQ thr1 105490 RunQ thr1 104414 RunQ thr1 104237 RunQ thr1 104743 RunQ thr1 105494 RunQ thr1 105498 RunQ thr1 105500 RunQ thr1 105504 RunQ thr1 62765 62750 41165 0 R+ (threaded) thr1 103399 Run CPU 5 thr1 105129 RunQ thr1 105131 RunQ thr1 105132 RunQ thr1 105135 RunQ thr1 105138 RunQ thr1 105140 RunQ thr1 105144 RunQ thr1 105146 RunQ thr1 105149 RunQ thr1 105155 RunQ thr1 105159 RunQ thr1 105163 RunQ thr1 105169 RunQ thr1 105174 RunQ thr1 105181 RunQ thr1 105201 RunQ thr1 105211 RunQ thr1 105216 RunQ thr1 105225 RunQ thr1 105237 RunQ thr1 105240 RunQ thr1 105246 RunQ thr1 105255 RunQ thr1 105272 RunQ thr1 105277 RunQ thr1 105286 RunQ thr1 105292 RunQ thr1 105308 RunQ thr1 105316 RunQ thr1 104877 RunQ thr1 104901 RunQ thr1 105329 RunQ thr1 105330 RunQ thr1 105332 RunQ thr1 105416 RunQ thr1 105418 RunQ thr1 105419 RunQ thr1 105420 RunQ thr1 105423 RunQ thr1 104864 RunQ thr1 105426 RunQ thr1 100144 RunQ thr1 105429 RunQ thr1 105430 RunQ thr1 105434 RunQ thr1 104259 RunQ thr1 105438 RunQ thr1 105441 RunQ thr1 105086 RunQ thr1 104304 RunQ thr1 104504 RunQ thr1 104201 RunQ thr1 105446 RunQ thr1 105447 RunQ thr1 105451 RunQ thr1 104534 RunQ thr1 104740 RunQ thr1 104071 RunQ thr1 104150 RunQ thr1 105034 RunQ thr1 105066 RunQ thr1 104716 RunQ thr1 105096 RunQ thr1 105453 RunQ thr1 105455 RunQ thr1 105457 RunQ thr1 105461 RunQ thr1 105463 RunQ thr1 105465 RunQ thr1 105467 RunQ thr1 105469 RunQ thr1 105471 RunQ thr1 105473 RunQ thr1 105475 RunQ thr1 105479 RunQ thr1 105481 RunQ thr1 105483 RunQ thr1 105485 RunQ thr1 105487 RunQ thr1 105489 RunQ thr1 105491 RunQ thr1 105492 RunQ thr1 105493 RunQ thr1 105495 RunQ thr1 105497 RunQ thr1 105499 RunQ thr1 105501 RunQ thr1 62754 62718 41165 0 S+ nanslp 0xffffffff81c8bee0 sleep 62753 62718 41165 0 S+ wait 0xfffff807f2c53a60 sh 62752 62718 41165 0 S+ wait 0xfffff807f2ab1530 sh 62750 62723 41165 0 S+ wait 0xfffff8073fd49a60 thr1 62749 62718 41165 0 S+ wait 0xfffff807f21e8530 sh 62748 62718 41165 0 R+ sh 62746 62718 41165 0 R+ CPU 0 sh 62744 62718 41165 0 S+ wait 0xfffff807f2be3a60 sh 62742 62718 41165 0 S+ wait 0xfffff8073fe7e530 sh 62740 62718 41165 0 R+ CPU 6 sh 62738 62718 41165 0 S+ wait 0xfffff807f228ba60 sh 62736 62718 41165 0 S+ wait 0xfffff8073fbe8530 sh 62734 62718 41165 0 S+ wait 0xfffff807f228b530 sh 62732 62718 41165 0 S+ wait 0xfffff80801348530 sh 62730 62718 41165 0 S+ wait 0xfffff80488857530 sh 62728 62718 41165 0 S+ wait 0xfffff8080171aa60 sh 62726 62718 41165 0 S+ wait 0xfffff8080121ea60 sh 62725 62718 41165 0 S+ wait 0xfffff807f2ea8530 sh 62723 62718 41165 0 S+ nanslp 0xffffffff81c8bee2 thr1 62718 62716 41165 0 S+ wait 0xfffff807f2c53530 sh 62717 41165 41165 0 S+ piperd 0xfffff80744913000 tee 62716 41165 41165 0 S+ wait 0xfffff8073fe98530 sh 43602 43513 43513 0 S piperd 0xfffff800187c48e8 sh 43600 43513 43513 0 S piperd 0xfffff80007bb95f0 awk 43599 43513 43513 0 S wait 0xfffff800078f8000 sh 43513 1 43513 0 Ss wait 0xfffff80007c6b000 sh 41165 2376 41165 0 S+ wait 0xfffff8034a7e3000 sh 2376 2374 2376 0 S+ wait 0xfffff802f8cc2000 bash 2374 2373 2374 0 S+ pause 0xfffff80007c6c0a8 csh 2373 2344 2373 2006 S+ wait 0xfffff80007fd0000 su 2344 2343 2344 2006 Ss+ wait 0xfffff80004544530 bash 2343 2340 2340 2006 S select 0xfffff80007fe4540 sshd 2340 2276 2340 0 Ss select 0xfffff800045caf40 sshd 2336 2335 2336 0 S+ ttyin 0xfffff800061734b0 csh 2335 1 2335 0 Ss+ wait 0xfffff80007c6ca60 login 2334 1 2334 0 Ss+ ttyin 0xfffff800061808b0 getty 2333 1 2333 0 Ss+ ttyin 0xfffff80003c6d4b0 getty 2332 1 2332 0 Ss+ ttyin 0xfffff800038134b0 getty 2331 1 2331 0 Ss+ ttyin 0xfffff80003813cb0 getty 2330 1 2330 0 Ss+ ttyin 0xfffff80003c994b0 getty 2329 1 2329 0 Ss+ ttyin 0xfffff80003c99cb0 getty 2328 1 2328 0 Ss+ ttyin 0xfffff80003c984b0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff80003c98cb0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff80003c974b0 getty 2280 1 2280 0 Ss nanslp 0xffffffff81c8bee6 cron 2276 1 2276 0 Ss select 0xfffff800038c48c0 sshd 2247 1 2247 123 Ss (threaded) ntpd 100204 S select 0xfffff800045c90c0 ntpd 100769 S usem 0xfffff808158ead00 ntpd 2184 1 2184 0 Ss rpcsvc 0xfffff80007b57160 NLM: master 2181 1 2181 0 Ss select 0xfffff80007fe4640 rpc.statd 2135 1 2135 0 Ss nanslp 0xffffffff81c8bee0 watchdogd 2056 1 2056 0 Ss select 0xfffff8000446d3c0 rpcbind 2046 1 2046 0 Ss select 0xfffff800045c9440 syslogd 1975 1 1975 0 Ss select 0xfffff800038c4ac0 devd 1970 1 1970 65 Ss select 0xfffff80007fe47c0 dhclient 1926 1 1926 0 Ss select 0xfffff800060addc0 dhclient 1923 1 1923 0 Ss select 0xfffff800038c4a40 dhclient 34 0 0 0 DL vlruwt 0xfffff800071cca60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d623b0 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d61858 [bufdaemon] 100132 D - 0xffffffff8180a900 [bufspacedaemon-0] 100134 D - 0xffffffff81812bc0 [bufspacedaemon-1] 100135 D - 0xffffffff8181ae80 [bufspacedaemon-2] 100136 D - 0xffffffff81823140 [bufspacedaemon-3] 100137 D - 0xffffffff8182b400 [bufspacedaemon-4] 100138 D - 0xffffffff818336c0 [bufspacedaemon-5] 100139 D - 0xffffffff8183b980 [bufspacedaemon-6] 100151 D sdflush 0xfffff80003bfd2e8 [/ worker] 100203 D sdflush 0xfffff800073904e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81d7bb88 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81dd6198 [dom0] 100131 D launds 0xffffffff81dd61a4 [laundry: dom0] 100133 D umarcl 0xffffffff80f10e10 [uma] 29 0 0 0 DL idle 0xfffff800037fda60 [enc_daemon1] 28 0 0 0 DL idle 0xfffff800038c1000 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ae8c20 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81dd4840 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d6125c [soaiod4] 24 0 0 0 DL - 0xffffffff81d6125c [soaiod3] 23 0 0 0 DL - 0xffffffff81d6125c [soaiod2] 22 0 0 0 DL - 0xffffffff81d6125c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d1584460 [usbus0] 100097 D - 0xfffffe00d15844b8 [usbus0] 100098 D - 0xfffffe00d1584510 [usbus0] 100099 D - 0xfffffe00d1584568 [usbus0] 100100 D - 0xfffffe00d15845c0 [usbus0] 100102 D - 0xfffffe0037b76d10 [usbus1] 100103 D - 0xfffffe0037b76d68 [usbus1] 100104 D - 0xfffffe0037b76dc0 [usbus1] 100105 D - 0xfffffe0037b76e18 [usbus1] 100106 D - 0xfffffe0037b76e70 [usbus1] 100107 D - 0xfffffe00d16bdd10 [usbus2] 100108 D - 0xfffffe00d16bdd68 [usbus2] 100109 D - 0xfffffe00d16bddc0 [usbus2] 100110 D - 0xfffffe00d16bde18 [usbus2] 100111 D - 0xfffffe00d16bde70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff819c3fc0 [doneq0] 100092 D - 0xffffffff819c4040 [doneq1] 100093 D - 0xffffffff819c40c0 [doneq2] 100125 D - 0xffffffff819c3e88 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000408e450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000408e3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000408e390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000408e330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000408e2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000408e270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000408e210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000408e1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000408e150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000408e0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000408e090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000408e030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d761c8 [crypto] 14 0 0 0 DL seqstat 0xfffff80003f91888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81da4ce0 [g_event] 100063 D - 0xffffffff81da4cf0 [g_up] 100064 D - 0xffffffff81da4cd8 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi6: Giant taskq] 100017 I [swi5: fast taskq] 100021 I [swi6: task queue] 100047 I [swi3: vm] 100048 I [swi1: netisr 0] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100177 I [irq72: ioat0] 100178 I [irq73: ioat1] 100179 I [irq74: ioat2] 100180 I [irq75: ioat3] 100181 I [irq76: ioat4] 100182 I [irq77: ioat5] 100183 I [irq78: ioat6] 100184 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038bf530 [init] 10 0 0 0 DL audit_w 0xffffffff81dd5590 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81da4d20 [swapper] 100016 D - 0xfffff8000323cb00 [thread taskq] 100018 D - 0xfffff80003866000 [config_0] 100019 D - 0xfffff8000323c900 [kqueue_ctx taskq] 100020 D - 0xfffff8000323c800 [aiod_kick taskq] 100022 D - 0xfffff80003867e00 [if_io_tqg_0] 100023 D - 0xfffff80003867d00 [if_io_tqg_1] 100024 D - 0xfffff80003867c00 [if_io_tqg_2] 100025 D - 0xfffff80003867b00 [if_io_tqg_3] 100026 D - 0xfffff80003867a00 [if_io_tqg_4] 100027 D - 0xfffff80003867900 [if_io_tqg_5] 100028 D - 0xfffff80003867800 [if_io_tqg_6] 100029 D - 0xfffff80003867700 [if_io_tqg_7] 100030 D - 0xfffff80003867600 [if_io_tqg_8] 100031 D - 0xfffff80003867500 [if_io_tqg_9] 100032 D - 0xfffff80003867400 [if_io_tqg_10] 100033 D - 0xfffff80003867300 [if_io_tqg_11] 100034 D - 0xfffff80003867200 [if_config_tqg_0] 100035 D - 0xfffff80003867100 [softirq_0] 100036 D - 0xfffff80003867000 [softirq_1] 100037 D - 0xfffff80003868e00 [softirq_2] 100038 D - 0xfffff80003868d00 [softirq_3] 100039 D - 0xfffff80003868c00 [softirq_4] 100040 D - 0xfffff80003868b00 [softirq_5] 100041 D - 0xfffff80003868a00 [softirq_6] 100042 D - 0xfffff80003868900 [softirq_7] 100043 D - 0xfffff80003868800 [softirq_8] 100044 D - 0xfffff80003868700 [softirq_9] 100045 D - 0xfffff80003868600 [softirq_10] 100046 D - 0xfffff80003868500 [softirq_11] 100061 D - 0xfffff80003f12100 [firmware taskq] 100066 D - 0xfffff80003f12000 [crypto_0] 100067 D - 0xfffff80003f12000 [crypto_1] 100068 D - 0xfffff80003f12000 [crypto_2] 100069 D - 0xfffff80003f12000 [crypto_3] 100070 D - 0xfffff80003f12000 [crypto_4] 100071 D - 0xfffff80003f12000 [crypto_5] 100072 D - 0xfffff80003f12000 [crypto_6] 100073 D - 0xfffff80003f12000 [crypto_7] 100074 D - 0xfffff80003f12000 [crypto_8] 100075 D - 0xfffff80003f12000 [crypto_9] 100076 D - 0xfffff80003f12000 [crypto_10] 100077 D - 0xfffff80003f12000 [crypto_11] 100114 D - 0xfffff8000613fb00 [mca taskq] 100120 D - 0xfffff80007372000 [acpi_task_0] 100121 D - 0xfffff80007372000 [acpi_task_1] 100122 D - 0xfffff80007372000 [acpi_task_2] 100124 D - 0xfffff80003f13e00 [CAM taskq] 13128 62748 41165 0 Z+ vmstat db:0:pho> allt Tracing command sh pid 13158 tid 103019 td 0xfffff8080129c000 fork_trampoline() at fork_trampoline Tracing command vmstat pid 13157 tid 102677 td 0xfffff807f21fe5a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1c7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1c7e10 trap() at trap+0x46/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff80c1ca80, rsp = 0xfffffe00e7a95590, rbp = 0xfffffe00e7a955a0 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00e7a955a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e7a95630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e7a95680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e7a956c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e7a95740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e7a957f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e7a95940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e7a95980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7a95ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7a95ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command sh pid 13156 tid 103398 td 0xfffff80801c14000 fork_trampoline() at fork_trampoline Tracing command vmstat pid 13155 tid 100676 td 0xfffff8073faaa000 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e173df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e173e10 trap() at trap+0x46/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e5358590, rbp = 0xfffffe00e53585a0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e53585a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e5358630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e5358680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e53586c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e5358740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e53587f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e5358940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e5358980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5358ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5358ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command sh pid 13154 tid 103328 td 0xfffff8073fda55a0 fork_trampoline() at fork_trampoline Tracing command sh pid 13153 tid 103946 td 0xfffff807e3764000 fork_trampoline() at fork_trampoline Tracing command sh pid 13152 tid 104083 td 0xfffff802f8ed0000 fork_trampoline() at fork_trampoline Tracing command vmstat pid 13150 tid 101668 td 0xfffff807f2719000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1ebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1ebe10 trap() at trap+0x46/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e66cc590, rbp = 0xfffffe00e66cc5a0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e66cc5a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e66cc630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e66cc680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e66cc6c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e66cc740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e66cc7f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e66cc940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e66cc980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e66ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e66ccab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13149 tid 102151 td 0xfffff807f269b5a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1bbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1bbe10 trap() at trap+0x46/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e7045640, rbp = 0xfffffe00e7045650 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e7045650 _sx_xlock_hard() at _sx_xlock_hard+0x299/frame 0xfffffe00e7045700 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00e7045740 userland_sysctl() at userland_sysctl+0x117/frame 0xfffffe00e70457f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e7045940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e7045980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7045ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7045ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13148 tid 102480 td 0xfffff807f22a65a0 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e197df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e197e10 trap() at trap+0x46/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e76b8640, rbp = 0xfffffe00e76b8650 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e76b8650 _sx_xlock_hard() at _sx_xlock_hard+0x299/frame 0xfffffe00e76b8700 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00e76b8740 userland_sysctl() at userland_sysctl+0x117/frame 0xfffffe00e76b87f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e76b8940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e76b8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e76b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e76b8ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13146 tid 101408 td 0xfffff807f22e7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e61b23d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e61b2400 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00e61b2420 intr_event_handle() at intr_event_handle+0x189/frame 0xfffffe00e61b2470 intr_execute_handlers() at intr_execute_handlers+0x55/frame 0xfffffe00e61b24a0 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe00e61b24c0 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00e61b24c0 --- interrupt, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e61b2590, rbp = 0xfffffe00e61b25a0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e61b25a0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e61b2630 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e61b2680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x6c/frame 0xfffffe00e61b26c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e61b2740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e61b27f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e61b2940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e61b2980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e61b2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e61b2ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command vmstat pid 13145 tid 104197 td 0xfffff80570f6a5a0 (CPU 10) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00e56c7100 vpanic() at vpanic+0x1ba/frame 0xfffffe00e56c7150 panic() at panic+0x43/frame 0xfffffe00e56c71b0 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe00e56c7210 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e56c7270 trap() at trap+0x2bd/frame 0xfffffe00e56c7380 calltrap() at calltrap+0x8/frame 0xfffffe00e56c7380 --- trap 0xc, rip = 0xffffffff80f134b3, rsp = 0xfffffe00e56c7450, rbp = 0xfffffe00e56c7490 --- uma_vm_zone_stats() at uma_vm_zone_stats+0x1c3/frame 0xfffffe00e56c7490 sysctl_vm_zone_stats() at sysctl_vm_zone_stats+0x77e/frame 0xfffffe00e56c7680 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x7b/frame 0xfffffe00e56c76c0 sysctl_root() at sysctl_root+0x20c/frame 0xfffffe00e56c7740 userland_sysctl() at userland_sysctl+0x17b/frame 0xfffffe00e56c77f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e56c7940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e56c7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e56c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56c7ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command egrep pid 13141 tid 103073 td 0xfffff808012fa5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e8259a40 mi_switch() at mi_switch+0x172/frame 0xfffffe00e8259a70 ast() at ast+0x28b/frame 0xfffffe00e8259ab0 fast_syscall_common() at fast_syscall_common+0x198/frame 0xfffffe00e8259ab0 --- syscall (3297280), rip = 0x80023218a, rsp = 0x7fffffffcc28, rbp = 0x7fffffffcd90 --- Tracing command vmstat pid 13139 tid 100802 td 0xfffff8073f52e5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e18bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e18be10 trap() at trap+0x46/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e55d0640, rbp = 0xfffffe00e55d0650 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e55d0650 _sx_xlock_hard() at _sx_xlock_hard+0x299/frame 0xfffffe00e55d0700 _sx_xlock() at _sx_xlock+0xc1/frame 0xfffffe00e55d0740 userland_sysctl() at userland_sysctl+0x117/frame 0xfffffe00e55d07f0 kern___sysctlbyname() at kern___sysctlbyname+0x21b/frame 0xfffffe00e55d0940 sys___sysctlbyname() at sys___sysctlbyname+0x2d/frame 0xfffffe00e55d0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e55d0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e55d0ab0 --- syscall (570, FreeBSD ELF64, sys___sysctlbyname), rip = 0x80040187a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdce0 --- Tracing command sh pid 11016 tid 101899 td 0xfffff807f2cfd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e6b53560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e6b53590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e6b535d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e6b53630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e6b53660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e6b53700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e6b53790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6b53980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e6b53ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6b53ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command thr1 pid 62769 tid 104240 td 0xfffff807e1de8000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e496d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e49700 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e49740 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e497a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e497d0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3e49870 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe00e3e498d0 do_wait() at do_wait+0x206/frame 0xfffffe00e3e49940 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe00e3e49980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e49ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e49ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800277ebc, rsp = 0x7fffffffdc78, rbp = 0x7fffffffdd00 --- Tracing command thr1 pid 62769 tid 100224 td 0xfffff804f0edb000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 100385 td 0xfffff805b4b645a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104050 td 0xfffff804ba3bc5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104123 td 0xfffff807122aa5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104186 td 0xfffff803677c9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104191 td 0xfffff80735ddb000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104206 td 0xfffff8037db25000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104325 td 0xfffff80570fad000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104361 td 0xfffff805551325a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104379 td 0xfffff80443966000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104397 td 0xfffff807353305a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104409 td 0xfffff805fb1e15a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104424 td 0xfffff80735ddd000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104431 td 0xfffff804699ed000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104438 td 0xfffff804396a1000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104450 td 0xfffff802799535a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104455 td 0xfffff802762375a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104487 td 0xfffff80738d9d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104489 td 0xfffff805b4da45a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104491 td 0xfffff804f0f515a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104492 td 0xfffff8063941f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104493 td 0xfffff802794315a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104495 td 0xfffff80215e375a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104496 td 0xfffff80570c5c000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104500 td 0xfffff8071216c5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104503 td 0xfffff80723f08000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104510 td 0xfffff804db64b000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104513 td 0xfffff805b43e9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104531 td 0xfffff80443d75000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104543 td 0xfffff804cc0b05a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104552 td 0xfffff808017c45a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104558 td 0xfffff8011fecc5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104562 td 0xfffff8027912f5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104563 td 0xfffff80435ffb000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104564 td 0xfffff800454fd5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104568 td 0xfffff805fb5db000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104571 td 0xfffff806286e55a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104572 td 0xfffff8050def1000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104573 td 0xfffff802766335a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104581 td 0xfffff8027935a000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104623 td 0xfffff80435f385a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104625 td 0xfffff80443f785a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104628 td 0xfffff8074255b000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104629 td 0xfffff8063994a5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104631 td 0xfffff8037d1ba5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104633 td 0xfffff8058b2a8000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104634 td 0xfffff804ccbbd000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104635 td 0xfffff80276a6e000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104638 td 0xfffff804d2968000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104639 td 0xfffff805a09ce000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104640 td 0xfffff8001893a000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104643 td 0xfffff805b4da4000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104646 td 0xfffff80306fb55a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104648 td 0xfffff804f00c55a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104649 td 0xfffff8055090b000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104651 td 0xfffff804f0cd0000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104655 td 0xfffff80801701000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104656 td 0xfffff80481a835a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104657 td 0xfffff805239b2000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104661 td 0xfffff804f08bd5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104669 td 0xfffff8011ff195a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104670 td 0xfffff80625e45000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104677 td 0xfffff8017afc4000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104679 td 0xfffff803069935a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104685 td 0xfffff807235985a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104686 td 0xfffff80639b10000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104692 td 0xfffff803679105a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104696 td 0xfffff803b9090000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104704 td 0xfffff8026e6f9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104708 td 0xfffff80639a77000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104713 td 0xfffff80523a92000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104723 td 0xfffff8061c5ed5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104734 td 0xfffff805a06ff000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104737 td 0xfffff80801819000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104746 td 0xfffff80712107000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104754 td 0xfffff806281205a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104768 td 0xfffff8073faee5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104772 td 0xfffff80523f175a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104775 td 0xfffff805fb560000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104776 td 0xfffff805239b25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104791 td 0xfffff80639c4a000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104796 td 0xfffff806391c6000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104801 td 0xfffff804696ec5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104825 td 0xfffff807123535a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104831 td 0xfffff8063941e000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104835 td 0xfffff80272001000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104846 td 0xfffff80523f72000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104848 td 0xfffff80276b475a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104857 td 0xfffff804f0851000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104876 td 0xfffff807421eb000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104882 td 0xfffff806281465a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104899 td 0xfffff80628b4e000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104956 td 0xfffff805b490f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104957 td 0xfffff80481078000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104978 td 0xfffff8080119c000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 104983 td 0xfffff807e228d5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105001 td 0xfffff80279063000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105002 td 0xfffff804f0ec8000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105004 td 0xfffff806ed703000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105005 td 0xfffff8050d874000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105010 td 0xfffff8061c364000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105011 td 0xfffff8027961a000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105012 td 0xfffff80306d82000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105013 td 0xfffff805fbccc5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105016 td 0xfffff8017afc35a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105017 td 0xfffff80737494000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105018 td 0xfffff8027986b000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105020 td 0xfffff806281405a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105026 td 0xfffff80481a83000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105028 td 0xfffff807e1f5d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105029 td 0xfffff805b400f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105030 td 0xfffff805fb3c9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105036 td 0xfffff8011fe48000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105038 td 0xfffff80384f3f5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105039 td 0xfffff804f0f51000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105047 td 0xfffff806226755a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105055 td 0xfffff80628f3d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105061 td 0xfffff805b447b5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105062 td 0xfffff804698c65a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105069 td 0xfffff805fb6e8000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105077 td 0xfffff805b498a5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105078 td 0xfffff804f0a395a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105090 td 0xfffff8073fcf05a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105093 td 0xfffff801cb014000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105103 td 0xfffff8073fc615a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105106 td 0xfffff804696ec000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105108 td 0xfffff8017ad4d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105111 td 0xfffff804434ce000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105112 td 0xfffff8027935a5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105114 td 0xfffff802793bf5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105115 td 0xfffff802766885a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105116 td 0xfffff806391c45a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105118 td 0xfffff80367bcd5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105121 td 0xfffff804810785a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105122 td 0xfffff80276079000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105123 td 0xfffff80279868000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105124 td 0xfffff804f08b85a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105127 td 0xfffff80522ebe5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105128 td 0xfffff806223a1000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105134 td 0xfffff804f01845a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105136 td 0xfffff80495a835a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105141 td 0xfffff80723db5000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105143 td 0xfffff80712353000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105148 td 0xfffff80639906000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62769 tid 105162 td 0xfffff807e12a65a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 103144 td 0xfffff807f2e675a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e83bc6d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e83bc700 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e83bc740 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e83bc7a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e83bc7d0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e83bc870 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe00e83bc8d0 do_wait() at do_wait+0x206/frame 0xfffffe00e83bc940 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe00e83bc980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e83bcab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e83bcab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800277ebc, rsp = 0x7fffffffdc78, rbp = 0x7fffffffdd00 --- Tracing command thr1 pid 62768 tid 105412 td 0xfffff8027666c5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104366 td 0xfffff804f0c3c5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104722 td 0xfffff805fbab35a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104774 td 0xfffff803845d9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104368 td 0xfffff805fbe82000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104369 td 0xfffff806ed7035a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104389 td 0xfffff807354e45a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104390 td 0xfffff80317d825a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104382 td 0xfffff8037db275a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104214 td 0xfffff804810df5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104392 td 0xfffff804d2efe000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104332 td 0xfffff8026ee46000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104335 td 0xfffff804f08425a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104338 td 0xfffff8027906f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104350 td 0xfffff80215750000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104402 td 0xfffff804f0046000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104403 td 0xfffff806396ec5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104964 td 0xfffff807e23685a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104970 td 0xfffff80317564000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104979 td 0xfffff804f01735a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104982 td 0xfffff803178a2000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104482 td 0xfffff803679605a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104582 td 0xfffff807427985a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104585 td 0xfffff803069c9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104997 td 0xfffff8038d50d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62768 tid 104998 td 0xfffff8027941f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 102307 td 0xfffff807f291c5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e17fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e17fe10 trap() at trap+0x46/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e73535b0, rbp = 0xfffffe00e73535c0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e73535c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e7353650 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e73536a0 uma_zalloc_arg() at uma_zalloc_arg+0x5b2/frame 0xfffffe00e7353820 vm_thread_new() at vm_thread_new+0x4d/frame 0xfffffe00e7353860 thread_alloc() at thread_alloc+0x3b/frame 0xfffffe00e7353880 thread_create() at thread_create+0x111/frame 0xfffffe00e73538f0 sys_thr_new() at sys_thr_new+0xd2/frame 0xfffffe00e7353980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7353ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7353ab0 --- syscall (455, FreeBSD ELF64, sys_thr_new), rip = 0x80031b66a, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdd00 --- Tracing command thr1 pid 62766 tid 104251 td 0xfffff801b3867000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104507 td 0xfffff802793545a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105439 td 0xfffff80306738000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105440 td 0xfffff80622de65a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104963 td 0xfffff805fbe825a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105054 td 0xfffff80272a5b000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105445 td 0xfffff804db8855a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105334 td 0xfffff80004531000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104469 td 0xfffff80469271000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105337 td 0xfffff805fbdd0000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105448 td 0xfffff80625046000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105450 td 0xfffff802799a0000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104377 td 0xfffff803170d6000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104600 td 0xfffff80272562000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104706 td 0xfffff805b410d5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104714 td 0xfffff80279dc0000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104167 td 0xfffff804d2efe5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104105 td 0xfffff804ccf5d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105041 td 0xfffff8017a395000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104728 td 0xfffff80367eea000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104715 td 0xfffff8073fe6d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105452 td 0xfffff8017a2ae5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105454 td 0xfffff805fb8c8000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105456 td 0xfffff804f091c000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105460 td 0xfffff8062827c5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105462 td 0xfffff803177b1000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105466 td 0xfffff8073ad6d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105468 td 0xfffff80317a7d5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105470 td 0xfffff805b4bf75a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105474 td 0xfffff804438f25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105478 td 0xfffff805b410f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105480 td 0xfffff8038d910000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105482 td 0xfffff801b39345a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105486 td 0xfffff802f83435a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105490 td 0xfffff804cc764000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104414 td 0xfffff807375245a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104237 td 0xfffff804816325a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 104743 td 0xfffff80523a9c5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105494 td 0xfffff80306cbb000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105498 td 0xfffff804cc4465a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105500 td 0xfffff804cc4505a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62766 tid 105504 td 0xfffff8061c5c95a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 103399 td 0xfffff808011825a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1a3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1a3e10 trap() at trap+0x46/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff80c1ca82, rsp = 0xfffffe00e88bd5b0, rbp = 0xfffffe00e88bd5c0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00e88bd5c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e88bd650 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e88bd6a0 uma_zalloc_arg() at uma_zalloc_arg+0x8b9/frame 0xfffffe00e88bd820 vm_thread_new() at vm_thread_new+0x4d/frame 0xfffffe00e88bd860 thread_alloc() at thread_alloc+0x3b/frame 0xfffffe00e88bd880 thread_create() at thread_create+0x111/frame 0xfffffe00e88bd8f0 sys_thr_new() at sys_thr_new+0xd2/frame 0xfffffe00e88bd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e88bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e88bdab0 --- syscall (455, FreeBSD ELF64, sys_thr_new), rip = 0x80031b66a, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdd00 --- Tracing command thr1 pid 62765 tid 105129 td 0xfffff804dbb18000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105131 td 0xfffff804439f15a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105132 td 0xfffff801b57075a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105135 td 0xfffff80279ab85a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105138 td 0xfffff803067ca5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105140 td 0xfffff801cb929000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105144 td 0xfffff805fbdbb5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105146 td 0xfffff80003959000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105149 td 0xfffff80215e30000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105155 td 0xfffff8043967b5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105159 td 0xfffff8074267b000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105163 td 0xfffff8026ef18000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105169 td 0xfffff804f0b675a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105174 td 0xfffff80523a9b5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105181 td 0xfffff80550d60000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105201 td 0xfffff805fb3565a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105211 td 0xfffff800038245a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105216 td 0xfffff800454335a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105225 td 0xfffff80317ca3000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105237 td 0xfffff8017ada25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105240 td 0xfffff80279bcc5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105246 td 0xfffff8027654f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105255 td 0xfffff805b410d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105272 td 0xfffff801b31ce5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105277 td 0xfffff806ed606000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105286 td 0xfffff804cc76a5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105292 td 0xfffff807354c75a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105308 td 0xfffff80481594000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105316 td 0xfffff802720015a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104877 td 0xfffff803daeee000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104901 td 0xfffff80215c72000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105329 td 0xfffff8062522d5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105330 td 0xfffff8061c634000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105332 td 0xfffff807128bf5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105416 td 0xfffff800450115a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105418 td 0xfffff80628c315a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105419 td 0xfffff803f3b705a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105420 td 0xfffff805fba325a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105423 td 0xfffff804f0842000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104864 td 0xfffff8038dd975a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105426 td 0xfffff805239d25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 100144 td 0xfffff804f0fd9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105429 td 0xfffff8050d3135a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105430 td 0xfffff804f0c25000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105434 td 0xfffff8072380d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104259 td 0xfffff805fb76b5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105438 td 0xfffff80306eb0000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105441 td 0xfffff805fb6b25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105086 td 0xfffff80045f0f5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104304 td 0xfffff804f08b55a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104504 td 0xfffff80272292000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104201 td 0xfffff80215cfe5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105446 td 0xfffff80279a74000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105447 td 0xfffff8061c5c9000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105451 td 0xfffff8048142f5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104534 td 0xfffff8037d1c05a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104740 td 0xfffff8011f269000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104071 td 0xfffff805fb1cb000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104150 td 0xfffff80215ebd5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105034 td 0xfffff80306ecd5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105066 td 0xfffff807123d65a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 104716 td 0xfffff80279421000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105096 td 0xfffff8073faf05a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105453 td 0xfffff806396e2000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105455 td 0xfffff8017ac2f000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105457 td 0xfffff80276688000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105461 td 0xfffff805fb1655a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105463 td 0xfffff80279b47000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105465 td 0xfffff8027905a000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105467 td 0xfffff8027634e5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105469 td 0xfffff8073fe61000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105471 td 0xfffff804699ed5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105473 td 0xfffff804436e6000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105475 td 0xfffff80628305000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105479 td 0xfffff80306fb25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105481 td 0xfffff804f0184000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105483 td 0xfffff803b90e95a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105485 td 0xfffff80507a00000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105487 td 0xfffff808013af5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105489 td 0xfffff805a0fed5a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105491 td 0xfffff8050dc665a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105492 td 0xfffff8026eec25a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105493 td 0xfffff80523f71000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105495 td 0xfffff8026e6e55a0 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105497 td 0xfffff8066667d000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105499 td 0xfffff80495a83000 fork_trampoline() at fork_trampoline Tracing command thr1 pid 62765 tid 105501 td 0xfffff802791135a0 fork_trampoline() at fork_trampoline Tracing command sleep pid 62754 tid 102231 td 0xfffff802f889e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e71d5710 mi_switch() at mi_switch+0x172/frame 0xfffffe00e71d5740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e71d5780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e71d57e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e71d5820 _sleep() at _sleep+0x265/frame 0xfffffe00e71d58c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00e71d5940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e71d5980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e71d5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e71d5ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a5b8a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sh pid 62753 tid 102559 td 0xfffff807f2c9c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e7845560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e7845590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e78455d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e7845630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e7845660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e7845700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e7845790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e7845980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7845ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7845ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62752 tid 102471 td 0xfffff807f28955a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e768b560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e768b590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e768b5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e768b630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e768b660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e768b700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e768b790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e768b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e768bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e768bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command thr1 pid 62750 tid 104372 td 0xfffff8034a87f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3f42560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3f42590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3f425d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3f42630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3f42660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3f42700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3f42790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3f42980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3f42ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f42ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003eaa2a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe550 --- Tracing command sh pid 62749 tid 101397 td 0xfffff807f22e75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e617b560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e617b590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e617b5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e617b630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e617b660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e617b700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e617b790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e617b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e617bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e617bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62748 tid 101199 td 0xfffff8073fcc85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5d99560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5d99590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5d995d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5d99630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5d99660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5d99700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5d99790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5d99980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5d99ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d99ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62746 tid 100251 td 0xfffff807e1442000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81d8bae0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81d8bb00 trap() at trap+0x46/frame 0xffffffff81d8bc10 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d8bc10 --- trap 0x13, rip = 0xffffffff80c1ca80, rsp = 0xfffffe00e3f1a440, rbp = 0xfffffe00e3f1a450 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00e3f1a450 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00e3f1a4e0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe00e3f1a530 uma_zfree_arg() at uma_zfree_arg+0x3ee/frame 0xfffffe00e3f1a640 thread_reap() at thread_reap+0xd6/frame 0xfffffe00e3f1a660 proc_reap() at proc_reap+0x616/frame 0xfffffe00e3f1a6a0 proc_to_reap() at proc_to_reap+0x3ac/frame 0xfffffe00e3f1a6f0 kern_wait6() at kern_wait6+0x1ec/frame 0xfffffe00e3f1a790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3f1a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3f1aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f1aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62744 tid 101959 td 0xfffff8073f4e4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e6c81560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e6c81590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e6c815d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e6c81630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e6c81660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e6c81700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e6c81790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6c81980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e6c81ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6c81ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62742 tid 100449 td 0xfffff807f203f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e4ee3560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e4ee3590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e4ee35d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e4ee3630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e4ee3660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e4ee3700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e4ee3790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4ee3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e4ee3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4ee3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62740 tid 104520 td 0xfffff804888715a0 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1afdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1afe10 trap() at trap+0x46/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff80c1ca80, rsp = 0xfffffe033fe8b440, rbp = 0xfffffe033fe8b450 --- lock_delay() at lock_delay+0x40/frame 0xfffffe033fe8b450 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe033fe8b4e0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe033fe8b530 uma_zfree_arg() at uma_zfree_arg+0x3ee/frame 0xfffffe033fe8b640 thread_reap() at thread_reap+0xd6/frame 0xfffffe033fe8b660 proc_reap() at proc_reap+0x616/frame 0xfffffe033fe8b6a0 proc_to_reap() at proc_to_reap+0x3ac/frame 0xfffffe033fe8b6f0 kern_wait6() at kern_wait6+0x1ec/frame 0xfffffe033fe8b790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe033fe8b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe033fe8bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fe8bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62738 tid 102277 td 0xfffff807f24755a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e72bd560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e72bd590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e72bd5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e72bd630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e72bd660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e72bd700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e72bd790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e72bd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e72bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e72bdab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62736 tid 101160 td 0xfffff807f276d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5cd6560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5cd6590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5cd65d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5cd6630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5cd6660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5cd6700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5cd6790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5cd6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5cd6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5cd6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62734 tid 102287 td 0xfffff807f2475000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e72ef560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e72ef590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e72ef5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e72ef630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e72ef660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e72ef700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e72ef790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e72ef980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e72efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e72efab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62732 tid 102831 td 0xfffff808013fd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e7d99560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e7d99590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e7d995d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e7d99630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e7d99660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e7d99700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e7d99790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e7d99980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7d99ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7d99ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62730 tid 100987 td 0xfffff802f83925a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5971560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5971590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e59715d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5971630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5971660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5971700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5971790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5971980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5971ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5971ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62728 tid 102921 td 0xfffff808017055a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e7f5d560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e7f5d590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e7f5d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e7f5d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e7f5d660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e7f5d700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e7f5d790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e7f5d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e7f5dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7f5dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62726 tid 102644 td 0xfffff80570f37000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e79ee560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e79ee590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e79ee5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e79ee630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e79ee660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e79ee700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e79ee790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e79ee980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e79eeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e79eeab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command sh pid 62725 tid 103234 td 0xfffff807f2d835a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e8580560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e8580590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e85805d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e8580630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e8580660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e8580700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e8580790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e8580980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e8580ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8580ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command thr1 pid 62723 tid 102894 td 0xfffff802f81885a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ea30c710 mi_switch() at mi_switch+0x172/frame 0xfffffe00ea30c740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ea30c780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ea30c7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ea30c820 _sleep() at _sleep+0x265/frame 0xfffffe00ea30c8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ea30c940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ea30c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ea30cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea30cab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003eab8a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe540 --- Tracing command sh pid 62718 tid 102573 td 0xfffff807f2c9c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e788b560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e788b590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e788b5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e788b630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e788b660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e788b700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e788b790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e788b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e788bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e788bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command tee pid 62717 tid 103343 td 0xfffff808011b25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e87a36a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e87a36d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e87a3710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e87a3770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e87a37a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e87a3840 pipe_read() at pipe_read+0x348/frame 0xfffffe00e87a38a0 dofileread() at dofileread+0x81/frame 0xfffffe00e87a38f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e87a3930 sys_read() at sys_read+0x84/frame 0xfffffe00e87a3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e87a3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e87a3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041642a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 62716 tid 100666 td 0xfffff8073fe9b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5326560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5326590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e53265d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5326630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5326660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5326700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5326790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5326980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5326ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5326ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffaa88, rbp = 0x7fffffffab40 --- Tracing command sh pid 43602 tid 103519 td 0xfffff80801cc4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e8b176a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e8b176d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e8b17710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e8b17770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e8b177a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e8b17840 pipe_read() at pipe_read+0x348/frame 0xfffffe00e8b178a0 dofileread() at dofileread+0x81/frame 0xfffffe00e8b178f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e8b17930 sys_read() at sys_read+0x84/frame 0xfffffe00e8b17980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e8b17ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8b17ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047542a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 43600 tid 100240 td 0xfffff80007bcc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ef76a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ef76d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ef7710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ef7770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ef77a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3ef7840 pipe_read() at pipe_read+0x348/frame 0xfffffe00e3ef78a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ef78f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ef7930 sys_read() at sys_read+0x84/frame 0xfffffe00e3ef7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ef7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ef7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a42a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 43599 tid 100289 td 0xfffff803a9fee5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3fbf560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3fbf590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3fbf5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3fbf630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3fbf660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3fbf700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3fbf790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3fbf980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3fbfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3fbfab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe3d0 --- Tracing command sh pid 43513 tid 100185 td 0xfffff80007c56000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e04560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e04590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e045d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e04630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e04660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3e04700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3e04790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3e04980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e04ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e04ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe580 --- Tracing command sh pid 41165 tid 100256 td 0xfffff802f836b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3f38560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3f38590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3f385d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3f38630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3f38660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3f38700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3f38790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3f38980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3f38ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3f38ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800404a2a, rsp = 0x7fffffffada8, rbp = 0x7fffffffae60 --- Tracing command bash pid 2376 tid 100223 td 0xfffff802f8cbe000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ef2560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ef2590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ef25d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ef2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ef2660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3ef2700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3ef2790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3ef2980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ef2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ef2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800516a2a, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6a0 --- Tracing command csh pid 2374 tid 100213 td 0xfffff80007c585a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ec0750 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ec0780 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ec07c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ec0820 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ec0850 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3ec08f0 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00e3ec0950 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00e3ec0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ec0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ec0ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80048aaaa, rsp = 0x7fffffffdfd8, rbp = 0x7fffffffe060 --- Tracing command su pid 2373 tid 100206 td 0xfffff80007fe7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e9d560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e9d590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e9d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e9d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e9d660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3e9d700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3e9d790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3e9d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e9dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e9dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003eba2a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffeb20 --- Tracing command bash pid 2344 tid 100208 td 0xfffff80004541000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ea7560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ea7590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ea75d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ea7630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ea7660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3ea7700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3ea7790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3ea7980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ea7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ea7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800516a2a, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 2343 tid 100220 td 0xfffff802f8cbd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ee35c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ee35f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ee3630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ee3690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ee36c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3ee3720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3ee3760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3ee3940 sys_select() at sys_select+0x56/frame 0xfffffe00e3ee3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ee3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ee3ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008fd40a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2340 tid 100188 td 0xfffff800041225a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e13640 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e13670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e136b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e13710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e13740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3e137a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e137e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3e13960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e13980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e13ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e13ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089f37a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2336 tid 100196 td 0xfffff80018042000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e5f620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e5f650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e5f690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e5f6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e5f720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3e5f780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e5f7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e5f810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e5f840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e5f8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e5f8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e5f930 sys_read() at sys_read+0x84/frame 0xfffffe00e3e5f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e5fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e5fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fb42a, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2335 tid 100190 td 0xfffff80007c575a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e35560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e35590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e355d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e35630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e35660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3e35700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3e35790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3e35980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e35ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e35ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003eda2a, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command getty pid 2334 tid 100191 td 0xfffff80007c57000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e3a620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e3a650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e3a690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e3a6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e3a720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3e3a780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e3a7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e3a810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e3a840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e3a8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e3a8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e3a930 sys_read() at sys_read+0x84/frame 0xfffffe00e3e3a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e3aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e3aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2333 tid 100218 td 0xfffff80003c24000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ed9620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ed9650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ed9690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ed96f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ed9720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3ed9780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ed97b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ed9810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ed9840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ed98a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ed98f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ed9930 sys_read() at sys_read+0x84/frame 0xfffffe00e3ed9980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ed9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ed9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2332 tid 100217 td 0xfffff80003c245a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ed4620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ed4650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ed4690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ed46f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ed4720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3ed4780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ed47b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ed4810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ed4840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ed48a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ed48f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ed4930 sys_read() at sys_read+0x84/frame 0xfffffe00e3ed4980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ed4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ed4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2331 tid 100216 td 0xfffff80003c18000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ecf620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ecf650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ecf690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ecf6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ecf720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3ecf780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ecf7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ecf810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ecf840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ecf8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ecf8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ecf930 sys_read() at sys_read+0x84/frame 0xfffffe00e3ecf980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ecfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ecfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2330 tid 100215 td 0xfffff80003c185a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3eca620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3eca650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3eca690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3eca6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eca720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3eca780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eca7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eca810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eca840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eca8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eca8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eca930 sys_read() at sys_read+0x84/frame 0xfffffe00e3eca980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ecaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ecaab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2329 tid 100214 td 0xfffff80003c17000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ec5620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ec5650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ec5690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ec56f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ec5720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3ec5780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ec57b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ec5810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ec5840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ec58a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ec58f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ec5930 sys_read() at sys_read+0x84/frame 0xfffffe00e3ec5980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ec5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ec5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2328 tid 100200 td 0xfffff80003c16000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e73620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e73650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e73690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e736f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e73720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3e73780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e737b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e73810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e73840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e738a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e738f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e73930 sys_read() at sys_read+0x84/frame 0xfffffe00e3e73980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e73ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e73ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2327 tid 100207 td 0xfffff80003c175a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3ea2620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3ea2650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3ea2690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3ea26f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ea2720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3ea2780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ea27b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ea2810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ea2840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ea28a0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ea28f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ea2930 sys_read() at sys_read+0x84/frame 0xfffffe00e3ea2980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3ea2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ea2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2326 tid 100142 td 0xfffff8000381f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1ce4620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1ce4650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1ce4690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1ce46f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1ce4720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e1ce4780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1ce47b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1ce4810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1ce4840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1ce48a0 dofileread() at dofileread+0x81/frame 0xfffffe00e1ce48f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1ce4930 sys_read() at sys_read+0x84/frame 0xfffffe00e1ce4980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1ce4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ce4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043242a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2280 tid 100205 td 0xfffff800045415a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e98710 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e98740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e98780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e987e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e98820 _sleep() at _sleep+0x265/frame 0xfffffe00e3e988c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00e3e98940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e3e98980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e98ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e98ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6b8a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2276 tid 100155 td 0xfffff80007502000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1d255c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1d255f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1d25630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1d25690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d256c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e1d25720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d25760 kern_select() at kern_select+0x95a/frame 0xfffffe00e1d25940 sys_select() at sys_select+0x56/frame 0xfffffe00e1d25980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1d25ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d25ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008fd40a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2247 tid 100204 td 0xfffff80007fe75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e935c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e935f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e93630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e93690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e936c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3e93720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e93760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3e93940 sys_select() at sys_select+0x56/frame 0xfffffe00e3e93980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e93ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e93ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082840a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2247 tid 100769 td 0xfffff803a9e0b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe03817cb6b0 mi_switch() at mi_switch+0x172/frame 0xfffffe03817cb6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe03817cb720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe03817cb780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe03817cb7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe03817cb850 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe03817cb8b0 do_sem2_wait() at do_sem2_wait+0x41c/frame 0xfffffe03817cb930 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe03817cb980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe03817cbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03817cbab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80071c79a, rsp = 0x7fffdff7bed8, rbp = 0x7fffdff7bf50 --- Tracing command rpc.lockd pid 2184 tid 100202 td 0xfffff80004535000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e7d4e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e7d510 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e7d550 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e7d5b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e7d5f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3e7d660 svc_run_internal() at svc_run_internal+0xa90/frame 0xfffffe00e3e7d7a0 svc_run() at svc_run+0x24e/frame 0xfffffe00e3e7d800 sys_nlm_syscall() at sys_nlm_syscall+0x763/frame 0xfffffe00e3e7d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e7dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e7dab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f164a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2181 tid 100201 td 0xfffff800045355a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e785a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e785d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e78610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e78670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e786b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3e78720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3e78760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3e78940 sys_select() at sys_select+0x56/frame 0xfffffe00e3e78980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e78ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e78ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042640a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2135 tid 100150 td 0xfffff80003c15000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1d0c710 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1d0c740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1d0c780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1d0c7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d0c820 _sleep() at _sleep+0x265/frame 0xfffffe00e1d0c8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00e1d0c940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e1d0c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1d0cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d0cab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003beb8a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2056 tid 100195 td 0xfffff800180425a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e5a620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e5a650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e5a690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e5a6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e5a730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3e5a7a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3e5a7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3e5a960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e5a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e5aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e5aab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cd37a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2046 tid 100174 td 0xfffff80018044000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1d9c5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1d9c5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1d9c630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1d9c690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d9c6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e1d9c720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d9c760 kern_select() at kern_select+0x95a/frame 0xfffffe00e1d9c940 sys_select() at sys_select+0x56/frame 0xfffffe00e1d9c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1d9cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d9cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043740a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1975 tid 100167 td 0xfffff8000741a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1d795a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1d795d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1d79610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1d79670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d796b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e1d79720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1d79760 kern_select() at kern_select+0x95a/frame 0xfffffe00e1d79940 sys_select() at sys_select+0x56/frame 0xfffffe00e1d79980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1d79ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d79ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f52da, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1970 tid 100193 td 0xfffff80007bcc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e44620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e44650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e44690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e446f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e44730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3e447a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3e447e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3e44960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e44980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e44ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e44ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f037a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1926 tid 100186 td 0xfffff800045325a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e09640 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e09670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e096b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3e09710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e09740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3e097a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e097e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3e09960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e09980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3e09ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e09ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f037a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1923 tid 100156 td 0xfffff8000497e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1d2a5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1d2a5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1d2a630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1d2a690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d2a6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e1d2a720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d2a760 kern_select() at kern_select+0x95a/frame 0xfffffe00e1d2a940 sys_select() at sys_select+0x56/frame 0xfffffe00e1d2a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1d2aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d2aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044e40a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff800072d4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00daffd890 mi_switch() at mi_switch+0x172/frame 0xfffffe00daffd8c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00daffd900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00daffd940 _sleep() at _sleep+0x279/frame 0xfffffe00daffd9e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00daffda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00daffdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00daffdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff800072d45a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00daff88c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00daff88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00daff8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00daff8970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00daff89e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00daff8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00daff8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00daff8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff800072d3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d32468d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d3246900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d3246940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d3246980 _sleep() at _sleep+0x279/frame 0xfffffe00d3246a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe00d3246a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d3246ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3246ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff8000740b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d33f58c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d33f58f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d33f5930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33f5970 _sleep() at _sleep+0x279/frame 0xfffffe00d33f5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00d33f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d33f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8000740c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d33fa8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d33fa8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d33fa930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33fa970 _sleep() at _sleep+0x279/frame 0xfffffe00d33faa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00d33faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d33faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000740c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d33ff8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d33ff8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d33ff930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33ff970 _sleep() at _sleep+0x279/frame 0xfffffe00d33ffa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00d33ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d33ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000740d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00dae248c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00dae248f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00dae24930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dae24970 _sleep() at _sleep+0x279/frame 0xfffffe00dae24a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00dae24a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00dae24ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dae24ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff8000740d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00daf898c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00daf898f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00daf89930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00daf89970 _sleep() at _sleep+0x279/frame 0xfffffe00daf89a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00daf89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00daf89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00daf89ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000740e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00dafee8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00dafee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00dafee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00dafee970 _sleep() at _sleep+0x279/frame 0xfffffe00dafeea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00dafeea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00dafeeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dafeeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000740e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00daff38c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00daff38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00daff3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00daff3970 _sleep() at _sleep+0x279/frame 0xfffffe00daff3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00daff3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00daff3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00daff3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100151 td 0xfffff800039bc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1d118f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1d11920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1d11960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e1d119a0 _sleep() at _sleep+0x279/frame 0xfffffe00e1d11a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00e1d11a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00e1d11ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1d11ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100203 td 0xfffff80007fe5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3e8e8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3e8e920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3e8e960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e3e8e9a0 _sleep() at _sleep+0x279/frame 0xfffffe00e3e8ea40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00e3e8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00e3e8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3e8eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff800061ba5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d32358c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d32358f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d3235930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3235960 _sleep() at _sleep+0x2da/frame 0xfffffe00d3235a00 vm_daemon() at vm_daemon+0xa6f/frame 0xfffffe00d3235a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d3235ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff800071c0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d3230520 mi_switch() at mi_switch+0x172/frame 0xfffffe00d3230550 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d3230590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d32305d0 _sleep() at _sleep+0x279/frame 0xfffffe00d3230670 vm_pageout_worker() at vm_pageout_worker+0x26b/frame 0xfffffe00d3230a30 vm_pageout() at vm_pageout+0x176/frame 0xfffffe00d3230a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d3230ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3230ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff80003b235a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d33eb6b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d33eb6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d33eb720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d33eb750 _sleep() at _sleep+0x2da/frame 0xfffffe00d33eb7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xd99/frame 0xfffffe00d33eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d33ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100133 td 0xfffff80003b23000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d33f08c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d33f08f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d33f0930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33f0970 _sleep() at _sleep+0x279/frame 0xfffffe00d33f0a10 uma_reclaim_worker() at uma_reclaim_worker+0x80/frame 0xfffffe00d33f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d33f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000381f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d32138b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d32138e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d3213920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3213950 _sleep() at _sleep+0x2da/frame 0xfffffe00d32139f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe00d3213a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d3213ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3213ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000381e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d320e8b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d320e8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d320e920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d320e950 _sleep() at _sleep+0x2da/frame 0xfffffe00d320e9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe00d320ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d320eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d320eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff800071b45a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5ff8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5ff8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5ff930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5ff970 _sleep() at _sleep+0x279/frame 0xfffffe003e5ffa10 random_kthread() at random_kthread+0x26a/frame 0xfffffe003e5ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800071b25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5df910 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5df940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5df980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5df9b0 _sleep() at _sleep+0x2da/frame 0xfffffe003e5dfa50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe003e5dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000381e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5ce8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5ce910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5ce950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5ce990 _sleep() at _sleep+0x279/frame 0xfffffe003e5cea30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e5cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000381d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5c98e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5c9910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5c9950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5c9990 _sleep() at _sleep+0x279/frame 0xfffffe003e5c9a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e5c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000381d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5c48e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5c4910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5c4950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5c4990 _sleep() at _sleep+0x279/frame 0xfffffe003e5c4a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e5c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000381c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5bf8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5bf910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5bf950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5bf990 _sleep() at _sleep+0x279/frame 0xfffffe003e5bfa30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e5bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003cf3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e554930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e554960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5549d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e554a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e554a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e554ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e554ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003cf45a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e559930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e559960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e559a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e559a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e559ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e559ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003cf4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e55e930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e55e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e55e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e55e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e55ea30 usb_process() at usb_process+0x13b/frame 0xfffffe003e55ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e55eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e55eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003cf55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e563930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e563960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e563a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e563a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e563ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e563ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003cf5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e568930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e568960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e568a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e568a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e568ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e568ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003cff000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e572930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e572960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e572a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e572a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e572ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e572ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff8000497c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e577930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e577960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5779a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5779d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e577a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e577a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e577ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e577ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff8000497c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e57c930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e57c960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e57c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e57c9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e57ca30 usb_process() at usb_process+0x13b/frame 0xfffffe003e57ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e57cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e57cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff8000497d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e581930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e581960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5819a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5819d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e581a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e581a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e581ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e581ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000497d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e586930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e586960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5869a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5869d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e586a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e586a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e586ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e586ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800061ba000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e597930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e597960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5979a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5979d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e597a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800061bb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e59c930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e59c960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e59c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e59c9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e59ca30 usb_process() at usb_process+0x13b/frame 0xfffffe003e59ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e59cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e59cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800061bb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5a1930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5a1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5a19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5a19d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e5a1a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e5a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800061bc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5a6930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5a6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5a69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5a69d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e5a6a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e5a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800061bc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5ab930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5ab960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5ab9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5ab9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e5aba30 usb_process() at usb_process+0x13b/frame 0xfffffe003e5aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80004089000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e53b8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e53b910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e53b950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e53b980 _sleep() at _sleep+0x2da/frame 0xfffffe003e53ba20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe003e53ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e53bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e53bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff8000411f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5408e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e540910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e540950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e540980 _sleep() at _sleep+0x2da/frame 0xfffffe003e540a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe003e540a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e540ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e540ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff8000411f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5458e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e545910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e545950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e545980 _sleep() at _sleep+0x2da/frame 0xfffffe003e545a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe003e545a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e545ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e545ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff800071c05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d32098d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00d3209900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d3209940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3209970 _sleep() at _sleep+0x2da/frame 0xfffffe00d3209a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe00d3209a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d3209ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3209ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff800040895a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5368c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5368f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e536930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e536960 _sleep() at _sleep+0x2da/frame 0xfffffe003e536a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e536a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e536ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e536ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80004088000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5318c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5318f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e531930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e531960 _sleep() at _sleep+0x2da/frame 0xfffffe003e531a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e531a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e531ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e531ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff800040885a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e52c8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e52c8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e52c930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e52c960 _sleep() at _sleep+0x2da/frame 0xfffffe003e52ca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e52ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e52cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e52cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80004087000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5278c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5278f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e527930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e527960 _sleep() at _sleep+0x2da/frame 0xfffffe003e527a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e527a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e527ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e527ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff800040875a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5228c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5228f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e522930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e522960 _sleep() at _sleep+0x2da/frame 0xfffffe003e522a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e522a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e522ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e522ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80004086000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e51d8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e51d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e51d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e51d960 _sleep() at _sleep+0x2da/frame 0xfffffe003e51da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e51da70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e51dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e51dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff800040865a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5188c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e518930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e518960 _sleep() at _sleep+0x2da/frame 0xfffffe003e518a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e518a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e518ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e518ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80004085000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5138c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e513930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e513960 _sleep() at _sleep+0x2da/frame 0xfffffe003e513a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e513a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e513ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e513ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff800040b25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e50e8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e50e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e50e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e50e960 _sleep() at _sleep+0x2da/frame 0xfffffe003e50ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e50ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e50eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e50eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80004099000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5098c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e509930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e509960 _sleep() at _sleep+0x2da/frame 0xfffffe003e509a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e509a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e509ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e509ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff800040995a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5048c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e504930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e504960 _sleep() at _sleep+0x2da/frame 0xfffffe003e504a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e504a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e504ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e504ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80004098000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4ff8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4ff8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4ff930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4ff960 _sleep() at _sleep+0x2da/frame 0xfffffe003e4ffa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e4ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff800040985a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4fa8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4fa920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4fa960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4fa990 _sleep() at _sleep+0x2da/frame 0xfffffe003e4faa30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe003e4faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff800040b2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4b98f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4b9920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4b9960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4b9990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e4b99f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe003e4b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003f9d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e49e8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e49e920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e49e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e49e990 _sleep() at _sleep+0x2da/frame 0xfffffe003e49ea30 g_run_events() at g_run_events+0x4f/frame 0xfffffe003e49ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e49eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e49eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003f9d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4a38f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4a3920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4a3960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4a3990 _sleep() at _sleep+0x2da/frame 0xfffffe003e4a3a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe003e4a3a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe003e4a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003fa55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4a88f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4a8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4a8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4a8990 _sleep() at _sleep+0x2da/frame 0xfffffe003e4a8a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe003e4a8a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe003e4a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff800038ab000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00addae9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00addaea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00addaea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00addaeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff800038ac000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100021 td 0xfffff80003860000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00addcc9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00addcca10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00addcca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00addccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff80003fa5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff80003fa65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4049e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e404a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e404a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e404ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e404ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff80003fa6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4099e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e409a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e409a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e409ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e409ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff80003fa75a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003fa7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003fa85a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003fa8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003fbd5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003fbd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003f9a5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003f9a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003f9b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003f9b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003f9c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003cf2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e54a9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e54aa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e54aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e54aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e54aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003cf35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e54f9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e54fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e54fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e54fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e54fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003cff5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e56d9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e56da10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e56da70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e56dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e56dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800061bd5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800061bd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5b59e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5b5a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e5b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100177 td 0xfffff8000497f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff80003cf25a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff80018764000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff800188505a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff80018850000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8001804e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8001804e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8001809e5a0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800038bb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add66970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add669a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add66a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add66ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800038bc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add6b970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add6b9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add6ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add6bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800038bc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add70970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add709a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe00add70a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add70ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add70ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800038bd5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add75970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add759a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add75a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add75ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add75ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800038bd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add7a970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add7a9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add7aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add7aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800038be5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add7f970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add7f9a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe00add7fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add7fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800038be000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add84970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add849a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add84a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add84ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800038a95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add89950 mi_switch() at mi_switch+0x172/frame 0xfffffe00add89980 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00add899a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00add89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add89ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800038a9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add8e950 mi_switch() at mi_switch+0x172/frame 0xfffffe00add8e980 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00add8e9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00add8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800038aa5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003e1d3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003e1d3e10 trap() at trap+0x46/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff810103c6, rsp = 0xfffffe00add93910, rbp = 0xfffffe00add93910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add93910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00add93960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00add93980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00add939a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00add93a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add93ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800038aa000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add98970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add989a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add98a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add98ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800038ab5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add9d970 mi_switch() at mi_switch+0x172/frame 0xfffffe00add9d9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add9da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add9dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800038bb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add61560 mi_switch() at mi_switch+0x172/frame 0xfffffe00add61590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00add615d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00add61630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00add61660 _sleep() at _sleep+0x2d0/frame 0xfffffe00add61700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00add61790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add61980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00add61ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add61ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0e7a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800038ba000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00add5c910 mi_switch() at mi_switch+0x172/frame 0xfffffe00add5c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00add5c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00add5c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00add5ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe00add5ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00add5cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81da5260 sched_switch() at sched_switch+0x3f0/frame 0xffffffff824ef980 mi_switch() at mi_switch+0x172/frame 0xffffffff824ef9b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff824ef9f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff824efa30 _sleep() at _sleep+0x279/frame 0xffffffff824efad0 swapper() at swapper+0x77/frame 0xffffffff824efb20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff824efb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff800038ac5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00addb3900 mi_switch() at mi_switch+0x172/frame 0xfffffe00addb3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00addb3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addb39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00addb3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00addb3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00addb3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff800038ba5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00addbd930 mi_switch() at mi_switch+0x172/frame 0xfffffe00addbd960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00addbd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addbd9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00addbda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00addbda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00addbdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff8000385f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00addc2900 mi_switch() at mi_switch+0x172/frame 0xfffffe00addc2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00addc2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addc29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00addc2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00addc2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00addc2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800038605a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00addc7900 mi_switch() at mi_switch+0x172/frame 0xfffffe00addc7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00addc7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addc79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00addc7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00addc7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00addc7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800038615a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037781930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037781960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377819a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377819d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037781a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037781a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037781ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003861000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037786930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037786960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377869a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377869d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037786a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037786a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037786ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800038625a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003778b930 mi_switch() at mi_switch+0x172/frame 0xfffffe003778b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003778b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003778b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003778ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003778ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003778bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003862000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037790930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037790960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377909a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377909d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037790a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037790a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037790ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800038635a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037795930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037795960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377959a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377959d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037795a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037795a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037795ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003863000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003779a930 mi_switch() at mi_switch+0x172/frame 0xfffffe003779a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003779a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003779a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003779aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003779aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003779aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000382b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003779f930 mi_switch() at mi_switch+0x172/frame 0xfffffe003779f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003779f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003779f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003779fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003779fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003779fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff8000382b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377a4930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377a4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377a49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377a49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377a4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000382c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377a9930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377a9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377a99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377a99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377a9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377a9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377a9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff8000382c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377ae930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377ae960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377ae9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377ae9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377aea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000382d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377b3930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377b3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377b39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377b39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377b3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000382d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377b8930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377b8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377b89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377b89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377b8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000382e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377bd930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377bd960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377bd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377bd9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377bda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000382e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377c2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377c2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377c29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377c29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377c2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000385f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377c7930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377c7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377c79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377c79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377c7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003824000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377cc930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377cc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377cc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377cc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377cca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800038255a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377d1930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377d1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377d19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377d19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377d1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377d1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377d1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003825000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377d6930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377d6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377d69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377d69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377d6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377d6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800038265a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377db930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377db960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377db9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377db9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377dba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377dba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003826000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377e0930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377e0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377e09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377e09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377e0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377e0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800038275a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377e5930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377e5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377e59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377e59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377e5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377e5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377e5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003827000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377ea930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377ea960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377ea9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377ea9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377eaa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377eaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377eaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800038285a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377ef930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377ef960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377ef9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377ef9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377efa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377efa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377efab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003828000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377f4930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377f4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377f49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377f49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377f4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377f4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377f4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff8000381c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00377f9930 mi_switch() at mi_switch+0x172/frame 0xfffffe00377f9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00377f99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377f99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00377f9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00377f9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00377f9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003f9c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e499900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e499930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e499970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4999a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e499a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800040b35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4be900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4be930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4be970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4be9a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4bea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800040b3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4c3900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4c3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4c3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4c39a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4c3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800040b45a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4c8900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4c8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4c8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4c89a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4c8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800040b4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4cd900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4cd930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4cd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4cd9a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4cda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800040b55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4d2900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4d2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4d2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4d29a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4d2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800040b5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4d7900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4d7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4d7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4d79a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4d7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800040b65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4dc900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4dc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4dc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4dc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4dca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff800040b6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4e1900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4e1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4e1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4e19a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4e1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800040965a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4e6900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4e6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4e6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4e69a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4e6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80004096000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4eb900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4eb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4eb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4eb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4eba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800040975a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4f0900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4f0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4f0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4f09a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4f0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80004097000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e4f5900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e4f5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e4f5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4f59a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e4f5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e4f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e4f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800039bc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5ba930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5ba960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5ba9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5ba9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e5baa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e5baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff800071b2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5f0930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5f0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5f09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5f09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e5f0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e5f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800071b35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5f5930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5f5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5f59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5f59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e5f5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e5f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff800071b3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e5fa930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e5fa960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e5fa9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5fa9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e5faa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e5faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e5faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff800071b4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00d3204900 mi_switch() at mi_switch+0x172/frame 0xfffffe00d3204930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00d3204970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d32049a0 _sleep() at _sleep+0x2da/frame 0xfffffe00d3204a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00d3204a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00d3204ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3204ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 3016 out of 32624 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:0:pho> show allchains chain 1: thread 101899 (pid 11016, sh) sleeping on 0xfffff807f295b530 "wait" chain 2: thread 104240 (pid 62769, thr1) sleeping on 0xfffff808012af400 "uwait" chain 3: thread 102231 (pid 62754, sleep) sleeping on 0xffffffff81c8bee0 "nanslp" chain 4: thread 102559 (pid 62753, sh) sleeping on 0xfffff807f2c53a60 "wait" chain 5: thread 102471 (pid 62752, sh) sleeping on 0xfffff807f2ab1530 "wait" chain 6: thread 104372 (pid 62750, thr1) sleeping on 0xfffff8073fd49a60 "wait" chain 7: thread 101397 (pid 62749, sh) sleeping on 0xfffff807f21e8530 "wait" chain 8: thread 101959 (pid 62744, sh) sleeping on 0xfffff807f2be3a60 "wait" chain 9: thread 100449 (pid 62742, sh) sleeping on 0xfffff8073fe7e530 "wait" chain 10: thread 102277 (pid 62738, sh) sleeping on 0xfffff807f228ba60 "wait" chain 11: thread 101160 (pid 62736, sh) sleeping on 0xfffff8073fbe8530 "wait" chain 12: thread 102287 (pid 62734, sh) sleeping on 0xfffff807f228b530 "wait" chain 13: thread 102831 (pid 62732, sh) sleeping on 0xfffff80801348530 "wait" chain 14: thread 100987 (pid 62730, sh) sleeping on 0xfffff80488857530 "wait" chain 15: thread 102921 (pid 62728, sh) sleeping on 0xfffff8080171aa60 "wait" chain 16: thread 102644 (pid 62726, sh) sleeping on 0xfffff8080121ea60 "wait" chain 17: thread 103234 (pid 62725, sh) sleeping on 0xfffff807f2ea8530 "wait" chain 18: thread 102894 (pid 62723, thr1) sleeping on 0xffffffff81c8bee2 "nanslp" chain 19: thread 102573 (pid 62718, sh) sleeping on 0xfffff807f2c53530 "wait" chain 20: thread 103343 (pid 62717, tee) sleeping on 0xfffff80744913000 "piperd" chain 21: thread 100666 (pid 62716, sh) sleeping on 0xfffff8073fe98530 "wait" chain 22: thread 103519 (pid 43602, sh) sleeping on 0xfffff800187c48e8 "piperd" chain 23: thread 100240 (pid 43600, awk) sleeping on 0xfffff80007bb95f0 "piperd" chain 24: thread 100289 (pid 43599, sh) sleeping on 0xfffff800078f8000 "wait" chain 25: thread 100185 (pid 43513, sh) sleeping on 0xfffff80007c6b000 "wait" chain 26: thread 100256 (pid 41165, sh) sleeping on 0xfffff8034a7e3000 "wait" chain 27: thread 100223 (pid 2376, bash) sleeping on 0xfffff802f8cc2000 "wait" chain 28: thread 100213 (pid 2374, csh) sleeping on 0xfffff80007c6c0a8 "pause" chain 29: thread 100206 (pid 2373, su) sleeping on 0xfffff80007fd0000 "wait" chain 30: thread 100208 (pid 2344, bash) sleeping on 0xfffff80004544530 "wait" chain 31: thread 100220 (pid 2343, sshd) sleeping on 0xfffff80007fe4540 "select" chain 32: thread 100188 (pid 2340, sshd) sleeping on 0xfffff800045caf40 "select" chain 33: thread 100196 (pid 2336, csh) sleeping on 0xfffff800061734b0 "ttyin" chain 34: thread 100190 (pid 2335, login) sleeping on 0xfffff80007c6ca60 "wait" chain 35: thread 100191 (pid 2334, getty) sleeping on 0xfffff800061808b0 "ttyin" chain 36: thread 100218 (pid 2333, getty) sleeping on 0xfffff80003c6d4b0 "ttyin" chain 37: thread 100217 (pid 2332, getty) sleeping on 0xfffff800038134b0 "ttyin" chain 38: thread 100216 (pid 2331, getty) sleeping on 0xfffff80003813cb0 "ttyin" chain 39: thread 100215 (pid 2330, getty) sleeping on 0xfffff80003c994b0 "ttyin" chain 40: thread 100214 (pid 2329, getty) sleeping on 0xfffff80003c99cb0 "ttyin" chain 41: thread 100200 (pid 2328, getty) sleeping on 0xfffff80003c984b0 "ttyin" chain 42: thread 100207 (pid 2327, getty) sleeping on 0xfffff80003c98cb0 "ttyin" chain 43: thread 100142 (pid 2326, getty) sleeping on 0xfffff80003c974b0 "ttyin" chain 44: thread 100205 (pid 2280, cron) sleeping on 0xffffffff81c8bee6 "nanslp" chain 45: thread 100155 (pid 2276, sshd) sleeping on 0xfffff800038c48c0 "select" chain 46: thread 100204 (pid 2247, ntpd) sleeping on 0xfffff800045c90c0 "select" chain 47: thread 100769 (pid 2247, ntpd) sleeping on 0xfffff808158ead00 "usem" chain 48: thread 100202 (pid 2184, NLM: master) sleeping on 0xfffff80007b57160 "rpcsvc" chain 49: thread 100201 (pid 2181, rpc.statd) sleeping on 0xfffff80007fe4640 "select" chain 50: thread 100150 (pid 2135, watchdogd) sleeping on 0xffffffff81c8bee0 "nanslp" chain 51: thread 100195 (pid 2056, rpcbind) sleeping on 0xfffff8000446d3c0 "select" chain 52: thread 100174 (pid 2046, syslogd) sleeping on 0xfffff800045c9440 "select" chain 53: thread 100167 (pid 1975, devd) sleeping on 0xfffff800038c4ac0 "select" chain 54: thread 100193 (pid 1970, dhclient) sleeping on 0xfffff80007fe47c0 "select" chain 55: thread 100186 (pid 1926, dhclient) sleeping on 0xfffff800060addc0 "select" chain 56: thread 100156 (pid 1923, dhclient) sleeping on 0xfffff800038c4a40 "select" chain 57: thread 100141 (pid 34, vnlru) sleeping on 0xfffff800071cca60 "vlruwt" chain 58: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81d623b0 "syncer" chain 59: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d61858 "qsleep" chain 60: thread 100132 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a900 "-" chain 61: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812bc0 "-" chain 62: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181ae80 "-" chain 63: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81823140 "-" chain 64: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b400 "-" chain 65: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff818336c0 "-" chain 66: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183b980 "-" chain 67: thread 100151 (pid 32, / worker) sleeping on 0xfffff80003bfd2e8 "sdflush" chain 68: thread 100203 (pid 32, /tmp worker) sleeping on 0xfffff800073904e8 "sdflush" chain 69: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d7bb88 "psleep" chain 70: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81dd6198 "psleep" chain 71: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff81dd61a4 "launds" chain 72: thread 100133 (pid 30, uma) sleeping on 0xffffffff80f10e10 "umarcl" chain 73: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff800037fda60 "idle" chain 74: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff800038c1000 "idle" chain 75: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81ae8c20 "-" chain 76: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81dd4840 "waiting_for_work" chain 77: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d6125c "-" chain 78: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d6125c "-" chain 79: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d6125c "-" chain 80: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d6125c "-" chain 81: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d1584460 "-" chain 82: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d15844b8 "-" chain 83: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d1584510 "-" chain 84: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d1584568 "-" chain 85: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d15845c0 "-" chain 86: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0037b76d10 "-" chain 87: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0037b76d68 "-" chain 88: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0037b76dc0 "-" chain 89: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0037b76e18 "-" chain 90: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0037b76e70 "-" chain 91: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d16bdd10 "-" chain 92: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d16bdd68 "-" chain 93: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d16bddc0 "-" chain 94: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d16bde18 "-" chain 95: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d16bde70 "-" chain 96: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819c3fc0 "-" chain 97: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819c40c0 "-" chain 98: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819c3e88 "-" chain 99: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000408e450 "crypto_ret_wait" chain 100: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000408e3f0 "crypto_ret_wait" chain 101: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000408e390 "crypto_ret_wait" chain 102: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000408e330 "crypto_ret_wait" chain 103: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000408e2d0 "crypto_ret_wait" chain 104: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000408e270 "crypto_ret_wait" chain 105: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000408e210 "crypto_ret_wait" chain 106: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000408e1b0 "crypto_ret_wait" chain 107: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000408e150 "crypto_ret_wait" chain 108: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000408e0f0 "crypto_ret_wait" chain 109: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000408e090 "crypto_ret_wait" chain 110: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000408e030 "crypto_ret_wait" chain 111: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d761c8 "crypto_wait" chain 112: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003f91888 "seqstate" chain 113: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81da4ce0 "-" chain 114: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81da4cf0 "-" chain 115: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81da4cd8 "-" chain 116: thread 100002 (pid 1, init) sleeping on 0xfffff800038bf530 "wait" chain 117: thread 100001 (pid 10, audit) sleeping on 0xffffffff81dd5590 "audit_worker_cv" chain 118: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81da4d20 "swapin" chain 119: thread 100016 (pid 0, thread taskq) sleeping on 0xfffff8000323cb00 "-" chain 120: thread 100018 (pid 0, config_0) sleeping on 0xfffff80003866000 "-" chain 121: thread 100019 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000323c900 "-" chain 122: thread 100020 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000323c800 "-" chain 123: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003867e00 "-" chain 124: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003867d00 "-" chain 125: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003867c00 "-" chain 126: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003867b00 "-" chain 127: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003867a00 "-" chain 128: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003867900 "-" chain 129: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003867800 "-" chain 130: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003867700 "-" chain 131: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003867600 "-" chain 132: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003867500 "-" chain 133: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003867400 "-" chain 134: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003867300 "-" chain 135: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003867200 "-" chain 136: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003867100 "-" chain 137: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003867000 "-" chain 138: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003868e00 "-" chain 139: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003868d00 "-" chain 140: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003868c00 "-" chain 141: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003868b00 "-" chain 142: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003868a00 "-" chain 143: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003868900 "-" chain 144: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003868800 "-" chain 145: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003868700 "-" chain 146: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003868600 "-" chain 147: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003868500 "-" chain 148: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003f12100 "-" chain 149: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003f12000 "-" chain 150: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003f12000 "-" chain 151: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003f12000 "-" chain 152: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003f12000 "-" chain 153: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003f12000 "-" chain 154: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003f12000 "-" chain 155: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003f12000 "-" chain 156: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003f12000 "-" chain 157: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003f12000 "-" chain 158: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003f12000 "-" chain 159: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003f12000 "-" chain 160: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003f12000 "-" chain 161: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL thread 0 (pid 0, ) is inactive chain 162: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff80007372000 "-" chain 163: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff80007372000 "-" chain 164: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff80007372000 "-" chain 165: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003f13e00 "-" db:0:pho> chain 1: thread 101899 (pid 11016, sh) sleeping on 0xfffff807f295b530 "wait" chain 2: thread 104240 (pid 62769, thr1) sleeping on 0xfffff808012af400 "uwait" chain 3: thread 102231 (pid 62754, sleep) sleeping on 0xffffffff81c8bee0 "nanslp" chain 4: thread 102559 (pid 62753, sh) sleeping on 0xfffff807f2c53a60 "wait" chain 5: thread 102471 (pid 62752, sh) sleeping on 0xfffff807f2ab1530 "wait" chain 6: thread 104372 (pid 62750, thr1) sleeping on 0xfffff8073fd49a60 "wait" chain 7: thread 101397 (pid 62749, sh) sleeping on 0xfffff807f21e8530 "wait" chain 8: thread 101959 (pid 62744, sh) sleeping on 0xfffff807f2be3a60 "wait" chain 9: thread 100449 (pid 62742, sh) sleeping on 0xfffff8073fe7e530 "wait" chain 10: thread 102277 (pid 62738, sh) sleeping on 0xfffff807f228ba60 "wait" chain 11: thread 101160 (pid 62736, sh) sleeping on 0xfffff8073fbe8530 "wait" chain 12: thread 102287 (pid 62734, sh) sleeping on 0xfffff807f228b530 "wait" chain 13: thread 102831 (pid 62732, sh) sleeping on 0xfffff80801348530 "wait" chain 14: thread 100987 (pid 62730, sh) sleeping on 0xfffff80488857530 "wait" chain 15: thread 102921 (pid 62728, sh) sleeping on 0xfffff8080171aa60 "wait" chain 16: thread 102644 (pid 62726, sh) sleeping on 0xfffff8080121ea60 "wait" chain 17: thread 103234 (pid 62725, sh) sleeping on 0xfffff807f2ea8530 "wait" chain 18: thread 102894 (pid 62723, thr1) sleeping on 0xffffffff81c8bee2 "nanslp" chain 19: thread 102573 (pid 62718, sh) sleeping on 0xfffff807f2c53530 "wait" chain 20: thread 103343 (pid 62717, tee) sleeping on 0xfffff80744913000 "piperd" chain 21: thread 100666 (pid 62716, sh) sleeping on 0xfffff8073fe98530 "wait" chain 22: thread 103519 (pid 43602, sh) sleeping on 0xfffff800187c48e8 "piperd" chain 23: thread 100240 (pid 43600, awk) sleeping on 0xfffff80007bb95f0 "piperd" chain 24: thread 100289 (pid 43599, sh) sleeping on 0xfffff800078f8000 "wait" chain 25: thread 100185 (pid 43513, sh) sleeping on 0xfffff80007c6b000 "wait" chain 26: thread 100256 (pid 41165, sh) sleeping on 0xfffff8034a7e3000 "wait" chain 27: thread 100223 (pid 2376, bash) sleeping on 0xfffff802f8cc2000 "wait" chain 28: thread 100213 (pid 2374, csh) sleeping on 0xfffff80007c6c0a8 "pause" chain 29: thread 100206 (pid 2373, su) sleeping on 0xfffff80007fd0000 "wait" chain 30: thread 100208 (pid 2344, bash) sleeping on 0xfffff80004544530 "wait" chain 31: thread 100220 (pid 2343, sshd) sleeping on 0xfffff80007fe4540 "select" chain 32: thread 100188 (pid 2340, sshd) sleeping on 0xfffff800045caf40 "select" chain 33: thread 100196 (pid 2336, csh) sleeping on 0xfffff800061734b0 "ttyin" chain 34: thread 100190 (pid 2335, login) sleeping on 0xfffff80007c6ca60 "wait" chain 35: thread 100191 (pid 2334, getty) sleeping on 0xfffff800061808b0 "ttyin" chain 36: thread 100218 (pid 2333, getty) sleeping on 0xfffff80003c6d4b0 "ttyin" chain 37: thread 100217 (pid 2332, getty) sleeping on 0xfffff800038134b0 "ttyin" chain 38: thread 100216 (pid 2331, getty) sleeping on 0xfffff80003813cb0 "ttyin" chain 39: thread 100215 (pid 2330, getty) sleeping on 0xfffff80003c994b0 "ttyin" chain 40: thread 100214 (pid 2329, getty) sleeping on 0xfffff80003c99cb0 "ttyin" chain 41: thread 100200 (pid 2328, getty) sleeping on 0xfffff80003c984b0 "ttyin" chain 42: thread 100207 (pid 2327, getty) sleeping on 0xfffff80003c98cb0 "ttyin" chain 43: thread 100142 (pid 2326, getty) sleeping on 0xfffff80003c974b0 "ttyin" chain 44: thread 100205 (pid 2280, cron) sleeping on 0xffffffff81c8bee6 "nanslp" chain 45: thread 100155 (pid 2276, sshd) sleeping on 0xfffff800038c48c0 "select" chain 46: thread 100204 (pid 2247, ntpd) sleeping on 0xfffff800045c90c0 "select" chain 47: thread 100769 (pid 2247, ntpd) sleeping on 0xfffff808158ead00 "usem" chain 48: thread 100202 (pid 2184, NLM: master) sleeping on 0xfffff80007b57160 "rpcsvc" chain 49: thread 100201 (pid 2181, rpc.statd) sleeping on 0xfffff80007fe4640 "select" chain 50: thread 100150 (pid 2135, watchdogd) sleeping on 0xffffffff81c8bee0 "nanslp" chain 51: thread 100195 (pid 2056, rpcbind) sleeping on 0xfffff8000446d3c0 "select" chain 52: thread 100174 (pid 2046, syslogd) sleeping on 0xfffff800045c9440 "select" chain 53: thread 100167 (pid 1975, devd) sleeping on 0xfffff800038c4ac0 "select" chain 54: thread 100193 (pid 1970, dhclient) sleeping on 0xfffff80007fe47c0 "select" chain 55: thread 100186 (pid 1926, dhclient) sleeping on 0xfffff800060addc0 "select" chain 56: thread 100156 (pid 1923, dhclient) sleeping on 0xfffff800038c4a40 "select" chain 57: thread 100141 (pid 34, vnlru) sleeping on 0xfffff800071cca60 "vlruwt" chain 58: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81d623b0 "syncer" chain 59: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d61858 "qsleep" chain 60: thread 100132 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a900 "-" chain 61: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812bc0 "-" chain 62: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181ae80 "-" chain 63: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81823140 "-" chain 64: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b400 "-" chain 65: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff818336c0 "-" chain 66: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183b980 "-" chain 67: thread 100151 (pid 32, / worker) sleeping on 0xfffff80003bfd2e8 "sdflush" chain 68: thread 100203 (pid 32, /tmp worker) sleeping on 0xfffff800073904e8 "sdflush" chain 69: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d7bb88 "psleep" chain 70: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81dd6198 "psleep" chain 71: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff81dd61a4 "launds" chain 72: thread 100133 (pid 30, uma) sleeping on 0xffffffff80f10e10 "umarcl" chain 73: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff800037fda60 "idle" chain 74: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff800038c1000 "idle" chain 75: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81ae8c20 "-" chain 76: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81dd4840 "waiting_for_work" chain 77: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d6125c "-" chain 78: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d6125c "-" chain 79: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d6125c "-" chain 80: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d6125c "-" chain 81: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d1584460 "-" chain 82: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d15844b8 "-" chain 83: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d1584510 "-" chain 84: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d1584568 "-" chain 85: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d15845c0 "-" chain 86: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0037b76d10 "-" chain 87: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0037b76d68 "-" chain 88: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0037b76dc0 "-" chain 89: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0037b76e18 "-" chain 90: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0037b76e70 "-" chain 91: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d16bdd10 "-" chain 92: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d16bdd68 "-" chain 93: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d16bddc0 "-" chain 94: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d16bde18 "-" chain 95: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d16bde70 "-" chain 96: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819c3fc0 "-" chain 97: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819c40c0 "-" chain 98: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819c3e88 "-" chain 99: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000408e450 "crypto_ret_wait" chain 100: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000408e3f0 "crypto_ret_wait" chain 101: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000408e390 "crypto_ret_wait" chain 102: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000408e330 "crypto_ret_wait" chain 103: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000408e2d0 "crypto_ret_wait" chain 104: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000408e270 "crypto_ret_wait" chain 105: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000408e210 "crypto_ret_wait" chain 106: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000408e1b0 "crypto_ret_wait" chain 107: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000408e150 "crypto_ret_wait" chain 108: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000408e0f0 "crypto_ret_wait" chain 109: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000408e090 "crypto_ret_wait" chain 110: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000408e030 "crypto_ret_wait" chain 111: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d761c8 "crypto_wait" chain 112: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003f91888 "seqstate" chain 113: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81da4ce0 "-" chain 114: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81da4cf0 "-" chain 115: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81da4cd8 "-" chain 116: thread 100002 (pid 1, init) sleeping on 0xfffff800038bf530 "wait" chain 117: thread 100001 (pid 10, audit) sleeping on 0xffffffff81dd5590 "audit_worker_cv" chain 118: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81da4d20 "swapin" chain 119: thread 100016 (pid 0, thread taskq) sleeping on 0xfffff8000323cb00 "-" chain 120: thread 100018 (pid 0, config_0) sleeping on 0xfffff80003866000 "-" chain 121: thread 100019 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000323c900 "-" chain 122: thread 100020 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000323c800 "-" chain 123: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003867e00 "-" chain 124: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003867d00 "-" chain 125: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003867c00 "-" chain 126: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003867b00 "-" chain 127: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003867a00 "-" chain 128: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003867900 "-" chain 129: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003867800 "-" chain 130: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003867700 "-" chain 131: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003867600 "-" chain 132: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003867500 "-" chain 133: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003867400 "-" chain 134: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003867300 "-" chain 135: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003867200 "-" chain 136: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003867100 "-" chain 137: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003867000 "-" chain 138: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003868e00 "-" chain 139: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003868d00 "-" chain 140: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003868c00 "-" chain 141: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003868b00 "-" chain 142: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003868a00 "-" chain 143: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003868900 "-" chain 144: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003868800 "-" chain 145: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003868700 "-" chain 146: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003868600 "-" chain 147: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003868500 "-" chain 148: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003f12100 "-" chain 149: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003f12000 "-" chain 150: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003f12000 "-" chain 151: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003f12000 "-" chain 152: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003f12000 "-" chain 153: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003f12000 "-" chain 154: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003f12000 "-" chain 155: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003f12000 "-" chain 156: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003f12000 "-" chain 157: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003f12000 "-" chain 158: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003f12000 "-" chain 159: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003f12000 "-" chain 160: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003f12000 "-" chain 161: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL thread 0 (pid 0, ) is inactive chain 162: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff80007372000 "-" chain 163: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff80007372000 "-" chain 164: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff80007372000 "-" chain 165: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003f13e00 "-" db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 10 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:392 #2 0xffffffff8049af1b in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049accf in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff8049fd48 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049accf in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #6 0xffffffff8049aa44 in db_command_loop () at ../../../ddb/db_command.c:535 #7 0xffffffff8049dcff in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #8 0xffffffff80c1bd2c in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #9 0xffffffff8105051a in trap (frame=0xfffffe00e56c7030) at ../../../amd64/amd64/trap.c:585 #10 #11 kdb_enter (why=0xffffffff811fda7f "panic", msg=) at ../../../kern/subr_kdb.c:479 #12 0xffffffff80bcfc4a in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:897 #13 0xffffffff80bcf9c3 in panic (fmt=0xffffffff81c856b8 "h&\034\201\377\377\377\377") at ../../../kern/kern_shutdown.c:835 #14 0xffffffff8105096c in trap_fatal (frame=0xfffffe00e56c7390, eva=0x10) at ../../../amd64/amd64/trap.c:925 #15 0xffffffff81050a09 in trap_pfault (frame=, usermode=, signo=, ucode=0x0) at ../../../amd64/amd64/trap.c:743 #16 0xffffffff8104ffed in trap (frame=0xfffffe00e56c7390) at ../../../amd64/amd64/trap.c:407 #17 #18 0xffffffff80f134b3 in uma_vm_zone_stats (uth=0xfffffe00e56c7600, z=0xfffff800072dc000, sbuf=0xfffffe00e56c7578, ups=0xfffff801b3369c00, internal=0x0) at ../../../vm/uma_core.c:4086 #19 0xffffffff80f1317e in sysctl_vm_zone_stats (oidp=0xffffffff81959278 , arg1=0x0, arg2=0x0, req=0xfffffe00e56c7760) at ../../../vm/uma_core.c:4173 #20 0xffffffff80bdf47b in sysctl_root_handler_locked (oid=0xffffffff81959278 , arg1=0x0, arg2=0x0, req=0xfffffe00e56c7760, tracker=0xfffffe00e56c76d0) at ../../../kern/kern_sysctl.c:174 #21 0xffffffff80bde80c in sysctl_root (oidp=, arg1=0x0, arg2=0x0, req=0xfffffe00e56c7760) at ../../../kern/kern_sysctl.c:2110 #22 0xffffffff80bdeedb in userland_sysctl (td=, name=0xfffffe00e56c7820, namelen=0x2, old=, oldlenp=, inkernel=, new=0x0, newlen=0x0, retval=0xfffffe00e56c7970, flags=0x0) at ../../../kern/kern_sysctl.c:2267 #23 0xffffffff80bdf27b in kern___sysctlbyname (td=0xfffff80570f6a5a0, oname=, namelen=0xd, old=0x8006fe180, oldlenp=0x7fffffffdd20, new=0x0, newlen=0x0, retval=0xfffffe00e56c7970, flags=0x0, inkernel=) at ../../../kern/kern_sysctl.c:2180 #24 0xffffffff80bdf2cd in sys___sysctlbyname (td=0xfffffe00e56c7600, uap=0xfffff80570f6a968) at ../../../kern/kern_sysctl.c:2205 #25 0xffffffff81051534 in syscallenter (td=0xfffff80570f6a5a0) at ../../../amd64/amd64/../../kern/subr_syscall.c:144 #26 amd64_syscall (td=0xfffff80570f6a5a0, traced=0x0) at ../../../amd64/amd64/trap.c:1162 #27 #28 0x000000080040187a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffdc38 (kgdb) f 18 #18 0xffffffff80f134b3 in uma_vm_zone_stats (uth=0xfffffe00e56c7600, z=0xfffff800072dc000, sbuf=0xfffffe00e56c7578, ups=0xfffff801b3369c00, internal=0x0) at ../../../vm/uma_core.c:4086 4086 cache->uc_allocbucket->ub_cnt; (kgdb) l 4081 if (internal || CPU_ABSENT(i)) 4082 continue; 4083 cache = &z->uz_cpu[i]; 4084 if (cache->uc_allocbucket != NULL) 4085 ups[i].ups_cache_free += 4086 cache->uc_allocbucket->ub_cnt; 4087 if (cache->uc_freebucket != NULL) 4088 ups[i].ups_cache_free += 4089 cache->uc_freebucket->ub_cnt; 4090 if (cache->uc_crossbucket != NULL) (kgdb) info loc zdom = 0xfffff800072dc780 cache = 0xfffff800072dc280 i = 0x2 (kgdb) p *uth $1 = {uth_name = "kstack_cache", '\000' , uth_align = 0x0, uth_size = 0x4000, uth_rsize = 0x0, uth_maxpages = 0x0, uth_limit = 0x0, uth_pages = 0x0, uth_keg_free = 0x0, uth_zone_free = 0x0, uth_bucketsize = 0x0, uth_zone_flags = 0x0, uth_allocs = 0xbaf, uth_frees = 0xbb4, uth_fails = 0x0, uth_sleeps = 0x0, uth_xdomain = 0x0, _uth_reserved1 = {0x0}} (kgdb) p *z $2 = {{uz_keg = 0xfffff800072dc080, uz_lockptr = 0xfffff800072dc080}, uz_domain = 0xfffff800072dc780, uz_flags = 0x4030000, uz_size = 0x4000, uz_ctor = 0x0, uz_dtor = 0x0, uz_items = 0x0, uz_max_items = 0x0, uz_sleepers = 0x0, uz_count = 0x1, uz_count_max = 0x1, uz_import = 0xffffffff80f1bd80 , uz_release = 0xffffffff80f1be00 , uz_arg = 0x0, uz_init = 0x0, uz_fini = 0x0, uz_spare = 0x0, uz_bkt_count = 0x0, uz_bkt_max = 0x80, uz_lock = {lock_object = {lo_name = 0xffffffff81186244 "kstack_cache", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xfffff8087fd6c300}, mtx_lock = 0xfffff80570f6a5a0}, uz_link = {le_next = 0xfffff800037c8000, le_prev = 0xffffffff81d77c68 }, uz_name = 0xffffffff81186244 "kstack_cache", uz_warning = 0x0, uz_ratecheck = { tv_sec = 0x0, tv_usec = 0x0}, uz_maxaction = {ta_link = {stqe_next = 0x0}, ta_pending = 0x0, ta_priority = 0x0, ta_func = 0x0, ta_context = 0x0}, uz_count_min = 0x1, uz_allocs = 0xfffffe003e5e0300, uz_frees = 0xfffffe003e5e02f0, uz_fails = 0xfffffe003e5e02e0, uz_sleeps = 0x0, uz_xdomain = 0x0, uz_cpu = 0xfffff800072dc180} (kgdb) p *sbuf $3 = {s_buf = 0xfffff80421ad6400 "", s_drain_func = 0xffffffff80bdf3c0 , s_drain_arg = 0xfffffe00e56c7760, s_error = 0x0, s_size = 0x80, s_len = 0x2c, s_flags = 0x10000, s_sect_len = 0x0, s_rec_off = 0xfffffffffffcf02c} (kgdb) p *ups $4 = {ups_allocs = 0xe6cda, ups_frees = 0xe7f6f, ups_cache_free = 0x2, _ups_reserved = {0x0, 0x0, 0x0, 0x0, 0x0}} (kgdb) p *zdom $5 = {uzd_buckets = {tqh_first = 0x0, tqh_last = 0xfffff800072dc780}, uzd_nitems = 0x0, uzd_imax = 0x5c123, uzd_imin = 0x0, uzd_wss = 0x0} (kgdb) p *cache $6 = {uc_freebucket = 0xfffff807e3fee420, uc_allocbucket = 0x0, uc_crossbucket = 0x0, uc_allocs = 0xf2b9f, uc_frees = 0xf2be6} (kgdb) -- Test scenario: misc/vmstat.sh