vmcore.143 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r356654M: Sun Jan 12 07:31:27 CET 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.1 (git@github.com:llvm/llvm-project.git c1a0a213378a458fbea1a5c77b315c7dce08fd05) (based on LLVM 9.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 15 boot pages configured startup_alloc from "UMA Kegs", 13 boot pages left startup_alloc from "UMA Zones", 12 boot pages left startup_alloc from "UMA Zones", 11 boot pages left Entering uma_startup1 with 10 boot pages left Entering uma_startup2 with 10 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163755520 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 6 5 4 10 11 3 2 8 9 7 Timecounter "TSC-low" frequency 1750034950 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000055 [4336] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, caugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800048b2800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 12 Jan 07:35:17 ntpdate[2058]: step time server 192.168.5.1 offset -0.250998 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800286bd2d8 ufs (ufs) @ kern/vfs_mount.c:1603 2nd 0xfffff800289bb7b8 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1927 stack backtrace: #0 0xffffffff80c3a031 at witness_debugger+0x71 #1 0xffffffff80c39da6 at witness_checkorder+0xad6 #2 0xffffffff80ba00c8 at lockmgr_lock_fast_path+0x178 #3 0xffffffff81102998 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cbb25f at _vn_lock+0x4f #5 0xffffffff80eccd4f at softdep_flushworklist+0x7f #6 0xffffffff80efd9a6 at ffs_sync+0x406 #7 0xffffffff80c9e8ad at dounmount+0x44d #8 0xffffffff80c9e40e at sys_unmount+0x2ae #9 0xffffffff81085a01 at amd64_syscall+0x2f1 #10 0xffffffff8105be50 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 276 files, 38669 used, 1226738 free (114 frags, 153328 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sun Jan 12 07:35 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jan 12 07:35:28 mercat1 login[2342]: ROOT LOGIN (root) ON ttyu1 Last login: Sat Jan 11 10:11:14 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r356654M: Sun Jan 12 07:31:27 CET 2020 root@mercat1:~ # Jan 12 07:35:59 mercat1 su[2358]: pho to root on /dev/pts/0 20200112 07:36:12 all (1/48): 256m.sh 20200112 07:36:14 all (2/48): buildworld.sh 20200112 07:36:15 all (3/48): buildworld2.sh 20200112 07:36:16 all (4/48): buildworld3.sh lock order reversal: 1st 0xfffff8014b69ca28 syncer (syncer) @ kern/vfs_subr.c:2472 2nd 0xfffff802353fa2d8 ufs (ufs) @ kern/vfs_subr.c:2889 stack backtrace: #0 0xffffffff80c3a031 at witness_debugger+0x71 #1 0xffffffff80c39da6 at witness_checkorder+0xad6 #2 0xffffffff80ba06af at lockmgr_xlock_hard+0x6f #3 0xffffffff80ba123d at __lockmgr_args+0x60d #4 0xffffffff80eff20c at ffs_lock+0x7c #5 0xffffffff81102998 at VOP_LOCK1_APV+0x48 #6 0xffffffff80cbb25f at _vn_lock+0x4f #7 0xffffffff80ca6709 at vget_finish+0x89 #8 0xffffffff80f0cf25 at qsync+0xa5 #9 0xffffffff80efdb18 at ffs_sync+0x578 #10 0xffffffff80caf970 at sync_fsync+0x130 #11 0xffffffff81101790 at VOP_FSYNC_APV+0x60 #12 0xffffffff80cad5e2 at sched_sync+0x3e2 #13 0xffffffff80b8b5d0 at fork_exit+0x80 #14 0xffffffff8105c56e at fork_trampoline+0xe lock order reversal: 1st 0xfffff80028597a88 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffff80028195000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c3a031 at witness_debugger+0x71 #1 0xffffffff80c39da6 at witness_checkorder+0xad6 #2 0xffffffff80bac4d4 at __mtx_lock_flags+0x94 #3 0xffffffff80f0c4fd at quotaoff_inchange+0xbd #4 0xffffffff80f0da17 at ufs_quotactl+0xe7 #5 0xffffffff80cb01dd at sys_quotactl+0xed #6 0xffffffff81085a01 at amd64_syscall+0x2f1 #7 0xffffffff8105be50 at fast_syscall_common+0x101 20200112 07:56:21 all (5/48): buildworld4.sh 20200112 08:06:24 all (6/48): fs.sh lock order reversal: 1st 0xfffff80028abd638 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff802f0956068 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1718 stack backtrace: #0 0xffffffff80c3a031 at witness_debugger+0x71 #1 0xffffffff80c39da6 at witness_checkorder+0xad6 #2 0xffffffff80ba06af at lockmgr_xlock_hard+0x6f #3 0xffffffff80ba123d at __lockmgr_args+0x60d #4 0xffffffff80efaad1 at ffs_vgetf+0x161 #5 0xffffffff80f0d91b at ufs_root+0x1b #6 0xffffffff80cab480 at vfs_cache_root_fallback+0xf0 #7 0xffffffff80cab223 at vfs_cache_root+0x1b3 #8 0xffffffff80f05d3f at ufs_extattr_autostart+0x5f #9 0xffffffff80efce8e at ffs_mount+0x1c3e #10 0xffffffff80c9d5c0 at vfs_domount+0x800 #11 0xffffffff80c9bf71 at vfs_donmount+0x911 #12 0xffffffff80c9b629 at sys_nmount+0x69 #13 0xffffffff81085a01 at amd64_syscall+0x2f1 #14 0xffffffff8105be50 at fast_syscall_common+0x101 Jan 12 08:09:26 mercat1 kernel: pid 93800 (rw), uid 2007 inumber 1553 on /mnt: filesystem full Jan 12 08:12:26 mercat1 kernel: pid 11780 (rw), uid 2007 inumber 1302 on /mnt: filesystem full Jan 12 08:13:40 mercat1 kernel: pid 17370 (creat), uid 2007 inumber 1282 on /mnt: out of inodes Jan 12 08:14:15 mercat1 kernel: pid 17356 (creat), uid 2007 inumber 640 on /mnt: out of inodes Jan 12 08:14:22 mercat1 kernel: pid 17347 (creat), uid 2007 inumber 1280 on /mnt: out of inodes Jan 12 08:14:36 mercat1 kernel: pid 22966 (rw), uid 2007 inumber 2215 on /mnt: filesystem full Jan 12 08:15:17 mercat1 kernel: pid 22967 (rw), uid 2007 inumber 2321 on /mnt: filesystem full Jan 12 08:15:36 mercat1 kernel: pid 29642 (creat), uid 2007 inumber 1284 on /mnt: filesystem full Jan 12 08:15:43 mercat1 kernel: pid 29639 (rw), uid 2007 inumber 1337 on /mnt: filesystem full Jan 12 08:16:26 mercat1 kernel: pid 35218 (rw), uid 2007 inumber 646 on /mnt: filesystem full Jan 12 08:16:27 mercat1 kernel: pid 35214 (rw), uid 2007 inumber 1280 on /mnt: filesystem full Jan 12 08:16:29 mercat1 kernel: pid 35227 (mkdir), uid 2007 inumber 1914 on /mnt: out of inodes Jan 12 08:16:30 mercat1 kernel: pid 35221 (mkdir), uid 2007 inumber 1834 on /mnt: out of inodes Jan 12 08:16:33 mercat1 kernel: pid 35228 (mkdir), uid 2007 inumber 1173 on /mnt: out of inodes Jan 12 08:16:36 mercat1 kernel: pid 35223 (mkdir), uid 2007 inumber 2462 on /mnt: out of inodes Jan 12 08:17:29 mercat1 kernel: pid 41894 (mkdir), uid 2007 inumber 766 on /mnt: out of inodes Jan 12 08:17:30 mercat1 kernel: pid 41895 (creat), uid 2007 inumber 685 on /mnt: out of inodes Jan 12 08:17:32 mercat1 kernel: pid 41889 (creat), uid 2007 inumber 763 on /mnt: out of inodes Jan 12 08:17:34 mercat1 kernel: pid 41915 (mkdir), uid 2007 inumber 273 on /mnt: out of inodes Jan 12 08:17:35 mercat1 kernel: pid 41925 (creat), uid 2007 inumber 665 on /mnt: out of inodes Jan 12 08:17:37 mercat1 kernel: pid 41922 (creat), uid 2007 inumber 676 on /mnt: out of inodes Jan 12 08:17:38 mercat1 kernel: pid 41931 (creat), uid 2007 inumber 682 on /mnt: out of inodes Jan 12 08:17:40 mercat1 kernel: pid 41907 (creat), uid 2007 inumber 668 on /mnt: out of inodes Jan 12 08:17:41 mercat1 kernel: pid 41904 (creat), uid 2007 inumber 642 on /mnt: out of inodes Jan 12 08:17:42 mercat1 kernel: pid 41898 (creat), uid 2007 inumber 670 on /mnt: out of inodes Jan 12 08:17:43 mercat1 syslogd: last message repeated 1 times Jan 12 08:17:45 mercat1 kernel: pid 41907 (creat), uid 2007 inumber 668 on /mnt: out of inodes Jan 12 08:17:46 mercat1 kernel: pid 41912 (mkdir), uid 2007 inumber 568 on /mnt: out of inodes Jan 12 08:17:47 mercat1 kernel: pid 41934 (mkdir), uid 2007 inumber 2540 on /mnt: out of inodes Jan 12 08:17:48 mercat1 kernel: pid 41916 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:17:50 mercat1 kernel: pid 41892 (creat), uid 2007 inumber 651 on /mnt: out of inodes Jan 12 08:17:51 mercat1 kernel: pid 41904 (creat), uid 2007 inumber 642 on /mnt: out of inodes Jan 12 08:17:52 mercat1 kernel: pid 41919 (creat), uid 2007 inumber 674 on /mnt: out of inodes Jan 12 08:17:53 mercat1 kernel: pid 41895 (creat), uid 2007 inumber 685 on /mnt: out of inodes Jan 12 08:17:55 mercat1 kernel: pid 41928 (creat), uid 2007 inumber 664 on /mnt: out of inodes Jan 12 08:17:56 mercat1 kernel: pid 41898 (creat), uid 2007 inumber 670 on /mnt: out of inodes Jan 12 08:17:57 mercat1 kernel: pid 41904 (creat), uid 2007 inumber 642 on /mnt: out of inodes Jan 12 08:17:58 mercat1 syslogd: last message repeated 1 times Jan 12 08:17:59 mercat1 kernel: pid 41919 (creat), uid 2007 inumber 674 on /mnt: out of inodes Jan 12 08:18:00 mercat1 kernel: pid 41933 (mkdir), uid 2007 inumber 746 on /mnt: out of inodes Jan 12 08:18:02 mercat1 kernel: pid 41916 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:18:03 mercat1 kernel: pid 41925 (creat), uid 2007 inumber 665 on /mnt: out of inodes Jan 12 08:18:04 mercat1 kernel: pid 41904 (creat), uid 2007 inumber 642 on /mnt: out of inodes Jan 12 08:18:05 mercat1 syslogd: last message repeated 1 times Jan 12 08:18:06 mercat1 kernel: pid 41895 (creat), uid 2007 inumber 685 on /mnt: out of inodes Jan 12 08:18:07 mercat1 kernel: pid 41913 (creat), uid 2007 inumber 681 on /mnt: out of inodes Jan 12 08:18:08 mercat1 kernel: pid 41910 (creat), uid 2007 inumber 667 on /mnt: out of inodes Jan 12 08:18:10 mercat1 kernel: pid 41898 (creat), uid 2007 inumber 670 on /mnt: out of inodes Jan 12 08:18:11 mercat1 kernel: pid 41895 (creat), uid 2007 inumber 685 on /mnt: out of inodes Jan 12 08:18:12 mercat1 kernel: pid 41919 (creat), uid 2007 inumber 674 on /mnt: out of inodes Jan 12 08:18:13 mercat1 kernel: pid 41910 (creat), uid 2007 inumber 667 on /mnt: out of inodes Jan 12 08:18:14 mercat1 kernel: pid 41901 (creat), uid 2007 inumber 679 on /mnt: out of inodes Jan 12 08:18:15 mercat1 kernel: pid 41925 (creat), uid 2007 inumber 665 on /mnt: out of inodes Jan 12 08:18:16 mercat1 kernel: pid 41889 (creat), uid 2007 inumber 763 on /mnt: out of inodes Jan 12 08:18:17 mercat1 kernel: pid 41916 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:18:19 mercat1 kernel: pid 41910 (creat), uid 2007 inumber 667 on /mnt: out of inodes Jan 12 08:18:20 mercat1 kernel: pid 41928 (creat), uid 2007 inumber 664 on /mnt: out of inodes Jan 12 08:18:21 mercat1 kernel: pid 41910 (creat), uid 2007 inumber 667 on /mnt: out of inodes Jan 12 08:18:22 mercat1 kernel: pid 41904 (creat), uid 2007 inumber 642 on /mnt: out of inodes Jan 12 08:18:24 mercat1 kernel: pid 41910 (creat), uid 2007 inumber 667 on /mnt: out of inodes Jan 12 08:18:25 mercat1 kernel: pid 41907 (creat), uid 2007 inumber 668 on /mnt: out of inodes Jan 12 08:18:26 mercat1 kernel: pid 41901 (creat), uid 2007 inumber 679 on /mnt: out of inodes Jan 12 08:18:38 mercat1 kernel: pid 48638 (creat), uid 2007 inumber 645 on /mnt: out of inodes Jan 12 08:18:39 mercat1 kernel: pid 48664 (mkdir), uid 2007 inumber 2045 on /mnt: out of inodes Jan 12 08:18:42 mercat1 kernel: pid 48650 (creat), uid 2007 inumber 649 on /mnt: out of inodes Jan 12 08:18:43 mercat1 kernel: pid 48669 (mkdir), uid 2007 inumber 1938 on /mnt: out of inodes Jan 12 08:18:45 mercat1 kernel: pid 48663 (creat), uid 2007 inumber 12 on /mnt: out of inodes Jan 12 08:18:46 mercat1 kernel: pid 48655 (creat), uid 2007 inumber 10 on /mnt: out of inodes Jan 12 08:18:47 mercat1 kernel: pid 48638 (creat), uid 2007 inumber 645 on /mnt: out of inodes Jan 12 08:18:48 mercat1 kernel: pid 48650 (creat), uid 2007 inumber 649 on /mnt: out of inodes Jan 12 08:18:50 mercat1 kernel: pid 48632 (creat), uid 2007 inumber 643 on /mnt: out of inodes Jan 12 08:18:51 mercat1 kernel: pid 48638 (creat), uid 2007 inumber 645 on /mnt: out of inodes Jan 12 08:18:52 mercat1 kernel: pid 48654 (creat), uid 2007 inumber 1937 on /mnt: out of inodes Jan 12 08:18:53 mercat1 kernel: pid 48652 (creat), uid 2007 inumber 1924 on /mnt: out of inodes Jan 12 08:18:54 mercat1 kernel: pid 48638 (creat), uid 2007 inumber 645 on /mnt: out of inodes Jan 12 08:18:55 mercat1 kernel: pid 48641 (creat), uid 2007 inumber 7 on /mnt: out of inodes Jan 12 08:18:57 mercat1 kernel: pid 48666 (creat), uid 2007 inumber 1284 on /mnt: out of inodes Jan 12 08:18:58 mercat1 kernel: pid 48668 (creat), uid 2007 inumber 1285 on /mnt: out of inodes Jan 12 08:19:00 mercat1 kernel: pid 48654 (creat), uid 2007 inumber 1937 on /mnt: out of inodes Jan 12 08:19:01 mercat1 kernel: pid 48661 (creat), uid 2007 inumber 652 on /mnt: out of inodes Jan 12 08:19:02 mercat1 kernel: pid 48671 (creat), uid 2007 inumber 1283 on /mnt: out of inodes Jan 12 08:19:03 mercat1 kernel: pid 48654 (creat), uid 2007 inumber 1937 on /mnt: out of inodes Jan 12 08:19:05 mercat1 kernel: pid 48644 (creat), uid 2007 inumber 647 on /mnt: out of inodes Jan 12 08:19:06 mercat1 kernel: pid 48668 (creat), uid 2007 inumber 1285 on /mnt: out of inodes Jan 12 08:19:07 mercat1 kernel: pid 48665 (creat), uid 2007 inumber 651 on /mnt: out of inodes Jan 12 08:19:09 mercat1 kernel: pid 48635 (creat), uid 2007 inumber 6 on /mnt: out of inodes Jan 12 08:19:10 mercat1 kernel: pid 48649 (creat), uid 2007 inumber 9 on /mnt: out of inodes Jan 12 08:19:11 mercat1 kernel: pid 48652 (creat), uid 2007 inumber 1924 on /mnt: out of inodes Jan 12 08:19:12 mercat1 kernel: pid 48646 (creat), uid 2007 inumber 5 on /mnt: out of inodes Jan 12 08:19:14 mercat1 kernel: pid 48649 (creat), uid 2007 inumber 9 on /mnt: out of inodes Jan 12 08:19:16 mercat1 kernel: pid 48655 (creat), uid 2007 inumber 10 on /mnt: out of inodes Jan 12 08:19:17 mercat1 kernel: pid 48638 (creat), uid 2007 inumber 645 on /mnt: out of inodes Jan 12 08:19:18 mercat1 kernel: pid 48650 (creat), uid 2007 inumber 649 on /mnt: out of inodes Jan 12 08:19:20 mercat1 kernel: pid 48655 (creat), uid 2007 inumber 10 on /mnt: out of inodes Jan 12 08:19:21 mercat1 kernel: pid 48638 (creat), uid 2007 inumber 645 on /mnt: out of inodes Jan 12 08:19:23 mercat1 kernel: pid 48655 (creat), uid 2007 inumber 10 on /mnt: out of inodes Jan 12 08:19:24 mercat1 kernel: pid 48635 (creat), uid 2007 inumber 6 on /mnt: out of inodes Jan 12 08:19:25 mercat1 kernel: pid 48659 (creat), uid 2007 inumber 8 on /mnt: out of inodes Jan 12 08:19:26 mercat1 kernel: pid 48641 (creat), uid 2007 inumber 7 on /mnt: out of inodes Jan 12 08:19:27 mercat1 kernel: pid 48654 (creat), uid 2007 inumber 1937 on /mnt: out of inodes Jan 12 08:19:29 mercat1 kernel: pid 48668 (creat), uid 2007 inumber 1285 on /mnt: out of inodes Jan 12 08:19:30 mercat1 kernel: pid 48665 (creat), uid 2007 inumber 651 on /mnt: out of inodes Jan 12 08:19:31 mercat1 kernel: pid 48671 (creat), uid 2007 inumber 1283 on /mnt: out of inodes Jan 12 08:19:38 mercat1 kernel: pid 55335 (rw), uid 2007 inumber 674 on /mnt: filesystem full Jan 12 08:19:43 mercat1 kernel: pid 55362 (mkdir), uid 2007 inumber 1520 on /mnt: out of inodes Jan 12 08:19:47 mercat1 kernel: pid 55348 (mkdir), uid 2007 inumber 1187 on /mnt: filesystem full Jan 12 08:19:48 mercat1 kernel: pid 55355 (creat), uid 2007 inumber 1421 on /mnt: out of inodes Jan 12 08:19:49 mercat1 kernel: pid 55345 (creat), uid 2007 inumber 1424 on /mnt: out of inodes Jan 12 08:19:50 mercat1 kernel: pid 55343 (creat), uid 2007 inumber 1417 on /mnt: out of inodes Jan 12 08:19:52 mercat1 syslogd: last message repeated 1 times Jan 12 08:19:53 mercat1 kernel: pid 55355 (creat), uid 2007 inumber 1421 on /mnt: out of inodes Jan 12 08:19:54 mercat1 kernel: pid 55334 (creat), uid 2007 inumber 2025 on /mnt: out of inodes Jan 12 08:19:55 mercat1 kernel: pid 55345 (creat), uid 2007 inumber 1424 on /mnt: out of inodes Jan 12 08:19:56 mercat1 kernel: pid 55343 (creat), uid 2007 inumber 1417 on /mnt: out of inodes Jan 12 08:19:58 mercat1 kernel: pid 55349 (creat), uid 2007 inumber 1416 on /mnt: out of inodes Jan 12 08:19:59 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:00 mercat1 kernel: pid 55347 (creat), uid 2007 inumber 1418 on /mnt: out of inodes Jan 12 08:20:01 mercat1 kernel: pid 55334 (creat), uid 2007 inumber 2025 on /mnt: out of inodes Jan 12 08:20:02 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:03 mercat1 kernel: pid 55347 (creat), uid 2007 inumber 1418 on /mnt: out of inodes Jan 12 08:20:05 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:06 mercat1 kernel: pid 55336 (creat), uid 2007 inumber 770 on /mnt: out of inodes Jan 12 08:20:07 mercat1 kernel: pid 55357 (creat), uid 2007 inumber 1420 on /mnt: out of inodes Jan 12 08:20:08 mercat1 kernel: pid 55341 (creat), uid 2007 inumber 1411 on /mnt: out of inodes Jan 12 08:20:09 mercat1 kernel: pid 55355 (creat), uid 2007 inumber 1421 on /mnt: out of inodes Jan 12 08:20:10 mercat1 kernel: pid 55341 (creat), uid 2007 inumber 1411 on /mnt: out of inodes Jan 12 08:20:11 mercat1 kernel: pid 55334 (creat), uid 2007 inumber 2025 on /mnt: out of inodes Jan 12 08:20:12 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:14 mercat1 kernel: pid 55347 (creat), uid 2007 inumber 1418 on /mnt: out of inodes Jan 12 08:20:15 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:16 mercat1 kernel: pid 55353 (creat), uid 2007 inumber 1419 on /mnt: out of inodes Jan 12 08:20:17 mercat1 kernel: pid 55355 (creat), uid 2007 inumber 1421 on /mnt: out of inodes Jan 12 08:20:18 mercat1 kernel: pid 55345 (creat), uid 2007 inumber 1424 on /mnt: out of inodes Jan 12 08:20:19 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:20 mercat1 kernel: pid 55351 (creat), uid 2007 inumber 1433 on /mnt: out of inodes Jan 12 08:20:21 mercat1 kernel: pid 55349 (creat), uid 2007 inumber 1416 on /mnt: out of inodes Jan 12 08:20:23 mercat1 kernel: pid 55343 (creat), uid 2007 inumber 1417 on /mnt: out of inodes Jan 12 08:20:24 mercat1 kernel: pid 55355 (creat), uid 2007 inumber 1421 on /mnt: out of inodes Jan 12 08:20:25 mercat1 kernel: pid 55347 (creat), uid 2007 inumber 1418 on /mnt: out of inodes Jan 12 08:20:26 mercat1 kernel: pid 55339 (creat), uid 2007 inumber 1422 on /mnt: out of inodes Jan 12 08:20:27 mercat1 kernel: pid 55341 (creat), uid 2007 inumber 1411 on /mnt: out of inodes Jan 12 08:20:28 mercat1 kernel: pid 55345 (creat), uid 2007 inumber 1424 on /mnt: out of inodes Jan 12 08:20:29 mercat1 kernel: pid 55343 (creat), uid 2007 inumber 1417 on /mnt: out of inodes Jan 12 08:20:31 mercat1 syslogd: last message repeated 1 times Jan 12 08:20:32 mercat1 kernel: pid 55336 (creat), uid 2007 inumber 770 on /mnt: out of inodes Jan 12 08:20:33 mercat1 kernel: pid 55345 (creat), uid 2007 inumber 1424 on /mnt: out of inodes Jan 12 08:20:34 mercat1 kernel: pid 55353 (creat), uid 2007 inumber 1419 on /mnt: out of inodes Jan 12 08:20:35 mercat1 kernel: pid 55351 (creat), uid 2007 inumber 1433 on /mnt: out of inodes Jan 12 08:20:44 mercat1 kernel: pid 60965 (rw), uid 2007 inumber 646 on /mnt: filesystem full Jan 12 08:20:47 mercat1 kernel: pid 60953 (rw), uid 2007 inumber 662 on /mnt: filesystem full Jan 12 08:20:52 mercat1 kernel: pid 60967 (rw), uid 2007 inumber 660 on /mnt: filesystem full Jan 12 08:21:36 mercat1 kernel: pid 60966 (rw), uid 2007 inumber 662 on /mnt: filesystem full Jan 12 08:21:43 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:21:45 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:21:46 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:21:48 mercat1 kernel: pid 67630 (creat), uid 2007 inumber 660 on /mnt: out of inodes Jan 12 08:21:50 mercat1 syslogd: last message repeated 2 times Jan 12 08:21:51 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:21:52 mercat1 syslogd: last message repeated 1 times Jan 12 08:21:53 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:21:54 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:21:55 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:21:56 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:21:57 mercat1 syslogd: last message repeated 1 times Jan 12 08:21:58 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:21:59 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:22:00 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:22:01 mercat1 kernel: pid 67630 (creat), uid 2007 inumber 660 on /mnt: out of inodes Jan 12 08:22:02 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:22:03 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:22:04 mercat1 kernel: pid 67638 (creat), uid 2007 inumber 16 on /mnt: out of inodes Jan 12 08:22:05 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:22:06 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:22:07 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:22:08 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:22:09 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:22:10 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:22:11 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:22:12 mercat1 syslogd: last message repeated 1 times Jan 12 08:22:13 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:22:14 mercat1 kernel: pid 67638 (creat), uid 2007 inumber 16 on /mnt: out of inodes Jan 12 08:22:15 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:22:17 mercat1 kernel: pid 67638 (creat), uid 2007 inumber 16 on /mnt: out of inodes Jan 12 08:22:17 mercat1 kernel: pid 67630 (creat), uid 2007 inumber 660 on /mnt: out of inodes Jan 12 08:22:19 mercat1 kernel: pid 67638 (creat), uid 2007 inumber 16 on /mnt: out of inodes Jan 12 08:22:20 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:22:21 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:22:22 mercat1 kernel: pid 67638 (creat), uid 2007 inumber 16 on /mnt: out of inodes Jan 12 08:22:23 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:22:24 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:22:25 mercat1 kernel: pid 67636 (creat), uid 2007 inumber 655 on /mnt: out of inodes Jan 12 08:22:26 mercat1 syslogd: last message repeated 1 times Jan 12 08:22:27 mercat1 kernel: pid 67630 (creat), uid 2007 inumber 660 on /mnt: out of inodes Jan 12 08:22:28 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:22:29 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:22:30 mercat1 kernel: pid 67640 (creat), uid 2007 inumber 15 on /mnt: out of inodes Jan 12 08:22:32 mercat1 syslogd: last message repeated 2 times Jan 12 08:22:33 mercat1 kernel: pid 67632 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jan 12 08:22:34 mercat1 kernel: pid 67634 (creat), uid 2007 inumber 656 on /mnt: out of inodes Jan 12 08:22:35 mercat1 kernel: pid 67638 (creat), uid 2007 inumber 16 on /mnt: out of inodes Jan 12 08:22:36 mercat1 kernel: pid 67630 (creat), uid 2007 inumber 660 on /mnt: out of inodes 20200112 08:22:37 all (7/48): fsck.sh free inode /mnt11/403 had -2666130979403333632 blocks free inode /mnt11/582 had 44032 blocks free inode /mnt11/1195 had 5888 blocks free inode /mnt11/1250 had 80 blocks newblk leak: 294/323. 20200112 08:23:39 all (8/48): fsck3.sh 20200112 08:23:41 all (9/48): geli.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. newblk leak: 2521/2844. 20200112 08:29:13 all (10/48): gnop.sh GEOM_NOP: Device md10.nop created. Jan 12 08:31:26 mercat1 kernel: pid 20827 (rw), uid 2007 inumber 154608 on /mnt: filesystem full Jan 12 08:32:19 mercat1 kernel: pid 20774 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 08:33:07 mercat1 kernel: pid 20768 (mkdir), uid 2007 inumber 96118 on /mnt: filesystem full GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. Jan 12 08:33:37 mercat1 kernel: pid 24848 (rw), uid 2007 inumber 254610 on /mnt: filesystem full Jan 12 08:33:53 mercat1 kernel: pid 24864 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 08:34:05 mercat1 kernel: pid 24893 (swap), jid 0, uid 2007, was killed: out of swap space GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. Jan 12 08:38:18 mercat1 kernel: pid 28216 (swap), jid 0, uid 2007, was killed: out of swap space GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. Jan 12 08:43:37 mercat1 kernel: pid 32118 (creat), uid 2007 inumber 34059 on /mnt: out of inodes Jan 12 08:44:05 mercat1 kernel: pid 33453 (rw), uid 2007 inumber 64075 on /mnt: filesystem full Jan 12 08:44:19 mercat1 kernel: pid 33404 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 08:44:31 mercat1 kernel: pid 33513 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 08:45:17 mercat1 kernel: pid 33374 (symlink), uid 2007 inumber 32906 on /mnt: out of inodes GEOM_NOP: Device md10.nop removed. 20200112 08:46:00 all (11/48): gnop4.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200112 09:01:03 all (12/48): ldt2.sh 20200112 09:01:05 all (13/48): md8.sh 20200112 09:01:14 all (14/48): mkfifo.sh Jan 12 09:03:50 mercat1 kernel: pid 2149 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:07:49 mercat1 kernel: pid 7543 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:08:59 mercat1 kernel: pid 7586 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:14:28 mercat1 kernel: pid 11983 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:14:50 mercat1 kernel: pid 12013 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:15:02 mercat1 kernel: pid 12008 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:15:33 mercat1 kernel: pid 11986 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:18:40 mercat1 kernel: pid 20874 (swap), jid 0, uid 2007, was killed: out of swap space 20200112 09:22:22 all (15/48): mkfifo2c.sh 20200112 09:37:28 all (16/48): newfs.sh Jan 12 09:45:40 mercat1 kernel: pid 11156 (rw), uid 2007 inumber 910910 on /mnt: filesystem full Jan 12 09:45:49 mercat1 kernel: pid 12350 (rw), uid 2007 inumber 70807 on /mnt: filesystem full Jan 12 09:46:09 mercat1 kernel: pid 14662 (rw), uid 2007 inumber 147631 on /mnt: filesystem full Jan 12 09:47:38 mercat1 kernel: pid 24095 (rw), uid 2007 inumber 39830 on /mnt: filesystem full Jan 12 09:47:45 mercat1 kernel: pid 25276 (mkdir), uid 2007 inumber 24574 on /mnt: out of inodes Jan 12 09:47:48 mercat1 kernel: pid 25275 (mkdir), uid 2007 inumber 24511 on /mnt: out of inodes Jan 12 09:47:51 mercat1 kernel: pid 25263 (mkdir), uid 2007 inumber 32711 on /mnt: out of inodes Jan 12 09:47:56 mercat1 kernel: pid 26453 (mkdir), uid 2007 inumber 107427 on /mnt: filesystem full Jan 12 09:48:00 mercat1 kernel: pid 26432 (creat), uid 2007 inumber 65540 on /mnt: out of inodes Jan 12 09:48:11 mercat1 kernel: pid 27640 (mkdir), uid 2007 inumber 49275 on /mnt: out of inodes Jan 12 09:48:15 mercat1 kernel: pid 27624 (creat), uid 2007 inumber 49160 on /mnt: out of inodes Jan 12 09:48:17 mercat1 kernel: pid 27619 (creat), uid 2007 inumber 49155 on /mnt: out of inodes Jan 12 09:48:42 mercat1 kernel: pid 30928 (creat), uid 2007 inumber 8199 on /mnt: out of inodes Jan 12 09:48:50 mercat1 kernel: pid 31171 (rw), uid 2007 inumber 64310 on /mnt: filesystem full Jan 12 09:48:52 mercat1 kernel: pid 31182 (mkdir), uid 2007 inumber 30985 on /mnt: out of inodes Jan 12 09:48:56 mercat1 kernel: pid 32373 (mkdir), uid 2007 inumber 32585 on /mnt: out of inodes Jan 12 09:48:58 mercat1 kernel: pid 32376 (mkdir), uid 2007 inumber 24544 on /mnt: out of inodes Jan 12 09:48:59 mercat1 kernel: pid 32365 (mkdir), uid 2007 inumber 32691 on /mnt: out of inodes Jan 12 09:49:01 mercat1 kernel: pid 32362 (mkdir), uid 2007 inumber 24825 on /mnt: out of inodes Jan 12 09:49:02 mercat1 kernel: pid 32367 (mkdir), uid 2007 inumber 16379 on /mnt: out of inodes Jan 12 09:49:04 mercat1 kernel: pid 32374 (mkdir), uid 2007 inumber 24828 on /mnt: out of inodes Jan 12 09:49:09 mercat1 kernel: pid 33540 (rw), uid 2007 inumber 11539 on /mnt: filesystem full Jan 12 09:49:12 mercat1 kernel: pid 33543 (creat), uid 2007 inumber 12292 on /mnt: out of inodes Jan 12 09:49:13 mercat1 kernel: pid 33548 (creat), uid 2007 inumber 12302 on /mnt: out of inodes Jan 12 09:49:20 mercat1 kernel: pid 34717 (rw), uid 2007 inumber 4341 on /mnt: filesystem full Jan 12 09:49:24 mercat1 kernel: pid 34723 (rw), uid 2007 inumber 4472 on /mnt: filesystem full Jan 12 09:52:47 mercat1 kernel: pid 55908 (creat), uid 2007 inumber 12336 on /mnt: out of inodes Jan 12 09:52:58 mercat1 kernel: pid 57092 (creat), uid 2007 inumber 32776 on /mnt: filesystem full Jan 12 09:53:11 mercat1 kernel: pid 58277 (rw), uid 2007 inumber 16546 on /mnt: filesystem full Jan 12 09:53:22 mercat1 kernel: pid 59467 (rw), uid 2007 inumber 16130 on /mnt: filesystem full Jan 12 09:53:29 mercat1 kernel: pid 60640 (rw), uid 2007 inumber 6061 on /mnt: filesystem full Jan 12 09:53:31 mercat1 kernel: pid 60637 (creat), uid 2007 inumber 2053 on /mnt: out of inodes Jan 12 09:53:32 mercat1 kernel: pid 60650 (creat), uid 2007 inumber 2052 on /mnt: out of inodes Jan 12 09:53:34 mercat1 syslogd: last message repeated 1 times Jan 12 09:53:35 mercat1 kernel: pid 60637 (creat), uid 2007 inumber 2053 on /mnt: out of inodes Jan 12 09:53:36 mercat1 kernel: pid 60649 (creat), uid 2007 inumber 2067 on /mnt: out of inodes 20200112 09:53:37 all (17/48): pfl.sh 20200112 09:57:34 all (18/48): pfl2.sh Jan 12 09:57:44 mercat1 kernel: pid 86738 (link), uid 2007 inumber 65560 on /mnt10: filesystem full Jan 12 09:57:50 mercat1 kernel: pid 86690 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:58:03 mercat1 kernel: pid 86758 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 09:58:13 mercat1 kernel: pid 86765 (rw), uid 2007 inumber 79067 on /mnt10: filesystem full Jan 12 09:59:54 mercat1 kernel: pid 88785 (rw), uid 2007 inumber 49298 on /mnt11: filesystem full Jan 12 10:00:59 mercat1 kernel: pid 88839 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:02:07 mercat1 kernel: pid 90488 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:03:54 mercat1 kernel: pid 91925 (rw), uid 2007 inumber 106345 on /mnt10: filesystem full Jan 12 10:03:59 mercat1 kernel: pid 91939 (rw), uid 2007 inumber 130550 on /mnt10: filesystem full Jan 12 10:04:07 mercat1 kernel: pid 91971 (openat), uid 2007 inumber 65567 on /mnt11: out of inodes Jan 12 10:04:38 mercat1 kernel: pid 92049 (mkdir), uid 2007 inumber 65536 on /mnt11: out of inodes Jan 12 10:06:16 mercat1 kernel: pid 93418 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:06:30 mercat1 kernel: pid 93452 (swap), jid 0, uid 2007, was killed: out of swap space 20200112 10:07:59 all (19/48): sendfile11.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software Jan 12 10:09:17 mercat1 kernel: pid 96237 (swap), jid 0, uid 0, was killed: out of swap space GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. 20200112 10:09:28 all (20/48): sendfile13.sh pts leak: 1/2 20200112 10:16:29 all (21/48): sendfile14.sh 20200112 10:26:58 all (22/48): suj.sh Jan 12 10:39:06 mercat1 kernel: pid 79890 (rw), uid 2007 inumber 32770 on /mnt: filesystem full 20200112 10:47:07 all (23/48): suj10.sh 20200112 10:47:27 all (24/48): suj11.sh Jan 12 10:48:09 mercat1 kernel: pid 31469 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:48:27 mercat1 kernel: pid 31490 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:48:53 mercat1 kernel: pid 31487 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:56:43 mercat1 kernel: pid 42017 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 10:59:50 mercat1 kernel: pid 44563 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:01:53 mercat1 kernel: pid 45724 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:13:12 mercat1 kernel: pid 66634 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:13:46 mercat1 kernel: pid 66622 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:17:51 mercat1 kernel: pid 71721 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:18:12 mercat1 kernel: pid 71780 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:18:57 mercat1 kernel: pid 71789 (swap), jid 0, uid 2007, was killed: out of swap space 20200112 11:19:11 all (25/48): suj12.sh GEOM_NOP: Device md10.nop created. Jan 12 11:25:02 mercat1 kernel: pid 97649 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:32:04 mercat1 kernel: pid 7522 (rw), uid 2007 inumber 6268 on /mnt: filesystem full Expensive timeout(9) function: 0xffffffff809ecce0(0xfffffe00d2bfc428) 0.016619005 s GEOM_NOP: Device md10.nop removed. 20200112 11:39:58 all (26/48): suj13.sh Jan 12 11:49:05 mercat1 kernel: pid 44478 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:53:27 mercat1 kernel: pid 48304 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:53:54 mercat1 kernel: pid 48298 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:57:23 mercat1 kernel: pid 57118 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 11:57:36 mercat1 kernel: pid 57083 (swap), jid 0, uid 2007, was killed: out of swap space 20200112 12:01:18 all (27/48): suj14.sh Jan 12 12:01:36 mercat1 kernel: pid 64653 (cp), uid 0 inumber 238413 on /mnt: filesystem full Jan 12 12:01:37 mercat1 kernel: pid 64653 (cp), uid 0 inumber 238442 on /mnt: filesystem full Jan 12 12:01:38 mercat1 kernel: pid 64675 (cp), uid 0 inumber 40960 on /mnt: filesystem full Jan 12 12:01:39 mercat1 kernel: pid 64698 (mkdir), uid 0 inumber 40959 on /mnt: filesystem full Jan 12 12:01:40 mercat1 kernel: pid 64721 (cp), uid 0 inumber 40961 on /mnt: filesystem full 20200112 12:01:42 all (28/48): suj17.sh 20200112 12:05:43 all (29/48): suj18.sh Jan 12 12:08:56 mercat1 kernel: pid 1832 (creat), uid 2007 inumber 101549 on /mnt: filesystem full Jan 12 12:11:11 mercat1 kernel: pid 14151 (rw), uid 2007 inumber 103270 on /mnt: filesystem full Jan 12 12:11:50 mercat1 kernel: pid 25312 (rw), uid 2007 inumber 32778 on /mnt: filesystem full Jan 12 12:15:56 mercat1 kernel: pid 50078 (rw), uid 2007 inumber 68983 on /mnt: filesystem full Jan 12 12:18:27 mercat1 kernel: pid 63176 (rw), uid 2007 inumber 98978 on /mnt: filesystem full Jan 12 12:20:00 mercat1 kernel: pid 74338 (rw), uid 2007 inumber 102515 on /mnt: filesystem full Jan 12 12:20:05 mercat1 kernel: pid 74334 (rw), uid 2007 inumber 116065 on /mnt: filesystem full Jan 12 12:21:56 mercat1 kernel: pid 87700 (rw), uid 2007 inumber 16 on /mnt: filesystem full Jan 12 12:24:22 mercat1 kernel: pid 99677 (rw), uid 2007 inumber 39373 on /mnt: filesystem full 20200112 12:25:54 all (30/48): suj2.sh 20200112 12:25:56 all (31/48): suj23.sh 20200112 12:35:15 all (32/48): suj29.sh Jan 12 12:36:04 mercat1 kernel: pid 35534 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 12:41:21 mercat1 kernel: pid 48968 (swap), jid 0, uid 2007, was killed: out of swap space 20200112 12:41:42 all (33/48): suj3.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. 20200112 12:47:55 all (34/48): suj30.sh 20200112 12:55:37 all (35/48): suj31.sh Jan 12 12:55:50 mercat1 kernel: pid 33060 (rw), uid 2007 inumber 252290 on /mnt: filesystem full Jan 12 12:58:16 mercat1 kernel: pid 36353 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:00:00 mercat1 kernel: pid 37718 (rw), uid 2007 inumber 172429 on /mnt: filesystem full Jan 12 13:02:09 mercat1 kernel: pid 40300 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:03:18 mercat1 kernel: pid 40368 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:04:31 mercat1 kernel: pid 41773 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:05:03 mercat1 kernel: pid 41776 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:05:14 mercat1 kernel: pid 41748 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:06:45 mercat1 kernel: pid 43434 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:09:08 mercat1 kernel: pid 45004 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:09:59 mercat1 kernel: pid 45101 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:10:11 mercat1 kernel: pid 45117 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:10:23 mercat1 kernel: pid 45126 (swap), jid 0, uid 2007, was killed: out of swap space Jan 12 13:11:44 mercat1 kernel: pid 46415 (swap), jid 0, uid 2007, was killed: out of swap space Expensive timeout(9) function: 0xffffffff809ecce0(0xfffffe00d2bfc428) 0.070624396 s 20200112 13:17:15 all (36/48): suj32.sh 20200112 13:17:19 all (37/48): suj33.sh softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 Jan 12 14:25:10 mercat1 su[66082]: pho to root on /dev/pts/1 softdep_waitidle: Failed to flush worklist for 0xfffff80389477000 root@mercat1:~ # mount /dev/gpt/work on / (ufs, local, soft-updates) devfs on /dev (devfs) /dev/gpt/tmp on /tmp (ufs, local, soft-updates) root@mercat1:~ # ps -l UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 2341 1 0 52 0 10956 32 ttyin Is+ u0 0:00.00 /usr/libexec/getty 3wire ttyu0 0 2342 1 0 22 0 12056 0 wait IWs u1 0:00.00 login [pam] (login) 0 2343 2342 0 20 0 13448 3616 pause S u1 0:00.04 -csh (csh) 0 81696 2343 0 20 0 11756 3156 - R+ u1 0:00.00 ps -l 0 2333 1 0 52 0 10968 892 ttyin Is+ v0 0:00.00 /usr/libexec/getty Pc ttyv0 0 2334 1 0 52 0 10968 32 ttyin Is+ v1 0:00.00 /usr/libexec/getty Pc ttyv1 0 2335 1 0 52 0 10968 1564 ttyin Is+ v2 0:00.00 /usr/libexec/getty Pc ttyv2 0 2336 1 0 52 0 10968 892 ttyin Is+ v3 0:00.00 /usr/libexec/getty Pc ttyv3 0 2337 1 0 52 0 10968 1564 ttyin Is+ v4 0:00.00 /usr/libexec/getty Pc ttyv4 0 2338 1 0 52 0 10968 1564 ttyin Is+ v5 0:00.00 /usr/libexec/getty Pc ttyv5 0 2339 1 0 52 0 10968 1564 ttyin Is+ v6 0:00.00 /usr/libexec/getty Pc ttyv6 0 2340 1 0 52 0 10968 1564 ttyin Is+ v7 0:00.00 /usr/libexec/getty Pc ttyv7 0 2357 2351 0 21 0 12168 0 wait IW 0 0:00.00 su 0 2358 2357 0 21 0 13448 0 pause IW 0 0:00.00 _su (csh) 0 2360 2358 0 22 0 14000 0 wait IW 0 0:00.00 bash 0 2362 2360 0 52 0 12272 1176 wait I+ 0 0:00.18 /bin/sh ./all.sh -onc 256m.sh all.sh buildworld.sh buildworld2.sh buildworld3.sh buildworld4.sh fs.sh fsck.sh fsck3.sh fsync.sh geli.sh gnop.sh gnop4.sh ldt2.sh md8.sh mkfifo.sh mkfifo2c.sh newfs.sh pfl.sh pfl2.sh ren 0 52409 2362 0 52 0 12272 1176 wait I+ 0 0:00.00 /bin/sh ./all.sh -onc 256m.sh all.sh buildworld.sh buildworld2.sh buildworld3.sh buildworld4.sh fs.sh fsck.sh fsck3.sh fsync.sh geli.sh gnop.sh gnop4.sh ldt2.sh md8.sh mkfifo.sh mkfifo2c.sh newfs.sh pfl.sh pfl2.sh ren 0 52410 2362 0 20 0 10848 2412 piperd IC+ 0 0:00.00 tee /tmp/stress2.d/output 0 52411 52409 0 20 0 11688 2904 wait I+ 0 0:00.01 /bin/sh ./suj33.sh 0 69228 52411 0 20 0 10900 2424 softdeps D+ 0 0:00.00 umount /mnt 0 66081 99563 0 21 0 12168 3448 wait I 1 0:00.00 su 0 66082 66081 0 20 0 13448 4592 pause I 1 0:00.01 _su (csh) 0 66084 66082 0 20 0 14000 5328 wait I 1 0:00.02 bash 0 77231 66084 0 20 0 11100 2692 ufs D+ 1 0:00.00 fstat -mf /mnt root@mercat1:~ # procstat -k 69228 PID TID COMM TDNAME KSTACK 69228 100285 umount - mi_switch sleepq_switch sleepq_timedwait _sleep softdep_waitidle softdep_flushfiles ffs_unmount dounmount sys_unmount amd64_syscall fast_syscall_common root@mercat1:~ # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x101: movq $0,0x108087c(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2181 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffff80003951000 kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x979d80 curthread = 0xfffff80003951000: pid 11 tid 100003 critnest 2 "idle: cpu0" curpcb = 0xfffff800039514f0 fpcurthread = none idlethread = 0xfffff80003951000: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00add7ecc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x4ba804936 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7ebd80 curthread = 0xfffff8000394b6e0: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffff8000394bbd0 fpcurthread = none idlethread = 0xfffff8000394b6e0: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00add83cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x4ba805da7 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7f7d80 curthread = 0xfffff8000394b000: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffff8000394b4f0 fpcurthread = none idlethread = 0xfffff8000394b000: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00add88cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x3bfccdb8c gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc803d80 curthread = 0xfffff800039606e0: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffff80003960bd0 fpcurthread = none idlethread = 0xfffff800039606e0: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00add8dcc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x3af416fbb gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc80fd80 curthread = 0xfffff80003960000: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffff800039604f0 fpcurthread = none idlethread = 0xfffff80003960000: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00add92cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x3ecd45f3a gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc81bd80 curthread = 0xfffff8000395f6e0: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffff8000395fbd0 fpcurthread = none idlethread = 0xfffff8000395f6e0: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82415384 rsp0 = 0xfffffe00add97cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x25995fd7b gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc827d80 curthread = 0xfffff8000395f000: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffff8000395f4f0 fpcurthread = none idlethread = 0xfffff8000395f000: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add9ccc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x3485dfba4 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc833d80 curthread = 0xfffff800039526e0: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffff80003952bd0 fpcurthread = none idlethread = 0xfffff800039526e0: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00adda1cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x3bfca6937 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc83fd80 curthread = 0xfffff80003963000: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffff800039634f0 fpcurthread = none idlethread = 0xfffff80003963000: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00adda6cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x254ac1e89 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 418300131 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc84bd80 curthread = 0xfffff800039626e0: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffff80003962bd0 fpcurthread = none idlethread = 0xfffff800039626e0: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00addabcc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x4a0455952 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc857d80 curthread = 0xfffff80003962000: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffff800039624f0 fpcurthread = none idlethread = 0xfffff80003962000: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00addb0cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x2838f299a gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 418300133 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc863d80 curthread = 0xfffff800039616e0: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffff80003961bd0 fpcurthread = none idlethread = 0xfffff800039616e0: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81d9e9f0 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00addb5cc0 kcr3 = 0x8000000002309002 ucr3 = 0xffffffffffffffff scr3 = 0x14b47cf5c gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 418300133 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 77231 (fstat) thread 0xfffff8014b565000 (100333) shared lockmgr ufs (ufs) r = 0 (0xfffff8002833f7b8) locked @ kern/vfs_lookup.c:714 Process 75003 (ls) thread 0xfffff806244216e0 (101579) shared lockmgr ufs (ufs) r = 0 (0xfffff8002833f7b8) locked @ kern/vfs_lookup.c:714 Process 69228 (umount) thread 0xfffff8014bb2e000 (100285) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80028b62a28) locked @ kern/vfs_mount.c:1603 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8002833f750: type VDIR usecount 89, writecount 0, refcount 4 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff800039e5948 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 2) #0 0xffffffff80ba0554 at lockmgr_slock_hard+0x354 #1 0xffffffff80ba1392 at __lockmgr_args+0x762 #2 0xffffffff80eff20c at ffs_lock+0x7c #3 0xffffffff81102998 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cbb25f at _vn_lock+0x4f #5 0xffffffff80c995c1 at lookup+0xe1 #6 0xffffffff80c98f81 at namei+0x4f1 #7 0xffffffff80cb4f24 at kern_readlinkat+0x74 #8 0xffffffff80cb4ea6 at sys_readlink+0x26 #9 0xffffffff81085a01 at amd64_syscall+0x2f1 #10 0xffffffff8105be50 at fast_syscall_common+0x101 nlink=84, effnlink=84, size=2048, extsize 0 generation=56909bb9, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffff80028b629c0: type VDIR usecount 3, writecount 0, refcount 1 mountedhere 0xfffff80389477000 flags (VI_ACTIVE) v_object 0xfffff80028a25e70 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014bb2e000 (pid 69228, umount, tid 100285) with shared waiters pending #0 0xffffffff80ba0a4a at lockmgr_xlock_hard+0x40a #1 0xffffffff80ba123d at __lockmgr_args+0x60d #2 0xffffffff80eff20c at ffs_lock+0x7c #3 0xffffffff81102998 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cbb25f at _vn_lock+0x4f #5 0xffffffff80c9e4c7 at dounmount+0x67 #6 0xffffffff80c9e40e at sys_unmount+0x2ae #7 0xffffffff81085a01 at amd64_syscall+0x2f1 #8 0xffffffff8105be50 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=74d5cf41, uid=0, gid=0, flags=0x0 ino 37078272, on dev gpt/work db:1:pho1> show mount 0xfffff80028194000 /dev/gpt/work on / (ufs) 0xfffff80028340000 devfs on /dev (devfs) 0xfffff80127935000 /dev/gpt/tmp on /tmp (ufs) 0xfffff80389477000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 84427 Buf domain 0 freebufs 15100 lofreebufs 219 hifreebufs 329 bufspace 458752 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 2, 4, 2, 0, 1, 0, 0, 2, 3, 4, 0, 14, Locked buffers: 0 space 0 Total buffers: 48069 space 458752 Buf domain 1 freebufs 15021 lofreebufs 219 hifreebufs 329 bufspace 2981888 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 9 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 56 (1568768) dirtyq count 9 (274432) wakeup 0 lim 25 CPU 0, 3, 0, 2, 0, 11, 1, 5, 14, 5, 2, 4, Locked buffers: 0 space 0 Total buffers: 12447 space 2981888 Buf domain 2 freebufs 13226 lofreebufs 219 hifreebufs 329 bufspace 61722624 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1827 (59293696) dirtyq count 0 (0) wakeup 0 lim 25 CPU 5, 3, 0, 5, 11, 1, 12, 10, 9, 13, 2, 9, Locked buffers: 0 space 0 Total buffers: 8704 space 61722624 Buf domain 3 freebufs 15080 lofreebufs 219 hifreebufs 329 bufspace 1040384 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 48 (1007616) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 1, 0, 0, 0, 0, 3, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 11511 space 1040384 Buf domain 4 freebufs 15032 lofreebufs 219 hifreebufs 329 bufspace 2465792 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 87 (2236416) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 7, 1, 0, 0, 0, 0, 3, 2, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 423 space 2465792 Buf domain 5 freebufs 15098 lofreebufs 219 hifreebufs 329 bufspace 663552 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 10 (180224) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 5, 0, 0, 1, 0, 0, 2, 1, 10, 0, 5, Locked buffers: 0 space 0 Total buffers: 9756 space 663552 Buf domain 6 freebufs 15024 lofreebufs 219 hifreebufs 329 bufspace 2801664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 61 (1540096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 14, 3, 5, 0, 0, 1, 18, 3, 3, 0, 0, Locked buffers: 0 space 0 Total buffers: 15021 space 2801664 db:1:pho1> show page vm_cnt.v_free_count: 7523284 vm_cnt.v_inactive_count: 42862 vm_cnt.v_active_count: 222410 vm_cnt.v_laundry_count: 52 vm_cnt.v_wire_count: 333815 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 7523284 dom 0 page_cnt 8124087 free 7523284 pq_act 222410 pq_inact 42862 pq_laund 52 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000002 | 000000 11 (008192K) | 000100 | 000000 10 (004096K) | 001108 | 000000 09 (002048K) | 002618 | 000000 08 (001024K) | 006247 | 000008 07 (000512K) | 008614 | 000018 06 (000256K) | 011093 | 000067 05 (000128K) | 014393 | 000136 04 (000064K) | 019244 | 000278 03 (000032K) | 027331 | 000530 02 (000016K) | 039189 | 001818 01 (000008K) | 055657 | 003620 00 (000004K) | 073622 | 000071 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000002 | 000000 02 (000016K) | 000004 | 000000 01 (000008K) | 000004 | 000000 00 (000004K) | 000005 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree VNODE 624 220761 104121 112277443 0 16 202726368 0 VM OBJECT 264 221777 376543 124019034 0 30 157956480 0 FFS2 dinode 256 220650 104145 106179829 0 62 83147520 0 RADIX NODE 144 26371 501367 133092356 0 61 75994272 0 FFS inode 160 220650 136800 112276121 0 61 57192000 0 L VFS Cache 328 142961 14011 355037 0 29 51486816 0 512 512 564 90132 128756675 0 29 46436352 0 mbuf_cluster 2048 14840 42 82127 0 5 30478336 0 S VFS Cache 108 99172 141452 52026463 0 125 25987392 0 swblk 136 1884 186268 3432789 0 61 25588672 0 256 256 38 61717 141182565 0 61 15809280 0 BUF TRIE 144 411 105541 83723853 0 61 15257088 0 128 128 393 100729 344412123 0 125 12943616 0 64 64 852 150977 329804393 0 253 9717056 0 128 128 434 74772 216095770 0 125 9626368 0 mbuf 256 16495 2790 41273008 0 253 4936960 0 vmem btag 56 13379 52920 711842 0 253 3712744 0 256 256 13 13007 123097411 0 61 3333120 0 socket 904 55 2981 7889 0 13 2744544 0 64 Bucket 512 3454 1482 9540459 0 30 2527232 0 UMA Slabs 112 22531 18 1227201 0 125 2525488 0 swpctrie 144 245 14651 274621 0 61 2145024 0 128 Bucket 1024 1649 327 8429979 0 15 2023424 0 128 128 14341 1376 1015183 0 125 2011776 0 256 Bucket 2048 863 76 21158221 0 8 1923072 0 256 256 77 7423 129792565 0 61 1920000 0 128 128 11675 1500 947035 0 125 1686400 0 32 Bucket 256 5998 526 10907516 0 61 1670144 0 4096 4096 353 12 154685 0 1 1495040 0 DIRHASH 1024 51 1189 3390386 0 13 1269760 0 THREAD 1760 659 57 10000 0 5 1260160 0 VMSPACE 2536 50 388 1882427 0 3 1110768 0 16384 16384 11 49 2177227 0 1 983040 0 4096 4096 92 148 1882547 0 1 983040 0 32768 32768 8 21 2478 0 1 950272 0 65536 65536 3 11 415 0 1 917504 0 16384 16384 49 4 2801 0 1 868352 0 8192 8192 91 1 110 0 1 753664 0 64 64 8632 3086 2189445934 0 253 749952 0 PROC 1328 84 456 1882539 0 9 717120 0 mbuf_packet 256 29 2526 79620 0 253 654080 0 pbuf 984 0 663 0 0 0 652392 0 MAP ENTRY 96 2201 4561 97656089 0 125 649152 0 64 64 9313 389 22091 0 253 620928 0 128 128 411 4022 32811889 0 125 567424 0 g_bio 408 0 1220 343712256 0 31 497760 0 65536 65536 1 6 38116 0 1 458752 0 32768 32768 13 1 34 0 1 458752 0 512 512 462 418 431637 0 29 450560 0 16 Bucket 128 632 2529 3555725 0 125 404608 0 64 64 3413 2824 8774138 0 253 399168 0 32768 32768 12 0 166 0 1 393216 0 128 128 1479 1280 724735 0 125 353152 0 65536 65536 2 3 358 0 1 327680 0 256 256 315 945 239405955 0 61 322560 0 filedesc0 1104 85 206 1882540 0 9 321264 0 ksiginfo 112 515 2257 43826 0 125 310464 0 256 256 450 675 49796 0 61 288000 0 256 256 426 684 69746 0 61 284160 0 1024 1024 217 55 2726 0 13 278528 0 32 32 6628 2066 11991 0 253 278208 0 65536 65536 4 0 2171 0 1 262144 0 16 16 13821 1929 281965 0 253 252000 0 8192 8192 14 14 29671 0 1 229376 0 2048 2048 18 90 3742704 0 5 221184 0 4096 4096 47 6 113 0 1 217088 0 pipe 760 8 277 1056120 0 13 216600 0 8 Bucket 64 228 3110 2745487 0 253 213632 0 NAMEI 1024 2 206 675510820 0 13 212992 0 2048 2048 97 7 112 0 5 212992 0 Files 80 133 2517 105713586 0 125 212000 0 256 256 32 793 99206028 0 61 211200 0 128 128 113 1499 79942 0 125 206336 0 64 64 102 3111 15498671 0 253 205632 0 128 128 49 1501 1343969349 0 125 198400 0 64 64 34 3053 159587 0 253 197568 0 selfd 64 384 2640 4298923 0 253 193536 0 UMA Zones 2176 86 0 87 0 3 187136 0 512 512 7 353 947479 0 29 184320 0 udp_inpcb 488 20 348 1988 0 29 179584 0 12 Bucket 96 79 1727 1795681 0 125 173376 0 6 Bucket 48 43 3569 1360979 0 253 173376 0 1024 1024 31 133 518032 0 13 167936 0 1024 1024 5 159 1097 0 13 167936 0 64 64 38 2545 686164307 0 253 165312 0 64 64 35 2548 272351 0 253 165312 0 1024 1024 1 159 4636526 0 13 163840 0 TURNSTILE 136 717 375 717 0 61 148512 0 Mountpoints 3008 4 44 1108 0 3 144384 0 rl_entry 40 532 2801 532 0 253 133320 0 32 32 583 3575 468310 0 253 133056 0 32768 32768 1 3 205385 0 1 131072 0 unpcb 256 22 488 5533 0 61 130560 0 fakepg 104 0 1131 228 0 125 117624 0 SLEEPQUEUE 88 717 563 717 0 125 112640 0 512 512 148 68 6239 0 29 110592 0 32 32 550 2852 23350 0 253 108864 0 8192 8192 13 0 17673 0 1 106496 0 512 512 4 204 94435 0 29 106496 0 4096 4096 15 10 550303 0 1 102400 0 32 32 109 3041 283627 0 253 100800 0 4 Bucket 32 294 2856 4184331 0 253 100800 0 32768 32768 0 3 362351 0 1 98304 0 16384 16384 6 0 26 0 1 98304 0 udpcb 32 20 2878 1988 0 253 92736 0 32 32 6 2892 14214 0 253 92736 0 32 32 45 2853 136 0 253 92736 0 ttyinq 160 345 230 555 0 61 92000 0 2048 2048 3 41 7471 0 5 90112 0 ttyoutq 256 181 164 290 0 61 88320 0 clpbuf 984 0 84 15189297 0 5 82656 0 1024 1024 2 78 14876 0 13 81920 0 32 32 121 2399 37439 0 253 80640 0 8192 8192 7 2 2777 0 1 73728 0 512 512 62 74 62 0 29 69632 0 65536 65536 1 0 16 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 4096 4096 16 0 42 0 1 65536 0 swrbuf 984 0 65 571090 0 5 63960 0 512 512 38 82 5939 0 29 61440 0 8192 8192 5 2 1065 0 1 57344 0 4096 4096 1 12 893227 0 1 53248 0 16 16 171 3079 182022 0 253 52000 0 16 16 329 2921 69701 0 253 52000 0 16 16 257 2993 291203 0 253 52000 0 16384 16384 3 0 3 0 1 49152 0 1024 1024 20 20 24072650 0 13 40960 0 32 32 63 1197 73 0 253 40320 0 cpuset 104 27 345 27 0 125 38688 0 2048 2048 2 16 48108 0 5 36864 0 64 pcpu 8 3111 1497 3460 0 253 36864 0 16 16 47 2203 29742 0 253 36000 0 16 16 63 2187 96 0 253 36000 0 256 256 39 96 362601 0 61 34560 0 32768 32768 1 0 2325 0 1 32768 0 8192 8192 4 0 4 0 1 32768 0 mt_stats_zone 64 431 81 434 0 253 32768 0 rtentry 208 12 140 15 0 61 31616 0 UMA Kegs 384 75 2 76 0 29 29568 0 16 16 27 1723 28 0 253 28000 0 4096 4096 1 5 4994 0 1 24576 0 KMAP ENTRY 96 15 234 33 0 125 23904 0 tcpcb 1008 10 10 274 0 13 20160 0 rentr 24 0 835 1106 0 253 20040 0 mt_zone 24 431 404 434 0 253 20040 0 16 16 471 779 902727 0 253 20000 0 tcp_inpcb 488 10 30 274 0 29 19520 0 16384 16384 1 0 267 0 1 16384 0 8192 8192 2 0 5 0 1 16384 0 2048 2048 4 4 5638 0 5 16384 0 1024 1024 7 9 7 0 13 16384 0 MAP 216 2 69 2 0 61 15336 0 2048 2048 4 2 4 0 5 12288 0 int pcpu 4 194 2366 194 0 253 10240 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 3 1 32667 0 5 8192 0 1024 1024 4 4 4 0 13 8192 0 512 512 5 11 434 0 29 8192 0 epoch_record pcpu 256 5 11 5 0 61 4096 0 4096 4096 1 0 13 0 1 4096 0 2048 2048 1 1 1 0 5 4096 0 procdesc 136 1 28 90 0 61 3944 0 ripcb 488 1 7 3 0 29 3904 0 vmem 1856 0 1 0 0 5 1856 0 FFS1 dinode 128 0 0 6096248 0 125 0 0 IPsec SA lft_c 16 0 0 0 0 253 0 0 udplite_inpcb 488 0 0 0 0 29 0 0 sctp_asconf_ack 48 0 0 0 0 253 0 0 sctp_asconf 40 0 0 0 0 253 0 0 sctp_stream_msg_out 112 0 0 0 0 125 0 0 sctp_readq 152 0 0 0 0 61 0 0 sctp_chunk 152 0 0 0 0 61 0 0 sctp_raddr 736 0 0 0 0 13 0 0 sctp_laddr 48 0 0 4 0 253 0 0 sctp_asoc 2408 0 0 0 0 3 0 0 sctp_ep 1280 0 0 0 0 9 0 0 tcp_log_node 120 0 0 0 0 125 0 0 tcp_log_bucket 184 0 0 0 0 61 0 0 tcp_log 408 0 0 0 0 29 0 0 tcpreass 48 0 0 0 0 253 0 0 tfo_ccache_entries 80 0 0 0 0 125 0 0 tfo 4 0 0 0 0 253 0 0 sackhole 32 0 0 0 0 253 0 0 hostcache 96 0 0 1 0 125 0 0 syncache 168 0 0 129 0 61 0 0 tcptw 88 0 0 127 0 125 0 0 ipq 56 0 0 0 0 253 0 0 KNOTE 160 0 0 0 0 61 0 0 itimer 352 0 0 0 0 29 0 0 AIOLIO 280 0 0 0 0 29 0 0 AIOCB 752 0 0 0 0 13 0 0 AIOP 32 0 0 0 0 253 0 0 AIO 208 0 0 0 0 61 0 0 NCLNODE 744 0 0 0 0 13 0 0 LTS VFS Cache 368 0 0 0 0 29 0 0 STS VFS Cache 148 0 0 0 0 61 0 0 VNODEPOLL 120 0 0 0 0 125 0 0 vtnet_tx_hdr 24 0 0 0 0 253 0 0 crypto_session 24 0 0 39 0 253 0 0 cryptodesc 120 0 0 0 0 125 0 0 cryptop 128 0 0 0 0 125 0 0 nvme_request 128 0 0 0 0 125 0 0 FPU_save_area 832 0 0 0 0 13 0 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 0 mbuf_extpgs 256 0 0 0 0 61 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 22 0 1 0 0 audit_record 1280 0 0 0 0 9 0 0 domainset 40 0 0 0 0 253 0 0 MAC labels 40 0 0 0 0 253 0 0 vnpbuf 984 0 0 209580 0 13 0 0 mdpbuf 984 0 0 25721 0 1 0 0 nfspbuf 984 0 0 0 0 5 0 0 swwbuf 984 0 0 2080940 0 1 0 0 umtx_shm 88 0 0 0 0 125 0 0 umtx pi 96 0 0 0 0 125 0 0 rangeset pctrie nodes 144 0 0 0 0 61 0 0 65536 65536 0 0 78 0 1 0 0 65536 65536 0 0 14 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 1 0 1 0 0 16384 16384 0 0 0 0 1 0 0 UMA Hash 256 0 0 0 0 61 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 532 7 9873 1 vm pgcache 4096 215855 458 136501868 18 vm pgcache 4096 16386 1189 1097395433 38 buf free cache 984 2350 19154 128224660 16 buffer arena-65 65536 0 0 569568 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 764 424 25602268 4 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 9 20 2208361 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 4916 1 buffer arena-40 4096 0 0 25309 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff80003951000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000394b6e0 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x61/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add83a30, rbp = 0xfffffe00add83a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add83a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add83a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add83ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add83ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add83bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add83bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add83bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000394b000 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x61/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add88a30, rbp = 0xfffffe00add88a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add88a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add88a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add88ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add88ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800039606e0 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x61/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add8da30, rbp = 0xfffffe00add8da30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add8da30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add8da90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add8dab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add8dad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add8dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003960000 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x61/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add92a30, rbp = 0xfffffe00add92a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add92a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add92a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add92ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add92ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add92bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add92bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add92bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000395f6e0 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x61/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add97a30, rbp = 0xfffffe00add97a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add97a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add97a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add97ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add97ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add97bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add97bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add97bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000395f000 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x61/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add9ca30, rbp = 0xfffffe00add9ca30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9ca30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9ca90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9cab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800039526e0 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x61/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00adda1a30, rbp = 0xfffffe00adda1a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda1a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda1a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda1ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda1ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003963000 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x61/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00adda6a30, rbp = 0xfffffe00adda6a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda6a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda6a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda6ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda6ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800039626e0 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x61/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00addaba30, rbp = 0xfffffe00addaba30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00addaba30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00addaba90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00addabab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00addabad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00addabbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addabbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addabbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003962000 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x61/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00addb0a30, rbp = 0xfffffe00addb0a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00addb0a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00addb0a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00addb0ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00addb0ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00addb0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800039616e0 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x61/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00addb5a30, rbp = 0xfffffe00addb5a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00addb5a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00addb5a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00addb5ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00addb5ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00addb5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 83923 2666 2631 0 S nanslp 0xffffffff81c816e2 sleep 77231 66084 77231 0 D+ ufs 0xfffff80028b62a28 fstat 75003 75002 2140 0 D ufs 0xfffff80028b62a28 ls 75002 2140 2140 0 S wait 0xfffff8014b51c000 sh 69228 52411 2362 0 D+ softdep 0xfffff803ee083cd0 umount 66084 66082 66084 0 S+ wait 0xfffff80462a61000 bash 66082 66081 66082 0 S+ pause 0xfffff802f28b95d8 csh 66081 99563 66081 2006 S+ wait 0xfffff802f28b9000 su 52423 0 0 0 DL mdwait 0xfffff8074fee0000 [md10] 52411 52409 2362 0 S+ wait 0xfffff8023552d000 sh 52410 2362 2362 0 S+ piperd 0xfffff805dd2b1be0 tee 52409 2362 2362 0 S+ wait 0xfffff8014b4f3000 sh 99563 99562 99563 2006 Ss+ wait 0xfffff80127639a60 bash 99562 99559 99559 2006 S select 0xfffff80320cb8ec0 sshd 99559 2283 99559 0 Ss select 0xfffff80028326e40 sshd 2669 2631 2631 0 S piperd 0xfffff800286f3000 sh 2667 2631 2631 0 S piperd 0xfffff80028d57be0 awk 2666 2631 2631 0 S wait 0xfffff800281d4530 sh 2631 1 2631 0 SWs wait 0xfffff80127b95000 sh 2362 2360 2362 0 S+ wait 0xfffff8003a2c5000 sh 2360 2358 2360 0 SW+ wait 0xfffff800281d4a60 bash 2358 2357 2358 0 SW+ pause 0xfffff80028b915d8 csh 2357 2351 2357 2006 SW+ wait 0xfffff80127b95530 su 2351 2350 2351 2006 SWs+ wait 0xfffff80028b91a60 bash 2350 2347 2347 2006 S select 0xfffff8000403f6c0 sshd 2347 2283 2347 0 Ss select 0xfffff8002832b0c0 sshd 2343 2342 2343 0 S+ ttyin 0xfffff800049dc0b0 csh 2342 1 2342 0 SWs+ wait 0xfffff80127b95a60 login 2341 1 2341 0 Ss+ ttyin 0xfffff800049dc4b0 getty 2340 1 2340 0 Ss+ ttyin 0xfffff800280960b0 getty 2339 1 2339 0 Ss+ ttyin 0xfffff800280964b0 getty 2338 1 2338 0 Ss+ ttyin 0xfffff800280968b0 getty 2337 1 2337 0 Ss+ ttyin 0xfffff80028096cb0 getty 2336 1 2336 0 Ss+ ttyin 0xfffff800280950b0 getty 2335 1 2335 0 Ss+ ttyin 0xfffff800280954b0 getty 2334 1 2334 0 Ss+ ttyin 0xfffff800280958b0 getty 2333 1 2333 0 Ss+ ttyin 0xfffff80028095cb0 getty 2287 1 2287 0 Ss nanslp 0xffffffff81c816e3 cron 2283 1 2283 0 Ss select 0xfffff80026f36840 sshd 2255 1 2255 0 Ss select 0xfffff800433a1d40 powerd 2252 1 2252 123 Ss (threaded) ntpd 100194 S select 0xfffff800289eb040 ntpd 100369 S usem 0xfffff800281f2880 ntpd 2189 1 2189 0 Ss rpcsvc 0xfffff800049fb360 NLM: master 2186 1 2186 0 Ss select 0xfffff8000400e7c0 rpc.statd 2140 1 2140 0 Ss wait 0xfffff8002824c530 watchdogd 2061 1 2061 0 Ss select 0xfffff800433a1ac0 rpcbind 2051 1 2051 0 Ss select 0xfffff800283444c0 syslogd 1980 1 1980 0 Ss select 0xfffff800289eb0c0 devd 1975 1 1975 65 Ss select 0xfffff8000400e8c0 dhclient 1928 1 1928 0 Ss select 0xfffff80028344540 dhclient 1925 1 1925 0 Ss select 0xfffff8002832b140 dhclient 34 0 0 0 DL vlruwt 0xfffff8002805ea60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d57b18 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d57018 [bufdaemon] 100131 D - 0xffffffff8180a980 [bufspacedaemon-0] 100132 D - 0xffffffff81812c40 [bufspacedaemon-1] 100133 D - 0xffffffff8181af00 [bufspacedaemon-2] 100134 D - 0xffffffff818231c0 [bufspacedaemon-3] 100135 D - 0xffffffff8182b480 [bufspacedaemon-4] 100138 D - 0xffffffff81833740 [bufspacedaemon-5] 100140 D - 0xffffffff8183ba00 [bufspacedaemon-6] 100153 D sdflush 0xfffff800283368e8 [/ worker] 100198 D sdflush 0xfffff800285510e8 [/tmp worker] 100349 D sdflush 0xfffff803ee083ce8 [/mnt worker] 31 0 0 0 DL psleep 0xffffffff81d72a88 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81d9fa98 [dom0] 100136 D launds 0xffffffff81d9faa4 [laundry: dom0] 100139 D umarcl 0xffffffff80f1e420 [uma] 29 0 0 0 DL idle 0xfffff8002824ba60 [enc_daemon1] 28 0 0 0 DL idle 0xfffff800281d3a60 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adbfa0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de5060 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d56a1c [soaiod4] 24 0 0 0 DL - 0xffffffff81d56a1c [soaiod3] 23 0 0 0 DL - 0xffffffff81d56a1c [soaiod2] 22 0 0 0 DL - 0xffffffff81d56a1c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2bfc440 [usbus0] 100097 D - 0xfffffe00d2bfc498 [usbus0] 100098 D - 0xfffffe00d2bfc4f0 [usbus0] 100099 D - 0xfffffe00d2bfc548 [usbus0] 100100 D - 0xfffffe00d2bfc5a0 [usbus0] 100102 D - 0xfffffe003e436cf0 [usbus1] 100103 D - 0xfffffe003e436d48 [usbus1] 100104 D - 0xfffffe003e436da0 [usbus1] 100105 D - 0xfffffe003e436df8 [usbus1] 100106 D - 0xfffffe003e436e50 [usbus1] 100107 D - 0xfffffe00d2f89cf0 [usbus2] 100108 D - 0xfffffe00d2f89d48 [usbus2] 100109 D - 0xfffffe00d2f89da0 [usbus2] 100110 D - 0xfffffe00d2f89df8 [usbus2] 100111 D - 0xfffffe00d2f89e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b7340 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b7440 [doneq2] 100125 D - 0xffffffff819b7208 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003be8450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003be83f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003be8390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003be8330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003be82d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003be8270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003be8210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003be81b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003be8150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003be80f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003be8090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003be8030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6cae8 [crypto] 14 0 0 0 DL seqstat 0xfffff80003abc888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9e0c8 [g_event] 100063 D - 0xffffffff81d9e0d8 [g_up] 100064 D - 0xffffffff81d9e0d0 [g_down] 12 0 0 0 WL (threaded) [intr] 100017 I [swi6: task queue] 100018 I [swi6: Giant taskq] 100020 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100179 I [irq72: ioat0] 100180 I [irq73: ioat1] 100181 I [irq74: ioat2] 100182 I [irq75: ioat3] 100183 I [irq76: ioat4] 100184 I [irq77: ioat5] 100185 I [irq78: ioat6] 100186 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff8000394a530 [init] 10 0 0 0 DL audit_w 0xffffffff81de5cf0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8c5f8 [swapper] 100015 D - 0xfffff800039a5000 [config_0] 100016 D - 0xfffff800039a4e00 [aiod_kick taskq] 100019 D - 0xfffff800039a4b00 [thread taskq] 100021 D - 0xfffff800039a4900 [kqueue_ctx taskq] 100022 D - 0xfffff800039a4800 [if_io_tqg_0] 100023 D - 0xfffff800039a4700 [if_io_tqg_1] 100024 D - 0xfffff800039a4600 [if_io_tqg_2] 100025 D - 0xfffff800039a4500 [if_io_tqg_3] 100026 D - 0xfffff800039a4400 [if_io_tqg_4] 100027 D - 0xfffff800039a4300 [if_io_tqg_5] 100028 D - 0xfffff800039a4200 [if_io_tqg_6] 100029 D - 0xfffff800039a4100 [if_io_tqg_7] 100030 D - 0xfffff800039a4000 [if_io_tqg_8] 100031 D - 0xfffff800039a3e00 [if_io_tqg_9] 100032 D - 0xfffff800039a3d00 [if_io_tqg_10] 100033 D - 0xfffff800039a3c00 [if_io_tqg_11] 100034 D - 0xfffff800039a3b00 [softirq_0] 100035 D - 0xfffff800039a3a00 [softirq_1] 100036 D - 0xfffff800039a3900 [softirq_2] 100037 D - 0xfffff800039a3800 [softirq_3] 100038 D - 0xfffff800039a3700 [softirq_4] 100039 D - 0xfffff800039a3600 [softirq_5] 100040 D - 0xfffff800039a3500 [softirq_6] 100041 D - 0xfffff800039a3400 [softirq_7] 100042 D - 0xfffff800039a3300 [softirq_8] 100043 D - 0xfffff800039a3200 [softirq_9] 100044 D - 0xfffff800039a3100 [softirq_10] 100045 D - 0xfffff800039a3000 [softirq_11] 100046 D - 0xfffff80003a88100 [if_config_tqg_0] 100061 D - 0xfffff80003a88000 [firmware taskq] 100066 D - 0xfffff80003a89e00 [crypto_0] 100067 D - 0xfffff80003a89e00 [crypto_1] 100068 D - 0xfffff80003a89e00 [crypto_2] 100069 D - 0xfffff80003a89e00 [crypto_3] 100070 D - 0xfffff80003a89e00 [crypto_4] 100071 D - 0xfffff80003a89e00 [crypto_5] 100072 D - 0xfffff80003a89e00 [crypto_6] 100073 D - 0xfffff80003a89e00 [crypto_7] 100074 D - 0xfffff80003a89e00 [crypto_8] 100075 D - 0xfffff80003a89e00 [crypto_9] 100076 D - 0xfffff80003a89e00 [crypto_10] 100077 D - 0xfffff80003a89e00 [crypto_11] 100114 D - 0xfffff80026023200 [mca taskq] 100120 D - 0xfffff800280c5300 [acpi_task_0] 100121 D - 0xfffff800280c5300 [acpi_task_1] 100122 D - 0xfffff800280c5300 [acpi_task_2] 100124 D - 0xfffff80003a89d00 [CAM taskq] db:0:pho> allt Tracing command sleep pid 83923 tid 101578 td 0xfffff8082d4db000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5657830 mi_switch() at mi_switch+0x165/frame 0xfffffe00e5657870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56578b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5657910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5657950 _sleep() at _sleep+0x258/frame 0xfffffe00e56579f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e5657a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e5657ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5657bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5657bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003aa62a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command fstat pid 77231 tid 100333 td 0xfffff8014b565000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5427240 mi_switch() at mi_switch+0x165/frame 0xfffffe00e5427280 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e54272c0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e5427320 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e54273d0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe00e5427490 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e54274e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e5427500 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e5427560 vget_finish() at vget_finish+0x89/frame 0xfffffe00e54275b0 cache_lookup() at cache_lookup+0x570/frame 0xfffffe00e5427690 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe00e54276f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5d/frame 0xfffffe00e5427710 lookup() at lookup+0x611/frame 0xfffffe00e54277b0 namei() at namei+0x4f1/frame 0xfffffe00e54278a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e54279c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e5427ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5427bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5427bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80042617a, rsp = 0x7fffffffce58, rbp = 0x7fffffffcf00 --- Tracing command ls pid 75003 tid 101579 td 0xfffff806244216e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5c9a240 mi_switch() at mi_switch+0x165/frame 0xfffffe00e5c9a280 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5c9a2c0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e5c9a320 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e5c9a3d0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe00e5c9a490 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e5c9a4e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e5c9a500 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e5c9a560 vget_finish() at vget_finish+0x89/frame 0xfffffe00e5c9a5b0 cache_lookup() at cache_lookup+0x570/frame 0xfffffe00e5c9a690 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe00e5c9a6f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5d/frame 0xfffffe00e5c9a710 lookup() at lookup+0x611/frame 0xfffffe00e5c9a7b0 namei() at namei+0x4f1/frame 0xfffffe00e5c9a8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e5c9a9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e5c9aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5c9abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5c9abf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80049517a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe470 --- Tracing command sh pid 75002 tid 100260 td 0xfffff8014b521000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e42b86b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e42b86f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e42b8730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e42b8790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e42b87a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e42b8840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e42b88d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e42b8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e42b8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e42b8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004094ca, rsp = 0x7fffffffe858, rbp = 0x7fffffffe910 --- Tracing command umount pid 69228 tid 100285 td 0xfffff8014bb2e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4335650 mi_switch() at mi_switch+0x165/frame 0xfffffe00e4335690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e43356d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4335710 _sleep() at _sleep+0x26c/frame 0xfffffe00e43357b0 softdep_waitidle() at softdep_waitidle+0x176/frame 0xfffffe00e4335830 softdep_flushfiles() at softdep_flushfiles+0x15e/frame 0xfffffe00e43358b0 ffs_unmount() at ffs_unmount+0xd7/frame 0xfffffe00e4335930 dounmount() at dounmount+0x43c/frame 0xfffffe00e4335990 sys_unmount() at sys_unmount+0x2ae/frame 0xfffffe00e4335ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e4335bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4335bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002de8fa, rsp = 0x7fffffffd318, rbp = 0x7fffffffd850 --- Tracing command bash pid 66084 tid 101453 td 0xfffff802359bf6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56866b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e56866f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5686730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5686790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e56867a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5686840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e56868d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5686ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5686bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5686bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8005194ca, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6a0 --- Tracing command csh pid 66082 tid 100350 td 0xfffff802359b6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e558a8a0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e558a8e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e558a920 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e558a980 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e558a990 _sleep() at _sleep+0x2c3/frame 0xfffffe00e558aa30 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe00e558aa90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00e558aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e558abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e558abf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80048e54a, rsp = 0x7fffffffdfd8, rbp = 0x7fffffffe060 --- Tracing command su pid 66081 tid 100344 td 0xfffff80235470000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e557b6b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e557b6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e557b730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e557b790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e557b7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e557b840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e557b8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e557bac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e557bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e557bbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ee4ca, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffeb20 --- Tracing command md10 pid 52423 tid 101552 td 0xfffff8082d3cb6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5c40a30 mi_switch() at mi_switch+0x165/frame 0xfffffe00e5c40a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5c40ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e5c40b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e5c40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e5c40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e5c40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 52411 tid 100328 td 0xfffff8023509c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e540e6b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e540e6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e540e730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e540e790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e540e7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e540e840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e540e8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e540eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e540ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e540ebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004094ca, rsp = 0x7fffffffe248, rbp = 0x7fffffffe300 --- Tracing command tee pid 52410 tid 100571 td 0xfffff8014b2b4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e54a47f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e54a4830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e54a4870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e54a48d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e54a48e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e54a4980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e54a49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e54a4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e54a4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e54a4ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e54a4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e54a4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800419f0a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 52409 tid 100278 td 0xfffff8014b69e6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e43126b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e43126f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4312730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4312790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e43127a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4312840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e43128d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4312ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e4312bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4312bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004094ca, rsp = 0x7fffffffde08, rbp = 0x7fffffffdec0 --- Tracing command bash pid 99563 tid 100196 td 0xfffff800283f16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b6d6b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b6d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b6d730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b6d790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1b6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e1b6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e1b6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e1b6dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8005194ca, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 99562 tid 101546 td 0xfffff80624a71000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addec710 mi_switch() at mi_switch+0x165/frame 0xfffffe00addec750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addec790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00addec7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00addec800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00addec860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00addec8a0 kern_select() at kern_select+0x962/frame 0xfffffe00addeca80 sys_select() at sys_select+0x56/frame 0xfffffe00addecac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00addecbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00addecbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f7eea, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 99559 tid 100296 td 0xfffff8014b91d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e436c790 mi_switch() at mi_switch+0x165/frame 0xfffffe00e436c7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e436c810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e436c870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e436c880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e436c8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e436c920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e436caa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e436cac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e436cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e436cbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089acea, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sh pid 2669 tid 100239 td 0xfffff80127f8b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e424f7f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e424f830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e424f870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e424f8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e424f8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e424f980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e424f9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e424fa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e424fa70 sys_read() at sys_read+0x83/frame 0xfffffe00e424fac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e424fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e424fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800478f0a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2667 tid 100238 td 0xfffff8014b26b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e424a7f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e424a830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e424a870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e424a8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e424a8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e424a980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e424a9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e424aa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e424aa70 sys_read() at sys_read+0x83/frame 0xfffffe00e424aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e424abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e424abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047df0a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2666 tid 100234 td 0xfffff8014b26b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e42366b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e42366f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4236730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4236790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e42367a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4236840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e42368d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4236ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e4236bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4236bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004094ca, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 2631 tid 100222 td 0xfffff80127bac6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bf66b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7de80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7de90 trap() at trap+0x73/frame 0xfffffe00add7dfc0 calltrap() at calltrap+0x8/frame 0xfffffe00add7dfc0 --- trap 0xc, rip = 0xffffffff81058820, rsp = 0xfffffe00add7e090, rbp = 0xfffffe00add7e120 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x32/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1bf66b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7e110 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2362 tid 100206 td 0xfffff801272796e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1ba66b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1ba66f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1ba6730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1ba6790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1ba67a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e1ba6840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e1ba68d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e1ba6ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1ba6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ba6bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004094ca, rsp = 0x7fffffffe128, rbp = 0x7fffffffe1e0 --- Tracing command bash pid 2360 tid 100203 td 0xfffff800280d06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b976b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7de80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7de90 trap() at trap+0x73/frame 0xfffffe00add7dfc0 calltrap() at calltrap+0x8/frame 0xfffffe00add7dfc0 --- trap 0xc, rip = 0xffffffff81058820, rsp = 0xfffffe00add7e090, rbp = 0xfffffe00add7e120 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x32/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1b976b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7e110 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2358 tid 100200 td 0xfffff80028a0e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a5b8a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7de80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7de90 trap() at trap+0x73/frame 0xfffffe00add7dfc0 calltrap() at calltrap+0x8/frame 0xfffffe00add7dfc0 --- trap 0xc, rip = 0xffffffff81058820, rsp = 0xfffffe00add7e090, rbp = 0xfffffe00add7e120 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x32/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1a5b8a8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7e110 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2357 tid 100219 td 0xfffff80127941000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1be76b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7de80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7de90 trap() at trap+0x73/frame 0xfffffe00add7dfc0 calltrap() at calltrap+0x8/frame 0xfffffe00add7dfc0 --- trap 0xc, rip = 0xffffffff81058820, rsp = 0xfffffe00add7e090, rbp = 0xfffffe00add7e120 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x32/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1be76b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7e110 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2351 tid 100187 td 0xfffff80028b8a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b346b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7de80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7de90 trap() at trap+0x73/frame 0xfffffe00add7dfc0 calltrap() at calltrap+0x8/frame 0xfffffe00add7dfc0 --- trap 0xc, rip = 0xffffffff81058820, rsp = 0xfffffe00add7e090, rbp = 0xfffffe00add7e120 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x32/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1b346b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7e110 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2350 tid 100204 td 0xfffff8012796d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b9c710 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b9c750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b9c790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b9c7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1b9c800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1b9c860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1b9c8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1b9ca80 sys_select() at sys_select+0x56/frame 0xfffffe00e1b9cac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b9cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b9cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f7eea, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2347 tid 100218 td 0xfffff80028a3f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1be2790 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1be27d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1be2810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1be2870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1be2880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1be28e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1be2920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1be2aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1be2ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1be2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1be2bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089acea, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2343 tid 100217 td 0xfffff8003a2ba000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bdd770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bdd7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bdd7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bdd850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bdd860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bdd8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bdd8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bdd950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bdd980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bdd9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bdda30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bdda70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bddac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bddbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bddbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fdf0a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2342 tid 100215 td 0xfffff801279416e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bd36b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7de80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7de90 trap() at trap+0x73/frame 0xfffffe00add7dfc0 calltrap() at calltrap+0x8/frame 0xfffffe00add7dfc0 --- trap 0xc, rip = 0xffffffff81058820, rsp = 0xfffffe00add7e090, rbp = 0xfffffe00add7e120 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x32/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1bd36b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00add7e110 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00add7e120 db_get_value() at db_get_value+0x4c/frame 0xfffffe00add7e160 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00add7e1f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00add7e210 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00add7e2b0 db_command() at db_command+0x25c/frame 0xfffffe00add7e380 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00add7e420 db_command() at db_command+0x25c/frame 0xfffffe00add7e4f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00add7e500 db_trap() at db_trap+0xe8/frame 0xfffffe00add7e590 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00add7e610 trap() at trap+0x7d4/frame 0xfffffe00add7e740 calltrap() at calltrap+0x8/frame 0xfffffe00add7e740 --- trap 0x3, rip = 0xffffffff80c18251, rsp = 0xfffffe00add7e810, rbp = 0xfffffe00add7e830 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2341 tid 100214 td 0xfffff80127bc2000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bce770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bce7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bce7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bce850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bce860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bce8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bce8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bce950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bce980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bce9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bcea30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bcea70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bceac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bcebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bcebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2340 tid 100213 td 0xfffff80127bc26e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bc9770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bc97b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bc97f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bc9850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bc9860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bc98c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bc98f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bc9950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bc9980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bc99e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bc9a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bc9a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bc9ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bc9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bc9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2339 tid 100212 td 0xfffff80127a17000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bc4770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bc47b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bc47f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bc4850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bc4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bc48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bc48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bc4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bc4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bc49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bc4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bc4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bc4ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bc4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bc4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2338 tid 100211 td 0xfffff80127a176e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bbf770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bbf7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bbf7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bbf850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bbf860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bbf8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bbf8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bbf950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bbf980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bbf9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bbfa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bbfa70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bbfac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bbfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bbfbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2337 tid 100210 td 0xfffff80127bb1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bba770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bba7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bba7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bba850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bba860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bba8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bba8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bba950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bba980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bba9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bbaa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bbaa70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bbaac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bbabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bbabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2336 tid 100209 td 0xfffff80127bb16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bb5770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bb57b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bb57f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bb5850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bb5860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bb58c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bb58f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bb5950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bb5980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bb59e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bb5a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bb5a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bb5ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bb5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bb5bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2335 tid 100208 td 0xfffff80127bac000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1bb0770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1bb07b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1bb07f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1bb0850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1bb0860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1bb08c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1bb08f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1bb0950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1bb0980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1bb09e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bb0a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bb0a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1bb0ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1bb0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bb0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2334 tid 100177 td 0xfffff80028df5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1ad2770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1ad27b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1ad27f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1ad2850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1ad2860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1ad28c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1ad28f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1ad2950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1ad2980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1ad29e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1ad2a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1ad2a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1ad2ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1ad2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ad2bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2333 tid 100142 td 0xfffff800285c76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e19fd770 mi_switch() at mi_switch+0x165/frame 0xfffffe00e19fd7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e19fd7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e19fd850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e19fd860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e19fd8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e19fd8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e19fd950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e19fd980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e19fd9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e19fda30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e19fda70 sys_read() at sys_read+0x83/frame 0xfffffe00e19fdac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e19fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e19fdbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2287 tid 100176 td 0xfffff80028df56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1acd830 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1acd870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1acd8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1acd910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1acd950 _sleep() at _sleep+0x258/frame 0xfffffe00e1acd9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e1acda80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e1acdac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1acdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1acdbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003da62a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2283 tid 100197 td 0xfffff80127279000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b72710 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b72750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b72790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b727f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1b72800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1b72860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1b728a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1b72a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1b72ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b72bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b72bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f7eea, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command powerd pid 2255 tid 100201 td 0xfffff801279866e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b8d6d0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b8d710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b8d750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b8d7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1b8d7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1b8d860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1b8d8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1b8da80 sys_select() at sys_select+0x56/frame 0xfffffe00e1b8dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b8dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b8dbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800432eea, rsp = 0x7fffffffeb78, rbp = 0x7fffffffecc0 --- Tracing command ntpd pid 2252 tid 100194 td 0xfffff800281e0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b63710 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b63750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b63790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b637f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1b63800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1b63860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1b638a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1b63a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1b63ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b63bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b63bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082aeea, rsp = 0x7fffffffdef8, rbp = 0x7fffffffdf30 --- Tracing command ntpd pid 2252 tid 100369 td 0xfffff8023573f000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6edb7f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e6edb830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6edb870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6edb8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6edb8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6edb980 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e6edb9e0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e6edba70 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e6edbac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6edbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6edbbf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80071f22a, rsp = 0x7fffdff3aed8, rbp = 0x7fffdff3af50 --- Tracing command rpc.lockd pid 2189 tid 100166 td 0xfffff800285be000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a83610 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1a83650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1a83690 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1a836f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1a83730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1a837a0 svc_run_internal() at svc_run_internal+0xabe/frame 0xfffffe00e1a838e0 svc_run() at svc_run+0x253/frame 0xfffffe00e1a83940 sys_nlm_syscall() at sys_nlm_syscall+0x745/frame 0xfffffe00e1a83ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1a83bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1a83bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f557a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2186 tid 100151 td 0xfffff800285be6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a2c6d0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1a2c710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1a2c750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1a2c7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1a2c7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1a2c860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1a2c8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1a2ca80 sys_select() at sys_select+0x56/frame 0xfffffe00e1a2cac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1a2cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1a2cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800429eea, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffebf0 --- Tracing command watchdogd pid 2140 tid 100195 td 0xfffff80028252000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b686b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b686f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b68730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b68790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1b687a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e1b68840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e1b688d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e1b68ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b68bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b68bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c34ca, rsp = 0x7fffffffea28, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2061 tid 100190 td 0xfffff800432fd6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b43750 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b43790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b437d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1b43830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1b43870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1b438e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1b43920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1b43aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1b43ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1b43bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1b43bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d0cea, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2051 tid 100178 td 0xfffff800282526e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1ad7710 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1ad7750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1ad7790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1ad77f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1ad7800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1ad7860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1ad78a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1ad7a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1ad7ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1ad7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ad7bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043aeea, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1980 tid 100164 td 0xfffff800049706e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a796d0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1a79710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1a79750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1a797b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1a797f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1a79860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1a798a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1a79a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1a79ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1a79bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1a79bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f7f7a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1975 tid 100146 td 0xfffff800284a26e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a13750 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1a13790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1a137d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1a13830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e1a13870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1a138e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1a13920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1a13aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1a13ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1a13bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1a13bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f3cea, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100175 td 0xfffff800283d6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1ac8790 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1ac87d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1ac8810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1ac8870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1ac8880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1ac88e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1ac8920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1ac8aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1ac8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1ac8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ac8bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f3cea, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100157 td 0xfffff800281e06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a4a710 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1a4a750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1a4a790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e1a4a7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e1a4a800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1a4a860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1a4a8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1a4aa80 sys_select() at sys_select+0x56/frame 0xfffffe00e1a4aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e1a4abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1a4abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800450eea, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff800284ab000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e19f89b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e19f89f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e19f8a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e19f8a70 _sleep() at _sleep+0x26c/frame 0xfffffe00e19f8b10 vnlru_proc() at vnlru_proc+0x90/frame 0xfffffe00e19f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e19f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e19f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100137 td 0xfffff800284ab6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e19e49f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e19e4a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e19e4a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e19e4ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00e19e4b20 sched_sync() at sched_sync+0x68d/frame 0xfffffe00e19e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e19e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e19e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff800280cc000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c31a00 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c31a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c31a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d2c31ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d2c31b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d2c31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff800283796e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dbec49f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00dbec4a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dbec4a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dbec4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dbec4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dbec4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dbec4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dbec4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff80028379000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dbfe99f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00dbfe9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dbfe9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dbfe9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dbfe9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dbfe9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dbfe9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dbfe9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff800281b36e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dbfee9f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00dbfeea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dbfeea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dbfeeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dbfeeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dbfeebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dbfeebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dbfeebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff800281b3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dbff39f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00dbff3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dbff3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dbff3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dbff3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dbff3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dbff3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dbff3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff800282636e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dbff89f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00dbff8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dbff8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dbff8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dbff8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dbff8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dbff8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dbff8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff800284c8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e19e99f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e19e9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e19e9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e19e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e19e9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e19e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e19e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e19e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffff800284c96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e19f39f0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e19f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e19f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e19f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e19f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e19f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e19f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e19f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff800281f8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1a369e0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1a36a20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1a36a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e1a36aa0 _sleep() at _sleep+0x26c/frame 0xfffffe00e1a36b40 softdep_flush() at softdep_flush+0x27c/frame 0xfffffe00e1a36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1a36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1a36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100198 td 0xfffff8003a2ba6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e1b839e0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e1b83a20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e1b83a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e1b83aa0 _sleep() at _sleep+0x26c/frame 0xfffffe00e1b83b40 softdep_flush() at softdep_flush+0x27c/frame 0xfffffe00e1b83bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1b83bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1b83bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100349 td 0xfffff803b2a9e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6ec79e0 mi_switch() at mi_switch+0x165/frame 0xfffffe00e6ec7a20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6ec7a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e6ec7aa0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6ec7b40 softdep_flush() at softdep_flush+0x27c/frame 0xfffffe00e6ec7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e6ec7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e6ec7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff800280cc6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c2ca20 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d2c2cb40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d2c2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff800280cb000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c27650 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c27690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c276d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d2c27710 _sleep() at _sleep+0x26c/frame 0xfffffe00d2c277b0 vm_pageout_worker() at vm_pageout_worker+0x26c/frame 0xfffffe00d2c27b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d2c27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100136 td 0xfffff800283f1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dbffd810 mi_switch() at mi_switch+0x165/frame 0xfffffe00dbffd850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dbffd890 _sleep() at _sleep+0x2cd/frame 0xfffffe00dbffd930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc2b/frame 0xfffffe00dbffdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dbffdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dbffdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100139 td 0xfffff800283f06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e19eea20 mi_switch() at mi_switch+0x165/frame 0xfffffe00e19eea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e19eeaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e19eeae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e19eeb80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e19eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e19eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e19eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff80028263000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c22a10 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c22a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c22a90 _sleep() at _sleep+0x2cd/frame 0xfffffe00d2c22b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe00d2c22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff800281f86e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c1da10 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c1da50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c1da90 _sleep() at _sleep+0x2cd/frame 0xfffffe00d2c1db30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe00d2c1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff80026f5b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c0e9d0 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c0ea10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c0ea50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d2c0ea90 _sleep() at _sleep+0x26c/frame 0xfffffe00d2c0eb30 random_kthread() at random_kthread+0x67/frame 0xfffffe00d2c0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800280706e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037beea70 mi_switch() at mi_switch+0x165/frame 0xfffffe0037beeab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beeaf0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037beeb90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037beebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037beebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037beebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff80026f486e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bdda10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bdda50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bdda90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bddad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bddb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80026f5c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd8a10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bd8a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd8a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bd8ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bd8b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff80026f5c6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd3a10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bd3a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd3a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bd3ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bd3b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bd3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80026f5b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bcea10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bcea50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bcea90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bcead0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bceb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff800041036e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b63a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b63ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b63b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b63b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80004103000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b68a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b68ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b68b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003d676e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6da90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b6dad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6db10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6db70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80004876000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b72a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b72ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b72b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b72b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff800048716e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b77a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff800048726e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b81a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80004872000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b86a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800048946e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b8ba90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80004894000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b90a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b90ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b90b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b90b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000488f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b95a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff80004970000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba6a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ba6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba6b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba6b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800049716e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037baba90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037babad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037babb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037babb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037babbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037babbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037babbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff80004971000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb0a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bb0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb0b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bb0b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bb0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800049656e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb5a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bb5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb5b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bb5b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bb5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff80004965000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bbaa90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003d67000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b4aa40 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b4aa80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003d686e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b4fa40 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b4fa80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4fac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003d68000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b54a40 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b54a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff800280cb6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c18a30 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c18a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c18ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d2c18b50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe00d2c18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003bee6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b45a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b45a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80003bfa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b40a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b40a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff80003bfa6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b3ba20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b3ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80003bf9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b36a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b36a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff80003bf96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b31a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b31a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003bea000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b2ca20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003bea6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b27a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003bef000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b22a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b22a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003bef6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1da20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b1da60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1daa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003bee000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b18a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b18a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff80003bde6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b13a20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b13a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80003be1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b0ea20 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b0ea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff80003be16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b09a50 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b09a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003b29000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac8a50 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ac8a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac8ad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ac8b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe0037ac8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003b286e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aada50 mi_switch() at mi_switch+0x165/frame 0xfffffe0037aada90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aadad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aadb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037aadbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aadbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aadbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003b28000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab2a50 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ab2a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab2ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab2b70 g_io_schedule_up() at g_io_schedule_up+0x4c/frame 0xfffffe0037ab2ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ab2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003b296e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab7a50 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ab7a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab7ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab7b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037ab7ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037ab7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff800039ac000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addc4b10 mi_switch() at mi_switch+0x165/frame 0xfffffe00addc4b50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe00addc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800039ab6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addc9b10 mi_switch() at mi_switch+0x165/frame 0xfffffe00addc9b50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe00addc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100020 td 0xfffff800039636e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003a9a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a0eb10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037a0eb50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003a8e6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003a8e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003a7d6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003aaf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003ab06e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003ab0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003ab16e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003ab1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003ab36e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003ab3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003ab46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003ab4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a4ab10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037a4ab50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe0037a4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff80003aaf6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff8000410f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b59b10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b59b50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff8000410f000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b5eb10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b5eb50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80004871000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b7cb10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b7cb50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff8000498d6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000498d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc4b10 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bc4b50 ithread_loop() at ithread_loop+0x98/frame 0xfffffe0037bc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100179 td 0xfffff80043394000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff800433896e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff80043389000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8004338a6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8004338a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff800433a46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff800433a4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff800433a56e0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff80003951000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add7e830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add7e840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add7e870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add7e8b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add7e900 intr_execute_handlers() at intr_execute_handlers+0x75/frame 0xfffffe00add7e940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add7e960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add7e960 --- interrupt, rip = 0xffffffff81044846, rsp = 0xfffffe00add7ea30, rbp = 0xfffffe00add7ea30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ea30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ea90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7eab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7ead0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000394b6e0 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x61/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add83a30, rbp = 0xfffffe00add83a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add83a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add83a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add83ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add83ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add83bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add83bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add83bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000394b000 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x61/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add88a30, rbp = 0xfffffe00add88a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add88a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add88a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add88ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add88ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800039606e0 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x61/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add8da30, rbp = 0xfffffe00add8da30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add8da30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add8da90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add8dab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add8dad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add8dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003960000 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x61/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add92a30, rbp = 0xfffffe00add92a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add92a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add92a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add92ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add92ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add92bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add92bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add92bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000395f6e0 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x61/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add97a30, rbp = 0xfffffe00add97a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add97a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add97a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add97ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add97ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add97bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add97bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add97bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000395f000 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x61/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00add9ca30, rbp = 0xfffffe00add9ca30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9ca30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9ca90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9cab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800039526e0 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x61/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00adda1a30, rbp = 0xfffffe00adda1a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda1a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda1a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda1ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda1ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003963000 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x61/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00adda6a30, rbp = 0xfffffe00adda6a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda6a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda6a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda6ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda6ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800039626e0 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x61/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00addaba30, rbp = 0xfffffe00addaba30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00addaba30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00addaba90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00addabab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00addabad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00addabbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addabbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addabbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003962000 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x61/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00addb0a30, rbp = 0xfffffe00addb0a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00addb0a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00addb0a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00addb0ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00addb0ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00addb0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800039616e0 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x61/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81044846, rsp = 0xfffffe00addb5a30, rbp = 0xfffffe00addb5a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00addb5a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00addb5a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00addb5ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00addb5ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00addb5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800039516e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add796b0 mi_switch() at mi_switch+0x165/frame 0xfffffe00add796f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add79730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add79790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add797a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add79840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add798d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add79ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00add79bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add79bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b2dca, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003952000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add74a70 mi_switch() at mi_switch+0x165/frame 0xfffffe00add74ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add74af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add74b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add74bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add74bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add74bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9e1c0 sched_switch() at sched_switch+0x5ba/frame 0xffffffff82302bf0 mi_switch() at mi_switch+0x165/frame 0xffffffff82302c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82302c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82302cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82302d50 swapper() at swapper+0x75/frame 0xffffffff82302da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82302df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff80003961000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addbaa90 mi_switch() at mi_switch+0x165/frame 0xfffffe00addbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800039ac6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addbfa60 mi_switch() at mi_switch+0x165/frame 0xfffffe00addbfaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbfae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addbfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff800039ab000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addcea60 mi_switch() at mi_switch+0x165/frame 0xfffffe00addceaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addceae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addceb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff800039b0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addd8a60 mi_switch() at mi_switch+0x165/frame 0xfffffe00addd8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addd8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800039af6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003778da90 mi_switch() at mi_switch+0x165/frame 0xfffffe003778dad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003778db10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800039af000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037792a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037792ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037792b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037792b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037792bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037792bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037792bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800039ae6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037797a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037797ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037797b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037797b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037797bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037797bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037797bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800039ae000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779ca90 mi_switch() at mi_switch+0x165/frame 0xfffffe003779cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800039e46e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a1a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377a1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800039e4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a6a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377a6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800039e36e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377aba90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377abad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377abb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377abb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff800039e3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b0a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377b0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800039b06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b5a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377b5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff800039e9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377baa90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377baad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377bab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377babb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377babf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377babf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800039e86e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377bfa90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377bfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377bfb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bfb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff800039e8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c4a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377c4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800039e76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c9a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377c9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff800039e7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377cea90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377cead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ceb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ceb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377cebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377cebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377cebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003a7a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d3a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377d3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003a7a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d8a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377d8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003a7b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377dda90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377ddad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ddb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ddb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003a7b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e2a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377e2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800039e96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e7a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377e7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003a7d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377eca90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377ecad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ecb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ecb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff80003a7e6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f1a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377f1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003a7e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f6a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377f6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003a796e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377fba90 mi_switch() at mi_switch+0x165/frame 0xfffffe00377fbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377fbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377fbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377fbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003a79000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a04a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037a04ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a04b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037a04b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003a9a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a09a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037a09ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037a09b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003b27000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa8a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037aa8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003bdb6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acda60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037acdaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acdae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003bdb000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad2a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ad2aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ad2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003bdc6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad7a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ad7aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ad7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003bdc000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037adca60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037adcaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037adcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003b276e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae1a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003bde000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae6a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003bdf6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aeba60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003bdf000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af0a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003be06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af5a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003be0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037afaa60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003be66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037affa60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003be6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b04a60 mi_switch() at mi_switch+0x165/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800049886e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc9a90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bc9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bc9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff80028070000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bffa90 mi_switch() at mi_switch+0x165/frame 0xfffffe0037bffad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bffb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800280646e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c04a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c04ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c04b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d2c04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00d2c04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80028064000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c09a90 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c09ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c09b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d2c09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00d2c09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff800280d0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00d2c13a60 mi_switch() at mi_switch+0x165/frame 0xfffffe00d2c13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d2c13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d2c13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d2c13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d2c13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d2c13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 101578 (pid 83923, sleep) sleeping on 0xffffffff81c816e2 "nanslp" chain 2: thread 100333 (pid 77231, fstat) blocked on lockmgr ufsEXCL thread 100285 (pid 69228, umount) sleeping on 0xfffff803ee083cd0 "softdeps" chain 3: thread 101579 (pid 75003, ls) blocked on lockmgr ufsEXCL thread 100285 (pid 69228, umount) sleeping on 0xfffff803ee083cd0 "softdeps" chain 4: thread 100260 (pid 75002, sh) sleeping on 0xfffff8014b51c000 "wait" chain 5: thread 100285 (pid 69228, umount) sleeping on 0xfffff803ee083cd0 "softdeps" chain 6: thread 101453 (pid 66084, bash) sleeping on 0xfffff80462a61000 "wait" chain 7: thread 100350 (pid 66082, csh) sleeping on 0xfffff802f28b95d8 "pause" chain 8: thread 100344 (pid 66081, su) sleeping on 0xfffff802f28b9000 "wait" chain 9: thread 101552 (pid 52423, md10) sleeping on 0xfffff8074fee0000 "mdwait" chain 10: thread 100328 (pid 52411, sh) sleeping on 0xfffff8023552d000 "wait" chain 11: thread 100571 (pid 52410, tee) sleeping on 0xfffff805dd2b1be0 "piperd" chain 12: thread 100278 (pid 52409, sh) sleeping on 0xfffff8014b4f3000 "wait" chain 13: thread 100196 (pid 99563, bash) sleeping on 0xfffff80127639a60 "wait" chain 14: thread 101546 (pid 99562, sshd) sleeping on 0xfffff80320cb8ec0 "select" chain 15: thread 100296 (pid 99559, sshd) sleeping on 0xfffff80028326e40 "select" chain 16: thread 100239 (pid 2669, sh) sleeping on 0xfffff800286f3000 "piperd" chain 17: thread 100238 (pid 2667, awk) sleeping on 0xfffff80028d57be0 "piperd" chain 18: thread 100234 (pid 2666, sh) sleeping on 0xfffff800281d4530 "wait" chain 19: thread 100222 (pid 2631, sh) sleeping on 0xfffff80127b95000 "wait" chain 20: thread 100206 (pid 2362, sh) sleeping on 0xfffff8003a2c5000 "wait" chain 21: thread 100203 (pid 2360, bash) sleeping on 0xfffff800281d4a60 "wait" chain 22: thread 100200 (pid 2358, csh) sleeping on 0xfffff80028b915d8 "pause" chain 23: thread 100219 (pid 2357, su) sleeping on 0xfffff80127b95530 "wait" chain 24: thread 100187 (pid 2351, bash) sleeping on 0xfffff80028b91a60 "wait" chain 25: thread 100204 (pid 2350, sshd) sleeping on 0xfffff8000403f6c0 "select" chain 26: thread 100218 (pid 2347, sshd) sleeping on 0xfffff8002832b0c0 "select" chain 27: thread 100217 (pid 2343, csh) sleeping on 0xfffff800049dc0b0 "ttyin" chain 28: thread 100215 (pid 2342, login) sleeping on 0xfffff80127b95a60 "wait" chain 29: thread 100214 (pid 2341, getty) sleeping on 0xfffff800049dc4b0 "ttyin" chain 30: thread 100213 (pid 2340, getty) sleeping on 0xfffff800280960b0 "ttyin" chain 31: thread 100212 (pid 2339, getty) sleeping on 0xfffff800280964b0 "ttyin" chain 32: thread 100211 (pid 2338, getty) sleeping on 0xfffff800280968b0 "ttyin" chain 33: thread 100210 (pid 2337, getty) sleeping on 0xfffff80028096cb0 "ttyin" chain 34: thread 100209 (pid 2336, getty) sleeping on 0xfffff800280950b0 "ttyin" chain 35: thread 100208 (pid 2335, getty) sleeping on 0xfffff800280954b0 "ttyin" chain 36: thread 100177 (pid 2334, getty) sleeping on 0xfffff800280958b0 "ttyin" chain 37: thread 100142 (pid 2333, getty) sleeping on 0xfffff80028095cb0 "ttyin" chain 38: thread 100176 (pid 2287, cron) sleeping on 0xffffffff81c816e3 "nanslp" chain 39: thread 100197 (pid 2283, sshd) sleeping on 0xfffff80026f36840 "select" chain 40: thread 100201 (pid 2255, powerd) sleeping on 0xfffff800433a1d40 "select" chain 41: thread 100194 (pid 2252, ntpd) sleeping on 0xfffff800289eb040 "select" chain 42: thread 100369 (pid 2252, ntpd) sleeping on 0xfffff800281f2880 "usem" chain 43: thread 100166 (pid 2189, NLM: master) sleeping on 0xfffff800049fb360 "rpcsvc" chain 44: thread 100151 (pid 2186, rpc.statd) sleeping on 0xfffff8000400e7c0 "select" chain 45: thread 100195 (pid 2140, watchdogd) sleeping on 0xfffff8002824c530 "wait" chain 46: thread 100190 (pid 2061, rpcbind) sleeping on 0xfffff800433a1ac0 "select" chain 47: thread 100178 (pid 2051, syslogd) sleeping on 0xfffff800283444c0 "select" chain 48: thread 100164 (pid 1980, devd) sleeping on 0xfffff800289eb0c0 "select" chain 49: thread 100146 (pid 1975, dhclient) sleeping on 0xfffff8000400e8c0 "select" chain 50: thread 100175 (pid 1928, dhclient) sleeping on 0xfffff80028344540 "select" chain 51: thread 100157 (pid 1925, dhclient) sleeping on 0xfffff8002832b140 "select" chain 52: thread 100141 (pid 34, vnlru) sleeping on 0xfffff8002805ea60 "vlruwt" chain 53: thread 100137 (pid 33, syncer) sleeping on 0xffffffff81d57b18 "syncer" chain 54: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d57018 "qsleep" chain 55: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 56: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 57: thread 100133 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 58: thread 100134 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 59: thread 100135 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 60: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 61: thread 100140 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 62: thread 100153 (pid 32, / worker) sleeping on 0xfffff800283368e8 "sdflush" chain 63: thread 100198 (pid 32, /tmp worker) sleeping on 0xfffff800285510e8 "sdflush" chain 64: thread 100349 (pid 32, /mnt worker) sleeping on 0xfffff803ee083ce8 "sdflush" chain 65: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d72a88 "psleep" chain 66: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81d9fa98 "psleep" chain 67: thread 100136 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9faa4 "launds" chain 68: thread 100139 (pid 30, uma) sleeping on 0xffffffff80f1e420 "umarcl" chain 69: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8002824ba60 "idle" chain 70: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff800281d3a60 "idle" chain 71: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbfa0 "-" chain 72: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 73: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d56a1c "-" chain 74: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d56a1c "-" chain 75: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d56a1c "-" chain 76: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d56a1c "-" chain 77: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc440 "-" chain 78: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc498 "-" chain 79: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc4f0 "-" chain 80: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc548 "-" chain 81: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc5a0 "-" chain 82: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e436cf0 "-" chain 83: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e436d48 "-" chain 84: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e436da0 "-" chain 85: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e436df8 "-" chain 86: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e436e50 "-" chain 87: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2f89cf0 "-" chain 88: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2f89d48 "-" chain 89: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2f89da0 "-" chain 90: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2f89df8 "-" chain 91: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2f89e50 "-" chain 92: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b7340 "-" chain 93: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b7440 "-" chain 94: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b7208 "-" chain 95: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003be8450 "crypto_ret_wait" chain 96: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003be83f0 "crypto_ret_wait" chain 97: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003be8390 "crypto_ret_wait" chain 98: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003be8330 "crypto_ret_wait" chain 99: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003be82d0 "crypto_ret_wait" chain 100: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003be8270 "crypto_ret_wait" chain 101: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003be8210 "crypto_ret_wait" chain 102: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003be81b0 "crypto_ret_wait" chain 103: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003be8150 "crypto_ret_wait" chain 104: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003be80f0 "crypto_ret_wait" chain 105: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003be8090 "crypto_ret_wait" chain 106: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003be8030 "crypto_ret_wait" chain 107: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6cae8 "crypto_wait" chain 108: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003abc888 "seqstate" chain 109: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 110: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 111: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 112: thread 100002 (pid 1, init) sleeping on 0xfffff8000394a530 "wait" chain 113: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 114: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8c5f8 "swapin" chain 115: thread 100015 (pid 0, config_0) sleeping on 0xfffff800039a5000 "-" chain 116: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff800039a4e00 "-" chain 117: thread 100019 (pid 0, thread taskq) sleeping on 0xfffff800039a4b00 "-" chain 118: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800039a4900 "-" chain 119: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff800039a4800 "-" chain 120: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff800039a4700 "-" chain 121: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff800039a4600 "-" chain 122: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff800039a4500 "-" chain 123: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff800039a4400 "-" chain 124: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff800039a4300 "-" chain 125: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff800039a4200 "-" chain 126: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff800039a4100 "-" chain 127: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff800039a4000 "-" chain 128: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff800039a3e00 "-" chain 129: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff800039a3d00 "-" chain 130: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff800039a3c00 "-" chain 131: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff800039a3b00 "-" chain 132: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff800039a3a00 "-" chain 133: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff800039a3900 "-" chain 134: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff800039a3800 "-" chain 135: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff800039a3700 "-" chain 136: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff800039a3600 "-" chain 137: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff800039a3500 "-" chain 138: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff800039a3400 "-" chain 139: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff800039a3300 "-" chain 140: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff800039a3200 "-" chain 141: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff800039a3100 "-" chain 142: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff800039a3000 "-" chain 143: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003a88100 "-" chain 144: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a88000 "-" chain 145: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a89e00 "-" chain 146: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a89e00 "-" chain 147: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a89e00 "-" chain 148: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a89e00 "-" chain 149: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a89e00 "-" chain 150: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a89e00 "-" chain 151: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a89e00 "-" chain 152: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a89e00 "-" chain 153: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a89e00 "-" chain 154: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a89e00 "-" chain 155: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a89e00 "-" chain 156: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a89e00 "-" chain 157: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL chain 158: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff800280c5300 "-" chain 159: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff800280c5300 "-" chain 160: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff800280c5300 "-" chain 161: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a89d00 "-" db:0:pho> chain 1: thread 101578 (pid 83923, sleep) sleeping on 0xffffffff81c816e2 "nanslp" chain 2: thread 100333 (pid 77231, fstat) blocked on lockmgr ufsEXCL thread 100285 (pid 69228, umount) sleeping on 0xfffff803ee083cd0 "softdeps" chain 3: thread 101579 (pid 75003, ls) blocked on lockmgr ufsEXCL thread 100285 (pid 69228, umount) sleeping on 0xfffff803ee083cd0 "softdeps" chain 4: thread 100260 (pid 75002, sh) sleeping on 0xfffff8014b51c000 "wait" chain 5: thread 100285 (pid 69228, umount) sleeping on 0xfffff803ee083cd0 "softdeps" chain 6: thread 101453 (pid 66084, bash) sleeping on 0xfffff80462a61000 "wait" chain 7: thread 100350 (pid 66082, csh) sleeping on 0xfffff802f28b95d8 "pause" chain 8: thread 100344 (pid 66081, su) sleeping on 0xfffff802f28b9000 "wait" chain 9: thread 101552 (pid 52423, md10) sleeping on 0xfffff8074fee0000 "mdwait" chain 10: thread 100328 (pid 52411, sh) sleeping on 0xfffff8023552d000 "wait" chain 11: thread 100571 (pid 52410, tee) sleeping on 0xfffff805dd2b1be0 "piperd" chain 12: thread 100278 (pid 52409, sh) sleeping on 0xfffff8014b4f3000 "wait" chain 13: thread 100196 (pid 99563, bash) sleeping on 0xfffff80127639a60 "wait" chain 14: thread 101546 (pid 99562, sshd) sleeping on 0xfffff80320cb8ec0 "select" chain 15: thread 100296 (pid 99559, sshd) sleeping on 0xfffff80028326e40 "select" chain 16: thread 100239 (pid 2669, sh) sleeping on 0xfffff800286f3000 "piperd" chain 17: thread 100238 (pid 2667, awk) sleeping on 0xfffff80028d57be0 "piperd" chain 18: thread 100234 (pid 2666, sh) sleeping on 0xfffff800281d4530 "wait" chain 19: thread 100222 (pid 2631, sh) sleeping on 0xfffff80127b95000 "wait" chain 20: thread 100206 (pid 2362, sh) sleeping on 0xfffff8003a2c5000 "wait" chain 21: thread 100203 (pid 2360, bash) sleeping on 0xfffff800281d4a60 "wait" chain 22: thread 100200 (pid 2358, csh) sleeping on 0xfffff80028b915d8 "pause" chain 23: thread 100219 (pid 2357, su) sleeping on 0xfffff80127b95530 "wait" chain 24: thread 100187 (pid 2351, bash) sleeping on 0xfffff80028b91a60 "wait" chain 25: thread 100204 (pid 2350, sshd) sleeping on 0xfffff8000403f6c0 "select" chain 26: thread 100218 (pid 2347, sshd) sleeping on 0xfffff8002832b0c0 "select" chain 27: thread 100217 (pid 2343, csh) sleeping on 0xfffff800049dc0b0 "ttyin" chain 28: thread 100215 (pid 2342, login) sleeping on 0xfffff80127b95a60 "wait" chain 29: thread 100214 (pid 2341, getty) sleeping on 0xfffff800049dc4b0 "ttyin" chain 30: thread 100213 (pid 2340, getty) sleeping on 0xfffff800280960b0 "ttyin" chain 31: thread 100212 (pid 2339, getty) sleeping on 0xfffff800280964b0 "ttyin" chain 32: thread 100211 (pid 2338, getty) sleeping on 0xfffff800280968b0 "ttyin" chain 33: thread 100210 (pid 2337, getty) sleeping on 0xfffff80028096cb0 "ttyin" chain 34: thread 100209 (pid 2336, getty) sleeping on 0xfffff800280950b0 "ttyin" chain 35: thread 100208 (pid 2335, getty) sleeping on 0xfffff800280954b0 "ttyin" chain 36: thread 100177 (pid 2334, getty) sleeping on 0xfffff800280958b0 "ttyin" chain 37: thread 100142 (pid 2333, getty) sleeping on 0xfffff80028095cb0 "ttyin" chain 38: thread 100176 (pid 2287, cron) sleeping on 0xffffffff81c816e3 "nanslp" chain 39: thread 100197 (pid 2283, sshd) sleeping on 0xfffff80026f36840 "select" chain 40: thread 100201 (pid 2255, powerd) sleeping on 0xfffff800433a1d40 "select" chain 41: thread 100194 (pid 2252, ntpd) sleeping on 0xfffff800289eb040 "select" chain 42: thread 100369 (pid 2252, ntpd) sleeping on 0xfffff800281f2880 "usem" chain 43: thread 100166 (pid 2189, NLM: master) sleeping on 0xfffff800049fb360 "rpcsvc" chain 44: thread 100151 (pid 2186, rpc.statd) sleeping on 0xfffff8000400e7c0 "select" chain 45: thread 100195 (pid 2140, watchdogd) sleeping on 0xfffff8002824c530 "wait" chain 46: thread 100190 (pid 2061, rpcbind) sleeping on 0xfffff800433a1ac0 "select" chain 47: thread 100178 (pid 2051, syslogd) sleeping on 0xfffff800283444c0 "select" chain 48: thread 100164 (pid 1980, devd) sleeping on 0xfffff800289eb0c0 "select" chain 49: thread 100146 (pid 1975, dhclient) sleeping on 0xfffff8000400e8c0 "select" chain 50: thread 100175 (pid 1928, dhclient) sleeping on 0xfffff80028344540 "select" chain 51: thread 100157 (pid 1925, dhclient) sleeping on 0xfffff8002832b140 "select" chain 52: thread 100141 (pid 34, vnlru) sleeping on 0xfffff8002805ea60 "vlruwt" chain 53: thread 100137 (pid 33, syncer) sleeping on 0xffffffff81d57b18 "syncer" chain 54: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d57018 "qsleep" chain 55: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 56: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 57: thread 100133 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 58: thread 100134 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 59: thread 100135 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 60: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 61: thread 100140 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 62: thread 100153 (pid 32, / worker) sleeping on 0xfffff800283368e8 "sdflush" chain 63: thread 100198 (pid 32, /tmp worker) sleeping on 0xfffff800285510e8 "sdflush" chain 64: thread 100349 (pid 32, /mnt worker) sleeping on 0xfffff803ee083ce8 "sdflush" chain 65: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d72a88 "psleep" chain 66: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81d9fa98 "psleep" chain 67: thread 100136 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9faa4 "launds" chain 68: thread 100139 (pid 30, uma) sleeping on 0xffffffff80f1e420 "umarcl" chain 69: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8002824ba60 "idle" chain 70: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff800281d3a60 "idle" chain 71: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbfa0 "-" chain 72: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 73: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d56a1c "-" chain 74: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d56a1c "-" chain 75: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d56a1c "-" chain 76: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d56a1c "-" chain 77: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc440 "-" chain 78: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc498 "-" chain 79: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc4f0 "-" chain 80: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc548 "-" chain 81: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc5a0 "-" chain 82: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e436cf0 "-" chain 83: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e436d48 "-" chain 84: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e436da0 "-" chain 85: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e436df8 "-" chain 86: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e436e50 "-" chain 87: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2f89cf0 "-" chain 88: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2f89d48 "-" chain 89: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2f89da0 "-" chain 90: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2f89df8 "-" chain 91: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2f89e50 "-" chain 92: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b7340 "-" chain 93: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b7440 "-" chain 94: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b7208 "-" chain 95: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003be8450 "crypto_ret_wait" chain 96: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003be83f0 "crypto_ret_wait" chain 97: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003be8390 "crypto_ret_wait" chain 98: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003be8330 "crypto_ret_wait" chain 99: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003be82d0 "crypto_ret_wait" chain 100: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003be8270 "crypto_ret_wait" chain 101: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003be8210 "crypto_ret_wait" chain 102: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003be81b0 "crypto_ret_wait" chain 103: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003be8150 "crypto_ret_wait" chain 104: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003be80f0 "crypto_ret_wait" chain 105: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003be8090 "crypto_ret_wait" chain 106: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003be8030 "crypto_ret_wait" chain 107: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6cae8 "crypto_wait" chain 108: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003abc888 "seqstate" chain 109: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 110: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 111: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 112: thread 100002 (pid 1, init) sleeping on 0xfffff8000394a530 "wait" chain 113: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 114: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8c5f8 "swapin" chain 115: thread 100015 (pid 0, config_0) sleeping on 0xfffff800039a5000 "-" chain 116: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff800039a4e00 "-" chain 117: thread 100019 (pid 0, thread taskq) sleeping on 0xfffff800039a4b00 "-" chain 118: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800039a4900 "-" chain 119: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff800039a4800 "-" chain 120: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff800039a4700 "-" chain 121: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff800039a4600 "-" chain 122: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff800039a4500 "-" chain 123: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff800039a4400 "-" chain 124: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff800039a4300 "-" chain 125: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff800039a4200 "-" chain 126: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff800039a4100 "-" chain 127: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff800039a4000 "-" chain 128: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff800039a3e00 "-" chain 129: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff800039a3d00 "-" chain 130: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff800039a3c00 "-" chain 131: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff800039a3b00 "-" chain 132: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff800039a3a00 "-" chain 133: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff800039a3900 "-" chain 134: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff800039a3800 "-" chain 135: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff800039a3700 "-" chain 136: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff800039a3600 "-" chain 137: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff800039a3500 "-" chain 138: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff800039a3400 "-" chain 139: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff800039a3300 "-" chain 140: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff800039a3200 "-" chain 141: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff800039a3100 "-" chain 142: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff800039a3000 "-" chain 143: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003a88100 "-" chain 144: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a88000 "-" chain 145: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a89e00 "-" chain 146: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a89e00 "-" chain 147: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a89e00 "-" chain 148: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a89e00 "-" chain 149: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a89e00 "-" chain 150: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a89e00 "-" chain 151: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a89e00 "-" chain 152: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a89e00 "-" chain 153: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a89e00 "-" chain 154: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a89e00 "-" chain 155: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a89e00 "-" chain 156: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a89e00 "-" chain 157: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL chain 158: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff800280c5300 "-" chain 159: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff800280c5300 "-" chain 160: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff800280c5300 "-" chain 161: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a89d00 "-" db> (kgdb) tid 0xfffff8014bb2e000 (kgdb) bt #0 sched_switch (td=0xfffff8014bb2e000, flags=) at ../../../kern/sched_ule.c:2148 #1 0xffffffff80bda015 in mi_switch (flags=0x104) at ../../../kern/kern_synch.c:525 #2 0xffffffff80c27ada in sleepq_switch (wchan=0xfffff803ee083cd0, pri=0x54) at ../../../kern/subr_sleepqueue.c:623 #3 0xffffffff80c2813b in sleepq_timedwait (wchan=0xfffff803ee083cd0, pri=0x54) at ../../../kern/subr_sleepqueue.c:705 #4 0xffffffff80bd967c in _sleep (ident=0xfffff803ee083cd0, lock=, priority=, wmesg=0xffffffff8113a841 "softdeps", sbt=0x9fffff470, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:216 #5 0xffffffff80ecd4b6 in softdep_waitidle (mp=0xfffff80389477000, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:1955 #6 0xffffffff80ecd18e in softdep_flushfiles (oldmnt=0xfffff80389477000, flags=0x0, td=0xfffff8014bb2e000) at ../../../ufs/ffs/ffs_softdep.c:2027 #7 0xffffffff80efd097 in ffs_unmount (mp=0xfffff80389477000, mntflags=) at ../../../ufs/ffs/ffs_vfsops.c:1257 #8 0xffffffff80c9e89c in dounmount (mp=, flags=0x8000000, td=0xfffff8014bb2e000) at ../../../kern/vfs_mount.c:1705 #9 0xffffffff80c9e40e in sys_unmount (td=0xfffff8014bb2e000, uap=0xfffff8014bb2e3d0) at ../../../kern/vfs_mount.c:1376 #10 0xffffffff81085a01 in syscallenter (td=0xfffff8014bb2e000) at ../../../amd64/amd64/../../kern/subr_syscall.c:144 #11 amd64_syscall (td=0xfffff8014bb2e000, traced=) at ../../../amd64/amd64/trap.c:1163 #12 #13 0x00000008002de8fa in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffd318 (kgdb) f 5 #5 0xffffffff80ecd4b6 in softdep_waitidle (mp=0xfffff80389477000, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:1955 1955 msleep(&ump->softdep_deps, LOCK_PTR(ump), PVM | PDROP, (kgdb) p *mp $1 = {mnt_mtx = {lock_object = {lo_name = 0xffffffff8110d776 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd66c00}, mtx_lock = 0x0}, mnt_gen = 0x27, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffff80127935028}, mnt_op = 0xffffffff81958960 , mnt_vfc = 0xffffffff81958a80 , mnt_vnodecovered = 0xfffff80028b629c0, mnt_syncer = 0x0, mnt_ref = 0x1, mnt_nvnodelist = {tqh_first = 0x0, tqh_last = 0xfffff80389477060}, mnt_nvnodelistsize = 0x0, mnt_writeopcount = 0x1, mnt_kern_flag = 0x41806144, mnt_flag = 0x100001000, mnt_opt = 0xfffff805b005d460, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20140518, f_type = 0x35, f_flags = 0x100001000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x3dfa5, f_bfree = 0x3d794, f_bavail = 0x38840, f_files = 0x1fffe, f_ffree = 0x1fffb, f_syncwrites = 0x24e5b, f_asyncwrites = 0x12931, f_syncreads = 0x208, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x5e1b0e51, 0xa81ba64e}}, f_charspare = '\000' , f_fstypename = "ufs", '\000' , f_mntfromname = "/dev/md10a", '\000' , f_mntonname = "/mnt", '\000' }, mnt_cred = 0xfffff805fd6da000, mnt_data = 0xfffff80719cc1e00, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xf7b4b91e, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x12594c, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_listmtx = { lock_object = {lo_name = 0xffffffff811986ef "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd73500}, mtx_lock = 0x0}, mnt_activevnodelist = {tqh_first = 0x0, tqh_last = 0xfffff80389477a38}, mnt_activevnodelistsize = 0x0, mnt_tmpfreevnodelist = {tqh_first = 0x0, tqh_last = 0xfffff80389477a50}, mnt_tmpfreevnodelistsize = 0x0, mnt_explock = {lock_object = {lo_name = 0xffffffff811cb58c "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71700}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x0, pcs = {0x0 }}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffff80389477b40}, mnt_vfs_ops = 0x1, mnt_thread_in_ops_pcpu = 0xfffffe00e5603e80, mnt_ref_pcpu = 0xfffffe00e5603e70, mnt_lockref_pcpu = 0xfffffe00e5603e60, mnt_writeopcount_pcpu = 0xfffffe00e5603e50, mnt_rootvnode = 0x0} (kgdb) p *ump $2 = {um_mountp = 0xfffff80389477000, um_dev = 0xfffff800280e9c00, um_cp = 0xfffff8084787ad80, um_bo = 0xfffff8033d4f5168, um_devvp = 0xfffff8033d4f5000, um_fstype = 0x2, um_fs = 0xfffffe00e26f3000, um_extattr = {uepm_lock = {lock_object = { lo_name = 0xffffffff8111a474 "ufs_extattr_sx", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xfffff8087fd73980}, sx_lock = 0x1}, uepm_list = {lh_first = 0x0}, uepm_ucred = 0x0, uepm_flags = 0x1}, um_nindir = 0x1000, um_bptrtodb = 0x3, um_seqinc = 0x8, um_lock = { lock_object = {lo_name = 0xffffffff8112fc04 "FFS", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd73900}, mtx_lock = 0x0}, um_fsckpid = 0x0, um_softdep = 0xfffff803ee083c00, um_quotas = {0x0, 0x0}, um_cred = {0x0, 0x0}, um_btime = {0x0, 0x0}, um_itime = {0x0, 0x0}, um_qflags = "\000", um_savedmaxfilesize = 0x0, um_flags = 0x0, um_last_fullmsg = {tv_sec = 0x0, tv_usec = 0x0}, um_secs_fullmsg = 0x0, um_last_integritymsg = {tv_sec = 0x0, tv_usec = 0x0}, um_secs_integritymsg = 0x0, um_trim_inflight = 0x0, um_trim_inflight_blks = 0x0, um_trim_total = 0x0, um_trim_total_blks = 0x0, um_trim_tq = 0x0, um_trimhash = 0x0, um_trimlisthashsize = 0x0, um_balloc = 0xffffffff80ec2760 , um_blkatoff = 0xffffffff80ef8dc0 , um_truncate = 0xffffffff80ec4660 , um_update = 0xffffffff80ec42f0 , um_valloc = 0xffffffff80ebcef0 , um_vfree = 0xffffffff80ebdd10 , um_ifree = 0xffffffff80efdee0 , um_rdonly = 0xffffffff80ec6290 , um_snapgone = 0xffffffff80ec9e30 , um_check_blkno = 0x0} (kgdb) info loc ump = 0xfffff80719cc1e00 devvp = 0xfffff8033d4f5000 td = 0xfffff8014bb2e000 error = 0x0 i = 0xe (kgdb) p/d ump->um_softdep->sd_deps $3 = 1 (kgdb) p *ump->um_softdep $4 = {sd_fslock = {lock_object = {lo_name = 0xffffffff81224253 "per-fs softdep", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd73c80}, rw_lock = 0x1}, sd_workitem_pending = {lh_first = 0x0}, sd_worklist_tail = 0xfffff803ee083c20, sd_journal_pending = { lh_first = 0x0}, sd_journal_tail = 0xfffff803ee083c30, sd_jblocks = 0xfffff8071c665000, sd_unlinked = {tqh_first = 0xfffff80148f06800, tqh_last = 0xfffff80148f06840}, sd_dirtycg = {lh_first = 0x0}, sd_mkdirlisthd = {lh_first = 0x0}, sd_pdhash = 0xfffffe00e5a22000, sd_pdhashsize = 0xffff, sd_pdnextclean = 0x0, sd_idhash = 0xfffffe00e4800000, sd_idhashsize = 0x7ffff, sd_idnextclean = 0x191bf, sd_newblkhash = 0xfffffe00e4c00000, sd_newblkhashsize = 0xfffff, sd_bmhash = 0xfffffe00e1c76000, sd_bmhashsize = 0x3ff, sd_indirhash = 0xfffff8050d4b31a0, sd_indirhashsize = 0x1, sd_on_journal = 0x0, sd_on_worklist = 0x0, sd_deps = 0x1, sd_accdeps = 0x427931, sd_req = 0x1, sd_flags = 0x0, sd_cleanups = 0x0, sd_flushtd = 0xfffff803b2a9e000, sd_next = {tqe_next = 0x0, tqe_prev = 0xfffff800285510f0}, sd_ump = 0xfffff80719cc1e00, sd_curdeps = {0x0, 0x0, 0x1, 0x0 }} (kgdb) Index: src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- src/sys/ufs/ffs/ffs_softdep.c (revision 356654) +++ src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -9849,14 +9849,20 @@ handle_workitem_remove(dirrem, flags) /* * Move all dependencies waiting on the remove to complete * from the dirrem to the inode inowait list to be completed - * after the inode has been updated and written to disk. Any - * marked MKDIR_PARENT are saved to be completed when the .. ref - * is removed. + * after the inode has been updated and written to disk. + * + * Any marked MKDIR_PARENT are saved to be completed when the + * dotdot ref is removed unless DIRCHG is specified. For + * directory change operations there will be no further + * directory writes and the jsegdeps need to be moved along + * with the rest to be completed when the inode is free or + * stable in the inode free list. */ LIST_INIT(&dotdotwk); while ((wk = LIST_FIRST(&dirrem->dm_jwork)) != NULL) { WORKLIST_REMOVE(wk); - if (wk->wk_state & MKDIR_PARENT) { + if ((dirrem->dm_state & DIRCHG) == 0 && + wk->wk_state & MKDIR_PARENT) { wk->wk_state &= ~MKDIR_PARENT; WORKLIST_INSERT(&dotdotwk, wk); continue; @@ -9864,6 +9870,7 @@ handle_workitem_remove(dirrem, flags) WORKLIST_INSERT(&inodedep->id_inowait, wk); } LIST_SWAP(&dirrem->dm_jwork, &dotdotwk, worklist, wk_list); + /* * Normal file deletion. */ -- Test scenario: misc/suj33.sh