KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r357853M: Thu Feb 13 08:19:46 CET 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.1 (git@github.com:llvm/llvm-project.git c1a0a213378a458fbea1a5c77b315c7dce08fd05) (based on LLVM 9.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33164111872 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 2 11 6 5 4 8 10 7 3 9 Timecounter "TSC-low" frequency 1750034010 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000055 [4341] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80005046800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 13 Feb 11:49:07 ntpdate[2058]: step time server 192.168.5.1 offset 0.243503 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. Feb 13 11:49:08 mercat1 savecore[2157]: reboot after panic: swap_pager_getpages_locked: object not swappable Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800206f6068 ufs (ufs) @ kern/vfs_mount.c:1628 2nd 0xfffff800207357e8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1404 stack backtrace: #0 0xffffffff80c36c81 at witness_debugger+0x71 #1 0xffffffff80c369f6 at witness_checkorder+0xad6 #2 0xffffffff80b9ba08 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80ee72d3 at ffs_flushfiles+0xa3 #6 0xffffffff80ec911d at softdep_flushfiles+0xad #7 0xffffffff80ee9b17 at ffs_unmount+0xd7 #8 0xffffffff80c9b73a at dounmount+0x42a #9 0xffffffff80c9b2b9 at kern_unmount+0x2b9 #10 0xffffffff81074afe at amd64_syscall+0x2ee #11 0xffffffff8104a460 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 299 files, 1265297 used, 110 free (110 frags, 0 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Feb 13 11:49 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Feb 13 11:50:41 mercat1 login[2350]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Feb 13 08:23:08 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r357853M: Thu Feb 13 08:19:46 CET 2020 root@mercat1:~ # Feb 13 11:50:56 mercat1 su[2369]: pho to root on /dev/pts/0 Feb 13 11:55:23 mercat1 kernel: pid 2378 (svnlite), uid 0 inumber 238 on /tmp: filesystem full root@mercat1:~ # swp_pager_getswapspace(32): failed 20200213 12:29:28 all (1/1): swapoff3.sh swp_pager_getswapspace(32): failed freework leak: 12/33. pts leak: 1/2 20200213 12:34:59 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed newblk leak: 36092/36116. 20200213 12:37:12 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 12:39:21 all (1/1): swapoff3.sh swp_pager_getswapspace(2): failed newblk leak: 37257/73373. 20200213 12:44:44 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed newblk leak: 2051/75424. 20200213 12:51:35 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 12:53:47 all (1/1): swapoff3.sh 20200213 12:56:03 all (1/1): swapoff3.sh 20200213 13:00:06 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:04:42 all (1/1): swapoff3.sh 20200213 13:11:52 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:15:23 all (1/1): swapoff3.sh 20200213 13:19:29 all (1/1): swapoff3.sh swp_pager_getswapspace(2): failed 20200213 13:21:46 all (1/1): swapoff3.sh swp_pager_getswapspace(2): failed 20200213 13:24:46 all (1/1): swapoff3.sh swp_pager_getswapspace(2): failed 20200213 13:28:43 all (1/1): swapoff3.sh swp_pager_getswapspace(3): failed 20200213 13:30:47 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:34:29 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:38:48 all (1/1): swapoff3.sh 20200213 13:46:25 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:50:35 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:52:43 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:54:52 all (1/1): swapoff3.sh swp_pager_getswapspace(1): failed 20200213 13:57:16 all (1/1): swapoff3.sh 20200213 14:04:16 all (1/1): swapoff3.sh swap_pager: indefinite wait buffer: bufobj: 0, blkno: 6197173134, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 6197173272, size: 12288 20200213 14:10:32 all (1/1): swapoff3.sh swp_pager_getswapspace(25): failed 20200213 14:14:26 all (1/1): swapoff3.sh swp_pager_getswapspace(32): failed 20200213 14:17:42 all (1/1): swapoff3.sh 20200213 14:20:00 all (1/1): swapoff3.sh swp_pager_getswapspace(3): failed 20200213 14:23:02 all (1/1): swapoff3.sh swp_pager_getswapspace(9): failed 20200213 14:29:46 all.sh done, elapsed 0 day(s), 02:00.18 20200213 14:29:49 all (1/10): md7.sh Feb 13 14:32:53 mercat1 kernel: pid 27093 (mkdir), uid 0 inumber 44738 on /mnt: out of inodes Feb 13 14:36:15 mercat1 kernel: pid 45941 (creat), uid 0 inumber 44811 on /mnt: out of inodes Feb 13 14:36:28 mercat1 kernel: pid 45944 (creat), uid 0 inumber 44865 on /mnt: out of inodes Feb 13 14:36:42 mercat1 kernel: pid 45941 (creat), uid 0 inumber 44811 on /mnt: out of inodes Feb 13 14:36:53 mercat1 kernel: pid 45929 (creat), uid 0 inumber 44841 on /mnt: out of inodes Feb 13 14:37:03 mercat1 kernel: pid 45920 (creat), uid 0 inumber 44853 on /mnt: out of inodes Feb 13 14:37:25 mercat1 kernel: pid 45947 (creat), uid 0 inumber 44830 on /mnt: out of inodes Feb 13 14:37:35 mercat1 kernel: pid 45888 (creat), uid 0 inumber 44818 on /mnt: out of inodes Feb 13 14:37:46 mercat1 kernel: pid 45920 (creat), uid 0 inumber 44853 on /mnt: out of inodes Feb 13 14:37:55 mercat1 kernel: pid 45938 (creat), uid 0 inumber 44852 on /mnt: out of inodes 20200213 14:40:14 all (2/10): oom.sh 20200213 14:40:15 all (3/10): stealer.sh Feb 13 14:40:46 mercat1 kernel: pid 51475 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 14:41:07 mercat1 kernel: pid 51424 (stealer), jid 0, uid 2007, was killed: out of swap space swap_pager: out of swap space swp_pager_getswapspace(19): failed swp_pager_getswapspace(4): failed Feb 13 14:41:34 mercat1 kernel: pid 51459 (stealer), jid 0, uid 2007, was killed: out of swap space swp_pager_getswapspace(32): failed 20200213 14:44:16 all (4/10): swap3.sh 20200213 14:49:24 all (5/10): swap5.sh 20200213 14:58:38 all (6/10): swapoff.sh Feb 13 14:58:49 mercat1 kernel: pid 13808 (rw), uid 2007 inumber 805 on /mnt: filesystem full Feb 13 14:58:51 mercat1 kernel: pid 13805 (rw), uid 2007 inumber 21409 on /mnt: filesystem full Feb 13 14:59:00 mercat1 kernel: pid 13895 (creat), uid 2007 inumber 98353 on /mnt: out of inodes Feb 13 14:59:06 mercat1 kernel: pid 13871 (mkdir), uid 2007 inumber 60218 on /mnt: out of inodes Feb 13 14:59:21 mercat1 kernel: pid 13900 (creat), uid 2007 inumber 98352 on /mnt: out of inodes Feb 13 14:59:32 mercat1 kernel: pid 13895 (creat), uid 2007 inumber 98353 on /mnt: out of inodes Feb 13 14:59:44 mercat1 kernel: pid 13891 (creat), uid 2007 inumber 98351 on /mnt: out of inodes Feb 13 14:59:50 mercat1 kernel: pid 13905 (creat), uid 2007 inumber 98364 on /mnt: out of inodes Feb 13 14:59:56 mercat1 kernel: pid 13900 (creat), uid 2007 inumber 98352 on /mnt: out of inodes Feb 13 15:00:03 mercat1 kernel: pid 13894 (creat), uid 2007 inumber 98361 on /mnt: out of inodes Feb 13 15:00:10 mercat1 kernel: pid 13897 (creat), uid 2007 inumber 98359 on /mnt: out of inodes Feb 13 15:00:17 mercat1 kernel: pid 13890 (creat), uid 2007 inumber 98349 on /mnt: out of inodes Feb 13 15:00:24 mercat1 kernel: pid 13891 (creat), uid 2007 inumber 98351 on /mnt: out of inodes Feb 13 15:00:30 mercat1 kernel: pid 13894 (creat), uid 2007 inumber 98361 on /mnt: out of inodes Feb 13 15:00:39 mercat1 kernel: pid 13905 (creat), uid 2007 inumber 98364 on /mnt: out of inodes 20200213 15:01:15 all (7/10): swapoff3.sh swp_pager_getswapspace(22): failed newblk leak: 8171/59813. 20200213 15:07:34 all (8/10): swapoff4a.sh 20200213 15:08:08 all (9/10): swappedout.sh 20200213 15:08:10 all (10/10): vmio.sh 20200213 15:08:11 all.sh done, elapsed 0 day(s), 00:38.22 20200213 15:08:15 all (1/10): md7.sh Feb 13 15:08:28 mercat1 kernel: pid 44636 (rw), uid 0 inumber 117953 on /mnt: filesystem full Feb 13 15:10:33 mercat1 kernel: pid 48783 (rw), uid 0 inumber 124598 on /mnt: filesystem full Feb 13 15:10:43 mercat1 kernel: pid 48784 (mkdir), uid 0 inumber 44794 on /mnt: out of inodes Feb 13 15:11:10 mercat1 kernel: pid 48773 (rw), uid 0 inumber 132686 on /mnt: filesystem full Feb 13 15:12:38 mercat1 kernel: pid 52671 (creat), uid 0 inumber 89675 on /mnt: out of inodes Feb 13 15:12:43 mercat1 kernel: pid 52598 (symlink), uid 0 inumber 89759 on /mnt: out of inodes Feb 13 15:12:51 mercat1 kernel: pid 52628 (creat), uid 0 inumber 89732 on /mnt: out of inodes Feb 13 15:13:02 mercat1 kernel: pid 52619 (creat), uid 0 inumber 89631 on /mnt: out of inodes Feb 13 15:13:12 mercat1 kernel: pid 52631 (creat), uid 0 inumber 89764 on /mnt: out of inodes Feb 13 15:13:22 mercat1 syslogd: last message repeated 1 times Feb 13 15:13:35 mercat1 kernel: pid 52636 (creat), uid 0 inumber 89756 on /mnt: out of inodes Feb 13 15:13:45 mercat1 kernel: pid 52619 (creat), uid 0 inumber 89631 on /mnt: out of inodes Feb 13 15:13:55 mercat1 kernel: pid 52655 (creat), uid 0 inumber 89664 on /mnt: out of inodes Feb 13 15:14:03 mercat1 kernel: pid 52631 (creat), uid 0 inumber 89764 on /mnt: out of inodes Feb 13 15:14:13 mercat1 kernel: pid 52655 (creat), uid 0 inumber 89664 on /mnt: out of inodes Feb 13 15:14:21 mercat1 syslogd: last message repeated 1 times Feb 13 15:15:19 mercat1 kernel: pid 55858 (mkdir), uid 0 inumber 178906 on /mnt: out of inodes Feb 13 15:16:43 mercat1 kernel: pid 58257 (creat), uid 0 inumber 31 on /mnt: out of inodes Feb 13 15:16:48 mercat1 kernel: pid 58307 (creat), uid 0 inumber 71 on /mnt: out of inodes Feb 13 15:16:53 mercat1 kernel: pid 58263 (creat), uid 0 inumber 16 on /mnt: out of inodes Feb 13 15:17:04 mercat1 kernel: pid 58307 (creat), uid 0 inumber 71 on /mnt: out of inodes Feb 13 15:17:12 mercat1 kernel: pid 58236 (creat), uid 0 inumber 52 on /mnt: out of inodes Feb 13 15:17:26 mercat1 kernel: pid 58267 (creat), uid 0 inumber 38 on /mnt: out of inodes Feb 13 15:17:37 mercat1 kernel: pid 58291 (creat), uid 0 inumber 66 on /mnt: out of inodes Feb 13 15:17:51 mercat1 syslogd: last message repeated 2 times Feb 13 15:17:58 mercat1 kernel: pid 58293 (rw), uid 0 inumber 152712 on /mnt: filesystem full Feb 13 15:18:07 mercat1 kernel: pid 58267 (creat), uid 0 inumber 38 on /mnt: out of inodes Feb 13 15:18:13 mercat1 kernel: pid 58314 (creat), uid 0 inumber 73 on /mnt: out of inodes Feb 13 15:18:19 mercat1 kernel: pid 58241 (creat), uid 0 inumber 33 on /mnt: out of inodes Feb 13 15:18:26 mercat1 kernel: pid 58282 (creat), uid 0 inumber 58 on /mnt: out of inodes Feb 13 15:18:31 mercat1 kernel: pid 58279 (creat), uid 0 inumber 54 on /mnt: out of inodes 20200213 15:18:43 all (2/10): oom.sh 20200213 15:18:44 all (3/10): stealer.sh Feb 13 15:19:02 mercat1 kernel: pid 63369 (stealer), jid 0, uid 2007, was killed: out of swap space swp_pager_getswapspace(9): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(32): failed 20200213 15:25:12 all (4/10): swap3.sh Feb 13 15:27:57 mercat1 kernel: pid 68045 (swap2), jid 0, uid 0, was killed: out of swap space 20200213 15:30:20 all (5/10): swap5.sh 20200213 15:39:36 all (6/10): swapoff.sh Feb 13 15:40:25 mercat1 kernel: pid 33290 (swap), jid 0, uid 2007, was killed: out of swap space Feb 13 15:41:08 mercat1 kernel: pid 33280 (rw), uid 2007 inumber 65716 on /mnt: filesystem full 20200213 15:42:19 all (7/10): swapoff3.sh swp_pager_getswapspace(5): failed freework leak: 12/33. newblk leak: 22358/22383. 20200213 15:48:35 all (8/10): swapoff4a.sh 20200213 15:49:47 all (9/10): swappedout.sh 20200213 15:51:54 all (10/10): vmio.sh 20200213 15:51:55 all.sh done, elapsed 0 day(s), 00:43.40 20200213 15:58:15 all (1/696): 1st.sh 20200213 15:58:16 all (2/696): 256m.sh 20200213 15:58:18 all (3/696): audit.sh 20200213 15:58:19 all (4/696): beneath3.sh 20200213 15:58:21 all (5/696): buildworld.sh 20200213 15:58:22 all (6/696): buildworld2.sh 20200213 15:58:23 all (7/696): cluster.sh newblk leak: 6476/6504. 20200213 16:08:50 all (8/696): cpuset.sh 20200213 16:08:51 all (9/696): crossmp2.sh 20200213 16:08:53 all (10/696): crossmp6.sh 20200213 16:08:54 all (11/696): datagram2.sh 20200213 16:08:56 all (12/696): datagram3.sh 20200213 16:08:57 all (13/696): datamove.sh freework leak: 5/41. 20200213 16:08:59 all (14/696): datamove3.sh 20200213 16:09:00 all (15/696): devfs2.sh 20200213 16:09:02 all (16/696): devfs5.sh 20200213 16:09:03 all (17/696): dtrace_fault.sh 20200213 16:09:04 all (18/696): dumpfs.sh 20200213 16:09:06 all (19/696): dup2.sh 20200213 16:09:08 all (20/696): extattr_set_fd.sh 20200213 16:09:09 all (21/696): extattrctl.sh lock order reversal: 1st 0xfffff80020727a38 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff802c7a9cce8 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1737 stack backtrace: #0 0xffffffff80c36c81 at witness_debugger+0x71 #1 0xffffffff80c369f6 at witness_checkorder+0xad6 #2 0xffffffff80b9bfee at lockmgr_xlock_hard+0x6e #3 0xffffffff80b9cbec at __lockmgr_args+0x62c #4 0xffffffff80ee7531 at ffs_vgetf+0x161 #5 0xffffffff80efa58b at ufs_root+0x1b #6 0xffffffff80ca8c63 at vfs_cache_root_fallback+0x143 #7 0xffffffff80ca8996 at vfs_cache_root+0x1f6 #8 0xffffffff80ef28ff at ufs_extattr_autostart+0x5f #9 0xffffffff80ee990e at ffs_mount+0x1c3e #10 0xffffffff80c9a487 at vfs_domount+0x847 #11 0xffffffff80c98e31 at vfs_donmount+0x911 #12 0xffffffff80c984e9 at sys_nmount+0x69 #13 0xffffffff81074afe at amd64_syscall+0x2ee #14 0xffffffff8104a460 at fast_syscall_common+0x101 20200213 16:09:11 all (22/696): fcntl3.sh 20200213 16:09:12 all (23/696): fexecve.sh 20200213 16:09:13 all (24/696): fifo.sh 20200213 16:09:15 all (25/696): forkbomb.sh 20200213 16:09:16 all (26/696): fsck2.sh 20200213 16:09:18 all (27/696): fsck3.sh 20200213 16:09:19 all (28/696): fsck4.sh 20200213 16:09:21 all (29/696): getrandom.sh 20200213 16:09:23 all (30/696): gnop3.sh 20200213 16:09:24 all (31/696): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200213 16:09:26 all (32/696): holdcnt0.sh 20200213 16:09:27 all (33/696): holdcnt02.sh 20200213 16:09:29 all (34/696): holdcnt03.sh 20200213 16:09:30 all (35/696): holdcnt04.sh 20200213 16:09:31 all (36/696): holdcnt05.sh 20200213 16:09:33 all (37/696): isofs2.sh 20200213 16:09:34 all (38/696): jail.sh 20200213 16:09:36 all (39/696): jail2.sh 20200213 16:09:37 all (40/696): jail3.sh 20200213 16:09:39 all (41/696): jail4.sh 20200213 16:09:40 all (42/696): kern_umtx_inf_loop.sh 20200213 16:09:42 all (43/696): kevent10.sh 20200213 16:09:43 all (44/696): kevent3.sh 20200213 16:09:45 all (45/696): ldt.sh 20200213 16:09:47 all (46/696): ldt2.sh 20200213 16:09:48 all (47/696): libMicro.sh 20200213 16:09:49 all (48/696): linux.sh 20200213 16:09:51 all (49/696): lockd.sh 20200213 16:09:52 all (50/696): lockf.sh 20200213 16:09:53 all (51/696): lookup_shared.sh 20200213 16:09:55 all (52/696): mac.sh 20200213 16:09:56 all (53/696): mac_chkexec.sh 20200213 16:09:58 all (54/696): machipc.sh 20200213 16:09:59 all (55/696): machipc2.sh 20200213 16:10:00 all (56/696): maxmemdom.sh 20200213 16:10:02 all (57/696): maxproc.sh 20200213 16:10:03 all (58/696): md4.sh 20200213 16:10:05 all (59/696): md5.sh 20200213 16:10:06 all (60/696): md6.sh 20200213 16:10:08 all (61/696): mdconfig.sh 20200213 16:10:09 all (62/696): mdconfig3.sh 20200213 16:10:11 all (63/696): memguard4.sh 20200213 16:10:12 all (64/696): mkfifo5.sh 20200213 16:10:14 all (65/696): mkfifo7.sh mount leak: 16/47 20200213 16:10:15 all (66/696): mlockall5.sh 20200213 16:10:17 all (67/696): mmap.sh 20200213 16:10:18 all (68/696): mmap12.sh 20200213 16:10:20 all (69/696): mmap16.sh 20200213 16:10:21 all (70/696): mmap17.sh 20200213 16:10:22 all (71/696): mmap20.sh 20200213 16:10:24 all (72/696): mmap24.sh 20200213 16:10:26 all (73/696): mmap30.sh 20200213 16:10:27 all (74/696): mmap33.sh 20200213 16:10:28 all (75/696): mmap35.sh 20200213 16:10:30 all (76/696): mmap36.sh 20200213 16:10:31 all (77/696): mount.sh 20200213 16:10:33 all (78/696): mountro3.sh 20200213 16:10:34 all (79/696): mprotect.sh 20200213 16:10:36 all (80/696): msdos2.sh 20200213 16:10:37 all (81/696): msdos3.sh 20200213 16:10:39 all (82/696): msdos7.sh lock order reversal: 1st 0xfffff8000eedc568 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3431 2nd 0xfffff80331098a68 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c36c81 at witness_debugger+0x71 #1 0xffffffff80c369f6 at witness_checkorder+0xad6 #2 0xffffffff80b9ba08 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80a82349 at msdosfs_fsync+0x49 #6 0xffffffff810f0b59 at VOP_FSYNC_APV+0x59 #7 0xffffffff80cb5526 at kern_fsync+0x196 #8 0xffffffff81074afe at amd64_syscall+0x2ee #9 0xffffffff8104a460 at fast_syscall_common+0x101 20200213 16:10:40 all (83/696): msdos8.sh 20200213 16:10:42 all (84/696): msetdomain.sh 20200213 16:10:43 all (85/696): nanosleep.sh 20200213 16:10:45 all (86/696): nbufkv.sh root@mercat1:~ # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x101: movq $0,0x108547c(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1650 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffffe003e3e4300 kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add72830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add72840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add72870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add728b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add72900 intr_execute_handlers() at intr_execute_handlers+0x6a/frame 0xfffffe00add72940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add72960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add72960 --- interrupt, rip = 0xffffffff81032d36, rsp = 0xfffffe00add72a30, rbp = 0xfffffe00add72a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add72a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add72a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add72ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x975d80 curthread = 0xfffffe003e3e4300: pid 11 tid 100003 critnest 2 "idle: cpu0" curpcb = 0xfffffe003e3e4800 fpcurthread = none idlethread = 0xfffffe003e3e4300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00add72cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x7eb8dec1d gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f6d80 curthread = 0xfffffe003e3e3c00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe003e3e4100 fpcurthread = none idlethread = 0xfffffe003e3e3c00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00add77cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x30732ac91 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 71719570 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc802d80 curthread = 0xfffffe003e3e3500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe003e3e3a00 fpcurthread = none idlethread = 0xfffffe003e3e3500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00add7ccc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x5240d0d4c gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80ed80 curthread = 0xfffffe003e3e2e00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe003e3e3300 fpcurthread = none idlethread = 0xfffffe003e3e2e00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00add81cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x3708b6d0e gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc81ad80 curthread = 0xfffffe003e3e2700: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe003e3e2c00 fpcurthread = none idlethread = 0xfffffe003e3e2700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00add86cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x30732a9da gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc826d80 curthread = 0xfffffe003e3e2000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe003e3e2500 fpcurthread = none idlethread = 0xfffffe003e3e2000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82415384 rsp0 = 0xfffffe00add8bcc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x5076fe97f gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc832d80 curthread = 0xfffffe003e3eca00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe003e3ecf00 fpcurthread = none idlethread = 0xfffffe003e3eca00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add90cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x2d456690f gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83ed80 curthread = 0xfffffe003e3ec300: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe003e3ec800 fpcurthread = none idlethread = 0xfffffe003e3ec300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00add95cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x37c761be5 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc84ad80 curthread = 0xfffffe003e3ebc00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe003e3ec100 fpcurthread = none idlethread = 0xfffffe003e3ebc00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00add9acc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x53d55ef01 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc856d80 curthread = 0xfffffe003e3eb500: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe003e3eba00 fpcurthread = none idlethread = 0xfffffe003e3eb500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00add9fcc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x120ae496b gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc862d80 curthread = 0xfffffe003e3eae00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe003e3eb300 fpcurthread = none idlethread = 0xfffffe003e3eae00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00adda4cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x481430dc3 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 71719571 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86ed80 curthread = 0xfffffe003e3ea700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe003e3eac00 fpcurthread = none idlethread = 0xfffffe003e3ea700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00adda9cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x18c50bc4 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 71719571 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 54479 (grep) thread 0xfffffe00d3dfba00 (100732) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8000eedc568) locked @ kern/vfs_vnops.c:877 Process 54470 (sh) thread 0xfffffe00d35e7a00 (100822) shared lockmgr ufs (ufs) r = 0 (0xfffff80020330568) locked @ kern/vfs_lookup.c:751 Process 54462 (sh) thread 0xfffffe00e6de7100 (100311) shared lockmgr ufs (ufs) r = 0 (0xfffff80020330568) locked @ kern/vfs_lookup.c:751 Process 54461 (newsyslog) thread 0xfffffe00e6dea300 (100314) shared lockmgr ufs (ufs) r = 0 (0xfffff800206b47e8) locked @ kern/vfs_vnops.c:801 Process 54455 (sh) thread 0xfffffe00e7cbee00 (100902) shared lockmgr ufs (ufs) r = 0 (0xfffff80020330568) locked @ kern/vfs_lookup.c:751 Process 54447 (sh) thread 0xfffffe00d3df9e00 (100151) shared lockmgr ufs (ufs) r = 0 (0xfffff80020330568) locked @ kern/vfs_lookup.c:751 Process 54441 (dd) thread 0xfffffe00e7ca3100 (100883) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e26492e8) locked @ kern/vfs_vnops.c:877 Process 54425 (sh) thread 0xfffffe00e817c800 (100875) shared lockmgr ufs (ufs) r = 0 (0xfffff8002c1c4ce8) locked @ kern/vfs_vnops.c:801 Process 54418 (ls) thread 0xfffffe00e7638e00 (100789) shared lockmgr ufs (ufs) r = 0 (0xfffff80472a39068) locked @ kern/vfs_lookup.c:751 Process 54415 (sed) thread 0xfffffe00dd1ddc00 (100237) shared lockmgr ufs (ufs) r = 0 (0xfffff804e27567e8) locked @ kern/vfs_vnops.c:801 Process 54414 (sed) thread 0xfffffe00e763f800 (100784) shared lockmgr ufs (ufs) r = 0 (0xfffff804e27567e8) locked @ kern/vfs_vnops.c:801 Process 52161 (nbufkv) thread 0xfffffe00d35e6500 (100827) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038c9b850) locked @ kern/vfs_bio.c:3488 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a40efa0) locked @ kern/vfs_bio.c:3885 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8001b692568) locked @ kern/vfs_vnops.c:877 Process 52152 (md10) thread 0xfffffe00dd1dc000 (100262) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8042d240568) locked @ dev/md/md.c:992 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffff80020558880) locked @ vm/vm_pager.c:391 Process 33 (syncer) thread 0xfffffe00d3df3300 (100140) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a357eb0) locked @ kern/vfs_bio.c:1663 exclusive lockmgr syncer (syncer) r = 0 (0xfffff804dcabcce8) locked @ kern/vfs_subr.c:2466 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80020330500: type VDIR usecount 10, writecount 0, refcount 4 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80020ba4318 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 4) #0 0xffffffff80b9be94 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9cd58 at __lockmgr_args+0x798 #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80c96481 at lookup+0xe1 #6 0xffffffff80c95e19 at namei+0x579 #7 0xffffffff80cb2a4f at kern_statat+0x7f #8 0xffffffff80cb320f at sys_fstatat+0x2f #9 0xffffffff81074afe at amd64_syscall+0x2ee #10 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=45ed3519, uid=2, gid=5, flags=0x0 ino 7704605, on dev gpt/work vnode 0xfffff8002c1c4c80: type VREG usecount 1, writecount 0, refcount 2 flags (VMP_LAZYLIST) v_object 0xfffff80020c8f948 ref 0 pages 6 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b9be94 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9cd58 at __lockmgr_args+0x798 #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80cbd747 at vn_read+0x107 #6 0xffffffff80cbd593 at vn_io_fault_doio+0x43 #7 0xffffffff80cb9fbc at vn_io_fault1+0x16c #8 0xffffffff80cb7cd2 at vn_io_fault+0x182 #9 0xffffffff80c3af71 at dofileread+0x81 #10 0xffffffff80c3abb9 at kern_readv+0x49 #11 0xffffffff80c3ab63 at sys_read+0x83 #12 0xffffffff81074afe at amd64_syscall+0x2ee #13 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=22087, extsize 0 generation=c6b16738, uid=0, gid=0, flags=0x0 ino 90528916, on dev gpt/work vnode 0xfffff800206b4780: type VREG usecount 1, writecount 0, refcount 1 flags () v_object 0xfffff80020bbec60 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b9be94 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9cd58 at __lockmgr_args+0x798 #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80cbd747 at vn_read+0x107 #6 0xffffffff80cbd593 at vn_io_fault_doio+0x43 #7 0xffffffff80cb9fbc at vn_io_fault1+0x16c #8 0xffffffff80cb7cd2 at vn_io_fault+0x182 #9 0xffffffff80c3af71 at dofileread+0x81 #10 0xffffffff80c3abb9 at kern_readv+0x49 #11 0xffffffff80c3ab63 at sys_read+0x83 #12 0xffffffff81074afe at amd64_syscall+0x2ee #13 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=141, extsize 0 generation=b9a2f731, uid=0, gid=0, flags=0x0 ino 75601220, on dev gpt/work vnode 0xfffff804e2756780: type VREG usecount 2, writecount 0, refcount 2 flags (VMP_LAZYLIST) v_object 0xfffff803582cae70 ref 0 pages 1 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 2) #0 0xffffffff80b9be94 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9cd58 at __lockmgr_args+0x798 #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80cbd747 at vn_read+0x107 #6 0xffffffff80cbd593 at vn_io_fault_doio+0x43 #7 0xffffffff80cb9fbc at vn_io_fault1+0x16c #8 0xffffffff80cb7cd2 at vn_io_fault+0x182 #9 0xffffffff80c3af71 at dofileread+0x81 #10 0xffffffff80c3abb9 at kern_readv+0x49 #11 0xffffffff80c3ab63 at sys_read+0x83 #12 0xffffffff81074afe at amd64_syscall+0x2ee #13 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=377, extsize 0 generation=6eb76bdf, uid=0, gid=0, flags=0x0 ino 52247814, on dev gpt/work vnode 0xfffff804e2649280: type VREG usecount 5, writecount 1, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff80351af8a50 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e7ca3100 (pid 54441, dd, tid 100883) with shared waiters pending #0 0xffffffff80b9c38a at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cbec at __lockmgr_args+0x62c #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80cbdafc at vn_write+0x1cc #6 0xffffffff80cbd593 at vn_io_fault_doio+0x43 #7 0xffffffff80cb9fbc at vn_io_fault1+0x16c #8 0xffffffff80cb7cd2 at vn_io_fault+0x182 #9 0xffffffff80c3b511 at dofilewrite+0x81 #10 0xffffffff80c3b159 at kern_writev+0x49 #11 0xffffffff80c3b103 at sys_write+0x83 #12 0xffffffff81074afe at amd64_syscall+0x2ee #13 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=0, extsize 0 generation=a894135, uid=2, gid=5, flags=0x1 ino 7704723, on dev gpt/work vnode 0xfffff8042d240500: type VREG usecount 1, writecount 1, refcount 2 flags (VV_MD|VMP_LAZYLIST) v_object 0xfffff8065b64d108 ref 0 pages 3740796 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00dd1dc000 (pid 52152, md10, tid 100262) #0 0xffffffff80b9c38a at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cbec at __lockmgr_args+0x62c #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff806ec9bf at mdstart_vnode+0x3af #6 0xffffffff806ea80c at md_kthread+0x20c #7 0xffffffff80b87170 at fork_exit+0x80 #8 0xffffffff8104ab7e at fork_trampoline+0xe nlink=1, effnlink=1, size=21474836480, extsize 0 generation=867cfa3a, uid=0, gid=0, flags=0x0 ino 7704764, on dev gpt/work vnode 0xfffff8000eedc500: type VREG usecount 1, writecount 1, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff807cd628630 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00d3dfba00 (pid 54479, grep, tid 100732) #0 0xffffffff80b9c38a at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cbec at __lockmgr_args+0x62c #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80cbdafc at vn_write+0x1cc #6 0xffffffff80cbd593 at vn_io_fault_doio+0x43 #7 0xffffffff80cb9fbc at vn_io_fault1+0x16c #8 0xffffffff80cb7cd2 at vn_io_fault+0x182 #9 0xffffffff80c3b511 at dofilewrite+0x81 #10 0xffffffff80c3b159 at kern_writev+0x49 #11 0xffffffff80c3b103 at sys_write+0x83 #12 0xffffffff81074afe at amd64_syscall+0x2ee #13 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=0, extsize 0 generation=7c5f50ff, uid=0, gid=0, flags=0x0 ino 101, on dev gpt/tmp vnode 0xfffff80472a39000: type VDIR usecount 4, writecount 0, refcount 4 mountedhere 0 flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff803ce46bd68 ref 0 pages 16 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b9be94 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9cd58 at __lockmgr_args+0x798 #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80c96481 at lookup+0xe1 #6 0xffffffff80c95e19 at namei+0x579 #7 0xffffffff80cb2a4f at kern_statat+0x7f #8 0xffffffff80cb320f at sys_fstatat+0x2f #9 0xffffffff81074afe at amd64_syscall+0x2ee #10 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=d2f2efe7, uid=0, gid=0, flags=0x0 ino 2, on dev md10a vnode 0xfffff8001b692500: type VREG usecount 2, writecount 1, refcount 3780 flags (VMP_LAZYLIST) v_object 0xfffff8065bf70000 ref 0 pages 90336 cleanbuf 252 dirtybuf 3526 lock type ufs: EXCL by thread 0xfffffe00d35e6500 (pid 52161, nbufkv, tid 100827) with shared waiters pending #0 0xffffffff80b9c38a at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cbec at __lockmgr_args+0x62c #2 0xffffffff80eebcbc at ffs_lock+0x7c #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80cbdafc at vn_write+0x1cc #6 0xffffffff80cbd593 at vn_io_fault_doio+0x43 #7 0xffffffff80cb9fbc at vn_io_fault1+0x16c #8 0xffffffff80cb7cd2 at vn_io_fault+0x182 #9 0xffffffff80c3b511 at dofilewrite+0x81 #10 0xffffffff80c3b159 at kern_writev+0x49 #11 0xffffffff80c3b103 at sys_write+0x83 #12 0xffffffff81074afe at amd64_syscall+0x2ee #13 0xffffffff8104a460 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=21474836480, extsize 0 generation=58cf98de, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode 0xfffff804dcabcc80: type VNON usecount 1, writecount 0, refcount 2 flags () lock type syncer: EXCL by thread 0xfffffe00d3df3300 (pid 33, syncer, tid 100140) #0 0xffffffff80b9ba70 at lockmgr_lock_fast_path+0x1e0 #1 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #2 0xffffffff80cb9804 at _vn_lock+0x54 #3 0xffffffff80cabc34 at sched_sync+0x3c4 #4 0xffffffff80b87170 at fork_exit+0x80 #5 0xffffffff8104ab7e at fork_trampoline+0xe db:1:pho1> show mount 0xfffffe00d3def700 /dev/gpt/work on / (ufs) 0xfffffe00d3df0280 devfs on /dev (devfs) 0xfffffe00e549d280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e549c700 /dev/md10a on /mnt (ufs) 0xfffffe00e81cd700 /dev/md11a on /mnt2 (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 89956 Buf domain 0 freebufs 15098 lofreebufs 219 hifreebufs 329 bufspace 1011712 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 19 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1 (4096) dirtyq count 19 (622592) wakeup 0 lim 25 CPU 2, 0, 0, 3, 1, 4, 1, 0, 0, 1, 1, 0, Locked buffers: 2 space 65536 Total buffers: 4529 space 1011712 Buf domain 1 freebufs 15013 lofreebufs 219 hifreebufs 329 bufspace 2854912 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 31 (827392) dirtyq count 0 (0) wakeup 0 lim 25 CPU 14, 15, 8, 0, 3, 5, 0, 5, 10, 3, 13, 13, Locked buffers: 0 space 0 Total buffers: 123 space 2854912 Buf domain 2 freebufs 15050 lofreebufs 219 hifreebufs 329 bufspace 1728512 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 26 (782336) dirtyq count 1 (8192) wakeup 0 lim 25 CPU 2, 10, 5, 3, 2, 14, 1, 3, 2, 5, 3, 6, Locked buffers: 0 space 0 Total buffers: 43552 space 1728512 Buf domain 3 freebufs 14768 lofreebufs 219 hifreebufs 329 bufspace 10985472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 201 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 63 (1540096) dirtyq count 201 (6557696) wakeup 0 lim 25 CPU 0, 5, 11, 14, 0, 19, 18, 3, 14, 0, 6, 11, Locked buffers: 0 space 0 Total buffers: 365 space 10985472 Buf domain 4 freebufs 11349 lofreebufs 219 hifreebufs 329 bufspace 247930880 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3531 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 3783 (247922688) wakeup 1 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 254 space 16588800 Total buffers: 41719 space 247930880 Buf domain 5 freebufs 14928 lofreebufs 219 hifreebufs 329 bufspace 5378048 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 139 (4169728) dirtyq count 2 (36864) wakeup 0 lim 25 CPU 3, 8, 0, 2, 1, 22, 5, 2, 3, 3, 1, 14, Locked buffers: 0 space 0 Total buffers: 207 space 5378048 Buf domain 6 freebufs 7943 lofreebufs 219 hifreebufs 329 bufspace 235405312 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 7 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7065 (231264256) dirtyq count 7 (368640) wakeup 0 lim 25 CPU 5, 19, 15, 0, 0, 16, 19, 6, 19, 7, 11, 1, Locked buffers: 2 space 73728 Total buffers: 15436 space 235405312 db:1:pho1> show page vm_cnt.v_free_count: 300240 vm_cnt.v_inactive_count: 7500536 vm_cnt.v_active_count: 3178 vm_cnt.v_laundry_count: 9536 vm_cnt.v_wire_count: 308937 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 300240 dom 0 page_cnt 8124099 free 300240 pq_act 3178 pq_inact 7500536 pq_laund 9536 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000019 | 000001 10 (004096K) | 000001 | 000001 09 (002048K) | 000001 | 000000 08 (001024K) | 000036 | 000048 07 (000512K) | 000092 | 000035 06 (000256K) | 001028 | 000075 05 (000128K) | 000480 | 000082 04 (000064K) | 000558 | 000152 03 (000032K) | 000595 | 000262 02 (000016K) | 000708 | 000459 01 (000008K) | 000421 | 001013 00 (000004K) | 000001 | 001644 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree RADIX NODE 144 517721 10041 59625252 0 62 75997728 0 256 256 9034 174401 84916571 0 62 46959360 0 VM OBJECT 264 40303 131162 25646196 0 30 45266760 0 VNODE 640 59876 196 19172701 0 16 38446080 0 mbuf_cluster 2048 15626 68 341341 0 8 32141312 0 FFS2 dinode 256 59689 686 19172148 0 62 15456000 0 BUF TRIE 144 876 105076 19839402 0 62 15257088 0 swblk 136 0 105357 5566968 0 62 14328552 0 FFS inode 160 59689 711 19172159 0 62 9664000 0 L VFS Cache 328 16831 149 17039 0 30 5569440 0 256 Bucket 2048 602 2062 15726628 0 82 5455872 0 mbuf 256 16603 3546 767147 0 254 5158144 0 S VFS Cache 108 45690 1506 11287242 0 126 5097168 0 64 Bucket 512 2904 3848 3485554 0 200 3457024 0 socket 904 53 2998 7182 0 16 2758104 0 g_bio 408 508 6062 133173899 0 30 2680560 0 128 128 14412 1522 63259719 0 126 2039552 0 UMA Slabs 0 112 12846 3006 2393829 0 126 1775424 0 swpctrie 144 0 11340 521795 0 62 1632960 0 32768 32768 9 40 5293 0 1 1605632 0 128 128 10902 1436 520990883 0 126 1579264 0 4096 4096 348 25 719258 0 2 1527808 0 32768 32768 24 19 8556957 0 1 1409024 0 16384 16384 25 52 486222 0 1 1261568 0 vmem btag 56 13013 8421 57575 0 254 1200304 0 THREAD 1776 506 115 1562 0 8 1102896 0 65536 65536 3 13 3394 0 1 1048576 0 mbuf_packet 256 27 3314 625058 0 254 855296 0 pbuf 984 0 821 0 0 0 807864 0 8192 8192 98 0 98 0 1 802816 0 VMSPACE 2536 66 249 853739 0 4 798840 0 64 64 9304 3044 366907254 0 254 790272 0 64 64 9028 2816 1068229 0 254 758016 0 4096 4096 160 22 944134 0 2 745472 0 MAP ENTRY 96 2582 4852 117710355 0 126 713664 0 16384 16384 37 0 37 0 1 606208 0 128 Bucket 1024 311 221 16033530 0 16 544768 0 PROC 1328 101 295 853880 0 8 525888 0 128 128 2282 1345 977339 0 126 464256 0 2048 2048 28 180 27985926 0 8 425984 0 8192 8192 26 24 610235 0 1 409600 0 32 Bucket 256 162 1412 8233830 0 62 402944 0 64 64 3456 2529 267758024 0 254 383040 0 1024 1024 152 188 402 0 16 348160 0 256 256 263 1057 3452359 0 62 337920 0 ksiginfo 112 364 2552 24638 0 126 326592 0 32 32 6987 3093 134199 0 254 322560 0 512 512 510 90 2698 0 30 307200 0 filedesc0 1104 102 157 853881 0 8 285936 0 128 128 713 1519 2786741 0 126 285696 0 pipe 760 24 321 448681 0 16 262200 0 65536 65536 4 0 4 0 1 262144 0 64 64 224 3807 134267 0 254 257984 0 512 512 31 465 24433090 0 30 253952 0 16 16 13965 1535 86739 0 254 248000 0 256 256 218 742 675 0 62 245760 0 1024 1024 36 192 1766800 0 16 233472 0 256 256 21 879 5517400 0 62 230400 0 512 512 78 362 1738802 0 30 225280 0 256 256 122 733 464389 0 62 218880 0 64 64 287 3052 867332 0 254 213696 0 NAMEI 1024 5 203 165163851 0 16 212992 0 2048 2048 88 16 248 0 8 212992 0 512 512 352 64 112464 0 30 212992 0 64 64 215 3061 858622 0 254 209664 0 1024 1024 11 193 612 0 16 208896 0 selfd 64 166 3047 2787926 0 254 205632 0 1024 1024 5 195 1032 0 16 204800 0 Files 80 179 2371 18718547 0 126 204000 0 256 256 37 758 18186711 0 62 203520 0 16 Bucket 144 492 879 2807745 0 62 197424 0 DIRHASH 1024 19 173 718248 0 16 196608 0 16384 16384 0 12 171 0 1 196608 0 UMA Zones 2176 88 1 90 0 4 193664 0 512 512 15 361 666 0 30 192512 0 udp_inpcb 488 20 364 1655 0 30 187392 0 128 128 176 1281 5064652 0 126 186496 0 4 Bucket 48 108 3672 1592858 0 254 181440 0 256 256 15 690 625281 0 62 180480 0 4096 4096 21 23 2478 0 2 180224 0 1024 1024 0 176 34 0 16 180224 0 128 128 113 1282 1396 0 126 178560 0 512 512 0 336 635 0 30 172032 0 128 128 59 1274 308 0 126 170624 0 2048 2048 2 80 10188 0 8 167936 0 unpcb 256 20 625 5415 0 62 165120 0 fakepg 104 0 1521 621 0 126 158184 0 8 Bucket 80 135 1764 1786268 0 126 151920 0 TURNSTILE 136 622 428 622 0 62 142800 0 65536 65536 2 0 2 0 1 131072 0 128 128 8 1015 2761633 0 126 130944 0 rl_entry 40 376 2755 376 0 254 125240 0 KNOTE 160 0 750 3102 0 62 120000 0 32 32 574 3080 283942 0 254 116928 0 2 Bucket 32 355 3299 2316147 0 254 116928 0 clpbuf 984 0 112 3349444 0 4 110208 0 Mountpoints 2944 5 31 50 0 4 105984 0 32 32 157 3119 384485 0 254 104832 0 SLEEPQUEUE 88 622 562 622 0 126 104192 0 4096 4096 1 24 2063 0 2 102400 0 4096 4096 1 24 165 0 2 102400 0 udpcb 32 20 3130 1655 0 254 100800 0 32 32 236 2914 2121 0 254 100800 0 32 32 71 3079 3192 0 254 100800 0 8192 8192 3 9 188 0 1 98304 0 32 32 185 2839 316069 0 254 96768 0 ttyinq 160 345 205 555 0 62 88000 0 256 256 112 218 643 0 62 84480 0 16384 16384 5 0 5 0 1 81920 0 ttyoutq 256 181 134 290 0 62 80640 0 1024 1024 50 26 1505 0 16 77824 0 FFS1 dinode 128 0 527 11 0 126 67456 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 rentr 24 0 2672 75 0 254 64128 0 16 16 472 3278 1521517 0 254 60000 0 8192 8192 7 0 7 0 1 57344 0 512 512 33 79 33 0 30 57344 0 16 16 465 3035 232188 0 254 56000 0 16 16 435 3065 268449 0 254 56000 0 1024 1024 36 16 36 0 16 53248 0 16 16 35 3215 2820690 0 254 52000 0 16 16 19 3231 150 0 254 52000 0 2048 2048 9 15 42 0 8 49152 0 swrbuf 984 0 46 2065405 14 4 45264 0 4096 4096 8 3 9 0 2 45056 0 mt_stats_zone 64 433 271 433 0 254 45056 0 TMPFS node 232 0 187 4 0 62 43384 0 procdesc 136 1 318 36 0 62 43384 0 cpuset 104 27 376 27 0 126 41912 0 64 pcpu 8 3110 2010 3500 0 254 40960 0 TMPFS dirent 64 0 567 2 0 254 36288 0 32 32 8 1126 32869 0 254 36288 0 16384 16384 1 1 2 0 1 32768 0 8192 8192 4 0 4 0 1 32768 0 UMA Kegs 384 77 8 79 0 30 32640 0 tcpcb 1008 10 18 41 0 16 28224 0 KMAP ENTRY 96 18 273 21 0 126 27936 0 rtentry 208 12 121 15 0 62 27664 0 8192 8192 0 3 3 0 1 24576 0 16 16 17 1483 18 0 254 24000 0 swwbuf 984 0 24 3228111 0 2 23616 0 64 64 0 315 9 0 254 20160 0 64 64 9 306 18 0 254 20160 0 mt_zone 24 433 402 433 0 254 20040 0 tcp_inpcb 488 10 30 41 0 30 19520 0 16384 16384 0 1 1 0 1 16384 0 4096 4096 4 0 4 0 2 16384 0 32 32 12 492 13 0 254 16128 0 ripcb 488 1 31 9 0 30 15616 0 MAP 216 2 69 2 0 62 15336 0 2048 2048 3 3 8 0 8 12288 0 1024 1024 8 4 8 0 16 12288 0 umtx pi 96 0 126 1 0 126 12096 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 2 2 2 0 8 8192 0 int pcpu 4 146 1902 146 0 254 8192 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 1 0 2 4096 0 2048 2048 2 0 2 0 8 4096 0 2048 2048 1 1 1 0 8 4096 0 UMA Slabs 1 176 12 9 12 0 62 3696 0 vmem 1856 0 1 0 0 8 1856 0 mdpbuf 984 1 0 4872173 0 0 984 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 4 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 0 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 96 0 0 1 0 126 0 0 syncache 168 0 0 2 0 62 0 0 tcptw 88 0 0 20 0 126 0 0 ipq 56 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 744 0 0 173 0 16 0 0 LTS VFS Cache 368 0 0 18 0 30 0 0 STS VFS Cache 148 0 0 479 0 62 0 0 VNODEPOLL 120 0 0 0 0 126 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 24 0 0 0 0 254 0 0 cryptodesc 120 0 0 0 0 126 0 0 cryptop 128 0 0 0 0 126 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_extpgs 256 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 4 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 984 0 0 0 0 16 0 0 nfspbuf 984 0 0 0 0 4 0 0 umtx_shm 88 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 512 512 0 0 0 0 30 0 0 16 16 0 0 4 0 254 0 0 SMR CPU 24 0 0 0 0 254 0 0 SMR SHARED 16 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 379 19 1435 1 vm pgcache 4096 78664 19 28380458 2 vm pgcache 4096 7634744 1633 440656237 177 buf free cache 984 11782 4193 29341487 16 buffer arena-65 65536 14 23 55282 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 95 22 2661962 2 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 2 23 1218 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e4300 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add72830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add72840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add72870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add728b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add72900 intr_execute_handlers() at intr_execute_handlers+0x6a/frame 0xfffffe00add72940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add72960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add72960 --- interrupt, rip = 0xffffffff81032d36, rsp = 0xfffffe00add72a30, rbp = 0xfffffe00add72a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add72a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add72a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add72ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3e3c00 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x56/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add77a30, rbp = 0xfffffe00add77a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add77a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add77a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add77ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3e3500 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x56/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add7ca30, rbp = 0xfffffe00add7ca30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ca30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ca90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7cab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3e2e00 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x56/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add81a30, rbp = 0xfffffe00add81a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add81a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add81a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add81ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3e2700 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x56/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add86a30, rbp = 0xfffffe00add86a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add86a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add86a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add86ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3e2000 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x56/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add8ba30, rbp = 0xfffffe00add8ba30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add8ba30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add8ba90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add8bab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3eca00 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x56/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add90a30, rbp = 0xfffffe00add90a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add90a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add90a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add90ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3ec300 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x56/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add95a30, rbp = 0xfffffe00add95a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add95a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add95a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add95ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3ebc00 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x56/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add9aa30, rbp = 0xfffffe00add9aa30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9aa30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9aa90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9aab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3eb500 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x56/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add9fa30, rbp = 0xfffffe00add9fa30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9fa30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9fa90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9fab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3eae00 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x56/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda4a30, rbp = 0xfffffe00adda4a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda4a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda4a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda4ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3ea700 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1f7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1f7df0 trap() at trap+0x56/frame 0xfffffe003e1f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f7f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda9a30, rbp = 0xfffffe00adda9a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda9a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda9a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda9ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 54479 54477 54477 0 D+ newbuf 0xffffffff8182b438 grep 54477 2371 54477 0 S+ wait 0xfffff80043453000 sh 54470 54469 54470 2 Ds ufs 0xfffff804e26492e8 sh 54469 2295 2295 0 S piperd 0xfffff806117fa2f8 cron 54462 54459 54462 2 Ds ufs 0xfffff804e26492e8 sh 54461 54458 54461 0 Ds newbuf 0xffffffff8182b438 newsyslog 54459 2295 2295 0 S piperd 0xfffff802766e6be0 cron 54458 2295 2295 0 S piperd 0xfffff802527a88e8 cron 54455 54453 54455 2 Ds ufs 0xfffff804e26492e8 sh 54453 2295 2295 0 S piperd 0xfffff804a0d0cbe0 cron 54447 54446 54447 2 Ds ufs 0xfffff804e26492e8 sh 54446 2295 2295 0 S piperd 0xfffff804a0d182f8 cron 54441 54438 54438 2 D newbuf 0xffffffff8182b438 dd 54438 54437 54438 2 Ss wait 0xfffff8028698b530 sh 54437 2295 2295 0 S piperd 0xfffff804ac5a2000 cron 54425 54421 1928 0 D newbuf 0xffffffff8182b438 sh 54421 1928 1928 0 S wait 0xfffff80020819530 sh 54418 54417 2140 0 D ufs 0xfffff8001b692568 ls 54417 2140 2140 0 S wait 0xfffff80020963000 sh 54416 10831 10796 0 S piperd 0xfffff806dd3f08e8 sh 54415 10831 10796 0 D newbuf 0xffffffff8182b438 sed 54414 10831 10796 0 D newbuf 0xffffffff8182b438 sed 52161 4861 6811 0 D+ biowr 0xfffffe0038c9b7d0 nbufkv 52156 0 0 0 DL mdwait 0xfffff8004f9ec000 [md11] 52152 0 0 0 DL newbuf 0xffffffff8182b438 [md10] 4862 6811 6811 0 S+ piperd 0xfffff80042aa45f0 tee 4861 4860 6811 0 S+ pause 0xfffff80286a0b0a8 sh 4860 6811 6811 0 S+ wait 0xfffff80286a0ba60 sh 6811 2371 6811 0 S+ wait 0xfffff80235401a60 sh 13766 11965 13766 2006 S+ select 0xfffff804e5771040 top 11965 11964 11965 2006 Ss+ wait 0xfffff8041dc9a000 bash 11964 10842 10842 2006 S select 0xfffff80020583dc0 sshd 10842 2291 10842 0 Ss select 0xfffff8002c2b0a40 sshd 10833 10796 10796 0 S piperd 0xfffff804e79eabe0 sh 10832 10796 10796 0 S piperd 0xfffff804e27a65f0 awk 10831 10796 10796 0 S wait 0xfffff80020963a60 sh 10796 1 10796 0 Ss wait 0xfffff80020268a60 sh 2371 2369 2371 0 S+ wait 0xfffff8002005b530 bash 2369 2368 2369 0 S+ pause 0xfffff80020a105d8 csh 2368 2363 2368 2006 S+ wait 0xfffff800209f4000 su 2363 2362 2363 2006 Ss+ wait 0xfffff800041e8530 bash 2362 2359 2359 2006 S select 0xfffff800050182c0 sshd 2359 2291 2359 0 Ss select 0xfffff800202a8d40 sshd 2355 2350 2355 0 S+ ttyin 0xfffff80003b3d4b0 csh 2350 1 2350 0 Ss+ wait 0xfffff80020065530 login 2349 1 2349 0 Ss+ ttyin 0xfffff80003b3d8b0 getty 2348 1 2348 0 Ss+ ttyin 0xfffff8002019c8b0 getty 2347 1 2347 0 Ss+ ttyin 0xfffff8002019ccb0 getty 2346 1 2346 0 Ss+ ttyin 0xfffff8002019b0b0 getty 2345 1 2345 0 Ss+ ttyin 0xfffff8002019b4b0 getty 2344 1 2344 0 Ss+ ttyin 0xfffff8002019b8b0 getty 2343 1 2343 0 Ss+ ttyin 0xfffff8002019bcb0 getty 2342 1 2342 0 Ss+ ttyin 0xfffff8002019a0b0 getty 2341 1 2341 0 Ss+ ttyin 0xfffff8002019a4b0 getty 2295 1 2295 0 Ss nanslp 0xffffffff81c82711 cron 2291 1 2291 0 Ss select 0xfffff800050181c0 sshd 2263 1 2263 0 Ss select 0xfffff800201dc940 powerd 2260 1 2260 123 Ss (threaded) ntpd 100204 S select 0xfffff80003ad0740 ntpd 2197 1 2197 0 Ss rpcsvc 0xfffff8022ae31460 NLM: master 2194 1 2194 0 Ss select 0xfffff80003ad1f40 rpc.statd 2140 1 2140 0 Ss wait 0xfffff8002070c530 watchdogd 2061 1 2061 0 Ss select 0xfffff800039f2540 rpcbind 2051 1 2051 0 Ss select 0xfffff80005018340 syslogd 1980 1 1980 0 Ss select 0xfffff80003ad03c0 devd 1975 1 1975 65 Ss piperd 0xfffff80020e10a50 dhclient 1928 1 1928 0 Ss wait 0xfffff800041f5a60 dhclient 1925 1 1925 0 Ss select 0xfffff800039f2640 dhclient 34 0 0 0 DL vlruwt 0xfffff80020065a60 [vnlru] 33 0 0 0 DL newbuf 0xffffffff8182b438 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100131 D wdrain 0xffffffff81d58090 [bufdaemon] 100133 D - 0xffffffff8180a980 [bufspacedaemon-0] 100134 D - 0xffffffff81812c40 [bufspacedaemon-1] 100135 D - 0xffffffff8181af00 [bufspacedaemon-2] 100136 D - 0xffffffff818231c0 [bufspacedaemon-3] 100137 D bufspac 0xffffffff8182b438 [bufspacedaemon-4] 100138 D - 0xffffffff81833740 [bufspacedaemon-5] 100139 D - 0xffffffff8183ba00 [bufspacedaemon-6] 100152 D sdflush 0xfffff8002060f8e8 [/ worker] 100203 D sdflush 0xfffff80003f81ce8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81d73b08 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81d9fa98 [dom0] 100130 D launds 0xffffffff81d9faa4 [laundry: dom0] 100132 D umarcl 0xffffffff80f0dc20 [uma] 29 0 0 0 DL idle 0xfffff80020267000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80020267530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adcfb0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de5060 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d57a9c [soaiod4] 24 0 0 0 DL - 0xffffffff81d57a9c [soaiod3] 23 0 0 0 DL - 0xffffffff81d57a9c [soaiod2] 22 0 0 0 DL - 0xffffffff81d57a9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a1cf0 [usbus1] 100103 D - 0xfffffe003e4a1d48 [usbus1] 100104 D - 0xfffffe003e4a1da0 [usbus1] 100105 D - 0xfffffe003e4a1df8 [usbus1] 100106 D - 0xfffffe003e4a1e50 [usbus1] 100107 D - 0xfffffe00d2e2bcf0 [usbus2] 100108 D - 0xfffffe00d2e2bd48 [usbus2] 100109 D - 0xfffffe00d2e2bda0 [usbus2] 100110 D - 0xfffffe00d2e2bdf8 [usbus2] 100111 D - 0xfffffe00d2e2be50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b83c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b84c0 [doneq2] 100125 D - 0xffffffff819b8288 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003affc50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003affbf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003affb90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003affb30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003affad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003affa70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003affa10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003aff9b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003aff950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003aff8f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003aff890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003aff830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6db78 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a71888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9e0c8 [g_event] 100063 D - 0xffffffff81d9e0d8 [g_up] 100064 D - 0xffffffff81d9e0d0 [g_down] 12 0 0 0 WL (threaded) [intr] 100016 I [swi6: task queue] 100017 I [swi6: Giant taskq] 100019 I [swi5: fast taskq] 100047 I [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100180 I [irq72: ioat0] 100181 I [irq73: ioat1] 100182 I [irq74: ioat2] 100183 I [irq75: ioat3] 100184 I [irq76: ioat4] 100185 I [irq77: ioat5] 100186 I [irq78: ioat6] 100187 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003896000 [init] 10 0 0 0 DL audit_w 0xffffffff81de5cf0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8d688 [swapper] 100015 D - 0xfffff8000377f100 [aiod_kick taskq] 100018 D - 0xfffff8000377ea00 [thread taskq] 100020 D - 0xfffff80003777000 [config_0] 100021 D - 0xfffff8000377e500 [kqueue_ctx taskq] 100022 D - 0xfffff80003776e00 [if_io_tqg_0] 100023 D - 0xfffff80003776d00 [if_io_tqg_1] 100024 D - 0xfffff80003776c00 [if_io_tqg_2] 100025 D - 0xfffff80003776b00 [if_io_tqg_3] 100026 D - 0xfffff80003776a00 [if_io_tqg_4] 100027 D - 0xfffff80003776900 [if_io_tqg_5] 100028 D - 0xfffff80003776800 [if_io_tqg_6] 100029 D - 0xfffff80003776700 [if_io_tqg_7] 100030 D - 0xfffff80003776600 [if_io_tqg_8] 100031 D - 0xfffff80003776500 [if_io_tqg_9] 100032 D - 0xfffff80003776400 [if_io_tqg_10] 100033 D - 0xfffff80003776300 [if_io_tqg_11] 100034 D - 0xfffff80003776200 [if_config_tqg_0] 100035 D - 0xfffff80003776100 [softirq_0] 100036 D - 0xfffff80003776000 [softirq_1] 100037 D - 0xfffff80003775e00 [softirq_2] 100038 D - 0xfffff80003775d00 [softirq_3] 100039 D - 0xfffff80003775c00 [softirq_4] 100040 D - 0xfffff80003775b00 [softirq_5] 100041 D - 0xfffff80003775a00 [softirq_6] 100042 D - 0xfffff80003775900 [softirq_7] 100043 D - 0xfffff80003775800 [softirq_8] 100044 D - 0xfffff80003775700 [softirq_9] 100045 D - 0xfffff80003775600 [softirq_10] 100046 D - 0xfffff80003775500 [softirq_11] 100061 D - 0xfffff80003a0f400 [firmware taskq] 100066 D - 0xfffff80003a10d00 [crypto_0] 100067 D - 0xfffff80003a10d00 [crypto_1] 100068 D - 0xfffff80003a10d00 [crypto_2] 100069 D - 0xfffff80003a10d00 [crypto_3] 100070 D - 0xfffff80003a10d00 [crypto_4] 100071 D - 0xfffff80003a10d00 [crypto_5] 100072 D - 0xfffff80003a10d00 [crypto_6] 100073 D - 0xfffff80003a10d00 [crypto_7] 100074 D - 0xfffff80003a10d00 [crypto_8] 100075 D - 0xfffff80003a10d00 [crypto_9] 100076 D - 0xfffff80003a10d00 [crypto_10] 100077 D - 0xfffff80003a10d00 [crypto_11] 100114 D - 0xfffff80003780300 [mca taskq] 100120 D - 0xfffff800200fc900 [acpi_task_0] 100121 D - 0xfffff800200fc900 [acpi_task_1] 100122 D - 0xfffff800200fc900 [acpi_task_2] 100124 D - 0xfffff80003a11100 [CAM taskq] db:0:pho> allt Tracing command grep pid 54479 tid 100732 td 0xfffffe00d3dfba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7944100 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7944140 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7944180 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7944220 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00e7944280 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e79442f0 getblkx() at getblkx+0x558/frame 0xfffffe00e79443c0 getblk() at getblk+0x22/frame 0xfffffe00e79443f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcfe/frame 0xfffffe00e7944590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e7944630 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe00e7944740 vn_write() at vn_write+0x27a/frame 0xfffffe00e79447c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e7944820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e7944970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e79449e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e7944a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e7944a70 sys_write() at sys_write+0x83/frame 0xfffffe00e7944ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e7944bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7944bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80047a8aa, rsp = 0x7fffffffe738, rbp = 0x7fffffffe760 --- Tracing command sh pid 54477 tid 100752 td 0xfffffe00e7c92a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e79ad6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e79ad6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e79ad730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e79ad790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e79ad7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e79ad840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e79ad8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e79adac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e79adbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e79adbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe880 --- Tracing command sh pid 54470 tid 100822 td 0xfffffe00d35e7a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8b0d140 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8b0d180 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8b0d1c0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e8b0d220 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e8b0d2d0 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e8b0d390 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e8b0d3e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e8b0d400 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e8b0d460 vget_finish() at vget_finish+0x79/frame 0xfffffe00e8b0d490 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e8b0d4e0 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e8b0d570 ufs_lookup_ino() at ufs_lookup_ino+0xbe4/frame 0xfffffe00e8b0d680 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe00e8b0d6a0 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe00e8b0d6f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e8b0d710 lookup() at lookup+0x611/frame 0xfffffe00e8b0d7b0 namei() at namei+0x579/frame 0xfffffe00e8b0d8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e8b0d9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e8b0dac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8b0dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8b0dbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x800477a5a, rsp = 0x7fffffffe4e8, rbp = 0x7fffffffe590 --- Tracing command cron pid 54469 tid 100220 td 0xfffffe00d39d5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e638e7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e638e830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e638e870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e638e8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e638e8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e638e980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e638e9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e638ea30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e638ea70 sys_read() at sys_read+0x83/frame 0xfffffe00e638eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e638ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e638ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044b8ea, rsp = 0x7fffffffe458, rbp = 0x7fffffffe470 --- Tracing command sh pid 54462 tid 100311 td 0xfffffe00e6de7100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e785e140 mi_switch() at mi_switch+0x159/frame 0xfffffe00e785e180 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e785e1c0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e785e220 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e785e2d0 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e785e390 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e785e3e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e785e400 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e785e460 vget_finish() at vget_finish+0x79/frame 0xfffffe00e785e490 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e785e4e0 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e785e570 ufs_lookup_ino() at ufs_lookup_ino+0xbe4/frame 0xfffffe00e785e680 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe00e785e6a0 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe00e785e6f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e785e710 lookup() at lookup+0x611/frame 0xfffffe00e785e7b0 namei() at namei+0x579/frame 0xfffffe00e785e8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e785e9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e785eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e785ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e785ebf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x800477a5a, rsp = 0x7fffffffe4e8, rbp = 0x7fffffffe590 --- Tracing command newsyslog pid 54461 tid 100314 td 0xfffffe00e6dea300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7872340 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7872380 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e78723c0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7872460 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00e78724c0 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e7872530 getblkx() at getblkx+0x558/frame 0xfffffe00e7872600 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e7872670 ffs_read() at ffs_read+0x238/frame 0xfffffe00e7872730 VOP_READ_APV() at VOP_READ_APV+0x56/frame 0xfffffe00e7872750 vn_read() at vn_read+0x1f0/frame 0xfffffe00e78727c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e7872820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e7872970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e78729e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7872a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7872a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7872ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e7872bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7872bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042b8ea, rsp = 0x7fffffffcda8, rbp = 0x7fffffffcdc0 --- Tracing command cron pid 54459 tid 100169 td 0xfffffe00d3df6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62477f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6247830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6247870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62478d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62478e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6247980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e62479e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6247a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6247a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6247ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6247bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6247bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044b8ea, rsp = 0x7fffffffe458, rbp = 0x7fffffffe470 --- Tracing command cron pid 54458 tid 100213 td 0xfffffe00e54fce00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e635f7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e635f830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e635f870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e635f8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e635f8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e635f980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e635f9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e635fa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e635fa70 sys_read() at sys_read+0x83/frame 0xfffffe00e635fac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e635fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e635fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044b8ea, rsp = 0x7fffffffe458, rbp = 0x7fffffffe470 --- Tracing command sh pid 54455 tid 100902 td 0xfffffe00e7cbee00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8c6b140 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8c6b180 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8c6b1c0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e8c6b220 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e8c6b2d0 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e8c6b390 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e8c6b3e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e8c6b400 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e8c6b460 vget_finish() at vget_finish+0x79/frame 0xfffffe00e8c6b490 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e8c6b4e0 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e8c6b570 ufs_lookup_ino() at ufs_lookup_ino+0xbe4/frame 0xfffffe00e8c6b680 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe00e8c6b6a0 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe00e8c6b6f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e8c6b710 lookup() at lookup+0x611/frame 0xfffffe00e8c6b7b0 namei() at namei+0x579/frame 0xfffffe00e8c6b8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e8c6b9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e8c6bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8c6bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8c6bbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x800477a5a, rsp = 0x7fffffffe4e8, rbp = 0x7fffffffe590 --- Tracing command cron pid 54453 tid 100850 td 0xfffffe00d35e5700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8b997f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8b99830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8b99870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8b998d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8b998e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8b99980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e8b999e0 dofileread() at dofileread+0x81/frame 0xfffffe00e8b99a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e8b99a70 sys_read() at sys_read+0x83/frame 0xfffffe00e8b99ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8b99bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8b99bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044b8ea, rsp = 0x7fffffffe458, rbp = 0x7fffffffe470 --- Tracing command sh pid 54447 tid 100151 td 0xfffffe00d3df9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fdd140 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fdd180 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fdd1c0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e4fdd220 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e4fdd2d0 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e4fdd390 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e4fdd3e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e4fdd400 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e4fdd460 vget_finish() at vget_finish+0x79/frame 0xfffffe00e4fdd490 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e4fdd4e0 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e4fdd570 ufs_lookup_ino() at ufs_lookup_ino+0xbe4/frame 0xfffffe00e4fdd680 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe00e4fdd6a0 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe00e4fdd6f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e4fdd710 lookup() at lookup+0x611/frame 0xfffffe00e4fdd7b0 namei() at namei+0x579/frame 0xfffffe00e4fdd8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e4fdd9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e4fddac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fddbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fddbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x800477a5a, rsp = 0x7fffffffe4e8, rbp = 0x7fffffffe590 --- Tracing command cron pid 54446 tid 100173 td 0xfffffe00d5cd1300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e625b7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e625b830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e625b870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e625b8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e625b8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e625b980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e625b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e625ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e625ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e625bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e625bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e625bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044b8ea, rsp = 0x7fffffffe458, rbp = 0x7fffffffe470 --- Tracing command dd pid 54441 tid 100883 td 0xfffffe00e7ca3100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8c0c100 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8c0c140 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8c0c180 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8c0c220 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00e8c0c280 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e8c0c2f0 getblkx() at getblkx+0x558/frame 0xfffffe00e8c0c3c0 getblk() at getblk+0x22/frame 0xfffffe00e8c0c3f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcfe/frame 0xfffffe00e8c0c590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e8c0c630 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe00e8c0c740 vn_write() at vn_write+0x27a/frame 0xfffffe00e8c0c7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e8c0c820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e8c0c970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e8c0c9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e8c0ca30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e8c0ca70 sys_write() at sys_write+0x83/frame 0xfffffe00e8c0cac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8c0cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8c0cbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004388aa, rsp = 0x7fffffffeb88, rbp = 0x7fffffffebc0 --- Tracing command sh pid 54438 tid 100815 td 0xfffffe00e81f3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8aea6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8aea6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8aea730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8aea790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8aea7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8aea840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e8aea8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e8aeaac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8aeabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8aeabf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe8b8, rbp = 0x7fffffffe970 --- Tracing command cron pid 54437 tid 100313 td 0xfffffe00e6deaa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e78777f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7877830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7877870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e78778d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e78778e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7877980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e78779e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7877a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7877a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7877ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e7877bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7877bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044b8ea, rsp = 0x7fffffffe458, rbp = 0x7fffffffe470 --- Tracing command sh pid 54425 tid 100875 td 0xfffffe00e817c800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e793a340 mi_switch() at mi_switch+0x159/frame 0xfffffe00e793a380 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e793a3c0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e793a460 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00e793a4c0 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e793a530 getblkx() at getblkx+0x558/frame 0xfffffe00e793a600 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e793a670 ffs_read() at ffs_read+0x238/frame 0xfffffe00e793a730 VOP_READ_APV() at VOP_READ_APV+0x56/frame 0xfffffe00e793a750 vn_read() at vn_read+0x1f0/frame 0xfffffe00e793a7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e793a820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e793a970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e793a9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e793aa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e793aa70 sys_read() at sys_read+0x83/frame 0xfffffe00e793aac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e793abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e793abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a8ea, rsp = 0x7fffffffe728, rbp = 0x7fffffffe770 --- Tracing command sh pid 54421 tid 100145 td 0xfffffe00d2e22c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fbf6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fbf6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fbf730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fbf790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fbf7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4fbf840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e4fbf8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4fbfac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fbfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fbfbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe290 --- Tracing command ls pid 54418 tid 100789 td 0xfffffe00e7638e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8a68270 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8a682b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8a682f0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e8a68350 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e8a68400 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e8a684c0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e8a68510 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00e8a68530 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00e8a68590 vget_finish() at vget_finish+0x79/frame 0xfffffe00e8a685c0 cache_lookup() at cache_lookup+0x57c/frame 0xfffffe00e8a686a0 vfs_cache_lookup() at vfs_cache_lookup+0x7d/frame 0xfffffe00e8a686f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00e8a68710 lookup() at lookup+0x611/frame 0xfffffe00e8a687b0 namei() at namei+0x579/frame 0xfffffe00e8a688a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e8a689c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e8a68ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8a68bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8a68bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x800496a5a, rsp = 0x7fffffffe2e8, rbp = 0x7fffffffe3a0 --- Tracing command sh pid 54417 tid 100175 td 0xfffffe00dd1df800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62656b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e62656f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6265730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6265790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62657a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6265840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e62658d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6265ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6265bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6265bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe818, rbp = 0x7fffffffe8d0 --- Tracing command sh pid 54416 tid 100160 td 0xfffffe00d3df1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e621a7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e621a830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e621a870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e621a8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e621a8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e621a980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e621a9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e621aa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e621aa70 sys_read() at sys_read+0x83/frame 0xfffffe00e621aac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e621abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e621abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a8ea, rsp = 0x7fffffffe068, rbp = 0x7fffffffe170 --- Tracing command sed pid 54415 tid 100237 td 0xfffffe00dd1ddc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63db340 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63db380 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63db3c0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e63db460 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00e63db4c0 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e63db530 getblkx() at getblkx+0x558/frame 0xfffffe00e63db600 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e63db670 ffs_read() at ffs_read+0x238/frame 0xfffffe00e63db730 VOP_READ_APV() at VOP_READ_APV+0x56/frame 0xfffffe00e63db750 vn_read() at vn_read+0x1f0/frame 0xfffffe00e63db7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e63db820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e63db970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e63db9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e63dba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e63dba70 sys_read() at sys_read+0x83/frame 0xfffffe00e63dbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e63dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63dbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004238ea, rsp = 0x7fffffffe088, rbp = 0x7fffffffe5d0 --- Tracing command sed pid 54414 tid 100784 td 0xfffffe00e763f800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8a4f340 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8a4f380 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8a4f3c0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8a4f460 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00e8a4f4c0 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e8a4f530 getblkx() at getblkx+0x558/frame 0xfffffe00e8a4f600 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e8a4f670 ffs_read() at ffs_read+0x238/frame 0xfffffe00e8a4f730 VOP_READ_APV() at VOP_READ_APV+0x56/frame 0xfffffe00e8a4f750 vn_read() at vn_read+0x1f0/frame 0xfffffe00e8a4f7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e8a4f820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e8a4f970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e8a4f9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e8a4fa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e8a4fa70 sys_read() at sys_read+0x83/frame 0xfffffe00e8a4fac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8a4fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8a4fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004238ea, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe600 --- Tracing command nbufkv pid 52161 tid 100827 td 0xfffffe00d35e6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8b25fc0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8b26000 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8b26040 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8b260e0 bufwait() at bufwait+0xc4/frame 0xfffffe00e8b26120 bufwrite() at bufwrite+0x258/frame 0xfffffe00e8b26170 flushbufqueues() at flushbufqueues+0x54c/frame 0xfffffe00e8b26220 bufspace_wait() at bufspace_wait+0xfb/frame 0xfffffe00e8b26280 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00e8b262f0 getblkx() at getblkx+0x558/frame 0xfffffe00e8b263c0 getblk() at getblk+0x22/frame 0xfffffe00e8b263f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x174d/frame 0xfffffe00e8b26590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e8b26630 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe00e8b26740 vn_write() at vn_write+0x27a/frame 0xfffffe00e8b267c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e8b26820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e8b26970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e8b269e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e8b26a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e8b26a70 sys_write() at sys_write+0x83/frame 0xfffffe00e8b26ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8b26bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8b26bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80041b8aa, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe610 --- Tracing command md11 pid 52156 tid 100192 td 0xfffffe003e4bb300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62f6a30 mi_switch() at mi_switch+0x159/frame 0xfffffe00e62f6a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62f6ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e62f6b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e62f6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e62f6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e62f6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 52152 tid 100262 td 0xfffffe00dd1dc000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037756420 mi_switch() at mi_switch+0x159/frame 0xfffffe0037756460 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377564a0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037756540 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00377565a0 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe0037756610 getblkx() at getblkx+0x558/frame 0xfffffe00377566e0 getblk() at getblk+0x22/frame 0xfffffe0037756710 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x16e3/frame 0xfffffe00377568b0 ffs_write() at ffs_write+0x21b/frame 0xfffffe0037756950 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0037756a60 mdstart_vnode() at mdstart_vnode+0x3f8/frame 0xfffffe0037756b50 md_kthread() at md_kthread+0x20c/frame 0xfffffe0037756bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037756bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037756bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 4862 tid 100226 td 0xfffffe00e77c0e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63ac7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63ac830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63ac870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e63ac8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e63ac8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e63ac980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e63ac9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e63aca30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e63aca70 sys_read() at sys_read+0x83/frame 0xfffffe00e63acac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e63acbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63acbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041b8ea, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6e0 --- Tracing command sh pid 4861 tid 100852 td 0xfffffe00d35dbe00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8ba38a0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8ba38e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8ba3920 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8ba3980 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8ba3990 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8ba3a30 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe00e8ba3a90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00e8ba3ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8ba3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8ba3bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80040acea, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command sh pid 4860 tid 100813 td 0xfffffe00d35dcc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8ae06b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8ae06f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8ae0730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8ae0790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8ae07a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8ae0840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e8ae08d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e8ae0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8ae0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8ae0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffa8f8, rbp = 0x7fffffffa9b0 --- Tracing command sh pid 6811 tid 100995 td 0xfffffe00e8175000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e8bdf6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e8bdf6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8bdf730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8bdf790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8bdf7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8bdf840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e8bdf8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e8bdfac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e8bdfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8bdfbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffac18, rbp = 0x7fffffffacd0 --- Tracing command top pid 13766 tid 100214 td 0xfffffe00e54fc700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63646d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6364710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6364750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e63647b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e63647f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e6364860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e63648a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6364a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6364ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6364bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6364bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004f48ca, rsp = 0x7fffffffe918, rbp = 0x7fffffffeb30 --- Tracing command bash pid 11965 tid 100286 td 0xfffffe00e5506300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addea6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addea6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addea730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00addea790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00addea7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00addea840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00addea8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00addeaac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00addeabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00addeabf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800528c6a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7d0 --- Tracing command sshd pid 11964 tid 100235 td 0xfffffe00e54ff800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63d1710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63d1750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63d1790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e63d17f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e63d1800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63d1860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e63d18a0 kern_select() at kern_select+0x952/frame 0xfffffe00e63d1a80 sys_select() at sys_select+0x56/frame 0xfffffe00e63d1ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e63d1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63d1bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffa538, rbp = 0x7fffffffa570 --- Tracing command sshd pid 10842 tid 100222 td 0xfffffe00e77d4e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6398790 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63987d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6398810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6398870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6398880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63988e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e6398920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e6398aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e6398ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6398bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6398bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089c48a, rsp = 0x7fffffffe598, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 10833 tid 100273 td 0xfffffe00e6de7800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e78227f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7822830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7822870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e78228d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e78228e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7822980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e78229e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7822a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7822a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7822ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e7822bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7822bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a8ea, rsp = 0x7fffffffe218, rbp = 0x7fffffffe320 --- Tracing command awk pid 10832 tid 100159 td 0xfffffe00dd1e8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62157f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6215830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6215870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62158d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62158e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6215980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e62159e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6215a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6215a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6215ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6215bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6215bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047f8ea, rsp = 0x7fffffffe308, rbp = 0x7fffffffe320 --- Tracing command sh pid 10831 tid 100149 td 0xfffffe00dd1e8700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fd36b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fd36f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fd3730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fd3790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fd37a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4fd3840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e4fd38d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4fd3ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fd3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fd3bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe308, rbp = 0x7fffffffe3c0 --- Tracing command sh pid 10796 tid 100158 td 0xfffffe00d5cd1a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62106b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e62106f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6210730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6210790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62107a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6210840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e62108d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6210ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6210bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6210bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe570 --- Tracing command bash pid 2371 tid 100163 td 0xfffffe00d3df9700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62296b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e62296f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6229730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6229790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62297a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6229840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e62298d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6229ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6229bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6229bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800528c6a, rsp = 0x7fffffffe628, rbp = 0x7fffffffe680 --- Tracing command csh pid 2369 tid 100150 td 0xfffffe00dd1ee000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fd88a0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fd88e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fd8920 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fd8980 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fd8990 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4fd8a30 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe00e4fd8a90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00e4fd8ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fd8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fd8bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80048fcea, rsp = 0x7fffffffdfe8, rbp = 0x7fffffffe070 --- Tracing command su pid 2368 tid 100146 td 0xfffffe00dd1dce00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fc46b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fc46f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fc4730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fc4790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fc47a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4fc4840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e4fc48d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4fc4ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fc4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fc4bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003efc6a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffeb30 --- Tracing command bash pid 2363 tid 100195 td 0xfffffe00e809c500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63056b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63056f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6305730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6305790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e63057a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6305840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e63058d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6305ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6305bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6305bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800528c6a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7d0 --- Tracing command sshd pid 2362 tid 100201 td 0xfffffe00dd1f0a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6323710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6323750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6323790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e63237f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6323800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e6323860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e63238a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6323a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6323ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6323bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6323bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffa538, rbp = 0x7fffffffa570 --- Tracing command sshd pid 2359 tid 100211 td 0xfffffe00e77d5500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6355790 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63557d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6355810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6355870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6355880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63558e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e6355920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e6355aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e6355ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6355bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6355bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089c48a, rsp = 0x7fffffffe598, rbp = 0x7fffffffe5d0 --- Tracing command csh pid 2355 tid 100205 td 0xfffffe00d39d5700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6337770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63377b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63377f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6337850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6337860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63378c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e63378f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6337950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e6337980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e63379e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6337a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6337a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6337ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6337bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6337bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004ff8ea, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe200 --- Tracing command login pid 2350 tid 100148 td 0xfffffe00d3df2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fce6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fce6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fce730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fce790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fce7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4fce840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e4fce8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4fceac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fcebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fcebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f1c6a, rsp = 0x7fffffffeb38, rbp = 0x7fffffffecf0 --- Tracing command getty pid 2349 tid 100147 td 0xfffffe00dd1dc700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fc9770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fc97b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fc97f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fc9850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fc9860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e4fc98c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e4fc98f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e4fc9950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e4fc9980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e4fc99e0 dofileread() at dofileread+0x81/frame 0xfffffe00e4fc9a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e4fc9a70 sys_read() at sys_read+0x83/frame 0xfffffe00e4fc9ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fc9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fc9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2348 tid 100218 td 0xfffffe00e5504e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6378770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63787b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63787f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6378850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6378860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63788c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e63788f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6378950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e6378980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e63789e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6378a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6378a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6378ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6378bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6378bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2347 tid 100217 td 0xfffffe00d39e0c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6373770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63737b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63737f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6373850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6373860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63738c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e63738f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6373950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e6373980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e63739e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6373a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6373a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6373ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6373bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6373bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2346 tid 100216 td 0xfffffe00d39e1300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e636e770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e636e7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e636e7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e636e850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e636e860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e636e8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e636e8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e636e950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e636e980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e636e9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e636ea30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e636ea70 sys_read() at sys_read+0x83/frame 0xfffffe00e636eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e636ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e636ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2345 tid 100215 td 0xfffffe00d39e1a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6369770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63697b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63697f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6369850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6369860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63698c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e63698f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6369950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e6369980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e63699e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6369a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6369a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6369ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6369bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6369bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2344 tid 100209 td 0xfffffe00d39e2800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e634b770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e634b7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e634b7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e634b850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e634b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e634b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e634b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e634b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e634b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e634b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e634ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e634ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e634bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e634bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e634bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2343 tid 100210 td 0xfffffe00d39e2100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6350770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e63507b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63507f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6350850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6350860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e63508c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e63508f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6350950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e6350980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e63509e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6350a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6350a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6350ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6350bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6350bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2342 tid 100189 td 0xfffffe00e77d6a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62db770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e62db7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62db7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62db850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62db860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e62db8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e62db8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e62db950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e62db980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e62db9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e62dba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e62dba70 sys_read() at sys_read+0x83/frame 0xfffffe00e62dbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e62dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62dbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2341 tid 100142 td 0xfffffe00d39d6c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fb0770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fb07b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fb07f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fb0850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fb0860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e4fb08c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e4fb08f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e4fb0950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e4fb0980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e4fb09e0 dofileread() at dofileread+0x81/frame 0xfffffe00e4fb0a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e4fb0a70 sys_read() at sys_read+0x83/frame 0xfffffe00e4fb0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fb0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fb0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command cron pid 2295 tid 100208 td 0xfffffe00e80a8500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6346830 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6346870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63468b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6346910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e6346950 _sleep() at _sleep+0x258/frame 0xfffffe00e63469f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e6346a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e6346ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6346bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6346bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dbdca, rsp = 0x7fffffffea98, rbp = 0x7fffffffec80 --- Tracing command sshd pid 2291 tid 100165 td 0xfffffe00dd1f1100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6233710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6233750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6233790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62337f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6233800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e6233860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e62338a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6233a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6233ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6233bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6233bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffe628, rbp = 0x7fffffffe660 --- Tracing command powerd pid 2263 tid 100179 td 0xfffffe00d39df000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62796d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6279710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6279750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62797b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e62797f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e6279860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e62798a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6279a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6279ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6279bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6279bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004348ca, rsp = 0x7fffffffeb48, rbp = 0x7fffffffec90 --- Tracing command ntpd pid 2260 tid 100204 td 0xfffffe00e77d5c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6332710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6332750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6332790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e63327f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6332800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e6332860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e63328a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6332a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6332ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6332bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6332bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082c8ca, rsp = 0x7fffffffded8, rbp = 0x7fffffffdf10 --- Tracing command rpc.lockd pid 2197 tid 100154 td 0xfffffe00d39d5e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fec610 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fec650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fec690 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fec6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e4fec730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e4fec7a0 svc_run_internal() at svc_run_internal+0xabe/frame 0xfffffe00e4fec8e0 svc_run() at svc_run+0x253/frame 0xfffffe00e4fec940 sys_nlm_syscall() at sys_nlm_syscall+0x745/frame 0xfffffe00e4fecac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fecbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fecbf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f65ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec80 --- Tracing command rpc.statd pid 2194 tid 100202 td 0xfffffe00dd1f0300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63286d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6328710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6328750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e63287b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e63287f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e6328860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e63288a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6328a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6328ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6328bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6328bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042b8ca, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2140 tid 100155 td 0xfffffe00d39dfe00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4ff16b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4ff16f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4ff1730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4ff1790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4ff17a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e4ff1840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e4ff18d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e4ff1ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4ff1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4ff1bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c4c6a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command rpcbind pid 2061 tid 100161 td 0xfffffe00d3df1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e621f750 mi_switch() at mi_switch+0x159/frame 0xfffffe00e621f790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e621f7d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e621f830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e621f870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e621f8e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e621f920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e621faa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e621fac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e621fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e621fbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d248a, rsp = 0x7fffffffc9f8, rbp = 0x7fffffffec10 --- Tracing command syslogd pid 2051 tid 100153 td 0xfffffe00d39d6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fe7710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fe7750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fe7790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fe77f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fe7800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e4fe7860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e4fe78a0 kern_select() at kern_select+0x952/frame 0xfffffe00e4fe7a80 sys_select() at sys_select+0x56/frame 0xfffffe00e4fe7ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fe7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fe7bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043c8ca, rsp = 0x7fffffffe708, rbp = 0x7fffffffec80 --- Tracing command devd pid 1980 tid 100168 td 0xfffffe00d3df6c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62426d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6242710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6242750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62427b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e62427f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e6242860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e62428a0 kern_select() at kern_select+0x952/frame 0xfffffe00e6242a80 sys_select() at sys_select+0x56/frame 0xfffffe00e6242ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6242bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6242bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f803a, rsp = 0x7fffffffcb08, rbp = 0x7fffffffeca0 --- Tracing command dhclient pid 1975 tid 100162 td 0xfffffe00dd1eb100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62247f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6224830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6224870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62248d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62248e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6224980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e62249e0 dofileread() at dofileread+0x81/frame 0xfffffe00e6224a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e6224a70 sys_read() at sys_read+0x83/frame 0xfffffe00e6224ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6224bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6224bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004528ea, rsp = 0x7fffffffc9e8, rbp = 0x7fffffffca10 --- Tracing command dhclient pid 1928 tid 100172 td 0xfffffe003e4bba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62566b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e62566f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6256730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6256790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e62567a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6256840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e62568d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e6256ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6256bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6256bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e2c6a, rsp = 0x7fffffffda68, rbp = 0x7fffffffdaf0 --- Tracing command dhclient pid 1925 tid 100144 td 0xfffffe003e4bc100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fba710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fba750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fba790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e4fba7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4fba800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e4fba860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e4fba8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e4fbaa80 sys_select() at sys_select+0x56/frame 0xfffffe00e4fbaac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e4fbabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e4fbabf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004528ca, rsp = 0x7fffffffe9a8, rbp = 0x7fffffffea60 --- Tracing command vnlru pid 34 tid 100141 td 0xfffffe00d3df2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dd9fd9b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00dd9fd9f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dd9fda30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dd9fda70 _sleep() at _sleep+0x26c/frame 0xfffffe00dd9fdb10 vnlru_proc() at vnlru_proc+0xaed/frame 0xfffffe00dd9fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dd9fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dd9fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffffe00d3df3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dd9f8690 mi_switch() at mi_switch+0x159/frame 0xfffffe00dd9f86d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dd9f8710 _sleep() at _sleep+0x2cd/frame 0xfffffe00dd9f87b0 bufspace_wait() at bufspace_wait+0x1ce/frame 0xfffffe00dd9f8810 getnewbuf() at getnewbuf+0x2af/frame 0xfffffe00dd9f8880 getblkx() at getblkx+0x558/frame 0xfffffe00dd9f8950 getblk() at getblk+0x22/frame 0xfffffe00dd9f8980 ffs_use_bwrite() at ffs_use_bwrite+0x62/frame 0xfffffe00dd9f89c0 ffs_sbput() at ffs_sbput+0xaa/frame 0xfffffe00dd9f8a10 ffs_sync() at ffs_sync+0x65c/frame 0xfffffe00dd9f8ac0 sync_fsync() at sync_fsync+0xeb/frame 0xfffffe00dd9f8b00 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe00dd9f8b20 sched_sync() at sched_sync+0x3f2/frame 0xfffffe00dd9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dd9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dd9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d3df3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037beb980 mi_switch() at mi_switch+0x159/frame 0xfffffe0037beb9c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beba00 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bebaa0 flushbufqueues() at flushbufqueues+0x64a/frame 0xfffffe0037bebb60 buf_daemon() at buf_daemon+0x1e1/frame 0xfffffe0037bebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d31aea00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf59f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bf5a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf5a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf5ab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf5b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffffe00d31ae300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bfa9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bfaa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfaa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfaab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffffe00d31adc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bff9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bffa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bffa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bffab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bffb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffffe00d31ad500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dd8049f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00dd804a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dd804a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dd804ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dd804b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dd804bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dd804bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dd804bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffffe00d3dfb300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dd9e99f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00dd9e9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dd9e9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dd9e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dd9e9b50 bufspace_daemon() at bufspace_daemon+0x254/frame 0xfffffe00dd9e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dd9e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dd9e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffffe00d3dfac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dd9ee9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00dd9eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dd9eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dd9eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dd9eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dd9eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dd9eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dd9eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d3dfa500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00dd9f39f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00dd9f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dd9f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dd9f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dd9f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dd9f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dd9f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dd9f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffffe00dd1eb800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e4fe2a20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e4fe2a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e4fe2aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4fe2ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e4fe2b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e4fe2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fe2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fe2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100203 td 0xfffffe00e809b700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e632da20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e632da60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e632daa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e632dae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e632db80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e632dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e632dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e632dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d3df4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037be1a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037be1a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be1aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037be1b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe0037be1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6099e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bdc610 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bdc650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bdc690 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bdc6d0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bdc770 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe0037bdcb70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe0037bdcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bdcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bdcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100130 td 0xfffffe00d3df7a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037be6810 mi_switch() at mi_switch+0x159/frame 0xfffffe0037be6850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be6890 _sleep() at _sleep+0x2cd/frame 0xfffffe0037be6930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc1b/frame 0xfffffe0037be6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffffe00d3df7300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf0a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bf0a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf0aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf0ae0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf0b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe0037bf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d5cd2100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd7a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bd7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd7a90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bd7b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d5cd2800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd2a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bd2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd2a90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bd2b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffffe00d609b300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc39d0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bc3a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc3a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bc3a90 _sleep() at _sleep+0x26c/frame 0xfffffe0037bc3b30 random_kthread() at random_kthread+0x67/frame 0xfffffe0037bc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d5ccf000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba3a70 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ba3ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba3af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ba3b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037ba3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d31af100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b9ea10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b9ea50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ea90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b9ead0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b9eb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b9ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d31af800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b99a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b99a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b99a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b99ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b99b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b99bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b99bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b99bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe00d6099000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b94a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b94a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b94a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b94ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b94b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b94bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b94bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b94bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe00d6099700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b8fa10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b8fa50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8fa90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b8fad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b8fb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b8fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4b9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b24a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b24ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b24b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b24b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4b9700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b29a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b29ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b29b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b29b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b29bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b29bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b29bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4b9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b2ea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b2ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b2eb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b2ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e474800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b33a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b33ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b33b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b33b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b33bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b33bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b33bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e474100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b38a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b38ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b38b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b38b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b38bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b38bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b38bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e22500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b42a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b42ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b42b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b42b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b42bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b42bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b42bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e21e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b47a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b47ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b47b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b47b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b47bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b47bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b47bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e21700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b4ca90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b4cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b4cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b4cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e21000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b51a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b51ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b51b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b51b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b51bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b51bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b51bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4bc800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b56a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b56ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b56b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b56b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b56bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b56bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b56bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe003e188100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b5ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b5bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b5bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b5bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31ace00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b60a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b60ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b60b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b60b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b60bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b60bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b60bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31ac700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b65a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b65ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b65b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b65b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b65bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b65bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d31ac000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b6aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e24800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b6fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e471700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b0ba40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b0ba80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0bac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0bb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b0bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e471000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b10a40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b10a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b10ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b10b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b10bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b10bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e188800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b15a40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b15a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b15ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b15b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b15bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b15bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d609a500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bcda30 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bcda70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bcdab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bcdb50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe0037bcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e471e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b06a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b06a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b06aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b06b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b06bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b06bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b06bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e472500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b01a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b01a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b01aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b01b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e472c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037afca20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037afca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afcaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afcb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037afcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e473300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af7a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037af7a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af7aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af7b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e194800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af2a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037af2a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af2aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af2b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e185000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aeda20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aeda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aedaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aedb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037aedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e185700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae8a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ae8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae8aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae8b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e185e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae3a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ae3a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae3aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae3b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e186500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037adea20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037adea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adeaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037adeb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037adebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e186c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad9a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ad9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad9aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad9b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e187300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad4a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ad4a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad4aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad4b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e187a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acfa20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037acfa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acfaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acfb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037acfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e191000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acaa50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037acaa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acaad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acab70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe0037acabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1c3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a89a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a89a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a89ad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037a89b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe0037a89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1cde00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a6ea50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a6ea90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a6ead0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a6eb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037a6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1c4800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a73a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a73a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a73ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0x4c/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1c4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a78a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a78a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a78ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a78b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037a78ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037a78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffffe003e3e5800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb3ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addb3b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00addb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffffe003e3fc300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb8ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addb8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00addb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffffe003e3fb500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe003e1cd700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377feae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00377feb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1cd000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a04ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a04b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e1dc800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffffe003e1dc100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe003e1dba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe003e1db300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffffe003e1dac00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffffe003e1da500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffffe003e1c1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffffe003e1d0800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003e1d0100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003e1cfa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003e1cf300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003e1cec00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4bac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1aae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b1ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b1abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4ba500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1fae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b1fb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b1fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e473a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b3dae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b3db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b3dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e24100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e23a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b79ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b79b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe00d5cd0500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00d5ccfe00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe00d5ccf700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe00e77c3100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe00e77c2a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe00e77c2300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe00e77c1c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe00e77c1500 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e4300 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x101/frame 0xfffffe00add72830 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00add72840 uart_intr_rxready() at uart_intr_rxready+0xa5/frame 0xfffffe00add72870 uart_intr() at uart_intr+0x138/frame 0xfffffe00add728b0 intr_event_handle() at intr_event_handle+0xce/frame 0xfffffe00add72900 intr_execute_handlers() at intr_execute_handlers+0x6a/frame 0xfffffe00add72940 lapic_handle_intr() at lapic_handle_intr+0x5b/frame 0xfffffe00add72960 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00add72960 --- interrupt, rip = 0xffffffff81032d36, rsp = 0xfffffe00add72a30, rbp = 0xfffffe00add72a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add72a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add72a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add72ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3e3c00 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x56/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add77a30, rbp = 0xfffffe00add77a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add77a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add77a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add77ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3e3500 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x56/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add7ca30, rbp = 0xfffffe00add7ca30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7ca30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add7ca90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7cab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3e2e00 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x56/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add81a30, rbp = 0xfffffe00add81a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add81a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add81a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add81ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3e2700 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x56/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add86a30, rbp = 0xfffffe00add86a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add86a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add86a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add86ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3e2000 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x56/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add8ba30, rbp = 0xfffffe00add8ba30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add8ba30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add8ba90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add8bab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3eca00 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x56/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add90a30, rbp = 0xfffffe00add90a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add90a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add90a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add90ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3ec300 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x56/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add95a30, rbp = 0xfffffe00add95a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add95a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add95a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add95ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3ebc00 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x56/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add9aa30, rbp = 0xfffffe00add9aa30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9aa30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9aa90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9aab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3eb500 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x56/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add9fa30, rbp = 0xfffffe00add9fa30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9fa30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9fa90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9fab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3eae00 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x56/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda4a30, rbp = 0xfffffe00adda4a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda4a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda4a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda4ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3ea700 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1f7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1f7df0 trap() at trap+0x56/frame 0xfffffe003e1f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f7f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda9a30, rbp = 0xfffffe00adda9a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda9a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda9a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda9ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e4a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add6d6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00add6d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add6d730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add6d790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add6dac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00add6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b2bfa, rsp = 0x7fffffffe768, rbp = 0x7fffffffe7d0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e5100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add68a70 mi_switch() at mi_switch+0x159/frame 0xfffffe00add68ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add68af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add68b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9e1c0 sched_switch() at sched_switch+0x5ba/frame 0xffffffff822ffbf0 mi_switch() at mi_switch+0x159/frame 0xffffffff822ffc30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff822ffc70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff822ffcb0 _sleep() at _sleep+0x26c/frame 0xffffffff822ffd50 swapper() at swapper+0x75/frame 0xffffffff822ffda0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff822ffdf0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3ea000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addaea60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addaeaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaeae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addaeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e3fbc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addbda60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addbdaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbdae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addbdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e3fae00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addc7a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00addc7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addc7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e3fa700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addcca60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addccaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addccae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addccb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e3fa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037781a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037781ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037781b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037781b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037781bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037781bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3ed800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037786a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037786ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037786b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037786b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3ed100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003778ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe003778bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003778bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e1f2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037790a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037790ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037790b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037790b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e1f2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037795a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037795ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037795b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037795b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e1f1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe003779aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e1f1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe003779fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e1f1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377a4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e3fd800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377a9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e3fd100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377aea90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377aead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377aeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377aeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e3fca00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b3a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377b3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e1e6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b8a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377b8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e1e5e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377bda90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377bdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377bdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e1e5700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c2a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377c2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e1e5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c7a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e1f4800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377cca90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e1f4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d1a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e1f3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d6a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e1f3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377dba90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe003e1d9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e0a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e1d9700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e5a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe003e1d9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377eaa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe003e1e8800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377efa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e1e8100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe003e1e7a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1ce500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a69a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a69aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a69ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a69b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1c3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a8ea60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a8eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a8eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1c2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a93a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a93aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a93ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a93b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1c2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a98a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a98aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a98ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a98b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1c1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a9da60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a9daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a9dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a9db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1c1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa2a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aa2aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e194100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa7a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aa7aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e193a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aaca60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aacaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aacae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aacb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e193300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab1a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ab1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e192c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab6a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ab6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e192500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037abba60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037abbaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037abbae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037abbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037abbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037abbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037abbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e191e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac0a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ac0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e191700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac5a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ac5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e23300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b7ea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b7ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037b7eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037b7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609c800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609c100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d609ba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bbea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bbeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d609ac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc8a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bc8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bc8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037bc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100732 (pid 54479, grep) sleeping on 0xffffffff8182b438 "newbuf" chain 2: thread 100752 (pid 54477, sh) sleeping on 0xfffff80043453000 "wait" chain 3: thread 100822 (pid 54470, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 4: thread 100220 (pid 54469, cron) sleeping on 0xfffff806117fa2f8 "piperd" chain 5: thread 100311 (pid 54462, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 6: thread 100314 (pid 54461, newsyslog) sleeping on 0xffffffff8182b438 "newbuf" chain 7: thread 100169 (pid 54459, cron) sleeping on 0xfffff802766e6be0 "piperd" chain 8: thread 100213 (pid 54458, cron) sleeping on 0xfffff802527a88e8 "piperd" chain 9: thread 100902 (pid 54455, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 10: thread 100850 (pid 54453, cron) sleeping on 0xfffff804a0d0cbe0 "piperd" chain 11: thread 100151 (pid 54447, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 12: thread 100173 (pid 54446, cron) sleeping on 0xfffff804a0d182f8 "piperd" chain 13: thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 14: thread 100815 (pid 54438, sh) sleeping on 0xfffff8028698b530 "wait" chain 15: thread 100313 (pid 54437, cron) sleeping on 0xfffff804ac5a2000 "piperd" chain 16: thread 100875 (pid 54425, sh) sleeping on 0xffffffff8182b438 "newbuf" chain 17: thread 100145 (pid 54421, sh) sleeping on 0xfffff80020819530 "wait" chain 18: thread 100789 (pid 54418, ls) blocked on lockmgr ufsEXCL thread 100827 (pid 52161, nbufkv) sleeping on 0xfffffe0038c9b7d0 "biowr" chain 19: thread 100175 (pid 54417, sh) blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 20: thread 100160 (pid 54416, sh) sleeping on 0xfffff806dd3f08e8 "piperd" chain 21: thread 100237 (pid 54415, sed) sleeping on 0xffffffff8182b438 "newbuf" chain 22: thread 100784 (pid 54414, sed) sleeping on 0xffffffff8182b438 "newbuf" chain 23: thread 100827 (pid 52161, nbufkv) sleeping on 0xfffffe0038c9b7d0 "biowr" chain 24: thread 100192 (pid 52156, md11) sleeping on 0xfffff8004f9ec000 "mdwait" chain 25: thread 100262 (pid 52152, md10) sleeping on 0xffffffff8182b438 "newbuf" chain 26: thread 100226 (pid 4862, tee) sleeping on 0xfffff80042aa45f0 "piperd" chain 27: thread 100852 (pid 4861, sh) sleeping on 0xfffff80286a0b0a8 "pause" chain 28: thread 100813 (pid 4860, sh) blocked on lockmgr 0 EXCL thread 0 (pid -512, ) is inactive chain 29: thread 100995 (pid 6811, sh) blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 30: thread 100214 (pid 13766, top) sleeping on 0xfffff804e5771040 "select" chain 31: thread 100286 (pid 11965, bash) sleeping on 0xfffff8041dc9a000 "wait" chain 32: thread 100235 (pid 11964, sshd) sleeping on 0xfffff80020583dc0 "select" chain 33: thread 100222 (pid 10842, sshd) sleeping on 0xfffff8002c2b0a40 "select" chain 34: thread 100273 (pid 10833, sh) sleeping on 0xfffff804e79eabe0 "piperd" chain 35: thread 100159 (pid 10832, awk) sleeping on 0xfffff804e27a65f0 "piperd" chain 36: thread 100149 (pid 10831, sh) sleeping on 0xfffff80020963a60 "wait" chain 37: thread 100158 (pid 10796, sh) sleeping on 0xfffff80020268a60 "wait" chain 38: thread 100163 (pid 2371, bash) sleeping on 0xfffff8002005b530 "wait" chain 39: thread 100150 (pid 2369, csh) sleeping on 0xfffff80020a105d8 "pause" chain 40: thread 100146 (pid 2368, su) sleeping on 0xfffff800209f4000 "wait" chain 41: thread 100195 (pid 2363, bash) sleeping on 0xfffff800041e8530 "wait" chain 42: thread 100201 (pid 2362, sshd) sleeping on 0xfffff800050182c0 "select" chain 43: thread 100211 (pid 2359, sshd) sleeping on 0xfffff800202a8d40 "select" chain 44: thread 100205 (pid 2355, csh) sleeping on 0xfffff80003b3d4b0 "ttyin" chain 45: thread 100148 (pid 2350, login) sleeping on 0xfffff80020065530 "wait" chain 46: thread 100147 (pid 2349, getty) sleeping on 0xfffff80003b3d8b0 "ttyin" chain 47: thread 100218 (pid 2348, getty) sleeping on 0xfffff8002019c8b0 "ttyin" chain 48: thread 100217 (pid 2347, getty) sleeping on 0xfffff8002019ccb0 "ttyin" chain 49: thread 100216 (pid 2346, getty) sleeping on 0xfffff8002019b0b0 "ttyin" chain 50: thread 100215 (pid 2345, getty) sleeping on 0xfffff8002019b4b0 "ttyin" chain 51: thread 100209 (pid 2344, getty) sleeping on 0xfffff8002019b8b0 "ttyin" chain 52: thread 100210 (pid 2343, getty) sleeping on 0xfffff8002019bcb0 "ttyin" chain 53: thread 100189 (pid 2342, getty) sleeping on 0xfffff8002019a0b0 "ttyin" chain 54: thread 100142 (pid 2341, getty) sleeping on 0xfffff8002019a4b0 "ttyin" chain 55: thread 100208 (pid 2295, cron) sleeping on 0xffffffff81c82711 "nanslp" chain 56: thread 100165 (pid 2291, sshd) sleeping on 0xfffff800050181c0 "select" chain 57: thread 100179 (pid 2263, powerd) sleeping on 0xfffff800201dc940 "select" chain 58: thread 100204 (pid 2260, ntpd) sleeping on 0xfffff80003ad0740 "select" chain 59: thread 100154 (pid 2197, NLM: master) sleeping on 0xfffff8022ae31460 "rpcsvc" chain 60: thread 100202 (pid 2194, rpc.statd) sleeping on 0xfffff80003ad1f40 "select" chain 61: thread 100155 (pid 2140, watchdogd) sleeping on 0xfffff8002070c530 "wait" chain 62: thread 100161 (pid 2061, rpcbind) sleeping on 0xfffff800039f2540 "select" chain 63: thread 100153 (pid 2051, syslogd) sleeping on 0xfffff80005018340 "select" chain 64: thread 100168 (pid 1980, devd) sleeping on 0xfffff80003ad03c0 "select" chain 65: thread 100162 (pid 1975, dhclient) sleeping on 0xfffff80020e10a50 "piperd" chain 66: thread 100172 (pid 1928, dhclient) sleeping on 0xfffff800041f5a60 "wait" chain 67: thread 100144 (pid 1925, dhclient) sleeping on 0xfffff800039f2640 "select" chain 68: thread 100141 (pid 34, vnlru) sleeping on 0xfffff80020065a60 "vlruwt" chain 69: thread 100140 (pid 33, syncer) sleeping on 0xffffffff8182b438 "newbuf" chain 70: thread 100131 (pid 32, bufdaemon) sleeping on 0xffffffff81d58090 "wdrain" chain 71: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 72: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 73: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 74: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 75: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b438 "bufspace" chain 76: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 77: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 78: thread 100152 (pid 32, / worker) sleeping on 0xfffff8002060f8e8 "sdflush" chain 79: thread 100203 (pid 32, /tmp worker) sleeping on 0xfffff80003f81ce8 "sdflush" chain 80: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d73b08 "psleep" chain 81: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81d9fa98 "psleep" chain 82: thread 100130 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9faa4 "launds" chain 83: thread 100132 (pid 30, uma) sleeping on 0xffffffff80f0dc20 "umarcl" chain 84: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80020267000 "idle" chain 85: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80020267530 "idle" chain 86: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adcfb0 "-" chain 87: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 88: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d57a9c "-" chain 89: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d57a9c "-" chain 90: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d57a9c "-" chain 91: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d57a9c "-" chain 92: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2d84440 "-" chain 93: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2d84498 "-" chain 94: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2d844f0 "-" chain 95: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2d84548 "-" chain 96: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2d845a0 "-" chain 97: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e4a1cf0 "-" chain 98: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e4a1d48 "-" chain 99: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e4a1da0 "-" chain 100: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e4a1df8 "-" chain 101: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e4a1e50 "-" chain 102: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bcf0 "-" chain 103: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bd48 "-" chain 104: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bda0 "-" chain 105: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bdf8 "-" chain 106: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2e2be50 "-" chain 107: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b83c0 "-" chain 108: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b84c0 "-" chain 109: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b8288 "-" chain 110: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003affc50 "crypto_ret_wait" chain 111: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003affbf0 "crypto_ret_wait" chain 112: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003affb90 "crypto_ret_wait" chain 113: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003affb30 "crypto_ret_wait" chain 114: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003affad0 "crypto_ret_wait" chain 115: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003affa70 "crypto_ret_wait" chain 116: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003affa10 "crypto_ret_wait" chain 117: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003aff9b0 "crypto_ret_wait" chain 118: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003aff950 "crypto_ret_wait" chain 119: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003aff8f0 "crypto_ret_wait" chain 120: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003aff890 "crypto_ret_wait" chain 121: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003aff830 "crypto_ret_wait" chain 122: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6db78 "crypto_wait" chain 123: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003a71888 "seqstate" chain 124: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 125: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 126: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 127: thread 100002 (pid 1, init) sleeping on 0xfffff80003896000 "wait" chain 128: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 129: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8d688 "swapin" chain 130: thread 100015 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000377f100 "-" chain 131: thread 100018 (pid 0, thread taskq) sleeping on 0xfffff8000377ea00 "-" chain 132: thread 100020 (pid 0, config_0) sleeping on 0xfffff80003777000 "-" chain 133: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000377e500 "-" chain 134: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003776e00 "-" chain 135: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003776d00 "-" chain 136: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003776c00 "-" chain 137: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003776b00 "-" chain 138: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003776a00 "-" chain 139: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003776900 "-" chain 140: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003776800 "-" chain 141: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003776700 "-" chain 142: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003776600 "-" chain 143: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003776500 "-" chain 144: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003776400 "-" chain 145: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003776300 "-" chain 146: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003776200 "-" chain 147: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003776100 "-" chain 148: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003776000 "-" chain 149: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003775e00 "-" chain 150: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003775d00 "-" chain 151: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003775c00 "-" chain 152: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003775b00 "-" chain 153: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003775a00 "-" chain 154: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003775900 "-" chain 155: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003775800 "-" chain 156: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003775700 "-" chain 157: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003775600 "-" chain 158: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003775500 "-" chain 159: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a0f400 "-" chain 160: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a10d00 "-" chain 161: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a10d00 "-" chain 162: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a10d00 "-" chain 163: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a10d00 "-" chain 164: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a10d00 "-" chain 165: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a10d00 "-" chain 166: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a10d00 "-" chain 167: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a10d00 "-" chain 168: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a10d00 "-" chain 169: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a10d00 "-" chain 170: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a10d00 "-" chain 171: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a10d00 "-" chain 172: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff80003780300 "-" chain 173: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff800200fc900 "-" chain 174: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff800200fc900 "-" chain 175: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff800200fc900 "-" chain 176: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a11100 "-" db:0:pho> chain 1: thread 100732 (pid 54479, grep) sleeping on 0xffffffff8182b438 "newbuf" chain 2: thread 100752 (pid 54477, sh) sleeping on 0xfffff80043453000 "wait" chain 3: thread 100822 (pid 54470, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 4: thread 100220 (pid 54469, cron) sleeping on 0xfffff806117fa2f8 "piperd" chain 5: thread 100311 (pid 54462, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 6: thread 100314 (pid 54461, newsyslog) sleeping on 0xffffffff8182b438 "newbuf" chain 7: thread 100169 (pid 54459, cron) sleeping on 0xfffff802766e6be0 "piperd" chain 8: thread 100213 (pid 54458, cron) sleeping on 0xfffff802527a88e8 "piperd" chain 9: thread 100902 (pid 54455, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 10: thread 100850 (pid 54453, cron) sleeping on 0xfffff804a0d0cbe0 "piperd" chain 11: thread 100151 (pid 54447, sh) blocked on lockmgr ufsEXCL thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 12: thread 100173 (pid 54446, cron) sleeping on 0xfffff804a0d182f8 "piperd" chain 13: thread 100883 (pid 54441, dd) sleeping on 0xffffffff8182b438 "newbuf" chain 14: thread 100815 (pid 54438, sh) sleeping on 0xfffff8028698b530 "wait" chain 15: thread 100313 (pid 54437, cron) sleeping on 0xfffff804ac5a2000 "piperd" chain 16: thread 100875 (pid 54425, sh) sleeping on 0xffffffff8182b438 "newbuf" chain 17: thread 100145 (pid 54421, sh) sleeping on 0xfffff80020819530 "wait" chain 18: thread 100789 (pid 54418, ls) blocked on lockmgr ufsEXCL thread 100827 (pid 52161, nbufkv) sleeping on 0xfffffe0038c9b7d0 "biowr" chain 19: thread 100175 (pid 54417, sh) blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 20: thread 100160 (pid 54416, sh) sleeping on 0xfffff806dd3f08e8 "piperd" chain 21: thread 100237 (pid 54415, sed) sleeping on 0xffffffff8182b438 "newbuf" chain 22: thread 100784 (pid 54414, sed) sleeping on 0xffffffff8182b438 "newbuf" chain 23: thread 100827 (pid 52161, nbufkv) sleeping on 0xfffffe0038c9b7d0 "biowr" chain 24: thread 100192 (pid 52156, md11) sleeping on 0xfffff8004f9ec000 "mdwait" chain 25: thread 100262 (pid 52152, md10) sleeping on 0xffffffff8182b438 "newbuf" chain 26: thread 100226 (pid 4862, tee) sleeping on 0xfffff80042aa45f0 "piperd" chain 27: thread 100852 (pid 4861, sh) sleeping on 0xfffff80286a0b0a8 "pause" chain 28: thread 100813 (pid 4860, sh) blocked on lockmgr 0 EXCL thread 0 (pid -512, ) is inactive chain 29: thread 100995 (pid 6811, sh) blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 30: thread 100214 (pid 13766, top) sleeping on 0xfffff804e5771040 "select" chain 31: thread 100286 (pid 11965, bash) sleeping on 0xfffff8041dc9a000 "wait" chain 32: thread 100235 (pid 11964, sshd) sleeping on 0xfffff80020583dc0 "select" chain 33: thread 100222 (pid 10842, sshd) sleeping on 0xfffff8002c2b0a40 "select" chain 34: thread 100273 (pid 10833, sh) sleeping on 0xfffff804e79eabe0 "piperd" chain 35: thread 100159 (pid 10832, awk) sleeping on 0xfffff804e27a65f0 "piperd" chain 36: thread 100149 (pid 10831, sh) sleeping on 0xfffff80020963a60 "wait" chain 37: thread 100158 (pid 10796, sh) sleeping on 0xfffff80020268a60 "wait" chain 38: thread 100163 (pid 2371, bash) sleeping on 0xfffff8002005b530 "wait" chain 39: thread 100150 (pid 2369, csh) sleeping on 0xfffff80020a105d8 "pause" chain 40: thread 100146 (pid 2368, su) sleeping on 0xfffff800209f4000 "wait" chain 41: thread 100195 (pid 2363, bash) sleeping on 0xfffff800041e8530 "wait" chain 42: thread 100201 (pid 2362, sshd) sleeping on 0xfffff800050182c0 "select" chain 43: thread 100211 (pid 2359, sshd) sleeping on 0xfffff800202a8d40 "select" chain 44: thread 100205 (pid 2355, csh) sleeping on 0xfffff80003b3d4b0 "ttyin" chain 45: thread 100148 (pid 2350, login) sleeping on 0xfffff80020065530 "wait" chain 46: thread 100147 (pid 2349, getty) sleeping on 0xfffff80003b3d8b0 "ttyin" chain 47: thread 100218 (pid 2348, getty) sleeping on 0xfffff8002019c8b0 "ttyin" chain 48: thread 100217 (pid 2347, getty) sleeping on 0xfffff8002019ccb0 "ttyin" chain 49: thread 100216 (pid 2346, getty) sleeping on 0xfffff8002019b0b0 "ttyin" chain 50: thread 100215 (pid 2345, getty) sleeping on 0xfffff8002019b4b0 "ttyin" chain 51: thread 100209 (pid 2344, getty) sleeping on 0xfffff8002019b8b0 "ttyin" chain 52: thread 100210 (pid 2343, getty) sleeping on 0xfffff8002019bcb0 "ttyin" chain 53: thread 100189 (pid 2342, getty) sleeping on 0xfffff8002019a0b0 "ttyin" chain 54: thread 100142 (pid 2341, getty) sleeping on 0xfffff8002019a4b0 "ttyin" chain 55: thread 100208 (pid 2295, cron) sleeping on 0xffffffff81c82711 "nanslp" chain 56: thread 100165 (pid 2291, sshd) sleeping on 0xfffff800050181c0 "select" chain 57: thread 100179 (pid 2263, powerd) sleeping on 0xfffff800201dc940 "select" chain 58: thread 100204 (pid 2260, ntpd) sleeping on 0xfffff80003ad0740 "select" chain 59: thread 100154 (pid 2197, NLM: master) sleeping on 0xfffff8022ae31460 "rpcsvc" chain 60: thread 100202 (pid 2194, rpc.statd) sleeping on 0xfffff80003ad1f40 "select" chain 61: thread 100155 (pid 2140, watchdogd) sleeping on 0xfffff8002070c530 "wait" chain 62: thread 100161 (pid 2061, rpcbind) sleeping on 0xfffff800039f2540 "select" chain 63: thread 100153 (pid 2051, syslogd) sleeping on 0xfffff80005018340 "select" chain 64: thread 100168 (pid 1980, devd) sleeping on 0xfffff80003ad03c0 "select" chain 65: thread 100162 (pid 1975, dhclient) sleeping on 0xfffff80020e10a50 "piperd" chain 66: thread 100172 (pid 1928, dhclient) sleeping on 0xfffff800041f5a60 "wait" chain 67: thread 100144 (pid 1925, dhclient) sleeping on 0xfffff800039f2640 "select" chain 68: thread 100141 (pid 34, vnlru) sleeping on 0xfffff80020065a60 "vlruwt" chain 69: thread 100140 (pid 33, syncer) sleeping on 0xffffffff8182b438 "newbuf" chain 70: thread 100131 (pid 32, bufdaemon) sleeping on 0xffffffff81d58090 "wdrain" chain 71: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 72: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 73: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 74: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 75: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b438 "bufspace" chain 76: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 77: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 78: thread 100152 (pid 32, / worker) sleeping on 0xfffff8002060f8e8 "sdflush" chain 79: thread 100203 (pid 32, /tmp worker) sleeping on 0xfffff80003f81ce8 "sdflush" chain 80: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d73b08 "psleep" chain 81: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81d9fa98 "psleep" chain 82: thread 100130 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9faa4 "launds" chain 83: thread 100132 (pid 30, uma) sleeping on 0xffffffff80f0dc20 "umarcl" chain 84: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80020267000 "idle" chain 85: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80020267530 "idle" chain 86: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adcfb0 "-" chain 87: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 88: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d57a9c "-" chain 89: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d57a9c "-" chain 90: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d57a9c "-" chain 91: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d57a9c "-" chain 92: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2d84440 "-" chain 93: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2d84498 "-" chain 94: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2d844f0 "-" chain 95: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2d84548 "-" chain 96: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2d845a0 "-" chain 97: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e4a1cf0 "-" chain 98: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e4a1d48 "-" chain 99: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e4a1da0 "-" chain 100: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e4a1df8 "-" chain 101: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e4a1e50 "-" chain 102: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bcf0 "-" chain 103: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bd48 "-" chain 104: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bda0 "-" chain 105: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bdf8 "-" chain 106: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2e2be50 "-" chain 107: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b83c0 "-" chain 108: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b84c0 "-" chain 109: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b8288 "-" chain 110: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003affc50 "crypto_ret_wait" chain 111: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003affbf0 "crypto_ret_wait" chain 112: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003affb90 "crypto_ret_wait" chain 113: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003affb30 "crypto_ret_wait" chain 114: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003affad0 "crypto_ret_wait" chain 115: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003affa70 "crypto_ret_wait" chain 116: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003affa10 "crypto_ret_wait" chain 117: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003aff9b0 "crypto_ret_wait" chain 118: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003aff950 "crypto_ret_wait" chain 119: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003aff8f0 "crypto_ret_wait" chain 120: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003aff890 "crypto_ret_wait" chain 121: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003aff830 "crypto_ret_wait" chain 122: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6db78 "crypto_wait" chain 123: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003a71888 "seqstate" chain 124: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 125: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 126: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 127: thread 100002 (pid 1, init) sleeping on 0xfffff80003896000 "wait" chain 128: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 129: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8d688 "swapin" chain 130: thread 100015 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000377f100 "-" chain 131: thread 100018 (pid 0, thread taskq) sleeping on 0xfffff8000377ea00 "-" chain 132: thread 100020 (pid 0, config_0) sleeping on 0xfffff80003777000 "-" chain 133: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000377e500 "-" chain 134: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003776e00 "-" chain 135: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003776d00 "-" chain 136: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003776c00 "-" chain 137: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003776b00 "-" chain 138: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003776a00 "-" chain 139: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003776900 "-" chain 140: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003776800 "-" chain 141: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003776700 "-" chain 142: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003776600 "-" chain 143: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003776500 "-" chain 144: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003776400 "-" chain 145: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003776300 "-" chain 146: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003776200 "-" chain 147: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003776100 "-" chain 148: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003776000 "-" chain 149: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003775e00 "-" chain 150: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003775d00 "-" chain 151: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003775c00 "-" chain 152: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003775b00 "-" chain 153: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003775a00 "-" chain 154: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003775900 "-" chain 155: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003775800 "-" chain 156: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003775700 "-" chain 157: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003775600 "-" chain 158: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003775500 "-" chain 159: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a0f400 "-" chain 160: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a10d00 "-" chain 161: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a10d00 "-" chain 162: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a10d00 "-" chain 163: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a10d00 "-" chain 164: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a10d00 "-" chain 165: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a10d00 "-" chain 166: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a10d00 "-" chain 167: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a10d00 "-" chain 168: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a10d00 "-" chain 169: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a10d00 "-" chain 170: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a10d00 "-" chain 171: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a10d00 "-" chain 172: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff80003780300 "-" chain 173: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff800200fc900 "-" chain 174: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff800200fc900 "-" chain 175: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff800200fc900 "-" chain 176: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a11100 "-" db> (kgdb) tid 0xfffffe00e7ca3100 (kgdb) bt #0 sched_switch (td=0xfffffe00e7ca3100, flags=) at ../../../kern/sched_ule.c:2147 #1 0xffffffff80bd6189 in mi_switch (flags=0x104) at ../../../kern/kern_synch.c:531 #2 0xffffffff80c23f1a in sleepq_switch (wchan=0xffffffff8182b438 , pri=0x60) at ../../../kern/subr_sleepqueue.c:622 #3 0xffffffff80bd581d in _sleep (ident=0xffffffff8182b438 , lock=, priority=, wmesg=0xffffffff81149b88 "newbuf", sbt=0x0, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:220 #4 0xffffffff80c86c0e in bufspace_wait (bd=0xffffffff81823280 , vp=0xfffff804e2649280, gbflags=, slpflag=, slptimeo=) at ../../../kern/vfs_bio.c:774 #5 0xffffffff80c8320f in getnewbuf (vp=, slpflag=0x0, slptimeo=0x0, maxsize=, gbflags=) at ../../../kern/vfs_bio.c:3292 #6 0xffffffff80c808e8 in getblkx (vp=0xfffff804e2649280, blkno=0x0, dblkno=, size=0x1000, slpflag=0x0, slptimeo=0x0, flags=0x8, bpp=0xfffffe00e8c0c3e8) at ../../../kern/vfs_bio.c:4026 #7 0xffffffff80c82f42 in getblk (vp=, blkno=, size=, slpflag=, slptimeo=, flags=) at ../../../kern/vfs_bio.c:3799 #8 0xffffffff80ebf78e in ffs_balloc_ufs2 (vp=, startoffset=, size=, cred=0xfffff80370dbd900, flags=, bpp=) at ../../../ufs/ffs/ffs_balloc.c:812 #9 0xffffffff80eeb75b in ffs_write (ap=0xfffffe00e8c0c758) at ../../../ufs/ffs/ffs_vnops.c:807 #10 0xffffffff810f032f in VOP_WRITE_APV (vop=0xffffffff81959298 , a=0xfffffe00e8c0c758) at vnode_if.c:925 #11 0xffffffff80cbdbaa in VOP_WRITE (vp=, uio=0xfffffe00e8c0ca80, ioflag=0x20001, cred=) at ./vnode_if.h:413 #12 vn_write (fp=0xfffff80734fc30a0, uio=0xfffffe00e8c0ca80, active_cred=, flags=, td=) at ../../../kern/vfs_vnops.c:894 #13 0xffffffff80cbd593 in vn_io_fault_doio (args=0xfffffe00e8c0c980, uio=0xfffffe00e8c0ca80, td=0xfffffe00e7ca3100) at ../../../kern/vfs_vnops.c:959 #14 0xffffffff80cb9fbc in vn_io_fault1 (vp=, uio=0xfffffe00e8c0ca80, args=0xfffffe00e8c0c980, td=0xfffffe00e7ca3100) at ../../../kern/vfs_vnops.c:1077 #15 0xffffffff80cb7cd2 in vn_io_fault (fp=0xfffff80734fc30a0, uio=0xfffffe00e8c0ca80, active_cred=0xfffff80286a8bb68, flags=0x0, td=) at ../../../kern/vfs_vnops.c:1181 #16 0xffffffff80c3b511 in fo_write (fp=0xfffff80734fc30a0, uio=0xfffffe00e8c0ca80, active_cred=, flags=, td=0xfffffe00e7ca3100) at ../../../sys/file.h:326 #17 dofilewrite (td=0xfffffe00e7ca3100, fd=0x4, fp=0xfffff80734fc30a0, auio=0xfffffe00e8c0ca80, offset=, flags=) at ../../../kern/sys_generic.c:564 #18 0xffffffff80c3b159 in kern_writev (td=0xfffffe00e7ca3100, fd=0x4, auio=0xfffffe00e8c0ca80) at ../../../kern/sys_generic.c:491 #19 0xffffffff80c3b103 in sys_write (td=, uap=) at ../../../kern/sys_generic.c:406 #20 0xffffffff81074afe in syscallenter (td=0xfffffe00e7ca3100) at ../../../amd64/amd64/../../kern/subr_syscall.c:151 #21 amd64_syscall (td=0xfffffe00e7ca3100, traced=) at ../../../amd64/amd64/trap.c:1155 #22 #23 0x00000008004388aa in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffeb88 (kgdb) f 4 #4 0xffffffff80c86c0e in bufspace_wait (bd=0xffffffff81823280 , vp=0xfffff804e2649280, gbflags=, slpflag=, slptimeo=) at ../../../kern/vfs_bio.c:774 774 error = msleep(&bd->bd_wanted, BD_LOCKPTR(bd), (kgdb) l 769 if (fl != 0) 770 continue; 771 if (bd->bd_wanted == 0) 772 break; 773 } 774 error = msleep(&bd->bd_wanted, BD_LOCKPTR(bd), 775 (PRIBIO + 4) | slpflag, "newbuf", slptimeo); 776 if (error != 0) 777 break; 778 } (kgdb) info loc td = norunbuf = fl = error = (kgdb) p *bd $1 = {bd_subq = {{bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818232c0 }, bq_index = 0x3, bq_subqueue = 0x0, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff81823340 }, bq_index = 0x3, bq_subqueue = 0x1, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818233c0 }, bq_index = 0x3, bq_subqueue = 0x2, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff81823440 }, bq_index = 0x3, bq_subqueue = 0x3, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818234c0 }, bq_index = 0x3, bq_subqueue = 0x4, bq_len = 0x0}, {bq_lock = {lock_object = { lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff81823540 }, bq_index = 0x3, bq_subqueue = 0x5, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818235c0 }, bq_index = 0x3, bq_subqueue = 0x6, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff81823640 }, bq_index = 0x3, bq_subqueue = 0x7, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818236c0 }, bq_index = 0x3, bq_subqueue = 0x8, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff81823740 }, bq_index = 0x3, bq_subqueue = 0x9, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818237c0 }, bq_index = 0x3, bq_subqueue = 0xa, bq_len = 0x0}, {bq_lock = {lock_object = { lo_name = 0xffffffff810fe0dd "bufq clean subqueue lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b600}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff81823840 }, bq_index = 0x3, bq_subqueue = 0xb, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0xffffffff811b3c16 "bufq clean lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b500}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0xffffffff818238c0 }, bq_index = 0x3, bq_subqueue = 0xc, bq_len = 0x0}, {bq_lock = {lock_object = {lo_name = 0x0, lo_flags = 0x0, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0x0, tqh_last = 0x0}, bq_index = 0x0, bq_subqueue = 0x0, bq_len = 0x0} }, bd_dirtyq = { bq_lock = {lock_object = {lo_name = 0xffffffff8120988b "bufq dirty lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b580}, mtx_lock = 0x0}, bq_queue = {tqh_first = 0xfffffe0038c9b7d0, tqh_last = 0xfffffe0039c0b330}, bq_index = 0x2, bq_subqueue = 0xffff, bq_len = 0xec7}, bd_cleanq = 0xffffffff81823880 , bd_run_lock = {lock_object = {lo_name = 0xffffffff8119e33a "bufspace daemon run lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b680}, mtx_lock = 0x0}, bd_maxbufspace = 0xec74000, bd_hibufspace = 0xec5d249, bd_lobufspace = 0xe08baf8, bd_bufspacethresh = 0xe6746a0, bd_hifreebuffers = 0x149, bd_lofreebuffers = 0xdb, bd_hidirtybuffers = 0xeca, bd_lodirtybuffers = 0x765, bd_dirtybufthresh = 0xd4f, bd_lim = 0x19, bd_wanted = 0x1, bd_numdirtybuffers = 0xdcb, bd_running = 0x23, bd_bufspace = 0xec72000, bd_freebuffers = 0x2c55} (kgdb) Index: src/sys/vm/swap_pager.c =================================================================== --- src/sys/vm/swap_pager.c (revision 357853) +++ src/sys/vm/swap_pager.c (working copy) @@ -1188,8 +1188,8 @@ swap_pager_unswapped(vm_page_t m) * The pages in "ma" must be busied and will remain busied upon return. */ static int -swap_pager_getpages(vm_object_t object, vm_page_t *ma, int count, int *rbehind, - int *rahead) +swap_pager_getpages_locked(vm_object_t object, vm_page_t *ma, int count, + int *rbehind, int *rahead) { struct buf *bp; vm_page_t bm, mpred, msucc, p; @@ -1197,7 +1197,7 @@ static int daddr_t blk; int i, maxahead, maxbehind, reqcount; - VM_OBJECT_WLOCK(object); + VM_OBJECT_ASSERT_WLOCKED(object); reqcount = count; KASSERT(object->type == OBJT_SWAP, @@ -1352,6 +1352,15 @@ static int */ } +static int +swap_pager_getpages(vm_object_t object, vm_page_t *ma, int count, + int *rbehind, int *rahead) +{ + + VM_OBJECT_WLOCK(object); + return (swap_pager_getpages_locked(object, ma, count, rbehind, rahead)); +} + /* * swap_pager_getpages_async(): * @@ -1444,18 +1453,6 @@ swap_pager_putpages(vm_object_t object, vm_page_t /* Maximum I/O size is limited by maximum swap block size. */ n = min(count - i, nsw_cluster_max); - /* Get a block of swap of size up to size n. */ - blk = swp_pager_getswapspace(&n, 4); - if (blk == SWAPBLK_NONE) { - for (j = 0; j < n; ++j) - rtvals[i + j] = VM_PAGER_FAIL; - continue; - } - - /* - * All I/O parameters have been satisfied. Build the I/O - * request and assign the swap space. - */ if (async) { mtx_lock(&swbuf_mtx); while (nsw_wcount_async == 0) @@ -1464,6 +1461,7 @@ swap_pager_putpages(vm_object_t object, vm_page_t nsw_wcount_async--; mtx_unlock(&swbuf_mtx); } + bp = uma_zalloc(swwbuf_zone, M_WAITOK); if (async) bp->b_flags = B_ASYNC; @@ -1470,13 +1468,19 @@ swap_pager_putpages(vm_object_t object, vm_page_t bp->b_flags |= B_PAGING; bp->b_iocmd = BIO_WRITE; - bp->b_rcred = crhold(thread0.td_ucred); - bp->b_wcred = crhold(thread0.td_ucred); - bp->b_bcount = PAGE_SIZE * n; - bp->b_bufsize = PAGE_SIZE * n; - bp->b_blkno = blk; - + /* Get a block of swap of size up to size n. */ VM_OBJECT_WLOCK(object); + blk = swp_pager_getswapspace(&n, 4); + if (blk == SWAPBLK_NONE) { + VM_OBJECT_WUNLOCK(object); + for (j = 0; j < n; ++j) + rtvals[i + j] = VM_PAGER_FAIL; + mtx_lock(&swbuf_mtx); + nsw_wcount_async++; + mtx_unlock(&swbuf_mtx); + uma_zfree(swwbuf_zone, bp); + continue; + } for (j = 0; j < n; ++j) { mreq = ma[i + j]; vm_page_aflag_clear(mreq, PGA_SWAP_FREE); @@ -1490,7 +1494,14 @@ swap_pager_putpages(vm_object_t object, vm_page_t bp->b_pages[j] = mreq; } VM_OBJECT_WUNLOCK(object); + + bp->b_rcred = crhold(thread0.td_ucred); + bp->b_wcred = crhold(thread0.td_ucred); + bp->b_bcount = PAGE_SIZE * n; + bp->b_bufsize = PAGE_SIZE * n; + bp->b_blkno = blk; bp->b_npages = n; + /* * Must set dirty range for NFS to work. */ @@ -1712,72 +1723,12 @@ swp_pager_force_dirty(vm_page_t m) { vm_page_dirty(m); -#ifdef INVARIANTS - if (!vm_page_wired(m) && m->a.queue == PQ_NONE) - panic("page %p is neither wired nor queued", m); -#endif vm_page_xunbusy(m); swap_pager_unswapped(m); -} - -static void -swp_pager_force_launder(vm_page_t m) -{ - - vm_page_dirty(m); vm_page_launder(m); - vm_page_xunbusy(m); - swap_pager_unswapped(m); } /* - * SWP_PAGER_FORCE_PAGEIN() - force swap blocks to be paged in - * - * This routine dissociates pages starting at the given index within an - * object from their backing store, paging them in if they do not reside - * in memory. Pages that are paged in are marked dirty and placed in the - * laundry queue. Pages are marked dirty because they no longer have - * backing store. They are placed in the laundry queue because they have - * not been accessed recently. Otherwise, they would already reside in - * memory. - */ -static void -swp_pager_force_pagein(vm_object_t object, vm_pindex_t pindex, int npages) -{ - vm_page_t ma[npages]; - int i, j; - - KASSERT(npages > 0, ("%s: No pages", __func__)); - KASSERT(npages <= MAXPHYS / PAGE_SIZE, - ("%s: Too many pages: %d", __func__, npages)); - KASSERT(object->type == OBJT_SWAP, - ("%s: Object not swappable", __func__)); - vm_object_pip_add(object, npages); - vm_page_grab_pages(object, pindex, VM_ALLOC_NORMAL, ma, npages); - for (i = j = 0;; i++) { - /* Count nonresident pages, to page-in all at once. */ - if (i < npages && ma[i]->valid != VM_PAGE_BITS_ALL) - continue; - if (j < i) { - VM_OBJECT_WUNLOCK(object); - /* Page-in nonresident pages. Mark for laundering. */ - if (swap_pager_getpages(object, &ma[j], i - j, NULL, - NULL) != VM_PAGER_OK) - panic("%s: read from swap failed", __func__); - VM_OBJECT_WLOCK(object); - do { - swp_pager_force_launder(ma[j]); - } while (++j < i); - } - if (i == npages) - break; - /* Mark dirty a resident page. */ - swp_pager_force_dirty(ma[j++]); - } - vm_object_pip_wakeupn(object, npages); -} - -/* * swap_pager_swapoff_object: * * Page in all of the pages that have been paged out for an object @@ -1787,62 +1738,80 @@ static void swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) { struct swblk *sb; - vm_pindex_t pi, s_pindex; - daddr_t blk, n_blks, s_blk; - int i; + vm_page_t m, ma[SWAP_META_PAGES]; + vm_pindex_t pi; + daddr_t blk; + int i, j, npages, nv, rahead, rv; KASSERT(object->type == OBJT_SWAP, ("%s: Object not swappable", __func__)); - n_blks = 0; + for (pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( &object->un_pager.swp.swp_blks, pi)) != NULL; ) { + if ((object->flags & OBJ_DEAD) != 0) { + swp_pager_meta_free_all(object); + break; + } for (i = 0; i < SWAP_META_PAGES; i++) { - blk = sb->d[i]; - if (!swp_pager_isondev(blk, sp)) - blk = SWAPBLK_NONE; - /* - * If there are no blocks/pages accumulated, start a new - * accumulation here. + * Count the number of contiguous valid blocks. */ - if (n_blks == 0) { - if (blk != SWAPBLK_NONE) { - s_blk = blk; - s_pindex = sb->p + i; - n_blks = 1; - } + for (nv = 0; nv < SWAP_META_PAGES - i; nv++) { + blk = sb->d[i + nv]; + if (!swp_pager_isondev(blk, sp) || + blk == SWAPBLK_NONE) + break; + } + if (nv == 0) continue; - } /* - * If the accumulation can be extended without breaking - * the sequence of consecutive blocks and pages that - * swp_pager_force_pagein() depends on, do so. + * Grab the page for the first valid block. If the page + * is valid, mark it dirty and free its swap block. Try + * to batch this operation since it may cause sp to be + * freed, meaning that we must restart the scan. + * Invalid pages will be revisited in future iterations. */ - if (n_blks < MAXPHYS / PAGE_SIZE && - s_blk + n_blks == blk && - s_pindex + n_blks == sb->p + i) { - ++n_blks; - continue; + m = vm_page_grab(object, sb->p + i, VM_ALLOC_NORMAL | + VM_ALLOC_WAITFAIL); + if (m == NULL) + break; + if (vm_page_all_valid(m)) { + npages = vm_page_grab_pages(object, + m->pindex + 1, + VM_ALLOC_NOCREAT | VM_ALLOC_NOWAIT, ma, + nv - 1); + swp_pager_force_dirty(m); + for (j = 0; j < npages; j++) { + if (vm_page_all_valid(ma[j])) + swp_pager_force_dirty(ma[j]); + else + vm_page_xunbusy(ma[j]); + } + break; } + vm_object_pip_add(object, 1); + rahead = SWAP_META_PAGES; + rv = swap_pager_getpages_locked(object, &m, 1, NULL, + &rahead); + if (rv != VM_PAGER_OK) + panic("%s: read from swap failed: %d", + __func__, rv); + vm_object_pip_wakeupn(object, 1); + VM_OBJECT_WLOCK(object); + vm_page_xunbusy(m); + /* - * The sequence of consecutive blocks and pages cannot - * be extended, so page them all in here. Then, - * because doing so involves releasing and reacquiring - * a lock that protects the swap block pctrie, do not - * rely on the current swap block. Break this loop and - * re-fetch the same pindex from the pctrie again. + * The object lock was dropped so we must restart the + * scan of this swap block. Pages paged in during this + * iteration will be marked dirty in a future iteration. */ - swp_pager_force_pagein(object, s_pindex, n_blks); - n_blks = 0; break; } if (i == SWAP_META_PAGES) pi = sb->p + SWAP_META_PAGES; } - if (n_blks > 0) - swp_pager_force_pagein(object, s_pindex, n_blks); } /* @@ -2078,7 +2047,7 @@ allocated: * Free the swblk if we end up with the empty page run. */ if (swapblk == SWAPBLK_NONE) - swp_pager_free_empty_swblk(object, sb); + swp_pager_free_empty_swblk(object, sb); return (prev_swapblk); } @@ -2350,7 +2319,7 @@ swaponsomething(struct vnode *vp, void *id, u_long sw_strategy_t *strategy, sw_close_t *close, dev_t dev, int flags) { struct swdevt *sp, *tsp; - swblk_t dvbase; + daddr_t dvbase; u_long mblocks; /* Index: src/sys/vm/swap_pager.h =================================================================== --- src/sys/vm/swap_pager.h (revision 357853) +++ src/sys/vm/swap_pager.h (working copy) @@ -38,14 +38,9 @@ */ #ifndef _VM_SWAP_PAGER_H_ -#define _VM_SWAP_PAGER_H_ 1 +#define _VM_SWAP_PAGER_H_ -typedef int32_t swblk_t; /* - * swap offset. This is the type used to - * address the "virtual swap device" and - * therefore the maximum swap space is - * 2^32 pages. - */ +#include struct buf; struct swdevt; @@ -62,8 +57,8 @@ struct swdevt { dev_t sw_dev; struct vnode *sw_vp; void *sw_id; - swblk_t sw_first; - swblk_t sw_end; + __daddr_t sw_first; + __daddr_t sw_end; struct blist *sw_blist; TAILQ_ENTRY(swdevt) sw_list; sw_strategy_t *sw_strategy; -- Test scenario: misc/nbufkv.sh