watchdogd fired, vmcore.209 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r363595: Mon Jul 27 07:30:44 CEST 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.1 (git@github.com:llvm/llvm-project.git llvmorg-10.0.1-rc2-0-g77d76b71d7d) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33165750272 (31629 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 3 8 5 11 4 9 7 6 10 2 Timecounter "TSC-low" frequency 1750037292 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000052 [4342] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Obsolete code will be removed soon: random(9) is the obsolete Park-Miller LCG from 1988 Expensive timeout(9) function: 0xffffffff804dbe40(0xfffffe00d2ad9000) 0.004466808 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device Trying to mount root from ufs:/dev/gpt/work [rw]... ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 Root mount waiting for: CAM usbus0 usbus1 usbus2 ses ses ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> Expensive timeout(9) function: 0xffffffff80a2e130(0xffffffff818e6758) 0.007134709 s ugen2.1: at usbus2 ugen1.1: at usbus1 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus1 uhub1: on usbus1 uhub2 on usbus0 uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub1: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub2: 21 ports with 21 removable, self powered Root mount waiting for: usbus0 usbus1 usbus2 igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff800040e2000), ignoring. Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/e2fsprogs /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.30/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP igb0: link state changed to DOWN Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800040e2000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 27 Jul 07:38:13 ntpdate[2078]: step time server 192.168.5.1 offset -0.939468 sec Starting rpcbind. NFS access cache time=60 Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800187a6578 ufs (ufs) @ kern/vfs_mount.c:1696 2nd 0xfffff8001874e2f0 devfs (devfs) @ kern/vfs_subr.c:3332 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba2052 at lockmgr_lock_flags+0x172 #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80cae845 at vput_final+0x135 #5 0xffffffff80e8510f at ffs_unmount+0x3af #6 0xffffffff80ca5a4d at dounmount+0x43d #7 0xffffffff80ca55b9 at kern_unmount+0x2b9 #8 0xffffffff81010969 at amd64_syscall+0x159 #9 0xffffffff80fe6a3e at fast_syscall_common+0xf8 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 345 files, 40074 used, 1225333 free (141 frags, 153149 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Jul 27 07:38 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jul 27 07:38:21 mercat1 login[2436]: ROOT LOGIN (root) ON ttyu1 Last login: Sat Jul 25 21:20:47 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r363595: Mon Jul 27 07:30:44 CEST 2020 root@mercat1:~ # Jul 27 07:38:27 mercat1 su[2452]: pho to root on /dev/pts/0 20200727 08:32:00 all (1/720): 1st.sh 20200727 08:32:03 all (2/720): 256m.sh 20200727 08:32:04 all (3/720): audit.sh 20200727 08:32:06 all (4/720): beneath3.sh 20200727 08:32:07 all (5/720): buildworld.sh 20200727 08:32:09 all (6/720): buildworld2.sh 20200727 08:32:10 all (7/720): cluster.sh 20200727 08:32:12 all (8/720): cpuset.sh 20200727 08:32:13 all (9/720): crossmp2.sh 20200727 08:32:15 all (10/720): crossmp6.sh 20200727 08:32:16 all (11/720): datagram3.sh 20200727 08:32:18 all (12/720): datamove.sh 20200727 08:32:20 all (13/720): datamove3.sh 20200727 08:32:21 all (14/720): devfs2.sh 20200727 08:32:23 all (15/720): devfs5.sh 20200727 08:32:24 all (16/720): dtrace_fault.sh 20200727 08:32:26 all (17/720): dumpfs.sh 20200727 08:32:27 all (18/720): dup2.sh 20200727 08:32:29 all (19/720): execi386.sh 20200727 08:32:31 all (20/720): extattr_set_fd.sh 20200727 08:32:32 all (21/720): extattrctl.sh lock order reversal: 1st 0xfffff80018c1ac40 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff8080c5d7068 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1998 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba275c at lockmgr_xlock_hard+0x6c #2 0xffffffff80ba34ca at __lockmgr_args+0x63a #3 0xffffffff80e8263d at ffs_vgetf+0x15d #4 0xffffffff80e95e9b at ufs_root+0x1b #5 0xffffffff80cb3ec0 at vfs_cache_root_fallback+0x140 #6 0xffffffff80e8e1ff at ufs_extattr_autostart+0x5f #7 0xffffffff80e84bdb at ffs_mount+0x1dbb #8 0xffffffff80ca4458 at vfs_domount+0x838 #9 0xffffffff80ca2e81 at vfs_donmount+0x871 #10 0xffffffff80ca25d9 at sys_nmount+0x69 #11 0xffffffff81010969 at amd64_syscall+0x159 #12 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 08:32:34 all (22/720): fcntl3.sh 20200727 08:32:35 all (23/720): fexecve.sh 20200727 08:32:37 all (24/720): fifo.sh 20200727 08:32:39 all (25/720): fsck2.sh 20200727 08:32:40 all (26/720): fsck3.sh 20200727 08:32:43 all (27/720): fsck4.sh 20200727 08:32:44 all (28/720): geomleak.sh 20200727 08:32:46 all (29/720): getrandom.sh 20200727 08:32:48 all (30/720): gnop3.sh 20200727 08:32:49 all (31/720): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200727 08:32:51 all (32/720): graid1_6.sh Jul 27 08:33:29 mercat1 kernel: pid 28786 (swap), jid 0, uid 2007, was killed: out of swap space Jul 27 08:34:39 mercat1 kernel: pid 28732 (rw), uid 2007 inumber 51013 on /mnt: filesystem full Jul 27 08:34:42 mercat1 kernel: pid 28750 (rw), uid 2007 inumber 50981 on /mnt: filesystem full 20200727 08:37:28 all (33/720): holdcnt0.sh 20200727 08:37:30 all (34/720): holdcnt02.sh 20200727 08:37:31 all (35/720): holdcnt03.sh 20200727 08:37:33 all (36/720): holdcnt04.sh 20200727 08:37:34 all (37/720): holdcnt05.sh 20200727 08:37:36 all (38/720): isofs2.sh 20200727 08:37:37 all (39/720): jail.sh 20200727 08:37:41 all (40/720): jail2.sh 20200727 08:37:43 all (41/720): jail3.sh 20200727 08:37:45 all (42/720): jail4.sh 20200727 08:37:46 all (43/720): jexec.sh 20200727 08:37:48 all (44/720): kern_umtx_inf_loop.sh 20200727 08:37:50 all (45/720): kevent10.sh 20200727 08:37:52 all (46/720): kevent3.sh 20200727 08:37:54 all (47/720): ldt.sh 20200727 08:37:55 all (48/720): ldt2.sh 20200727 08:37:57 all (49/720): libMicro.sh 20200727 08:37:58 all (50/720): linux.sh 20200727 08:38:00 all (51/720): lockd.sh 20200727 08:38:01 all (52/720): lockf.sh 20200727 08:38:03 all (53/720): lookup_shared.sh 20200727 08:38:04 all (54/720): mac.sh 20200727 08:38:06 all (55/720): mac_chkexec.sh 20200727 08:38:07 all (56/720): machipc.sh 20200727 08:38:09 all (57/720): machipc2.sh 20200727 08:38:10 all (58/720): maxmemdom.sh 20200727 08:38:12 all (59/720): maxproc.sh 20200727 08:38:13 all (60/720): md4.sh 20200727 08:38:15 all (61/720): md5.sh 20200727 08:38:16 all (62/720): md6.sh 20200727 08:38:18 all (63/720): mdconfig.sh 20200727 08:38:19 all (64/720): mdconfig3.sh 20200727 08:38:21 all (65/720): memguard4.sh 20200727 08:38:23 all (66/720): mkfifo5.sh 20200727 08:38:24 all (67/720): mkfifo7.sh 20200727 08:38:26 all (68/720): mlockall5.sh 20200727 08:38:27 all (69/720): mmap.sh 20200727 08:38:29 all (70/720): mmap12.sh 20200727 08:38:31 all (71/720): mmap16.sh 20200727 08:38:32 all (72/720): mmap17.sh 20200727 08:38:34 all (73/720): mmap20.sh 20200727 08:38:35 all (74/720): mmap24.sh 20200727 08:38:37 all (75/720): mmap30.sh 20200727 08:38:39 all (76/720): mmap33.sh 20200727 08:38:41 all (77/720): mmap35.sh 20200727 08:38:42 all (78/720): mmap36.sh 20200727 08:38:44 all (79/720): mount.sh 20200727 08:38:45 all (80/720): mountro3.sh 20200727 08:38:47 all (81/720): mprotect.sh 20200727 08:38:49 all (82/720): msdos2.sh 20200727 08:38:50 all (83/720): msdos3.sh 20200727 08:38:52 all (84/720): msdos7.sh lock order reversal: 1st 0xfffff8079a522800 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3473 2nd 0xfffff804c9e82a88 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba2052 at lockmgr_lock_flags+0x172 #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80a7dbe9 at msdosfs_fsync+0x49 #5 0xffffffff810c0219 at VOP_FSYNC_APV+0x59 #6 0xffffffff80cc0840 at kern_fsync+0x180 #7 0xffffffff81010969 at amd64_syscall+0x159 #8 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 08:38:53 all (85/720): msdos8.sh 20200727 08:38:55 all (86/720): msetdomain.sh 20200727 08:38:56 all (87/720): nanosleep.sh 20200727 08:38:58 all (88/720): nbufkv.sh 20200727 08:39:00 all (89/720): nfs.sh 20200727 08:39:01 all (90/720): nfs12.sh 20200727 08:39:03 all (91/720): nfs14.sh 20200727 08:39:04 all (92/720): nfs15.sh 20200727 08:39:06 all (93/720): nfs15lockd.sh 20200727 08:39:07 all (94/720): nfs15lockd3.sh 20200727 08:39:09 all (95/720): nfs3.sh 20200727 08:39:10 all (96/720): nfs4.sh 20200727 08:39:12 all (97/720): nfs7.sh 20200727 08:39:13 all (98/720): nfs8.sh 20200727 08:39:15 all (99/720): nfs9.sh 20200727 08:39:16 all (100/720): nfs_halfpage.sh 20200727 08:39:18 all (101/720): nfs_halfpage2.sh 20200727 08:39:19 all (102/720): nfsdelegation.sh 20200727 08:39:21 all (103/720): nfsdepth.sh 20200727 08:39:22 all (104/720): nfsrename.sh 20200727 08:39:24 all (105/720): nfssillyrename.sh 20200727 08:39:25 all (106/720): nullfs13.sh 20200727 08:39:27 all (107/720): nullfs14.sh 20200727 08:39:28 all (108/720): nullfs15.sh 20200727 08:39:30 all (109/720): nullfs21.sh 20200727 08:39:31 all (110/720): nullfs23.sh 20200727 08:39:33 all (111/720): nullfs4.sh mount leak: 13/44 20200727 08:39:34 all (112/720): nullfs6.sh 20200727 08:39:36 all (113/720): nullfs7.sh 20200727 08:39:38 all (114/720): nullfs9.sh 20200727 08:39:39 all (115/720): numa.sh 20200727 08:39:41 all (116/720): oom.sh 20200727 08:39:42 all (117/720): open.sh 20200727 08:39:44 all (118/720): pagefault.sh 20200727 08:39:45 all (119/720): parallelmount2.sh 20200727 08:39:47 all (120/720): pathconf.sh 20200727 08:39:48 all (121/720): pathconf2.sh 20200727 08:39:50 all (122/720): pcatch.sh 20200727 08:39:51 all (123/720): pcatch2.sh 20200727 08:39:53 all (124/720): ping.sh 20200727 08:39:54 all (125/720): pkru.sh 20200727 08:39:56 all (126/720): pkru2.sh 20200727 08:39:57 all (127/720): pmc4.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 20200727 08:39:59 all (128/720): pmc5.sh 20200727 08:40:01 all (129/720): pmc8.sh 20200727 08:40:02 all (130/720): poll.sh 20200727 08:40:04 all (131/720): posix_fadvise.sh 20200727 08:40:06 all (132/720): posix_fadvise2.sh 20200727 08:40:07 all (133/720): procfs5.sh 20200727 08:40:09 all (134/720): procfs6.sh 20200727 08:40:10 all (135/720): procstat.sh 20200727 08:40:12 all (136/720): pthread9.sh 20200727 08:40:13 all (137/720): ptrace.sh 20200727 08:40:15 all (138/720): ptrace3.sh 20200727 08:40:16 all (139/720): pts2.sh 20200727 08:40:18 all (140/720): quota5.sh 20200727 08:40:19 all (141/720): rename13.sh 20200727 08:40:21 all (142/720): rename4.sh 20200727 08:40:23 all (143/720): revoke.sh 20200727 08:40:24 all (144/720): routetbl.sh 20200727 08:40:26 all (145/720): ruby.sh 20200727 08:40:27 all (146/720): rwlock_ronly.sh 20200727 08:40:29 all (147/720): schedfuzz.sh 20200727 08:40:31 all (148/720): seekdir.sh 20200727 08:40:32 all (149/720): segnp.sh 20200727 08:40:34 all (150/720): segregs.sh 20200727 08:40:35 all (151/720): select3.sh 20200727 08:40:37 all (152/720): sendfile19.sh 20200727 08:40:38 all (153/720): sendfile20.sh 20200727 08:40:40 all (154/720): sendfile4.sh 20200727 08:40:42 all (155/720): setuid.sh 20200727 08:40:43 all (156/720): shm_super.sh 20200727 08:40:45 all (157/720): sigaltstack.sh 20200727 08:40:46 all (158/720): sigreturn.sh 20200727 08:40:48 all (159/720): sigstop.sh 20200727 08:40:50 all (160/720): snap.sh lock order reversal: 1st 0xfffffe003a93e458 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:309 2nd 0xfffff800065cfa30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2333 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba275c at lockmgr_xlock_hard+0x6c #2 0xffffffff80ba34ca at __lockmgr_args+0x63a #3 0xffffffff80e629c6 at ffs_copyonwrite+0x166 #4 0xffffffff80e863ea at ffs_geom_strategy+0xca #5 0xffffffff80e9a2a3 at ufs_strategy+0x83 #6 0xffffffff810c1a41 at VOP_STRATEGY_APV+0x61 #7 0xffffffff80c85dae at bufstrategy+0x3e #8 0xffffffff80c85c4a at bufwrite+0x24a #9 0xffffffff80e8841d at ffs_syncvnode+0x2ed #10 0xffffffff80e8732f at ffs_fsync+0x1f #11 0xffffffff810c0219 at VOP_FSYNC_APV+0x59 #12 0xffffffff80e97e28 at ufs_remove+0xd8 #13 0xffffffff810c03d1 at VOP_REMOVE_APV+0x81 #14 0xffffffff80cbd628 at kern_funlinkat+0x298 #15 0xffffffff80cbd388 at sys_unlink+0x28 #16 0xffffffff81010969 at amd64_syscall+0x159 #17 0xffffffff80fe6a3e at fast_syscall_common+0xf8 lock order reversal: 1st 0xfffff800065cfa30 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:963 2nd 0xfffff80516263a88 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1656 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba275c at lockmgr_xlock_hard+0x6c #2 0xffffffff80ba34ca at __lockmgr_args+0x63a #3 0xffffffff80e60f54 at ffs_snapremove+0xf4 #4 0xffffffff80e5b6b9 at ffs_truncate+0x269 #5 0xffffffff80e8ffac at ufs_inactive+0x1bc #6 0xffffffff810c1169 at VOP_INACTIVE_APV+0x59 #7 0xffffffff80caf707 at vinactivef+0x107 #8 0xffffffff80cae9a8 at vput_final+0x298 #9 0xffffffff80cbd683 at kern_funlinkat+0x2f3 #10 0xffffffff80cbd388 at sys_unlink+0x28 #11 0xffffffff81010969 at amd64_syscall+0x159 #12 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 08:40:52 all (161/720): snap12.sh 20200727 08:40:53 all (162/720): snap2-1.sh 20200727 08:40:55 all (163/720): snap2.sh 20200727 08:40:57 all (164/720): sndstat.sh 20200727 08:40:58 all (165/720): socketpair.sh 20200727 08:41:00 all (166/720): socketpair2.sh 20200727 08:41:01 all (167/720): suj2.sh 20200727 08:41:03 all (168/720): suj32.sh 20200727 08:41:05 all (169/720): suj35.sh Jul 27 08:41:06 mercat1 kernel: pid 78598 (mkdir), uid 0 inumber 255 on /mnt: out of inodes 20200727 08:41:06 all (170/720): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20200727 08:41:08 all (171/720): suj8.sh Jul 27 08:41:09 mercat1 kernel: pid 78831 (dd), uid 0 inumber 4 on /mnt: filesystem full Jul 27 08:41:09 mercat1 kernel: pid 78847 (dd), uid 0 inumber 5 on /mnt: filesystem full 20200727 08:41:10 all (172/720): swapoff3.sh 20200727 08:41:11 all (173/720): swapoff4.sh 20200727 08:41:13 all (174/720): swapoff5.sh 20200727 08:41:14 all (175/720): syzkaller1.sh 20200727 08:41:16 all (176/720): syzkaller2.sh 20200727 08:41:18 all (177/720): syzkaller3.sh 20200727 08:41:19 all (178/720): syzkaller5.sh 20200727 08:41:21 all (179/720): syzkaller6.sh 20200727 08:41:22 all (180/720): tar.sh 20200727 08:41:24 all (181/720): temp.sh 20200727 08:41:26 all (182/720): tmpfs15.sh 20200727 08:41:27 all (183/720): tmpfs4.sh 20200727 08:41:29 all (184/720): tmpfs6.sh 20200727 08:41:31 all (185/720): tmpfs7.sh 20200727 08:41:33 all (186/720): trim2.sh 20200727 08:41:35 all (187/720): trim5.sh 20200727 08:41:36 all (188/720): trim6.sh 20200727 08:41:38 all (189/720): trim7.sh 20200727 08:41:39 all (190/720): trim8.sh 20200727 08:41:41 all (191/720): truncate4.sh 20200727 08:41:43 all (192/720): truncate6.sh 20200727 08:41:44 all (193/720): tvnlru.sh 20200727 08:41:46 all (194/720): ufssuspend.sh 20200727 08:41:48 all (195/720): uma_zalloc_arg.sh 20200727 08:41:49 all (196/720): unlink.sh 20200727 08:41:51 all (197/720): vfork.sh 20200727 08:41:53 all (198/720): vmio.sh 20200727 08:41:54 all (199/720): watchman.sh 20200727 08:41:56 all (200/720): write.sh 20200727 08:41:57 all (201/720): datagram2.sh 20200727 08:41:59 all (202/720): mountro2.sh 20200727 08:42:01 all (203/720): scp.sh 20200727 08:42:04 all (204/720): sendfile6.sh 20200727 08:42:06 all (205/720): smrstress2.sh 20200727 08:42:08 all (206/720): beneath2.sh 20200727 08:42:09 all (207/720): contigmalloc3.sh 20200727 08:42:18 all (208/720): datagram.sh 20200727 08:42:21 all (209/720): datamove4.sh 20200727 08:42:25 all (210/720): ext2fs3.sh 20200727 08:42:27 all (211/720): extattr.sh 20200727 08:42:30 all (212/720): fcntl.sh 20200727 08:42:32 all (213/720): fpclone2.sh 20200727 08:42:34 all (214/720): isofs.sh 20200727 08:42:37 all (215/720): killpg.sh 20200727 08:42:39 all (216/720): md9.sh lock order reversal: 1st 0xfffff8001852e080 bufwait (bufwait) @ vm/vm_pager.c:391 2nd 0xfffff802483cf578 tmpfs (tmpfs) @ dev/md/md.c:987 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba3b55 at lockmgr_xlock+0x55 #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff806eb272 at mdstart_vnode+0x462 #5 0xffffffff806e8f8e at md_kthread+0x1fe #6 0xffffffff80b8d6c0 at fork_exit+0x80 #7 0xffffffff80fe716e at fork_trampoline+0xe 20200727 08:42:42 all (217/720): mmap25.sh 20200727 08:42:44 all (218/720): mmap26.sh 20200727 08:42:47 all (219/720): mmap28.sh Jul 27 08:42:49 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x801000000 with size 0x5c3000 to be written at offset 0xa6b000 for process mmap28 20200727 08:42:49 all (220/720): mmap8.sh 20200727 08:42:51 all (221/720): mmap9.sh 20200727 08:42:54 all (222/720): msdos9.sh 20200727 08:42:56 all (223/720): newfs5.sh 20200727 08:42:59 all (224/720): nullfs10.sh 20200727 08:43:02 all (225/720): nullfs12.sh 20200727 08:43:04 all (226/720): nullfs16.sh 20200727 08:43:06 all (227/720): nullfs3.sh 20200727 08:43:09 all (228/720): openlock.sh 20200727 08:43:12 all (229/720): overcommit.sh uid 2007, pid 15548: swap reservation for 5368709120 bytes failed uid 2007, pid 15552: swap reservation for 5368709120 bytes failed uid 2007, pid 15547: swap reservation for 4294971392 bytes failed uid 2007, pid 18366: swap reservation for 939524096 bytes failed uid 2007, pid 18424: swap reservation for 939524096 bytes failed uid 2007, pid 18430: swap reservation for 805310464 bytes failed uid 2007, pid 19717: swap reservation for 15032385536 bytes failed uid 2007, pid 19724: swap reservation for 12884905984 bytes failed 20200727 08:53:34 all (230/720): pipe_enomem.sh kern.ipc.maxpipekva exceeded; see tuning(7) 20200727 08:53:41 all (231/720): ptrace11.sh 20200727 08:53:44 all (232/720): ptrace8.sh 20200727 08:53:47 all (233/720): quota9.sh lock order reversal: 1st 0xfffff806dc489c90 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffffe00e0ac6000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80baea34 at __mtx_lock_flags+0x94 #2 0xffffffff80e94a2d at quotaoff_inchange+0xbd #3 0xffffffff80e82466 at ffs_flushfiles+0x126 #4 0xffffffff80e63bdd at softdep_flushfiles+0x9d #5 0xffffffff80e84e0c at ffs_unmount+0xac #6 0xffffffff80ca5a4d at dounmount+0x43d #7 0xffffffff80ca55b9 at kern_unmount+0x2b9 #8 0xffffffff81010969 at amd64_syscall+0x159 #9 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 08:53:49 all (234/720): random.sh 20200727 08:53:52 all (235/720): sendfile.sh 20200727 08:53:54 all (236/720): sendfile2.sh 20200727 08:53:55 all (237/720): smrstress.sh 20200727 08:53:58 all (238/720): snap10.sh 20200727 08:54:00 all (239/720): spin.sh 20200727 08:54:03 all (240/720): truncate5.sh 20200727 08:54:06 all (241/720): umtx_suspend.sh 20200727 08:54:09 all (242/720): vm_fault_dontneed.sh 20200727 08:54:11 all (243/720): contigmalloc2.sh 20200727 08:54:19 all (244/720): devfd.sh 20200727 08:54:23 all (245/720): dup.sh 20200727 08:54:27 all (246/720): extattr3.sh 20200727 08:54:30 all (247/720): mlockall7.sh 20200727 08:54:34 all (248/720): mmap23.sh 20200727 08:54:38 all (249/720): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff8021f9bb288: type VREG usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff805c42f9738 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00d390a100 (pid 33535, mmap4, tid 100254) #0 0xffffffff80ba20b5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8748d at ffs_lock+0x7d #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80cae845 at vput_final+0x135 #5 0xffffffff80eb2f1d at vm_map_process_deferred+0xad #6 0xffffffff80eba4ab at vm_map_remove+0xeb #7 0xffffffff80eb27e0 at vmspace_exit+0xd0 #8 0xffffffff80b88232 at exit1+0x532 #9 0xffffffff80b87cfd at sys_sys_exit+0xd #10 0xffffffff81010969 at amd64_syscall+0x159 #11 0xffffffff80fe6a3e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=8928adb1, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff8021f9bb288: type VREG usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff805c42f9738 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00d390a100 (pid 33535, mmap4, tid 100254) #0 0xffffffff80ba20b5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8748d at ffs_lock+0x7d #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80cae845 at vput_final+0x135 #5 0xffffffff80eb2f1d at vm_map_process_deferred+0xad #6 0xffffffff80eba4ab at vm_map_remove+0xeb #7 0xffffffff80eb27e0 at vmspace_exit+0xd0 #8 0xffffffff80b88232 at exit1+0x532 #9 0xffffffff80b87cfd at sys_sys_exit+0xd Jul 27 08:54:39 #10 0xffffffff81010969 at amd64_syscall+0x159 mercat1 kernel: #11 0xffffffff80fe6a3e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=8pid 33535 (mmap4), uid 0 inumber 4 on /mnt: filesystem full 928adb1, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff8021f9bb288: type VREG usecount 1, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff805c42f9738 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00d39a7a00 (pid 34595, umount, tid 100382) #0 0xffffffff80ba20b5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8748d at ffs_lock+0x7d #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80cada7a at vget_finish+0x7a #5 0xffffffff80cb1433 at vfs_periodic_msync_inactive+0x1b3 #6 0xffffffff80ca59dc at dounmount+0x3cc #7 0xffffffff80ca55b9 at kern_unmount+0x2b9 #8 0xffffffff81010969 at amd64_syscall+0x159 #9 0xffffffff80fe6a3e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=8928adb1, uid=0, gid=0, flags=0x0 ino 4, on dev md10a Jul 27 08:54:41 mercat1 kernel: pid 34595 (umount), uid 0 inumber 4 on /mnt: filesystem full 20200727 08:54:41 all (250/720): procfs2.sh 20200727 08:54:44 all (251/720): pthread.sh 20200727 08:54:48 all (252/720): rename6.sh 20200727 08:54:51 all (253/720): tmpfs5.sh 20200727 08:54:54 all (254/720): udp.sh 20200727 08:54:58 all (255/720): udp2.sh 20200727 08:55:01 all (256/720): unix_socket.sh 20200727 08:55:05 all (257/720): kevent8.sh lock order reversal: 1st 0xfffffe00e7fd5460 filedesc structure (filedesc structure) @ kern/kern_descrip.c:1303 2nd 0xfffff80496a14800 ufs (ufs) @ kern/vfs_subr.c:6196 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba2052 at lockmgr_lock_flags+0x172 #2 0xffffffff80e8748d at ffs_lock+0x7d #3 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cc4af4 at _vn_lock+0x54 #5 0xffffffff80b82a89 at knlist_remove_kq+0x89 #6 0xffffffff80cb9c34 at filt_vfsdetach+0x24 #7 0xffffffff80b83531 at knote_fdclose+0x1b1 #8 0xffffffff80b755f4 at closefp+0x104 #9 0xffffffff81010969 at amd64_syscall+0x159 #10 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 08:55:09 all (258/720): kevent2.sh 20200727 08:55:13 all (259/720): mkfifo6.sh 20200727 08:55:18 all (260/720): mmap13.sh 20200727 08:55:22 all (261/720): mountro4.sh 20200727 08:55:27 all (262/720): procfs3.sh 20200727 08:55:32 all (263/720): rename11.sh 20200727 08:55:36 all (264/720): symlink4.sh 20200727 08:55:41 all (265/720): truncate7.sh 20200727 08:55:46 all (266/720): procfs.sh 20200727 08:55:52 all (267/720): datamove5.sh 20200727 08:55:58 all (268/720): linger3.sh 20200727 08:56:03 all (269/720): pshared.sh 20200727 08:56:09 all (270/720): ptrace2.sh 20200727 08:56:14 all (271/720): sparse.sh 20200727 08:56:24 all (272/720): tmpfs10.sh 20200727 08:56:29 all (273/720): truncate3.sh 20200727 08:56:34 all (274/720): fork.sh 20200727 08:56:41 all (275/720): growfs.sh g_access(1029): provider ufsid/5f1e7aaa194a3a95 has error 6 set g_access(1029): provider ufsid/5f1e7aaa194a3a95 has error 6 set g_access(1029): provider ufsid/5f1e7aaa194a3a95 has error 6 set g_access(1029): provider gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda has error 6 set g_access(1029): provider gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda has error 6 set g_access(1029): provider gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5f1e7aaa194a3a95, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5f1e7aaa194a3a95, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/541c4a6a-cfd6-11ea-9e47-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5f1e7aaa194a3a95, error=17) GEOM leak: 14/87 20200727 08:56:48 all (276/720): linger2.sh Jul 27 08:56:51 mercat1 kernel: pid 81423 (linger2), uid 2007 inumber 888 on /mnt: filesystem full 20200727 08:56:54 all (277/720): linger4.sh Jul 27 08:57:00 mercat1 kernel: pid 82723 (linger4), uid 2007 inumber 56454 on /mnt: out of inodes 20200727 08:57:02 all (278/720): mlockall4.sh 20200727 08:57:08 all (279/720): ptrace9.sh 20200727 08:57:15 all (280/720): quota11.sh 20200727 08:57:21 all (281/720): sendfile18.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200727 08:57:28 all (282/720): sigfastblock.sh 20200727 08:57:36 all (283/720): symlink2.sh 20200727 08:57:44 all (284/720): sysctl.sh 20200727 08:57:52 all (285/720): ffs_blkfree.sh newblk leak: 15848/28682. 20200727 08:58:01 all (286/720): rename8.sh 20200727 08:58:09 all (287/720): tmpfs8.sh 20200727 08:58:19 all (288/720): compare.sh 20200727 08:58:30 all (289/720): fsck5.sh 20200727 08:58:41 all (290/720): proccontrol.sh 20200727 08:58:52 all (291/720): recursiveflushes.sh 20200727 08:59:02 all (292/720): thr.sh 20200727 08:59:12 all (293/720): umountf4.sh 20200727 08:59:23 all (294/720): execve.sh 20200727 08:59:37 all (295/720): md8.sh 20200727 08:59:48 all (296/720): nfs15lockd2.sh 20200727 09:00:00 all (297/720): posix_fadvise3.sh 20200727 09:00:11 all (298/720): rdgsbase.sh 20200727 09:00:23 all (299/720): sendfile24.sh GEOM_NOP: Device md10.nop created. g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 GEOM_NOP: Device md10.nop removed. 20200727 09:00:34 all (300/720): mprotect2.sh 20200727 09:00:47 all (301/720): pmc7.sh lock order reversal: 1st 0xffffffff81802580 proctree (proctree) @ /usr/src/sys/dev/hwpmc/hwpmc_mod.c:2033 2nd 0xfffff800186c0d10 ufs (ufs) @ kern/vfs_cache.c:2441 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80ba1f5c at lockmgr_lock_flags+0x7c #2 0xffffffff80e8748d at ffs_lock+0x7d #3 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cc4af4 at _vn_lock+0x54 #5 0xffffffff80c94373 at vn_vptocnp+0xb3 #6 0xffffffff80c93f65 at vn_fullpath_any+0x95 #7 0xffffffff80c941ec at vn_fullpath+0x6c #8 0xffffffff823438be at pmc_log_process_mappings+0x23e #9 0xffffffff82341b94 at pmc_syscall_handler+0x1684 #10 0xffffffff81010969 at amd64_syscall+0x159 #11 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 09:00:59 all (302/720): shm_open.sh 20200727 09:01:12 all (303/720): tmpfs14.sh 20200727 09:01:24 all (304/720): umountf6.sh 20200727 09:01:37 all (305/720): radix.sh Jul 27 09:01:42 mercat1 kernel: pid 73007 (radix), jid 0, uid 0, was killed: out of swap space 20200727 09:01:47 all (306/720): pipe2.sh 20200727 09:02:01 all (307/720): umountf11.sh 20200727 09:02:15 all (308/720): umountf12.sh 20200727 09:02:29 all (309/720): f_offset.sh 20200727 09:02:46 all (310/720): rdwr.sh 20200727 09:03:03 all (311/720): rename9.sh 20200727 09:04:16 all (312/720): mountu.sh 20200727 09:04:33 all (313/720): sem.sh 20200727 09:04:52 all (314/720): suj10.sh 20200727 09:05:10 all (315/720): ext2fs4.sh 20200727 09:05:30 all (316/720): kevent6.sh 20200727 09:05:51 all (317/720): pread.sh lock order reversal: (sleepable after non-sleepable) 1st 0xfffff80003ab4c08 seqflq (seqflq) @ dev/sound/midi/sequencer.c:758 2nd 0xffffffff81ae48d0 midistat lock (midistat lock) @ dev/sound/midi/midi.c:1493 stack backtrace: #0 0xffffffff80c3e6c1 at witness_debugger+0x71 #1 0xffffffff80bdae07 at _sx_xlock+0x67 #2 0xffffffff8097c8b2 at midimapper_open+0x22 #3 0xffffffff8097f792 at mseq_open+0xf2 #4 0xffffffff80a73cd8 at devfs_open+0x118 #5 0xffffffff810bebd6 at VOP_OPEN_APV+0x56 #6 0xffffffff80cc488e at vn_open_vnode+0x18e #7 0xffffffff80cc422f at vn_open_cred+0x39f #8 0xffffffff80cbc07a at kern_openat+0x1fa #9 0xffffffff81010969 at amd64_syscall+0x159 #10 0xffffffff80fe6a3e at fast_syscall_common+0xf8 20200727 09:06:13 all (318/720): suj14.sh Jul 27 09:06:25 mercat1 kernel: pid 74235 (cp), uid 0 inumber 41060 on /mnt: filesystem full Jul 27 09:06:26 mercat1 kernel: pid 74242 (mkdir), uid 0 inumber 41080 on /mnt: filesystem full Jul 27 09:06:27 mercat1 kernel: pid 74265 (cp), uid 0 inumber 41079 on /mnt: filesystem full Jul 27 09:06:28 mercat1 kernel: pid 74288 (mkdir), uid 0 inumber 41080 on /mnt: filesystem full Jul 27 09:06:29 mercat1 kernel: pid 74310 (mkdir), uid 0 inumber 41080 on /mnt: filesystem full 20200727 09:06:30 all (319/720): mkfifo3.sh 20200727 09:07:02 all (320/720): mmap7.sh 20200727 09:07:26 all (321/720): mountro6.sh 20200727 09:07:47 all (322/720): multicast.sh 20200727 09:08:09 all (323/720): pdfork.sh if_delmulti_locked: detaching ifnet instance 0xfffff800040e2000 20200727 09:08:31 all (324/720): suj33.sh Jul 27 09:08:40 mercat1 kernel: pid 19293 (creat), uid 2007 inumber 32779 on /mnt: filesystem full 20200727 09:08:53 all (325/720): core4.sh Jul 27 09:08:55 mercat1 kernel: Failed to write core file for process core4 (error 5) 20200727 09:09:14 all (326/720): mmap5.sh Jul 27 09:09:14 mercat1 syslogd: last message repeated 59 times 20200727 09:10:18 all (327/720): tmpfs2.sh 20200727 09:10:41 all (328/720): sendmsg2.sh 20200727 09:11:12 all (329/720): rename7.sh 20200727 09:11:33 all (330/720): nullfs22.sh 20200727 09:11:57 all (331/720): sendfile5.sh 20200727 09:12:25 all (332/720): tmpfs19.sh 20200727 09:12:59 all (333/720): multicast2.sh Jul 27 09:13:03 mercat1 mDNSResponder[4103]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) starting Jul 27 09:13:03 mercat1 mDNSResponder[4103]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Jul 27 09:13:03 mercat1 mDNSResponder[4103]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 failed errno 51 (Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff800040e2000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff800040e2000 if_delmulti_locked: detaching ifnet instance 0xfffff800040e2000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 if_delmulti_locked: detaching ifnet instance 0xfffff8025a9ac000 Jul 27 09:13:48 if_delmulti_locked: detaching ifnet instance 0xfffff800040e2000 mercat1 mDNSResponder[4103]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) stopping 20200727 09:14:44 all (334/720): core2.sh 20200727 09:15:14 all (335/720): sendfile3.sh newblk leak: 6534/35216. 20200727 09:15:44 all (336/720): mmap37.sh 20200727 09:16:16 all (337/720): namecache2.sh 20200727 09:16:48 all (338/720): rename3.sh 20200727 09:17:23 all (339/720): rl_entry.sh 20200727 09:17:55 all (340/720): credleak.sh 20200727 09:18:33 all (341/720): msdos5.sh GEOM leak: 19/106 20200727 09:19:05 all (342/720): pthread5.sh witness_lock_list_get: witness exhausted 20200727 09:20:07 all (343/720): fifo3.sh 20200727 09:20:39 all (344/720): split.sh 20200727 09:20:50 all (345/720): umountf5.sh Jul 27 09:21:01 mercat1 kernel: pid 98932 (creat), uid 0 inumber 388 on /mnt: out of inodes Jul 27 09:21:06 mercat1 kernel: pid 98924 (creat), uid 0 inumber 4 on /mnt: out of inodes Jul 27 09:21:11 mercat1 kernel: pid 98920 (creat), uid 0 inumber 1152 on /mnt: out of inodes Jul 27 09:21:18 mercat1 kernel: pid 98911 (creat), uid 0 inumber 772 on /mnt: out of inodes Jul 27 09:21:20 mercat1 kernel: pid 98908 (creat), uid 0 inumber 385 on /mnt: out of inodes Jul 27 09:21:24 mercat1 kernel: pid 98936 (creat), uid 0 inumber 389 on /mnt: out of inodes Jul 27 09:21:26 mercat1 kernel: pid 98935 (creat), uid 0 inumber 771 on /mnt: out of inodes Jul 27 09:21:29 mercat1 kernel: pid 98922 (creat), uid 0 inumber 1153 on /mnt: out of inodes Jul 27 09:21:30 mercat1 syslogd: last message repeated 1 times Jul 27 09:21:35 mercat1 kernel: pid 98917 (creat), uid 0 inumber 769 on /mnt: out of inodes Jul 27 09:21:57 mercat1 kernel: pid 98928 (creat), uid 0 inumber 386 on /mnt: out of inodes Jul 27 09:21:58 mercat1 kernel: pid 98922 (creat), uid 0 inumber 1153 on /mnt: out of inodes Jul 27 09:22:00 mercat1 kernel: pid 98911 (creat), uid 0 inumber 772 on /mnt: out of inodes Jul 27 09:22:05 mercat1 kernel: pid 98934 (creat), uid 0 inumber 770 on /mnt: out of inodes Jul 27 09:22:13 mercat1 kernel: pid 98932 (creat), uid 0 inumber 388 on /mnt: out of inodes Jul 27 09:22:30 mercat1 kernel: pid 98926 (creat), uid 0 inumber 5 on /mnt: out of inodes Jul 27 09:22:35 mercat1 kernel: pid 98908 (creat), uid 0 inumber 385 on /mnt: out of inodes Jul 27 09:22:37 mercat1 kernel: pid 98934 (creat), uid 0 inumber 770 on /mnt: out of inodes Jul 27 09:22:40 mercat1 kernel: pid 98922 (creat), uid 0 inumber 1153 on /mnt: out of inodes 20200727 09:23:00 all (346/720): sendfile_shm.sh 20200727 09:25:02 all (347/720): vnodes.sh 20200727 09:25:41 all (348/720): ufsbench.sh 20200727 09:26:19 all (349/720): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20200727 09:27:02 all (350/720): quota8.sh 20200727 09:27:43 all (351/720): umountf.sh 20200727 09:28:17 all (352/720): bench.sh 20200727 09:29:14 all (353/720): nullfs11.sh 20200727 09:30:04 all (354/720): tcp4.sh Expensive timeout(9) function: 0xffffffff80da71b0(0xfffffe01377e6860) 0.056092130 s Expensive timeout(9) function: 0xffffffff80da8210(0xfffffe00e01dd860) 0.073174343 s 20200727 09:30:54 all (355/720): exlock.sh 20200727 09:31:34 all (356/720): beneath.sh 20200727 09:32:26 all (357/720): fpu.sh 20200727 09:33:18 all (358/720): suj6.sh 20200727 09:34:07 all (359/720): posix_openpt.sh 20200727 09:34:52 all (360/720): suj5.sh 20200727 09:35:51 all (361/720): crossmp5.sh 20200727 09:36:51 all (362/720): jumbo.sh 20200727 09:37:53 all (363/720): advlock.sh 20200727 09:38:54 all (364/720): flock.sh 20200727 09:39:55 all (365/720): fsgs.sh 20200727 09:40:56 all (366/720): fts2.sh 20200727 09:41:57 all (367/720): fullpath.sh 20200727 09:42:59 all (368/720): geomleak2.sh 20200727 09:44:00 all (369/720): mdconfig2.sh 20200727 09:45:01 all (370/720): midi2.sh 20200727 09:46:02 all (371/720): mkfifo8.sh 20200727 09:47:03 all (372/720): mknod.sh 20200727 09:48:04 all (373/720): mmap29.sh 20200727 09:49:06 all (374/720): pts3.sh 20200727 09:50:09 all (375/720): sem_wait.sh 20200727 09:51:10 all (376/720): sendfile8.sh 20200727 09:52:11 all (377/720): sendfile9.sh 20200727 09:53:12 all (378/720): shm.sh 20200727 09:54:14 all (379/720): sigstop2.sh 20200727 09:55:15 all (380/720): socketpair3.sh 20200727 09:56:16 all (381/720): syzkaller10.sh 20200727 09:57:17 all (382/720): syzkaller12.sh 20200727 09:58:19 all (383/720): syzkaller14.sh 20200727 09:59:20 all (384/720): syzkaller4.sh 20200727 10:00:22 all (385/720): syzkaller7.sh 20200727 10:01:23 all (386/720): syzkaller8.sh 20200727 10:02:25 all (387/720): syzkaller9.sh 20200727 10:03:27 all (388/720): crossmp8.sh 20200727 10:04:29 all (389/720): fsck.sh 20200727 10:05:31 all (390/720): tcp3.sh 20200727 10:06:33 all (391/720): tmpfs21.sh 20200727 10:07:34 all (392/720): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200727 10:08:45 all.sh done, elapsed 0 day(s), 01:36.47 20200727 10:08:56 all.sh done, elapsed 0 day(s), 00:00.00 20200727 10:09:07 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:09:33 all (1/1): force.sh Jul 27 10:09:49 mercat1 kernel: pid 18471 (rw), uid 2007 inumber 10582 on /mnt: filesystem full g_vfs_done():md10[WRITE(offset=13019136, length=512)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:10:05 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=546779136, length=4096)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:10:51 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:11:55 all (1/1): force.sh Jul 27 10:12:01 mercat1 kernel: pid 25794 (rw), uid 2007 inumber 107117 on /mnt: filesystem full Jul 27 10:12:13 mercat1 kernel: pid 25838 (swap), jid 0, uid 2007, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:12:36 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:13:26 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt Jul 27 10:14:22 mercat1 kernel: pid 29538 (symlink), uid 2007 inumber 32925 on /mnt: filesystem full Jul 27 10:14:22 mercat1 kernel: pid 29639 (swap), jid 0, uid 2007, was killed: out of swap space 20200727 10:14:32 all (1/1): force.sh Jul 27 10:14:40 mercat1 kernel: pid 31455 (rw), uid 2007 inumber 53658 on /mnt: filesystem full Jul 27 10:14:44 mercat1 kernel: pid 31434 (rw), uid 2007 inumber 48149 on /mnt: filesystem full Jul 27 10:15:10 mercat1 kernel: pid 31539 (swap), jid 0, uid 2007, was killed: out of swap space g_vfs_done():md10[WRITE(offset=213024768, length=131072)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:15:19 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:16:05 all (1/1): force.sh Jul 27 10:16:28 mercat1 kernel: pid 34644 (swap), jid 0, uid 2007, was killed: out of swap space Jul 27 10:16:29 mercat1 kernel: pid 34603 (symlink), uid 2007 inumber 32942 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:16:50 all (1/1): force.sh Jul 27 10:17:00 mercat1 kernel: pid 37003 (symlink), uid 2007 inumber 65798 on /mnt: out of inodes Jul 27 10:17:05 mercat1 kernel: pid 37058 (creat), uid 2007 inumber 65826 on /mnt: out of inodes Jul 27 10:17:17 mercat1 kernel: pid 37082 (creat), uid 2007 inumber 65833 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:17:27 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=452984832, length=131072)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:18:09 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:19:10 all (1/1): force.sh Jul 27 10:19:17 mercat1 kernel: pid 42991 (rw), uid 2007 inumber 83076 on /mnt: filesystem full Jul 27 10:19:35 mercat1 kernel: pid 43052 (swap), jid 0, uid 2007, was killed: out of swap space Jul 27 10:19:54 mercat1 kernel: pid 43016 (swap), jid 0, uid 2007, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:20:02 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:20:56 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=810123264, length=32768)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:21:38 all (1/1): force.sh Jul 27 10:21:46 mercat1 kernel: pid 48046 (rw), uid 2007 inumber 15990 on /mnt: filesystem full Jul 27 10:21:50 mercat1 kernel: pid 48080 (creat), uid 2007 inumber 32925 on /mnt: out of inodes Jul 27 10:21:53 mercat1 kernel: pid 48085 (creat), uid 2007 inumber 32935 on /mnt: out of inodes Jul 27 10:22:13 mercat1 kernel: pid 48091 (swap), jid 0, uid 2007, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:22:21 all (1/1): force.sh Jul 27 10:23:18 mercat1 kernel: pid 49622 (swap), jid 0, uid 2007, was killed: out of swap space Jul 27 10:23:29 mercat1 kernel: pid 49677 (swap), jid 0, uid 2007, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:23:40 all (1/1): force.sh Jul 27 10:24:32 mercat1 kernel: pid 51144 (swap), jid 0, uid 2007, was killed: out of swap space g_vfs_done():md10[WRITE(offset=54263808, length=131072)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:24:48 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:25:42 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:26:03 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:27:19 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:28:00 all (1/1): force.sh Jul 27 10:28:41 mercat1 kernel: pid 64176 (swap), jid 0, uid 2007, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:29:19 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=807010304, length=32768)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:29:44 all (1/1): force.sh Jul 27 10:30:28 mercat1 kernel: pid 67363 (swap), jid 0, uid 2007, was killed: out of swap space Jul 27 10:30:32 mercat1 kernel: pid 67371 (rw), uid 2007 inumber 73482 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:30:43 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:31:19 all (1/1): force.sh Jul 27 10:31:30 mercat1 kernel: pid 71176 (rw), uid 2007 inumber 87262 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:31:39 all (1/1): force.sh Jul 27 10:31:50 mercat1 kernel: pid 72893 (symlink), uid 2007 inumber 32898 on /mnt: out of inodes Jul 27 10:32:06 mercat1 kernel: pid 72991 (creat), uid 2007 inumUFS: forcibly unmounting /dev/md10 from /mnt ber 32909 on /mnt: out of inodes 20200727 10:32:13 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:33:21 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:34:07 all (1/1): force.sh Jul 27 10:34:17 mercat1 kernel: pid 80871 (rw), uid 2007 inumber 56370 on /mnt: filesystem full g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =UFS: forcibly unmounting /dev/md10 from /mnt 6 20200727 10:34:38 all (1/1): force.sh Jul 27 10:34:47 mercat1 kernel: pid 82329 (link), uid 2007 inumber 32912 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:35:01 all (1/1): force.sh Jul 27 10:35:22 mercat1 kernel: pid 83926 (creat), uid 2007 inumber 32919 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:35:40 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=13730816, length=512)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:36:29 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:36:41 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:37:11 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt Jul 27 10:38:05 mercat1 kernel: pid 93510 (swap), jid 0, uid 2007, was killed: out of swap space 20200727 10:38:15 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:38:40 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:39:26 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=775847936, length=32768)]error =UFS: forcibly unmounting /dev/md10 from /mnt 6 20200727 10:40:07 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:40:31 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:41:55 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt g_vfs_done():md10[WRITE(offset=814374912, length=4096)]error = 6 Jul 27 10:42:32 mercat1 kernel: pid 4898 (swap), jid 0, uid 2007, was killed: out of swap space 20200727 10:42:45 all (1/1): force.sh Jul 27 10:42:54 mercat1 kernel: pid 6390 (rw), uid 2007 inumber 21041 on /mnt: filesystem full Jul 27 10:42:58 mercat1 kernel: pid 6435 (mkdir), uid 2007 inumber 32127 on /mnt: out of inodes Jul 27 10:43:05 mercat1 kernel: pid 6400 (creat), uid 2007 inumber 32905 on /mnt: out of inodes Jul 27 10:43:13 mercat1 kernel: pid 6446 (creat), uid 2007 inumber 32924 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:43:23 all (1/1): force.sh Jul 27 10:43:31 mercat1 kernel: pid 8093 (rw), uid 2007 inumber 43149 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:43:49 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:44:39 all (1/1): force.sh Jul 27 10:44:51 mercat1 kernel: pid 11345 (rw), uid 2007 inumber 111501 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:45:21 all (1/1): force.sh Jul 27 10:46:04 mercat1 kernel: pid 13170 (swap), jid 0, uid 2007, was killed: out of swap space UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:46:13 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:46:39 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:47:11 all (1/1): force.sh g_vfs_done():md10[WRITE(offset=272138240, length=32768)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:47:32 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:47:57 all (1/1): force.sh Jul 27 10:48:05 mercat1 kernel: pid 24180 (rw), uid 2007 inumber 32939 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:48:22 all (1/1): force.sh Jul 27 10:48:30 mercat1 kernel: pid 27274 (rw), uid 2007 inumber 34876 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20200727 10:49:10 all (1/1): force.sh UFS: forcibly unmounting /dev/md10 from /mnt mount leak: 13/57 GEOM leak: 4/91 interrupt total irq3: uart1 2316 irq4: uart0 5 irq9: acpi0 4 irq18: ehci0 ehci1 31404 irq19: xhci0 19502 cpu0:timer 9968295 cpu1:timer 9853360 cpu2:timer 10022373 cpu3:timer 11412131 cpu4:timer 10881372 cpu5:timer 12535280 cpu6:timer 9899078 cpu7:timer 10482513 cpu8:timer 10242371 cpu9:timer 10474001 cpu10:timer 10741200 cpu11:timer 9982104 irq56: ahci0 2873629 irq57: igb0:rxq0 33948 irq58: igb0:rxq1 363 irq59: igb0:rxq2 357 irq60: igb0:rxq3 306 irq61: igb0:rxq4 616 irq62: igb0:rxq5 47706 irq63: igb0:aq 2 Total 129504238 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1bd/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 0 tid 100045 ] Stopped at kdb_enter+0x37: movq $0,0x10ba9d6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2968 out of 32628 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 0 tid 100045 td 0xfffffe003e46f100 kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x795e80 curthread = 0xfffffe003e3d9300: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe003e3d9810 fpcurthread = none idlethread = 0xfffffe003e3d9300: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82210384 rsp0 = 0xfffffe00add46cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x5e028fb9c gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f5e80 curthread = 0xfffffe003e3d8c00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe003e3d9110 fpcurthread = none idlethread = 0xfffffe003e3d8c00: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82211384 rsp0 = 0xfffffe00add4bcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x84514ae8b gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc801e80 curthread = 0xfffffe003e3d8500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe003e3d8a10 fpcurthread = none idlethread = 0xfffffe003e3d8500: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82212384 rsp0 = 0xfffffe00add50cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x27de59fd0 gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80de80 curthread = 0xfffffe003e46f100: pid 0 tid 100045 critnest 1 "thread taskq" curpcb = 0xfffffe003e46f610 fpcurthread = none idlethread = 0xfffffe003e3d7e00: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82213384 rsp0 = 0xfffffe0037a18cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x49eb5ddee gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc819e80 curthread = 0xfffffe003e19b000: pid 20 tid 100092 critnest 1 "doneq1" curpcb = 0xfffffe003e19b510 fpcurthread = none idlethread = 0xfffffe003e3d7700: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82214384 rsp0 = 0xfffffe0037b63cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x347a41e46 gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc825e80 curthread = 0xfffffe003e3d7000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe003e3d7510 fpcurthread = none idlethread = 0xfffffe003e3d7000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82215384 rsp0 = 0xfffffe00add5fcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x780980d6b gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc831e80 curthread = 0xfffffe003e3e1a00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe003e3e1f10 fpcurthread = none idlethread = 0xfffffe003e3e1a00: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82216384 rsp0 = 0xfffffe00add64cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x600896f84 gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83de80 curthread = 0xfffffe003e3e1300: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe003e3e1810 fpcurthread = none idlethread = 0xfffffe003e3e1300: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82217384 rsp0 = 0xfffffe00add69cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x5dee72d3a gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc849e80 curthread = 0xfffffe003e3e0c00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe003e3e1110 fpcurthread = none idlethread = 0xfffffe003e3e0c00: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82218384 rsp0 = 0xfffffe00add6ecc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x80a205f8b gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc855e80 curthread = 0xfffffe003e3e0500: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe003e3e0a10 fpcurthread = none idlethread = 0xfffffe003e3e0500: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82219384 rsp0 = 0xfffffe00add73cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x7881639d7 gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc861e80 curthread = 0xfffffe003e3dfe00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe003e3e0310 fpcurthread = none idlethread = 0xfffffe003e3dfe00: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe00add78cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x267672f0e gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86de80 curthread = 0xfffffe003e3df700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe003e3dfc10 fpcurthread = none idlethread = 0xfffffe003e3df700: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe00add7dcc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x27d4f88d4 gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff800186c3510: type VDIR usecount 2785, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff800186e4d68 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 2) #0 0xffffffff80ba20b5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8748d at ffs_lock+0x7d #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80ca041d at lookup+0xdd #5 0xffffffff80c9fe79 at namei+0x5b9 #6 0xffffffff80cc41ab at vn_open_cred+0x31b #7 0xffffffff80cbc07a at kern_openat+0x1fa #8 0xffffffff81010969 at amd64_syscall+0x159 #9 0xffffffff80fe6a3e at fast_syscall_common+0xf8 nlink=30, effnlink=30, size=2048, extsize 0 generation=56909bb9, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffff8018b6faa20: type VREG usecount 1, writecount 1, refcount 3 seqc users 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff80018a82840 ref 0 pages 4 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00d55aea00 (pid 2071, syslogd, tid 100182) #0 0xffffffff80ba20b5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8748d at ffs_lock+0x7d #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80cc07b8 at kern_fsync+0xf8 #5 0xffffffff81010969 at amd64_syscall+0x159 #6 0xffffffff80fe6a3e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=112002, extsize 0 generation=1142b3a4, uid=0, gid=0, flags=0x0 ino 9951839, on dev gpt/work vnode 0xfffff805e599f000: type VDIR usecount 3, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe00d5dedb80 hold count flags () flags () v_object 0xfffff8043d898b58 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe003e46f100 (pid 0, kernel, tid 100045) with shared waiters pending #0 0xffffffff80ba20b5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80e8748d at ffs_lock+0x7d #2 0xffffffff810c15d0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc4af4 at _vn_lock+0x54 #4 0xffffffff80ca5676 at dounmount+0x66 #5 0xffffffff80e8179d at ffs_fsfail_unmount+0x2d #6 0xffffffff80c3086a at taskqueue_run_locked+0xaa #7 0xffffffff80c318e4 at taskqueue_thread_loop+0x94 #8 0xffffffff80b8d6c0 at fork_exit+0x80 #9 0xffffffff80fe716e at fork_trampoline+0xe nlink=2, effnlink=2, size=512, extsize 0 generation=74d5cf41, uid=0, gid=0, flags=0x0 ino 37078272, on dev gpt/work db:1:pho1> show mount 0xfffffe00d5529280 /dev/gpt/work on / (ufs) 0xfffffe00d5def280 devfs on /dev (devfs) 0xfffffe00de093280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e0ac7700 procfs on /proc (procfs) 0xfffffe00d5dedb80 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 96631 Buf domain 0 freebufs 14943 lofreebufs 219 hifreebufs 329 bufspace 2289664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 94 (1429504) dirtyq count 3 (53248) wakeup 0 lim 25 CPU 9, 3, 0, 9, 1, 5, 8, 4, 16, 9, 20, 8, Locked buffers: 1 space 32768 Total buffers: 19275 space 2289664 Buf domain 1 freebufs 14924 lofreebufs 219 hifreebufs 329 bufspace 2625536 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 86 (1667072) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 12, 0, 1, 9, 18, 7, 5, 9, 4, 11, 24, 22, Locked buffers: 0 space 0 Total buffers: 12929 space 2625536 Buf domain 2 freebufs 12056 lofreebufs 219 hifreebufs 329 bufspace 97075200 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2955 (94134272) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 16, 11, 0, 2, 13, 6, 13, 13, 17, 7, 19, 4, Locked buffers: 0 space 0 Total buffers: 14071 space 97075200 Buf domain 3 freebufs 14812 lofreebufs 219 hifreebufs 329 bufspace 6053888 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 20 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 243 (3891200) dirtyq count 20 (655360) wakeup 0 lim 25 CPU 0, 0, 0, 0, 10, 1, 0, 17, 16, 0, 8, 6, Locked buffers: 0 space 0 Total buffers: 21825 space 6053888 Buf domain 4 freebufs 14460 lofreebufs 219 hifreebufs 329 bufspace 17637376 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 607 (15687680) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 1, 0, 2, 7, 0, 1, 12, 2, 14, 24, 1, Locked buffers: 1 space 32768 Total buffers: 15336 space 17637376 Buf domain 5 freebufs 14382 lofreebufs 219 hifreebufs 329 bufspace 20783104 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 6 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 620 (17268736) dirtyq count 6 (196608) wakeup 0 lim 25 CPU 11, 9, 20, 4, 6, 2, 10, 2, 19, 13, 4, 24, Locked buffers: 1 space 32768 Total buffers: 5406 space 20783104 Buf domain 6 freebufs 14930 lofreebufs 219 hifreebufs 329 bufspace 2912256 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 75 (1310720) dirtyq count 1 (16384) wakeup 0 lim 25 CPU 17, 0, 2, 2, 16, 12, 5, 23, 12, 8, 12, 18, Locked buffers: 0 space 0 Total buffers: 17089 space 2912256 db:1:pho1> show page vm_cnt.v_free_count: 7558326 vm_cnt.v_inactive_count: 2835 vm_cnt.v_active_count: 4990 vm_cnt.v_laundry_count: 34 vm_cnt.v_wire_count: 556129 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51267 vm_cnt.v_free_target: 173136 vm_cnt.v_inactive_target: 259704 db:1:pho1> show pageq pq_free 7558326 dom 0 page_cnt 8124611 free 7558326 pq_act 4990 pq_inact 2835 pq_laund 34 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000087 | 000000 11 (008192K) | 000536 | 000000 10 (004096K) | 001178 | 000000 09 (002048K) | 001934 | 000002 08 (001024K) | 003795 | 000004 07 (000512K) | 007015 | 000010 06 (000256K) | 009595 | 000049 05 (000128K) | 012839 | 000148 04 (000064K) | 017547 | 000324 03 (000032K) | 028619 | 000686 02 (000016K) | 048264 | 001558 01 (000008K) | 070762 | 002694 00 (000004K) | 066985 | 005740 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000002 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000002 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000002 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree socket 960 53 939759 6447161 0 16 902219520 0 VM OBJECT 264 17857 628043 116741599 0 30 170517600 0 Files 80 161 941439 137948949 0 126 75328000 0 RADIX NODE 144 12791 494259 163915653 0 63 73015200 0 VNODE 648 31038 23916 54889818 0 19 35610192 0 THREAD 1792 3536 16327 10216951 0 8 35594496 0 mbuf_cluster 2048 14090 64 924406 0 8 28987392 0 128 128 40378 169430 97541346 0 126 26855424 0 512 512 220 38028 38610179 0 30 19582976 0 S VFS Cache 108 17927 141697 27970464 0 126 17239392 0 swblk 136 1734 116702 1326499 0 62 16107296 0 BUF TRIE 144 528 105424 23952034 0 62 15257088 0 FFS2 dinode 256 28742 23968 49209290 0 62 13493760 0 128 128 81600 6905 986172256 0 126 11328640 0 256 256 982 32993 91960401 0 62 8697600 0 FFS inode 160 28742 24958 49210455 0 63 8592000 0 128 128 64330 1018 148762 0 126 8364544 0 VMSPACE 2536 83 3034 9845162 0 4 7904712 0 128 128 6 60010 37845130 0 126 7682048 0 mbuf 256 16507 4322 313555993 0 254 5332224 0 PROC 1312 116 3289 9859291 0 8 4467360 0 vmem btag 56 20985 39482 637297 0 254 3386152 0 TURNSTILE 136 19864 464 19864 0 62 2764608 0 16 16 160633 3117 3867921 0 254 2620000 0 32 32 70514 3070 12948092 0 254 2354688 0 256 256 133 7937 20219765 0 62 2065920 0 UMA Slabs 0 112 15307 2183 891742 0 126 1958880 0 512 512 3429 275 6791155 0 30 1896448 0 256 256 284 6646 28043256 0 62 1774080 0 SLEEPQUEUE 88 19864 232 19864 0 126 1768448 0 128 Bucket 1024 1551 176 8249114 0 16 1768448 0 256 256 16 6449 113406413 0 62 1655040 0 128 128 10691 1957 5736457 0 126 1618944 0 swpctrie 144 285 10299 116575 0 62 1524096 0 32768 32768 9 35 1601 0 1 1441792 0 4096 4096 348 4 398452 0 2 1441792 0 256 256 0 5280 5246324 0 62 1351680 0 256 Bucket 2048 478 138 4349337 0 8 1261568 0 4096 4096 138 163 11465647 0 2 1232896 0 64 Bucket 512 1792 608 13375008 0 30 1228800 0 64 64 12258 3114 607347049 0 254 983808 0 L VFS Cache 328 153 2619 232797 0 30 909216 0 32 Bucket 256 2833 692 8631487 0 62 902400 0 32768 32768 4 22 384432 0 1 851968 0 64 64 9604 3248 27079168 0 254 822528 0 PWD 32 2768 22684 13110167 0 254 814464 0 16384 16384 46 3 123403 0 1 802816 0 128 128 924 4935 2920563 0 126 749952 0 MAP ENTRY 96 3046 4682 274242006 0 126 741888 0 8192 8192 86 0 87 0 1 704512 0 pbuf 984 0 705 0 0 0 693720 0 TMPFS node 232 0 2873 1873999 0 62 666536 0 65536 65536 1 9 299 0 1 655360 0 ksiginfo 112 3380 2272 1628432 0 126 633024 0 65536 65536 3 6 224 0 1 589824 0 65536 65536 4 5 3493 0 1 589824 0 DIRHASH 1024 417 143 1041079 0 16 573440 0 filedesc0 1080 116 318 9859292 0 10 468720 0 UMA Zones 2048 221 7 353 0 8 466944 0 mbuf_packet 256 5 1801 44472459 0 254 462336 0 256 256 9 1626 3925237 0 62 418560 0 32768 32768 12 0 12 0 1 393216 0 32768 32768 12 0 12 0 1 393216 0 64 64 2949 3099 552482 0 254 387072 0 16384 16384 22 1 46185 0 1 376832 0 Mountpoints 2944 5 115 45854 0 4 353280 0 4096 4096 66 13 693179 0 2 323584 0 NAMEI 1024 6 306 493624652 0 16 319488 0 2048 2048 133 13 4330082 0 8 299008 0 1024 1024 208 80 3644151 0 16 294912 0 rl_entry 40 5123 2149 5123 0 254 290880 0 32 32 6718 2102 9162 0 254 282240 0 g_bio 408 1 659 105092493 0 30 269280 0 1024 1024 68 192 9473101 0 16 266240 0 512 512 214 306 151235 0 30 266240 0 65536 65536 4 0 2180 0 1 262144 0 selfd 64 1463 2632 29912586 0 254 262080 0 pipe 760 14 321 1398940 0 16 254600 0 64 64 37 3869 674165155 0 254 249984 0 2048 2048 0 120 2879258 0 8 245760 0 16 16 13495 1755 22653 0 254 244000 0 65536 65536 3 0 15 0 1 196608 0 2048 2048 12 80 12751007 0 8 188416 0 256 256 46 689 429267 0 62 188160 0 udp_inpcb 488 20 364 1440 0 30 187392 0 16 Bucket 144 461 827 9580176 0 62 185472 0 128 128 56 1370 32006 0 126 182528 0 64 64 303 2532 72457 0 254 181440 0 256 256 63 627 32616114 0 62 176640 0 4 Bucket 48 166 3362 2853227 0 254 169344 0 1024 1024 4 160 1386496 0 16 167936 0 unpcb 256 20 625 6128754 0 62 165120 0 8192 8192 20 0 9904 0 1 163840 0 fakepg 104 0 1521 6136 0 126 158184 0 128 128 45 1133 295005 0 126 150784 0 8 Bucket 80 141 1659 2932071 0 126 144000 0 512 512 7 217 498476 0 30 114688 0 32 32 140 3388 884463 0 254 112896 0 32 32 168 3108 26040934 0 254 104832 0 32 32 121 3155 135889 0 254 104832 0 32 32 7 3143 1241439 0 254 100800 0 ttyinq 160 345 280 5356 0 62 100000 0 8192 8192 12 0 12 0 1 98304 0 2 Bucket 32 303 2721 7034082 0 254 96768 0 udpcb 32 20 2878 1440 0 254 92736 0 32 32 278 2620 4834565 0 254 92736 0 8192 8192 11 0 225380 0 1 90112 0 ttyoutq 256 181 149 2851 0 62 84480 0 clpbuf 984 0 78 2438848 0 2 76752 0 UMA Kegs 384 191 4 323 0 30 74880 0 32768 32768 2 0 3 0 1 65536 0 16384 16384 4 0 4 0 1 65536 0 8192 8192 6 2 25710 0 1 65536 0 16 16 847 2903 11153525 0 254 60000 0 8192 8192 6 1 11288 0 1 57344 0 2048 2048 21 7 258 0 8 57344 0 tcpcb 1040 10 45 316883 0 8 57200 0 4096 4096 13 0 15 0 2 53248 0 mt_stats_zone 64 427 341 438 0 254 49152 0 16 16 46 2954 89524 0 254 48000 0 cpuset 104 27 407 27 0 126 45136 0 16 16 24 2726 3708232 0 254 44000 0 4096 4096 0 10 77 0 2 40960 0 1024 1024 23 17 1241227 0 16 40960 0 512 512 23 57 4248 0 30 40960 0 64 pcpu 8 3242 1878 3922 0 254 40960 0 KMAP ENTRY 96 69 348 109 0 126 40032 0 1024 1024 3 33 125690 0 16 36864 0 64 64 72 495 1654400 0 254 36288 0 64 64 20 547 1298148 0 254 36288 0 32768 32768 1 0 2354 0 1 32768 0 2048 2048 0 16 50209 0 8 32768 0 512 512 0 64 2107330 0 30 32768 0 4096 4096 7 0 7 0 2 28672 0 swrbuf 984 0 29 83926 0 2 28536 0 procdesc 136 2 201 1295959 0 62 27608 0 8192 8192 1 2 233702 0 1 24576 0 1024 1024 5 19 11446 0 16 24576 0 mt_zone 24 427 575 438 0 254 24048 0 16 16 21 1479 3844866 0 254 24000 0 rtentry 208 12 102 18 0 62 23712 0 32 32 7 623 8 0 254 20160 0 16 16 29 1221 38 0 254 20000 0 tcp_inpcb 488 10 30 316883 0 30 19520 0 16384 16384 1 0 76 0 1 16384 0 16384 16384 1 0 1 0 1 16384 0 4096 4096 0 4 94810 0 2 16384 0 routing nhops 256 7 53 18 0 62 15360 0 MAP 216 2 69 2 0 62 15336 0 int pcpu 4 482 3102 31234 0 254 14336 0 4096 4096 1 2 28573 0 2 12288 0 512 512 13 11 13 0 30 12288 0 syncache 168 0 72 4487 0 62 12096 0 16 16 5 745 11284 0 254 12000 0 mbuf_jumbo_page 4096 0 2 14154674 0 2 8192 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 2 2 506 0 8 8192 0 1024 1024 6 2 6 0 16 8192 0 64 64 7 119 7 0 254 8064 0 rentr 24 0 334 13028965 0 254 8016 0 FPU_save_area 832 1 8 1 0 16 7488 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 1024 1024 4 0 322777 0 16 4096 0 hostcache 96 0 42 1 0 126 4032 0 VNODEPOLL 120 1 32 415 0 126 3960 0 ripcb 488 1 7 22 0 30 3904 0 UMA Slabs 1 176 16 6 18 0 62 3872 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 2 93 2 0 254 3040 0 SMR SHARED 24 2 93 2 0 254 2280 0 taskq_zone 48 0 0 0 0 254 0 0 dtrace_state_cache 16384 0 0 1 0 1 0 0 FFS1 dinode 128 0 0 11 0 126 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 25248 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 33730 0 254 0 0 tcptw 88 0 0 3266 0 126 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 8369231 0 62 0 0 itimer 352 0 0 1 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS dirent 64 0 0 1858437 0 254 0 0 NCLNODE 744 0 0 0 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 0 0 62 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 280 0 0 0 0 30 0 0 nvme_request 128 0 0 0 0 126 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 984 0 0 21732 0 8 0 0 mdpbuf 984 0 0 58075 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 684163 0 0 0 0 umtx_shm 88 0 0 35 0 126 0 0 umtx pi 96 0 0 2 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 kenv 258 0 0 19573 0 30 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 1 0 1 0 0 32768 32768 0 0 18 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 7 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 2048 2048 0 0 29 0 8 0 0 2048 2048 0 0 1 0 8 0 0 512 512 0 0 1049592 0 30 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 387934 1225 224311336 17 vm pgcache 4096 62650 1600 515677941 111 buf free cache 984 5424 3876 32442266 16 buffer arena-65 65536 0 0 1893 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1420 388 17501809 4 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 8 31 1770470 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 28 2 kstack_cache 16384 3536 7 10216950 1 db:0:pho> acttrace Tracing command cam pid 20 tid 100092 td 0xfffffe003e19b000 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff80ff2ac3, rsp = 0xfffffe0037b63750, rbp = 0xfffffe0037b637c0 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x303/frame 0xfffffe0037b637c0 pmap_invalidate_range() at pmap_invalidate_range+0x131/frame 0xfffffe0037b63820 allocbuf() at allocbuf+0xfd/frame 0xfffffe0037b63880 brelse() at brelse+0x1d4/frame 0xfffffe0037b638e0 bufdone() at bufdone+0x392/frame 0xfffffe0037b63950 ffs_backgroundwritedone() at ffs_backgroundwritedone+0xda/frame 0xfffffe0037b63980 bufdone() at bufdone+0x6c/frame 0xfffffe0037b639f0 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe0037b63a40 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe0037b63a90 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe0037b63ae0 g_disk_done() at g_disk_done+0xed/frame 0xfffffe0037b63b20 xpt_done_process() at xpt_done_process+0x382/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0xf5/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe003e3d9300 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de3aa0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de3ab0 trap() at trap+0x56/frame 0xffffffff81de3bc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de3bc0 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3d8c00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add4ba50, rbp = 0xfffffe00add4ba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add4ba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add4baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add4bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3d8500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3d7000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add5fa50, rbp = 0xfffffe00add5fa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5fa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e1a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e1300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add69a50, rbp = 0xfffffe00add69a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add69a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add69aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add69ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e0c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add6ea50, rbp = 0xfffffe00add6ea50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add6ea50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add6eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add6eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e0500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add73a50, rbp = 0xfffffe00add73a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add73a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add73aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add73ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3dfe00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add78a50, rbp = 0xfffffe00add78a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add78a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add78aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add78ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3df700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add7da50, rbp = 0xfffffe00add7da50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7da50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add7daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e46f100 (CPU 3) kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 67095 67088 67095 2006 S+ select 0xfffff803873ebcc0 top 67088 67087 67088 2006 Ss+ wait 0xfffff8000650ea40 bash 67087 65922 65922 2006 S select 0xfffff80305506540 sshd 67086 18637 18628 0 S nanslp 0xffffffff81cab9cb sleep 65922 2374 65922 0 Ss select 0xfffff804c9ead5c0 sshd 44593 44591 14630 0 S+ piperd 0xfffff801f3f108e8 grep 44592 44591 14630 0 D+ ufs 0xfffff805e599f068 ls 44591 44580 14630 0 S+ wait 0xfffff802dc0a1000 sh 44580 14630 14630 0 S+ piperd 0xfffff806dd8002f8 sh 31560 31559 2229 0 D ufs 0xfffff805e599f068 ls 31559 2229 2229 0 S wait 0xfffff8056d5e1a40 sh 29423 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 lockf 29079 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 rename 29076 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29066 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29064 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 creat 29060 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 creat 29058 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29053 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 mkdir 29052 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29050 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 creat 29049 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 mkfifo 29047 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29040 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29034 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 mkdir 29031 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 creat 29028 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 mkdir 29024 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 openat 29023 1 28930 2007 D+ vfs_bus 0xfffffe00d5dedb80 mkdir 29022 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 rename 29013 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 symlink 29006 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 lockf 28998 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 lockf 28990 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 symlink 28988 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 openat 28986 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 lockf 28984 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 symlink 28981 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 lockf 28979 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 symlink 28974 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 fts 28971 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 openat 28965 1 28930 2007 D+ suspfs 0xfffffe00d5dedc00 openat 28964 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 lockf2 28963 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 rw 28959 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 lockf2 28956 1 28930 2007 DE+ suspfs 0xfffffe00d5dedc00 lockf2 14630 2454 14630 0 S+ wait 0xfffff8079a9f6520 sh 29371 0 0 0 DL ftcl 0xffffffff82c114f4 [ftcleanup] 18640 18628 18628 0 S piperd 0xfffff800187b7be0 sh 18638 18628 18628 0 S piperd 0xfffff804993ee2f8 awk 18637 18628 18628 0 S wait 0xfffff800425c7000 sh 18628 1 18628 0 SWs wait 0xfffff80018ee3520 sh 2454 2452 2454 0 SW+ wait 0xfffff8027db50520 bash 2452 2451 2452 0 SW+ pause 0xfffff80018b2b5c8 csh 2451 2444 2451 2006 SW+ wait 0xfffff8001841c000 su 2444 2443 2444 2006 SWs+ wait 0xfffff8027d0b4520 bash 2443 2440 2440 2006 S select 0xfffff80004181840 sshd 2440 2374 2440 0 Ss select 0xfffff80003f2b3c0 sshd 2437 2436 2437 0 S+ ttyin 0xfffff800041d20b0 csh 2436 1 2436 0 SWs+ wait 0xfffff8000411aa40 login 2435 1 2435 0 Ss+ ttyin 0xfffff800041d24b0 getty 2434 1 2434 0 Ss+ ttyin 0xfffff800183680b0 getty 2433 1 2433 0 Ss+ ttyin 0xfffff800183684b0 getty 2432 1 2432 0 Ss+ ttyin 0xfffff800183688b0 getty 2431 1 2431 0 Ss+ ttyin 0xfffff80018368cb0 getty 2430 1 2430 0 Ss+ ttyin 0xfffff800183670b0 getty 2429 1 2429 0 Ss+ ttyin 0xfffff800183674b0 getty 2428 1 2428 0 Ss+ ttyin 0xfffff800183678b0 getty 2427 1 2427 0 Ss+ ttyin 0xfffff80018367cb0 getty 2378 1 2378 0 Ss nanslp 0xffffffff81cab9c1 cron 2374 1 2374 0 Ss select 0xfffff80018be8840 sshd 2346 1 2346 0 Ss select 0xfffff800425c89c0 powerd 2343 1 2343 123 Ss (threaded) ntpd 100207 S select 0xfffff80018be88c0 ntpd 2278 1 2278 0 Ss rpcsvc 0xfffff8018b6bb260 NLM: master 2275 1 2275 0 Ss select 0xfffff80003eb05c0 rpc.statd 2229 1 2229 0 Ss wait 0xfffff80018edca40 watchdogd 2081 1 2081 0 Ss select 0xfffff80003ef9240 rpcbind 2071 1 2071 0 Ds getbuf 0xfffffe003901aa1c syslogd 2000 1 2000 0 Ss select 0xfffff800185d65c0 devd 1989 1 1989 65 Ss select 0xfffff800041736c0 dhclient 1930 1 1930 0 Ss select 0xfffff80003f2b340 dhclient 1927 1 1927 0 Ss select 0xfffff800425c8bc0 dhclient 33 0 0 0 DL syncer 0xffffffff81d96908 [syncer] 32 0 0 0 DL idle 0xfffff8001841c520 [enc_daemon1] 31 0 0 0 DL vlruwt 0xfffff8001835ba40 [vnlru] 30 0 0 0 DL (threaded) [bufdaemon] 100128 D qsleep 0xffffffff81d95c30 [bufdaemon] 100129 D - 0xffffffff8180aa00 [bufspacedaemon-0] 100132 D - 0xffffffff81812cc0 [bufspacedaemon-1] 100136 D - 0xffffffff8181af80 [bufspacedaemon-2] 100137 D - 0xffffffff81823240 [bufspacedaemon-3] 100138 D - 0xffffffff8182b500 [bufspacedaemon-4] 100139 D - 0xffffffff818337c0 [bufspacedaemon-5] 100140 D - 0xffffffff8183ba80 [bufspacedaemon-6] 100150 D sdflush 0xfffff800188f9ce8 [/ worker] 100205 D sdflush 0xfffff800183128e8 [/tmp worker] 101686 D sdflush 0xfffff8042f2760e8 [/mnt worker] 29 0 0 0 DL idle 0xfffff8001841ca40 [enc_daemon0] 28 0 0 0 DL psleep 0xffffffff81dbaa88 [vmdaemon] 27 0 0 0 DL (threaded) [pagedaemon] 100125 D psleep 0xffffffff81daef18 [dom0] 100130 D launds 0xffffffff81daef24 [laundry: dom0] 100133 D umarcl 0xffffffff80ea67f0 [uma] 26 0 0 0 DL - 0xffffffff81adf578 [rand_harvestq] 25 0 0 0 DL - 0xffffffff81d9556c [soaiod4] 24 0 0 0 DL - 0xffffffff81d9556c [soaiod3] 23 0 0 0 DL - 0xffffffff81d9556c [soaiod2] 22 0 0 0 DL - 0xffffffff81d9556c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4afcf0 [usbus1] 100103 D - 0xfffffe003e4afd48 [usbus1] 100104 D - 0xfffffe003e4afda0 [usbus1] 100105 D - 0xfffffe003e4afdf8 [usbus1] 100106 D - 0xfffffe003e4afe50 [usbus1] 100107 D - 0xfffffe00d2e34cf0 [usbus2] 100108 D - 0xfffffe00d2e34d48 [usbus2] 100109 D - 0xfffffe00d2e34da0 [usbus2] 100110 D - 0xfffffe00d2e34df8 [usbus2] 100111 D - 0xfffffe00d2e34e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b72c0 [doneq0] 100092 Run CPU 4 [doneq1] 100093 D - 0xffffffff819b73c0 [doneq2] 100124 D - 0xffffffff819b7190 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003adac50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003adabf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003adab90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003adab30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003adaad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003adaa70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003adaa10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003ada9b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003ada950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003ada8f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003ada890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003ada830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81dac7d0 [crypto] 14 0 0 0 DL seqstat 0xfffff80003ab4c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81c8a950 [g_event] 100063 D - 0xffffffff81c8a958 [g_up] 100064 D - 0xffffffff81c8a960 [g_down] 12 0 0 0 WL (threaded) [intr] 100040 I [swi5: fast taskq] 100043 I [swi6: task queue] 100044 I [swi6: Giant taskq] 100047 I [swi3: vm] 100048 I [swi1: netisr 0] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100172 I [irq72: ioat0] 100173 I [irq73: ioat1] 100174 I [irq74: ioat2] 100175 I [irq75: ioat3] 100176 I [irq76: ioat4] 100177 I [irq77: ioat5] 100178 I [irq78: ioat6] 100179 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038d5000 [init] 10 0 0 0 DL audit_w 0xffffffff81dacbe8 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff81c8aef0 [swapper] 100015 D - 0xfffff800037d8000 [if_config_tqg_0] 100016 D - 0xfffff800037d7e00 [softirq_0] 100017 D - 0xfffff800037d7d00 [softirq_1] 100018 D - 0xfffff800037d7c00 [softirq_2] 100019 D - 0xfffff800037d7b00 [softirq_3] 100020 D - 0xfffff800037d7a00 [softirq_4] 100021 D - 0xfffff800037d7900 [softirq_5] 100022 D - 0xfffff800037d7800 [softirq_6] 100023 D - 0xfffff800037d7700 [softirq_7] 100024 D - 0xfffff800037d7600 [softirq_8] 100025 D - 0xfffff800037d7500 [softirq_9] 100026 D - 0xfffff800037d7400 [softirq_10] 100027 D - 0xfffff800037d7300 [softirq_11] 100028 D - 0xfffff800037d7200 [if_io_tqg_0] 100029 D - 0xfffff800037d7100 [if_io_tqg_1] 100030 D - 0xfffff800037d7000 [if_io_tqg_2] 100031 D - 0xfffff800037d6e00 [if_io_tqg_3] 100032 D - 0xfffff800037d6d00 [if_io_tqg_4] 100033 D - 0xfffff800037d6c00 [if_io_tqg_5] 100034 D - 0xfffff800037d6b00 [if_io_tqg_6] 100035 D - 0xfffff800037d6a00 [if_io_tqg_7] 100036 D - 0xfffff800037d6900 [if_io_tqg_8] 100037 D - 0xfffff800037d6800 [if_io_tqg_9] 100038 D - 0xfffff800037d6700 [if_io_tqg_10] 100039 D - 0xfffff800037d6600 [if_io_tqg_11] 100041 D - 0xfffff800037c3200 [aiod_kick taskq] 100042 D - 0xfffff800037c3000 [kqueue_ctx taskq] 100045 Run CPU 3 [thread taskq] 100046 D - 0xfffff800037c2700 [in6m_free taskq] 100061 D - 0xfffff800039f4400 [firmware taskq] 100066 D - 0xfffff800039f1b00 [crypto_0] 100067 D - 0xfffff800039f1b00 [crypto_1] 100068 D - 0xfffff800039f1b00 [crypto_2] 100069 D - 0xfffff800039f1b00 [crypto_3] 100070 D - 0xfffff800039f1b00 [crypto_4] 100071 D - 0xfffff800039f1b00 [crypto_5] 100072 D - 0xfffff800039f1b00 [crypto_6] 100073 D - 0xfffff800039f1b00 [crypto_7] 100074 D - 0xfffff800039f1b00 [crypto_8] 100075 D - 0xfffff800039f1b00 [crypto_9] 100076 D - 0xfffff800039f1b00 [crypto_10] 100077 D - 0xfffff800039f1b00 [crypto_11] 100114 D - 0xfffff80014086100 [mca taskq] 100119 D - 0xfffff8001834b600 [acpi_task_0] 100120 D - 0xfffff8001834b600 [acpi_task_1] 100121 D - 0xfffff8001834b600 [acpi_task_2] 100123 D - 0xfffff800037c6d00 [CAM taskq] 100500 D - 0xfffff80663c85300 [dtrace_taskq] 100567 D - 0xfffff80281eb5b00 [system_taskq_0] 100570 D - 0xfffff80281eb5b00 [system_taskq_1] 101472 D - 0xfffff80281eb5b00 [system_taskq_2] 101476 D - 0xfffff80281eb5b00 [system_taskq_3] 101502 D - 0xfffff80281eb5b00 [system_taskq_4] 101532 D - 0xfffff80281eb5b00 [system_taskq_5] 101534 D - 0xfffff80281eb5b00 [system_taskq_6] 101535 D - 0xfffff80281eb5b00 [system_taskq_7] 101539 D - 0xfffff80281eb5b00 [system_taskq_8] 101540 D - 0xfffff80281eb5b00 [system_taskq_9] 101544 D - 0xfffff80281eb5b00 [system_taskq_10] 101550 D - 0xfffff80281eb5b00 [system_taskq_11] 16820 1 10331 0 Z+ pdfork db:0:pho> allt Tracing command top pid 67095 tid 103296 td 0xfffffe01699cca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b3f3700 mi_switch() at mi_switch+0x155/frame 0xfffffe033b3f3720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b3f3760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033b3f37c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033b3f3800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe033b3f3870 seltdwait() at seltdwait+0x6b/frame 0xfffffe033b3f38b0 kern_select() at kern_select+0x87a/frame 0xfffffe033b3f3a90 sys_select() at sys_select+0x56/frame 0xfffffe033b3f3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033b3f3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033b3f3bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8005170ba, rsp = 0x7fffffffe8e8, rbp = 0x7fffffffeaf0 --- Tracing command bash pid 67088 tid 104429 td 0xfffffe014cccea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033642c6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033642c700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033642c740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033642c7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033642c7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033642c850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033642c8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033642cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033642cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033642cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80054325a, rsp = 0x7fffffffe728, rbp = 0x7fffffffe780 --- Tracing command sshd pid 67087 tid 103640 td 0xfffffe015b806000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0337cb3740 mi_switch() at mi_switch+0x155/frame 0xfffffe0337cb3760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0337cb37a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0337cb3800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0337cb3810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe0337cb3870 seltdwait() at seltdwait+0x8d/frame 0xfffffe0337cb38b0 kern_select() at kern_select+0x87a/frame 0xfffffe0337cb3a90 sys_select() at sys_select+0x56/frame 0xfffffe0337cb3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0337cb3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0337cb3bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f10ba, rsp = 0x7fffffffa4f8, rbp = 0x7fffffffa530 --- Tracing command sleep pid 67086 tid 102708 td 0xfffffe015b7c0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033d10d870 mi_switch() at mi_switch+0x155/frame 0xfffffe033d10d890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033d10d8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033d10d930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033d10d970 _sleep() at _sleep+0x258/frame 0xfffffe033d10da10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033d10da90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe033d10dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033d10dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033d10dbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003ba3ba, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6a0 --- Tracing command sshd pid 65922 tid 102586 td 0xfffffe014d79d700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033ca367b0 mi_switch() at mi_switch+0x155/frame 0xfffffe033ca367d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033ca36810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033ca36870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033ca36880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe033ca368e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe033ca36920 kern_poll() at kern_poll+0x4b7/frame 0xfffffe033ca36ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe033ca36ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033ca36bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033ca36bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089481a, rsp = 0x7fffffffe558, rbp = 0x7fffffffe590 --- Tracing command grep pid 44593 tid 103420 td 0xfffffe015bc64700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0337a63840 mi_switch() at mi_switch+0x155/frame 0xfffffe0337a63860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0337a638a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0337a63900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0337a63910 _sleep() at _sleep+0x2c3/frame 0xfffffe0337a639b0 pipe_read() at pipe_read+0x518/frame 0xfffffe0337a63a10 dofileread() at dofileread+0x81/frame 0xfffffe0337a63a60 sys_read() at sys_read+0xc0/frame 0xfffffe0337a63ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0337a63bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0337a63bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80048a0da, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe550 --- Tracing command ls pid 44592 tid 101000 td 0xfffffe015b750a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfd463d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfd463f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfd46430 sleeplk() at sleeplk+0x106/frame 0xfffffe00dfd46490 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe00dfd46530 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe00dfd46570 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe00dfd46590 _vn_lock() at _vn_lock+0x54/frame 0xfffffe00dfd465f0 vget_finish() at vget_finish+0x7a/frame 0xfffffe00dfd46620 cache_lookup() at cache_lookup+0x795/frame 0xfffffe00dfd466e0 vfs_cache_lookup() at vfs_cache_lookup+0x7d/frame 0xfffffe00dfd46730 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe00dfd46750 lookup() at lookup+0x601/frame 0xfffffe00dfd467f0 namei() at namei+0x59c/frame 0xfffffe00dfd468b0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00dfd469d0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00dfd46ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfd46bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfd46bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004b72ba, rsp = 0x7fffffffddd8, rbp = 0x7fffffffde90 --- Tracing command sh pid 44591 tid 102346 td 0xfffffe0165a15a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e05d86e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e05d8700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e05d8740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e05d87a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e05d87b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e05d8850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e05d88e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e05d8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e05d8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e05d8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80041a25a, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 44580 tid 102602 td 0xfffffe017693b800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033ca86840 mi_switch() at mi_switch+0x155/frame 0xfffffe033ca86860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033ca868a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033ca86900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033ca86910 _sleep() at _sleep+0x2c3/frame 0xfffffe033ca869b0 pipe_read() at pipe_read+0x518/frame 0xfffffe033ca86a10 dofileread() at dofileread+0x81/frame 0xfffffe033ca86a60 sys_read() at sys_read+0xc0/frame 0xfffffe033ca86ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033ca86bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033ca86bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004890da, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe530 --- Tracing command ls pid 31560 tid 104439 td 0xfffffe0150dfa500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033645e3d0 mi_switch() at mi_switch+0x155/frame 0xfffffe033645e3f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033645e430 sleeplk() at sleeplk+0x106/frame 0xfffffe033645e490 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe033645e530 ffs_lock() at ffs_lock+0x7d/frame 0xfffffe033645e570 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe033645e590 _vn_lock() at _vn_lock+0x54/frame 0xfffffe033645e5f0 vget_finish() at vget_finish+0x7a/frame 0xfffffe033645e620 cache_lookup() at cache_lookup+0x795/frame 0xfffffe033645e6e0 vfs_cache_lookup() at vfs_cache_lookup+0x7d/frame 0xfffffe033645e730 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe033645e750 lookup() at lookup+0x601/frame 0xfffffe033645e7f0 namei() at namei+0x59c/frame 0xfffffe033645e8b0 kern_statat() at kern_statat+0x7f/frame 0xfffffe033645e9d0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe033645ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033645ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033645ebf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004b72ba, rsp = 0x7fffffffe338, rbp = 0x7fffffffe3f0 --- Tracing command sh pid 31559 tid 100414 td 0xfffffe00d395ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033ce686e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033ce68700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033ce68740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033ce687a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033ce687b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033ce68850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033ce688e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033ce68ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033ce68bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033ce68bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80041a25a, rsp = 0x7fffffffe7d8, rbp = 0x7fffffffe890 --- Tracing command lockf pid 29423 tid 103942 td 0xfffffe015bc9aa00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0337e9f370 mi_switch() at mi_switch+0x155/frame 0xfffffe0337e9f390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0337e9f3d0 _sleep() at _sleep+0x2cd/frame 0xfffffe0337e9f470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0337e9f4c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0337e9f530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe0337e9f5b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe0337e9f5d0 closef() at closef+0x1db/frame 0xfffffe0337e9f660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe0337e9f6c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe0337e9f790 exit1() at exit1+0x487/frame 0xfffffe0337e9f800 sigexit() at sigexit+0x15c/frame 0xfffffe0337e9fae0 postsig() at postsig+0x2cc/frame 0xfffffe0337e9fbb0 ast() at ast+0x54b/frame 0xfffffe0337e9fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe480 Tracing command rename pid 29079 tid 102282 td 0xfffffe013532f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033cd62370 mi_switch() at mi_switch+0x155/frame 0xfffffe033cd62390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033cd623d0 _sleep() at _sleep+0x2cd/frame 0xfffffe033cd62470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033cd624c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe033cd62530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe033cd625b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe033cd625d0 closef() at closef+0x1db/frame 0xfffffe033cd62660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe033cd626c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe033cd62790 exit1() at exit1+0x487/frame 0xfffffe033cd62800 sigexit() at sigexit+0x15c/frame 0xfffffe033cd62ae0 postsig() at postsig+0x2cc/frame 0xfffffe033cd62bb0 ast() at ast+0x54b/frame 0xfffffe033cd62bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe370 Tracing command rename pid 29076 tid 101874 td 0xfffffe01769e4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e03086c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e03086e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0308720 _sleep() at _sleep+0x2cd/frame 0xfffffe00e03087c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e0308810 vn_open_cred() at vn_open_cred+0x67/frame 0xfffffe00e0308960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe00e0308ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e0308bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0308bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80043f41a, rsp = 0x7fffffffe288, rbp = 0x7fffffffe370 --- Tracing command rename pid 29066 tid 103819 td 0xfffffe0169a37500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03398366b0 mi_switch() at mi_switch+0x155/frame 0xfffffe03398366d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0339836710 _sleep() at _sleep+0x2cd/frame 0xfffffe03398367b0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0339836800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe0339836850 kern_renameat() at kern_renameat+0x50/frame 0xfffffe0339836ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0339836bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0339836bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002fb55a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 29064 tid 102965 td 0xfffffe015b7ea000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03394db7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe03394db7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03394db800 _sleep() at _sleep+0x2cd/frame 0xfffffe03394db8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe03394db8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe03394db960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe03394db9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe03394dba00 closef() at closef+0x1db/frame 0xfffffe03394dba90 closefp() at closefp+0x96/frame 0xfffffe03394dbad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03394dbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe03394dbbf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004440fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command creat pid 29060 tid 102949 td 0xfffffe015b7eb500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033948b7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe033948b7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033948b800 _sleep() at _sleep+0x2cd/frame 0xfffffe033948b8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033948b8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe033948b960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe033948b9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe033948ba00 closef() at closef+0x1db/frame 0xfffffe033948ba90 closefp() at closefp+0x96/frame 0xfffffe033948bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033948bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033948bbf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004440fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 29058 tid 100915 td 0xfffffe01769e3800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e06406b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e06406d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0640710 _sleep() at _sleep+0x2cd/frame 0xfffffe00e06407b0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e0640800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0640850 kern_renameat() at kern_renameat+0x50/frame 0xfffffe00e0640ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e0640bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0640bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002fb55a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command mkdir pid 29053 tid 104403 td 0xfffffe015bcde300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b5a87c0 mi_switch() at mi_switch+0x155/frame 0xfffffe033b5a87e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b5a8820 _sleep() at _sleep+0x2cd/frame 0xfffffe033b5a88c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033b5a8910 vn_start_write() at vn_start_write+0x71/frame 0xfffffe033b5a8960 kern_frmdirat() at kern_frmdirat+0x65/frame 0xfffffe033b5a8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033b5a8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033b5a8bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80032e78a, rsp = 0x7fffffffdc48, rbp = 0x7fffffffe080 --- Tracing command rename pid 29052 tid 101760 td 0xfffffe01768bce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033cd586c0 mi_switch() at mi_switch+0x155/frame 0xfffffe033cd586e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033cd58720 _sleep() at _sleep+0x2cd/frame 0xfffffe033cd587c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033cd58810 vn_open_cred() at vn_open_cred+0x67/frame 0xfffffe033cd58960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe033cd58ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033cd58bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033cd58bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80043f41a, rsp = 0x7fffffffe288, rbp = 0x7fffffffe370 --- Tracing command creat pid 29050 tid 102784 td 0xfffffe015bc38000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b08b6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe033b08b6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b08b730 _sleep() at _sleep+0x2cd/frame 0xfffffe033b08b7d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033b08b820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe033b08b870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe033b08bab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe033b08bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033b08bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033b08bbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043ba5a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command mkfifo pid 29049 tid 102438 td 0xfffffe00e7764700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e07126d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e07126f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0712730 _sleep() at _sleep+0x2cd/frame 0xfffffe00e07127d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e0712820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0712870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe00e0712ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0712ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e0712bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0712bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043ba5a, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- Tracing command rename pid 29047 tid 100427 td 0xfffffe0169860300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe01292c56c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01292c56e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01292c5720 _sleep() at _sleep+0x2cd/frame 0xfffffe01292c57c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe01292c5810 vn_open_cred() at vn_open_cred+0x67/frame 0xfffffe01292c5960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe01292c5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe01292c5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01292c5bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80043f41a, rsp = 0x7fffffffe288, rbp = 0x7fffffffe370 --- Tracing command rename pid 29040 tid 103522 td 0xfffffe0161044500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03396636c0 mi_switch() at mi_switch+0x155/frame 0xfffffe03396636e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0339663720 _sleep() at _sleep+0x2cd/frame 0xfffffe03396637c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0339663810 vn_open_cred() at vn_open_cred+0x67/frame 0xfffffe0339663960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe0339663ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0339663bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0339663bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80043f41a, rsp = 0x7fffffffe288, rbp = 0x7fffffffe370 --- Tracing command mkdir pid 29034 tid 101542 td 0xfffffe00d3951a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddaf27c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddaf27e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddaf2820 _sleep() at _sleep+0x2cd/frame 0xfffffe00ddaf28c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00ddaf2910 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00ddaf2960 kern_frmdirat() at kern_frmdirat+0x65/frame 0xfffffe00ddaf2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddaf2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddaf2bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80032e78a, rsp = 0x7fffffff8308, rbp = 0x7fffffff8740 --- Tracing command creat pid 29031 tid 104398 td 0xfffffe015bcf9c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b58f7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe033b58f7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b58f800 _sleep() at _sleep+0x2cd/frame 0xfffffe033b58f8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033b58f8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe033b58f960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe033b58f9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe033b58fa00 closef() at closef+0x1db/frame 0xfffffe033b58fa90 closefp() at closefp+0x96/frame 0xfffffe033b58fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033b58fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033b58fbf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004440fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command mkdir pid 29028 tid 101344 td 0xfffffe0132e4ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8df87c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8df87e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8df8820 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8df88c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e8df8910 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e8df8960 kern_frmdirat() at kern_frmdirat+0x65/frame 0xfffffe00e8df8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8df8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e8df8bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x80032e78a, rsp = 0x7fffffffdc48, rbp = 0x7fffffffe080 --- Tracing command openat pid 29024 tid 102756 td 0xfffffe015b781800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033d1fd7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe033d1fd7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033d1fd800 _sleep() at _sleep+0x2cd/frame 0xfffffe033d1fd8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033d1fd8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe033d1fd960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe033d1fd9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe033d1fda00 closef() at closef+0x1db/frame 0xfffffe033d1fda90 closefp() at closefp+0x96/frame 0xfffffe033d1fdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033d1fdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033d1fdbf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004440fa, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command mkdir pid 29023 tid 100393 td 0xfffffe0169aa1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0335d444c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0335d444e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0335d44520 _sleep() at _sleep+0x2cd/frame 0xfffffe0335d445c0 vfs_busy() at vfs_busy+0x2e3/frame 0xfffffe0335d44600 vn_vget_ino_gen() at vn_vget_ino_gen+0xa2/frame 0xfffffe0335d44670 vn_vget_ino() at vn_vget_ino+0x21/frame 0xfffffe0335d44690 ufs_lookup_ino() at ufs_lookup_ino+0x4c1/frame 0xfffffe0335d447a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe0335d447c0 vfs_cache_lookup() at vfs_cache_lookup+0xa8/frame 0xfffffe0335d44810 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe0335d44830 lookup() at lookup+0x601/frame 0xfffffe0335d448d0 namei() at namei+0x59c/frame 0xfffffe0335d44990 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe0335d44ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0335d44bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0335d44bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002fb8da, rsp = 0x7ffffffd3cc8, rbp = 0x7ffffffd4100 --- Tracing command rename pid 29022 tid 102651 td 0xfffffe014cc8d500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033cbc66b0 mi_switch() at mi_switch+0x155/frame 0xfffffe033cbc66d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033cbc6710 _sleep() at _sleep+0x2cd/frame 0xfffffe033cbc67b0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033cbc6800 vn_start_write() at vn_start_write+0x71/frame 0xfffffe033cbc6850 kern_renameat() at kern_renameat+0x50/frame 0xfffffe033cbc6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033cbc6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033cbc6bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002fb55a, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command symlink pid 29013 tid 102257 td 0xfffffe015b71e000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0204710 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0204730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0204770 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0204810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e0204860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e02048b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe00e0204ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e0204bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0204bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb69a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 29006 tid 103409 td 0xfffffe015bc65500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0337a2c6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe0337a2c6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0337a2c730 _sleep() at _sleep+0x2cd/frame 0xfffffe0337a2c7d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0337a2c820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe0337a2c870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe0337a2cab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0337a2cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0337a2cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0337a2cbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043ba5a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 28998 tid 102768 td 0xfffffe015b781100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b03b6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe033b03b6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b03b730 _sleep() at _sleep+0x2cd/frame 0xfffffe033b03b7d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033b03b820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe033b03b870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe033b03bab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe033b03bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033b03bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033b03bbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043ba5a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command symlink pid 28990 tid 104474 td 0xfffffe0145579700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033650d6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe033650d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033650d730 _sleep() at _sleep+0x2cd/frame 0xfffffe033650d7d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033650d820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe033650d870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe033650dab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe033650dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033650dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033650dbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043ba5a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command openat pid 28988 tid 102403 td 0xfffffe01622b9000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033cad17a0 mi_switch() at mi_switch+0x155/frame 0xfffffe033cad17c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033cad1800 _sleep() at _sleep+0x2cd/frame 0xfffffe033cad18a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033cad18f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe033cad1960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe033cad19e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe033cad1a00 closef() at closef+0x1db/frame 0xfffffe033cad1a90 closefp() at closefp+0x96/frame 0xfffffe033cad1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033cad1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033cad1bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004440fa, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 28986 tid 101817 td 0xfffffe015b7a6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0335e706c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0335e706e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0335e70720 _sleep() at _sleep+0x2cd/frame 0xfffffe0335e707c0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0335e70810 vn_open_cred() at vn_open_cred+0x67/frame 0xfffffe0335e70960 kern_openat() at kern_openat+0x1fa/frame 0xfffffe0335e70ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0335e70bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0335e70bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80043f41a, rsp = 0x7fffffffe398, rbp = 0x7fffffffe480 --- Tracing command symlink pid 28984 tid 102884 td 0xfffffe015b7dd800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033cc8b710 mi_switch() at mi_switch+0x155/frame 0xfffffe033cc8b730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033cc8b770 _sleep() at _sleep+0x2cd/frame 0xfffffe033cc8b810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033cc8b860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe033cc8b8b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe033cc8bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033cc8bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe033cc8bbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb69a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command lockf pid 28981 tid 100921 td 0xfffffe014cbcb800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e04896d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e04896f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0489730 _sleep() at _sleep+0x2cd/frame 0xfffffe00e04897d0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e0489820 vn_start_write() at vn_start_write+0x71/frame 0xfffffe00e0489870 kern_funlinkat() at kern_funlinkat+0x68/frame 0xfffffe00e0489ab0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e0489ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e0489bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e0489bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80043ba5a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4b0 --- Tracing command symlink pid 28979 tid 101038 td 0xfffffe015bcf8700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0335e52710 mi_switch() at mi_switch+0x155/frame 0xfffffe0335e52730 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0335e52770 _sleep() at _sleep+0x2cd/frame 0xfffffe0335e52810 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0335e52860 vn_start_write() at vn_start_write+0x71/frame 0xfffffe0335e528b0 kern_symlinkat() at kern_symlinkat+0x11d/frame 0xfffffe0335e52ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0335e52bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0335e52bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002fb69a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command fts pid 28974 tid 102140 td 0xfffffe017685c700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e095f7a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e095f7c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e095f800 _sleep() at _sleep+0x2cd/frame 0xfffffe00e095f8a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe00e095f8f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe00e095f960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe00e095f9e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe00e095fa00 closef() at closef+0x1db/frame 0xfffffe00e095fa90 closefp() at closefp+0x96/frame 0xfffffe00e095fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e095fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e095fbf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004430fa, rsp = 0x7fffffffe378, rbp = 0x7fffffffe420 --- Tracing command openat pid 28971 tid 103436 td 0xfffffe0176977800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0337ab3370 mi_switch() at mi_switch+0x155/frame 0xfffffe0337ab3390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0337ab33d0 _sleep() at _sleep+0x2cd/frame 0xfffffe0337ab3470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe0337ab34c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0337ab3530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe0337ab35b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe0337ab35d0 closef() at closef+0x1db/frame 0xfffffe0337ab3660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe0337ab36c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe0337ab3790 exit1() at exit1+0x487/frame 0xfffffe0337ab3800 sigexit() at sigexit+0x15c/frame 0xfffffe0337ab3ae0 postsig() at postsig+0x2cc/frame 0xfffffe0337ab3bb0 ast() at ast+0x54b/frame 0xfffffe0337ab3bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe370 Tracing command openat pid 28965 tid 103752 td 0xfffffe00d39a7a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03360e57a0 mi_switch() at mi_switch+0x155/frame 0xfffffe03360e57c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03360e5800 _sleep() at _sleep+0x2cd/frame 0xfffffe03360e58a0 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe03360e58f0 vn_close1() at vn_close1+0x8b/frame 0xfffffe03360e5960 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe03360e59e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe03360e5a00 closef() at closef+0x1db/frame 0xfffffe03360e5a90 closefp() at closefp+0x96/frame 0xfffffe03360e5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03360e5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe03360e5bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004440fa, rsp = 0x7fffffffe378, rbp = 0x7fffffffe4b0 --- Tracing command lockf2 pid 28964 tid 102038 td 0xfffffe01768cf100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0129289370 mi_switch() at mi_switch+0x155/frame 0xfffffe0129289390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe01292893d0 _sleep() at _sleep+0x2cd/frame 0xfffffe0129289470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe01292894c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0129289530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe01292895b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe01292895d0 closef() at closef+0x1db/frame 0xfffffe0129289660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe01292896c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe0129289790 exit1() at exit1+0x487/frame 0xfffffe0129289800 sigexit() at sigexit+0x15c/frame 0xfffffe0129289ae0 postsig() at postsig+0x2cc/frame 0xfffffe0129289bb0 ast() at ast+0x54b/frame 0xfffffe0129289bf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe0129289bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800445c3a, rsp = 0x7fffffffe438, rbp = 0x7fffffffe480 --- Tracing command rw pid 28963 tid 103529 td 0xfffffe0161043700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0339686370 mi_switch() at mi_switch+0x155/frame 0xfffffe0339686390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03396863d0 _sleep() at _sleep+0x2cd/frame 0xfffffe0339686470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe03396864c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe0339686530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe03396865b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe03396865d0 closef() at closef+0x1db/frame 0xfffffe0339686660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe03396866c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe0339686790 exit1() at exit1+0x487/frame 0xfffffe0339686800 sigexit() at sigexit+0x15c/frame 0xfffffe0339686ae0 postsig() at postsig+0x2cc/frame 0xfffffe0339686bb0 ast() at ast+0x54b/frame 0xfffffe0339686bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe4b0 Tracing command lockf2 pid 28959 tid 104063 td 0xfffffe01699b7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03362fe370 mi_switch() at mi_switch+0x155/frame 0xfffffe03362fe390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03362fe3d0 _sleep() at _sleep+0x2cd/frame 0xfffffe03362fe470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe03362fe4c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe03362fe530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe03362fe5b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe03362fe5d0 closef() at closef+0x1db/frame 0xfffffe03362fe660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe03362fe6c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe03362fe790 exit1() at exit1+0x487/frame 0xfffffe03362fe800 sigexit() at sigexit+0x15c/frame 0xfffffe03362feae0 postsig() at postsig+0x2cc/frame 0xfffffe03362febb0 ast() at ast+0x54b/frame 0xfffffe03362febf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe03362febf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800445c3a, rsp = 0x7fffffffe438, rbp = 0x7fffffffe480 --- Tracing command lockf2 pid 28956 tid 104409 td 0xfffffe015bcddc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b5c6370 mi_switch() at mi_switch+0x155/frame 0xfffffe033b5c6390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b5c63d0 _sleep() at _sleep+0x2cd/frame 0xfffffe033b5c6470 vn_start_write_refed() at vn_start_write_refed+0x260/frame 0xfffffe033b5c64c0 vn_close1() at vn_close1+0x8b/frame 0xfffffe033b5c6530 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe033b5c65b0 _fdrop() at _fdrop+0x1a/frame 0xfffffe033b5c65d0 closef() at closef+0x1db/frame 0xfffffe033b5c6660 fdescfree_fds() at fdescfree_fds+0x9c/frame 0xfffffe033b5c66c0 fdescfree() at fdescfree+0x3e3/frame 0xfffffe033b5c6790 exit1() at exit1+0x487/frame 0xfffffe033b5c6800 sigexit() at sigexit+0x15c/frame 0xfffffe033b5c6ae0 postsig() at postsig+0x2cc/frame 0xfffffe033b5c6bb0 ast() at ast+0x54b/frame 0xfffffe033b5c6bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe480 Tracing command sh pid 14630 tid 103471 td 0xfffffe017001fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0337b626e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0337b62700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0337b62740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0337b627a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0337b627b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0337b62850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0337b628e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0337b62ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0337b62bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0337b62bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80041a25a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ftcleanup pid 29371 tid 100469 td 0xfffffe00d39b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e03b2a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e03b2a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e03b2ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e03b2b60 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x269/frame 0xfffffe00e03b2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e03b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e03b2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 18640 tid 100646 td 0xfffffe00d35a6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e04c5840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e04c5860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e04c58a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e04c5900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e04c5910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e04c59b0 pipe_read() at pipe_read+0x518/frame 0xfffffe00e04c5a10 dofileread() at dofileread+0x81/frame 0xfffffe00e04c5a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e04c5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e04c5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e04c5bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004890da, rsp = 0x7fffffffddb8, rbp = 0x7fffffffe2e0 --- Tracing command awk pid 18638 tid 100384 td 0xfffffe00d45fd300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e03a3840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e03a3860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e03a38a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e03a3900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e03a3910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e03a39b0 pipe_read() at pipe_read+0x518/frame 0xfffffe00e03a3a10 dofileread() at dofileread+0x81/frame 0xfffffe00e03a3a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e03a3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e03a3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e03a3bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80048d0da, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe2e0 --- Tracing command sh pid 18637 tid 100206 td 0xfffffe00d31b6c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc2e6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc2e700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc2e740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc2e7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc2e7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00dfc2e850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00dfc2e8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00dfc2ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc2ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc2ebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80041a25a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command sh pid 18628 tid 100196 td 0xfffffe00d55f7300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddbed6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a17dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a17de0 trap() at trap+0x6c/frame 0xfffffe0037a17ef0 calltrap() at calltrap+0x8/frame 0xfffffe0037a17ef0 --- trap 0xc, rip = 0xffffffff80fe3390, rsp = 0xfffffe0037a17fc0, rbp = 0xfffffe0037a18050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00ddbed6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2454 tid 100217 td 0xfffffe00e0176e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc656e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a17dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a17de0 trap() at trap+0x6c/frame 0xfffffe0037a17ef0 calltrap() at calltrap+0x8/frame 0xfffffe0037a17ef0 --- trap 0xc, rip = 0xffffffff80fe3390, rsp = 0xfffffe0037a17fc0, rbp = 0xfffffe0037a18050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00dfc656e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2452 tid 100153 td 0xfffffe00d55b2000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddaaa8d0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a17dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a17de0 trap() at trap+0x6c/frame 0xfffffe0037a17ef0 calltrap() at calltrap+0x8/frame 0xfffffe0037a17ef0 --- trap 0xc, rip = 0xffffffff80fe3390, rsp = 0xfffffe0037a17fc0, rbp = 0xfffffe0037a18050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00ddaaa8d8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2451 tid 100156 td 0xfffffe00d61fba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddab96e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a17dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a17de0 trap() at trap+0x6c/frame 0xfffffe0037a17ef0 calltrap() at calltrap+0x8/frame 0xfffffe0037a17ef0 --- trap 0xc, rip = 0xffffffff80fe3390, rsp = 0xfffffe0037a17fc0, rbp = 0xfffffe0037a18050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00ddab96e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2444 tid 100190 td 0xfffffe00d5df2e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddb9f6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a17dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a17de0 trap() at trap+0x6c/frame 0xfffffe0037a17ef0 calltrap() at calltrap+0x8/frame 0xfffffe0037a17ef0 --- trap 0xc, rip = 0xffffffff80fe3390, rsp = 0xfffffe0037a17fc0, rbp = 0xfffffe0037a18050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00ddb9f6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2443 tid 100167 td 0xfffffe00d55b8a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddafc740 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddafc760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddafc7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddafc800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ddafc810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00ddafc870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ddafc8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00ddafca90 sys_select() at sys_select+0x56/frame 0xfffffe00ddafcad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddafcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddafcbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f142a, rsp = 0x7fffffffa4f8, rbp = 0x7fffffffa530 --- Tracing command sshd pid 2440 tid 100157 td 0xfffffe00d58e4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddabe7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddabe7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddabe810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddabe870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ddabe880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00ddabe8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ddabe920 kern_poll() at kern_poll+0x4b7/frame 0xfffffe00ddabeab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00ddabead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddabebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddabebf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800894b9a, rsp = 0x7fffffffe558, rbp = 0x7fffffffe590 --- Tracing command csh pid 2437 tid 100200 td 0xfffffe00d5599100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc047c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc047e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc04820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc04880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc04890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc048f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc04920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc04980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc049b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc04a10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc04a60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc04ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc04bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc04bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80051f44a, rsp = 0x7fffffffe198, rbp = 0x7fffffffe1c0 --- Tracing command login pid 2436 tid 100142 td 0xfffffe00d6097000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda736e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a17dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a17de0 trap() at trap+0x6c/frame 0xfffffe0037a17ef0 calltrap() at calltrap+0x8/frame 0xfffffe0037a17ef0 --- trap 0xc, rip = 0xffffffff80fe3390, rsp = 0xfffffe0037a17fc0, rbp = 0xfffffe0037a18050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00dda736e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a18040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a18050 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a18090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a18120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a18140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a181e0 db_command() at db_command+0x25c/frame 0xfffffe0037a182b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a18350 db_command() at db_command+0x25c/frame 0xfffffe0037a18420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a18430 db_trap() at db_trap+0xe8/frame 0xfffffe0037a184c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe0037a18530 trap() at trap+0x7b8/frame 0xfffffe0037a18640 calltrap() at calltrap+0x8/frame 0xfffffe0037a18640 --- trap 0x3, rip = 0xffffffff80c1b9c7, rsp = 0xfffffe0037a18710, rbp = 0xfffffe0037a18720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2435 tid 100223 td 0xfffffe00d3d7f100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc837c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc837e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc83820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc83880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc83890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc838f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc83920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc83980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc839b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc83a10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc83a60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc83ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc83bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc83bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2434 tid 100222 td 0xfffffe00d3d7f800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc7e7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc7e7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc7e820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc7e880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc7e890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc7e8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc7e920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc7e980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc7e9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc7ea10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc7ea60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc7ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc7ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc7ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2433 tid 100221 td 0xfffffe00d3de0000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc797c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc797e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc79820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc79880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc79890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc798f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc79920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc79980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc799b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc79a10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc79a60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc79ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc79bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc79bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2432 tid 100220 td 0xfffffe00d3de0700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc747c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc747e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc74820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc74880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc74890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc748f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc74920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc74980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc749b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc74a10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc74a60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc74ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc74bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc74bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2431 tid 100219 td 0xfffffe00d3de0e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc6f7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc6f7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc6f820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc6f880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc6f890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc6f8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc6f920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc6f980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc6f9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc6fa10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc6fa60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc6fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc6fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc6fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2430 tid 100218 td 0xfffffe00d58e6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc6a7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc6a7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc6a820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc6a880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc6a890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc6a8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc6a920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc6a980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc6a9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc6aa10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc6aa60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc6aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc6abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc6abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2429 tid 100208 td 0xfffffe00d58e7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc387c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc387e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc38820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc38880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc38890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc388f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc38920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc38980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc389b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc38a10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc38a60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc38ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc38bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc38bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2428 tid 100209 td 0xfffffe00d58e7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc3d7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc3d7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc3d820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc3d880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc3d890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc3d8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dfc3d920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dfc3d980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dfc3d9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dfc3da10 dofileread() at dofileread+0x81/frame 0xfffffe00dfc3da60 sys_read() at sys_read+0xc0/frame 0xfffffe00dfc3dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc3dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc3dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command getty pid 2427 tid 100141 td 0xfffffe00d58e5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda6e7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda6e7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda6e820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dda6e880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dda6e890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dda6e8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00dda6e920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00dda6e980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00dda6e9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00dda6ea10 dofileread() at dofileread+0x81/frame 0xfffffe00dda6ea60 sys_read() at sys_read+0xc0/frame 0xfffffe00dda6ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dda6ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dda6ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80044644a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebc0 --- Tracing command cron pid 2378 tid 100148 td 0xfffffe00d5df5800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda91870 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda91890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda918d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dda91930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00dda91970 _sleep() at _sleep+0x258/frame 0xfffffe00dda91a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00dda91a90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00dda91ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dda91bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dda91bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003eb73a, rsp = 0x7fffffffea58, rbp = 0x7fffffffec40 --- Tracing command sshd pid 2374 tid 100203 td 0xfffffe00d55b6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc13740 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc13760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc137a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc13800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc13810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc13870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00dfc138b0 kern_select() at kern_select+0x87a/frame 0xfffffe00dfc13a90 sys_select() at sys_select+0x56/frame 0xfffffe00dfc13ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc13bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc13bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f142a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe620 --- Tracing command powerd pid 2346 tid 100195 td 0xfffffe00d559c000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddbe8700 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddbe8720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddbe8760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddbe87c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ddbe8800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00ddbe8870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ddbe88b0 kern_select() at kern_select+0x87a/frame 0xfffffe00ddbe8a90 sys_select() at sys_select+0x56/frame 0xfffffe00ddbe8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddbe8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddbe8bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044342a, rsp = 0x7fffffffeb08, rbp = 0x7fffffffec50 --- Tracing command ntpd pid 2343 tid 100207 td 0xfffffe00d5596000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc33740 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc33760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc337a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc33800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dfc33810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dfc33870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00dfc338b0 kern_select() at kern_select+0x87a/frame 0xfffffe00dfc33a90 sys_select() at sys_select+0x56/frame 0xfffffe00dfc33ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc33bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc33bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082042a, rsp = 0x7fffffffde78, rbp = 0x7fffffffdeb0 --- Tracing command rpc.lockd pid 2278 tid 100202 td 0xfffffe00d5596700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc0e640 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc0e660 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc0e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dfc0e700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00dfc0e740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00dfc0e7b0 svc_run_internal() at svc_run_internal+0xafe/frame 0xfffffe00dfc0e8f0 svc_run() at svc_run+0x253/frame 0xfffffe00dfc0e950 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00dfc0ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dfc0ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dfc0ebf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002fb87a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffec40 --- Tracing command rpc.statd pid 2275 tid 100161 td 0xfffffe003e46dc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddad2700 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddad2720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddad2760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddad27c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ddad2800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00ddad2870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ddad28b0 kern_select() at kern_select+0x87a/frame 0xfffffe00ddad2a90 sys_select() at sys_select+0x56/frame 0xfffffe00ddad2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddad2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddad2bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043942a, rsp = 0x7fffffffea18, rbp = 0x7fffffffeb60 --- Tracing command watchdogd pid 2229 tid 100199 td 0xfffffe00d55f6500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddbfc6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddbfc700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddbfc740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddbfc7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ddbfc7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ddbfc850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ddbfc8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ddbfcad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddbfcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddbfcbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003d45da, rsp = 0x7fffffffe9a8, rbp = 0x7fffffffea60 --- Tracing command rpcbind pid 2081 tid 100143 td 0xfffffe00d5df3c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda78770 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda78790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda787d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dda78830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00dda78870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00dda788e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00dda78920 kern_poll() at kern_poll+0x4b7/frame 0xfffffe00dda78ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00dda78ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dda78bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dda78bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003e1b9a, rsp = 0x7fffffffc9b8, rbp = 0x7fffffffebd0 --- Tracing command syslogd pid 2071 tid 100182 td 0xfffffe00d55aea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddb777a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddb777c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddb77800 _sleep() at _sleep+0x2cd/frame 0xfffffe00ddb778a0 getdirtybuf() at getdirtybuf+0x28f/frame 0xfffffe00ddb778f0 flush_deplist() at flush_deplist+0x97/frame 0xfffffe00ddb77930 softdep_sync_metadata() at softdep_sync_metadata+0x2d2/frame 0xfffffe00ddb77990 ffs_syncvnode() at ffs_syncvnode+0x57/frame 0xfffffe00ddb77a10 ffs_fsync() at ffs_fsync+0x1f/frame 0xfffffe00ddb77a40 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe00ddb77a60 kern_fsync() at kern_fsync+0x180/frame 0xfffffe00ddb77ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddb77bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddb77bf0 --- syscall (95, FreeBSD ELF64, sys_fsync), rip = 0x80044a49a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffec40 --- Tracing command devd pid 2000 tid 100160 td 0xfffffe00d55b9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddacd700 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddacd720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddacd760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddacd7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ddacd800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00ddacd870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ddacd8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00ddacda90 sys_select() at sys_select+0x56/frame 0xfffffe00ddacdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddacdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddacdbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x302f0a, rsp = 0x7fffffffcac8, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1989 tid 100171 td 0xfffffe00d61fb300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddb10770 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddb10790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddb107d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddb10830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ddb10870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00ddb108e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ddb10920 kern_poll() at kern_poll+0x4b7/frame 0xfffffe00ddb10ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00ddb10ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddb10bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddb10bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800406b9a, rsp = 0x7fffffffeba8, rbp = 0x7fffffffebe0 --- Tracing command dhclient pid 1930 tid 100185 td 0xfffffe00d559c700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddb867b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddb867d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddb86810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ddb86870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ddb86880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00ddb868e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ddb86920 kern_poll() at kern_poll+0x4b7/frame 0xfffffe00ddb86ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00ddb86ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ddb86bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ddb86bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800406b9a, rsp = 0x7fffffffebb8, rbp = 0x7fffffffebe0 --- Tracing command dhclient pid 1927 tid 100147 td 0xfffffe00d559d500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda8c740 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda8c760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda8c7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00dda8c800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00dda8c810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00dda8c870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00dda8c8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00dda8ca90 sys_select() at sys_select+0x56/frame 0xfffffe00dda8cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00dda8cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00dda8cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80046342a, rsp = 0x7fffffffe968, rbp = 0x7fffffffea20 --- Tracing command syncer pid 33 tid 100134 td 0xfffffe00d5df4300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7bfda10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7bfda30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7bfda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7bfdab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00d7bfdb20 sched_sync() at sched_sync+0x68b/frame 0xfffffe00d7bfdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7bfdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7bfdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 32 tid 100135 td 0xfffffe00d61fc100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda44a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda44a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda44aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00dda44b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00dda44bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda44bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda44bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 31 tid 100131 td 0xfffffe00d5df4a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7bee9d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7bee9f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7beea30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7beea70 _sleep() at _sleep+0x26c/frame 0xfffffe00d7beeb10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe00d7beebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7beebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7beebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100128 td 0xfffffe00d5df5100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d628fa20 mi_switch() at mi_switch+0x155/frame 0xfffffe00d628fa40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d628fa80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d628fac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d628fb60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d628fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d628fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d628fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100129 td 0xfffffe00d58dda00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7b24a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7b24a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7b24a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7b24ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d7b24b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d7b24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7b24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7b24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100132 td 0xfffffe00d58dd300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7bf8a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7bf8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7bf8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7bf8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d7bf8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d7bf8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7bf8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7bf8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100136 td 0xfffffe00d58dcc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda49a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda49a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda49a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dda49ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dda49b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dda49bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda49bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda49bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100137 td 0xfffffe00d58dc500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda4ea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda4ea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda4ea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dda4eab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dda4eb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dda4ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda4ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda4ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100138 td 0xfffffe00d58dbe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda53a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda53a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda53a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dda53ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dda53b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dda53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100139 td 0xfffffe00d58db700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda58a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda58a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda58a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dda58ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dda58b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dda58bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda58bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda58bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100140 td 0xfffffe00d58db000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda5da10 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda5da30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda5da70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dda5dab0 _sleep() at _sleep+0x26c/frame 0xfffffe00dda5db50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00dda5dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda5dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda5dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100150 td 0xfffffe00d58e4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dda9ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe00dda9ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dda9baa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dda9bae0 _sleep() at _sleep+0x26c/frame 0xfffffe00dda9bb80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00dda9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dda9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dda9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 100205 td 0xfffffe00d5df2000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00dfc29a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00dfc29a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00dfc29aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00dfc29ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00dfc29b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00dfc29bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00dfc29bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00dfc29bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 30 tid 101686 td 0xfffffe0139cfbe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0339d56a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0339d56a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0339d56aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0339d56ae0 _sleep() at _sleep+0x26c/frame 0xfffffe0339d56b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe0339d56bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0339d56bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0339d56bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 29 tid 100126 td 0xfffffe00d61fc800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d6285a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6285a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d6285aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d6285b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d6285bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6285bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6285bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 28 tid 100127 td 0xfffffe00d6097e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d628aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d628aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d628aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d628ab40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d628abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d628abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d628abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 27 tid 100125 td 0xfffffe00d6098500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d6280670 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6280690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d62806d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6280710 _sleep() at _sleep+0x26c/frame 0xfffffe00d62807b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe00d6280b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d6280bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6280bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6280bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 27 tid 100130 td 0xfffffe00d58e6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7be9830 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7be9850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7be9890 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7be9930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc21/frame 0xfffffe00d7be9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7be9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7be9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 27 tid 100133 td 0xfffffe00d58e5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7bf3a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7bf3a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7bf3aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7bf3ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00d7bf3b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00d7bf3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7bf3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7bf3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 26 tid 100122 td 0xfffffe00d6099a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d62719f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6271a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d6271a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6271a90 _sleep() at _sleep+0x26c/frame 0xfffffe00d6271b30 random_kthread() at random_kthread+0x67/frame 0xfffffe00d6271bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6271bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6271bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d6097700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d6251a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6251a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d6251a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d6251ad0 _sleep() at _sleep+0x26c/frame 0xfffffe00d6251b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00d6251bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6251bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6251bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe003e4c5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d624ca30 mi_switch() at mi_switch+0x155/frame 0xfffffe00d624ca50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d624ca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d624cad0 _sleep() at _sleep+0x26c/frame 0xfffffe00d624cb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00d624cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d624cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d624cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe003e4c5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bffa30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bffa50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bffa90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bffad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bffb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe003e4c6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bfaa30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bfaa50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfaa90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfaad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfab70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4c3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b77ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4c3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b7cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b7cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b7cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4c3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b81ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e19e800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b86ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e19e100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b8bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e2b500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b95ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e2ae00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e2a700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e2a000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4c6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe00d31b5e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31b5700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbfb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbfb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31b5000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d2e2d800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e2d100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bceab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bcead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bceb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bceb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e19b700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b5ea60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b5ea80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5eac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b5eb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e19b000 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff80ff2ac3, rsp = 0xfffffe0037b63750, rbp = 0xfffffe0037b637c0 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x303/frame 0xfffffe0037b637c0 pmap_invalidate_range() at pmap_invalidate_range+0x131/frame 0xfffffe0037b63820 allocbuf() at allocbuf+0xfd/frame 0xfffffe0037b63880 brelse() at brelse+0x1d4/frame 0xfffffe0037b638e0 bufdone() at bufdone+0x392/frame 0xfffffe0037b63950 ffs_backgroundwritedone() at ffs_backgroundwritedone+0xda/frame 0xfffffe0037b63980 bufdone() at bufdone+0x6c/frame 0xfffffe0037b639f0 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe0037b63a40 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe0037b63a90 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe0037b63ae0 g_disk_done() at g_disk_done+0xed/frame 0xfffffe0037b63b20 xpt_done_process() at xpt_done_process+0x382/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0xf5/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e1aa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b68a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b68a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b68b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100124 td 0xfffffe00d6098c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d627ba70 mi_switch() at mi_switch+0x155/frame 0xfffffe00d627ba90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d627bad0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d627bb70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe00d627bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d627bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d627bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e19be00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b59a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b59a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b59ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b59b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e19c500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b54a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b54a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e19cc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4fa50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4fa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4fab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e19d300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4aa50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4aa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e1b6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b45a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b45a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e1a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b40a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b40a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e1a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b3ba50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b3ba70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3bab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e1a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b36a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b36a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e1a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b31a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b31a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e1a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b2ca50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b2ca70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2cab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e1a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b27a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b27a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e1a9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b22a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b22a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b50 crypto_ret_proc() at crypto_ret_proc+0x21f/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e1b3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b1da70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b1da90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1dad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db70 crypto_proc() at crypto_proc+0x25f/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037adca70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037adca90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037adcb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1efe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037acda70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037acda90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acdad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acdb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1e6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad2a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad2ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad2b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe0037ad2ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ad2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad7a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad7ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad7b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037ad7ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037ad7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100040 td 0xfffffe003e468300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffffe003e470000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a0eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a0eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100044 td 0xfffffe003e46f800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a13b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a13b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffffe003e1ef700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe003e1ef000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a57b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a57b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a57bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a57bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a57bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e473800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a5cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e473100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe003e472a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe003e472300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffffe003e471c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffffe003e471500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffffe003e1e3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffffe003e1f2800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003e1f2100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003e1f1a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003e1f1300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003e1f0c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4c4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b6db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b6db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4c4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b72b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b72b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e19da00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b90b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b90b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e2ca00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e2c300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bd8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bd8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037bd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100172 td 0xfffffe00d55b5800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe00d55b5100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffffe00d55b4a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100175 td 0xfffffe00d55b4300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffffe00d55b3c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00d55b3500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00d55b2e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00d45fda00 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3d9300 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de3aa0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de3ab0 trap() at trap+0x56/frame 0xffffffff81de3bc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de3bc0 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3d8c00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add4ba50, rbp = 0xfffffe00add4ba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add4ba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add4baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add4bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3d8500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3d7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add55ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3d7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3d7000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add5fa50, rbp = 0xfffffe00add5fa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5fa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e1a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e1300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add69a50, rbp = 0xfffffe00add69a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add69a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add69aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add69ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e0c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add6ea50, rbp = 0xfffffe00add6ea50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add6ea50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add6eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add6eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e0500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add73a50, rbp = 0xfffffe00add73a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add73a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add73aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add73ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3dfe00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add78a50, rbp = 0xfffffe00add78a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add78a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add78aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add78ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3df700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff80fcf7a6, rsp = 0xfffffe00add7da50, rbp = 0xfffffe00add7da50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7da50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add7daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3d9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add416e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add41700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add41740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add417a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add417b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add41850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add418e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00add41ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00add41bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00add41bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2bdd9a, rsp = 0x7fffffffe728, rbp = 0x7fffffffe790 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3da100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add3ca90 mi_switch() at mi_switch+0x155/frame 0xfffffe00add3cab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add3caf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add3cb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add3cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add3cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add3cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81c8b420 sched_switch() at sched_switch+0x5b2/frame 0xffffffff8211ead0 mi_switch() at mi_switch+0x155/frame 0xffffffff8211eaf0 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff8211eb30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8211eb70 _sleep() at _sleep+0x26c/frame 0xffffffff8211ec10 swapper() at swapper+0x75/frame 0xffffffff8211ec60 mi_startup() at mi_startup+0x2ed/frame 0xffffffff8211ecb0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3df000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add82ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add82ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add82b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add82b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe003e3da800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add87ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add87ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add87b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add87b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe003e3fe300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add8cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add8cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add8cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add8cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e3fdc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add91ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add91ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add91b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add91b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add91bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add91bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add91bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe003e3fd500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add96ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add96ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add96b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add96b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add96bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add96bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add96bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e3fce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add9bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add9bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add9bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add9bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e3fc700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e3fc000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3e2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addaaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addaaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addaabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3e2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addafad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addafb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e467c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e467500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e466e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addbeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e466700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e466000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e3ff800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addcdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addcdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addcdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addcdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e3ff100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e3fea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e46d500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adddcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adddcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adddcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adddcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adddcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adddcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e46ce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e46c700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e46c000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addebab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addebad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addebb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addebb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e469800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e469100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e468a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addfaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addfaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addfab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addfab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe003e470e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e470700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e46f100 (CPU 3) kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a18720 hardclock() at hardclock+0x1d0/frame 0xfffffe0037a18760 handleevents() at handleevents+0xb4/frame 0xfffffe0037a187a0 timercb() at timercb+0x196/frame 0xfffffe0037a187f0 lapic_handle_timer() at lapic_handle_timer+0x9b/frame 0xfffffe0037a18820 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0037a18820 --- interrupt, rip = 0xffffffff80e85590, rsp = 0xfffffe0037a188f0, rbp = 0xfffffe0037a18990 --- ffs_sync() at ffs_sync+0x1c0/frame 0xfffffe0037a18990 vfs_write_suspend() at vfs_write_suspend+0x165/frame 0xfffffe0037a189d0 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0x35/frame 0xfffffe0037a18a00 ffs_unmount() at ffs_unmount+0xb6/frame 0xfffffe0037a18a80 dounmount() at dounmount+0x43d/frame 0xfffffe0037a18ae0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x2d/frame 0xfffffe0037a18b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0x94/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe003e46ea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a1da80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a1daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a1dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a1db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ac8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037aeba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e1b6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037afaa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e1b5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037affa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e1b5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e1b4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e1b4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e1b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e1b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e2bc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bddab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bddad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bddb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bddb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100119 td 0xfffffe00d61f9000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d6262ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6262ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d6262b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d6262b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d6262bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6262bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6262bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d6267ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6267ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d6267b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d6267b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d6267bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6267bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6267bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d626cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d626cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d626cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d626cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d626cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d626cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d626cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe00d6099300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d6276a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00d6276aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d6276ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d6276b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00d6276bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d6276bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d6276bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100500 td 0xfffffe00dffdf100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe003775da80 mi_switch() at mi_switch+0x155/frame 0xfffffe003775daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003775dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003775db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe003775dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003775dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003775dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100567 td 0xfffffe00dffde300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e07e4a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e07e4aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e07e4ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e07e4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e07e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e07e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e07e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100570 td 0xfffffe00e0a09c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0443a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0443aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0443ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0443b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e0443bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0443bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0443bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101472 td 0xfffffe00e0a08e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0498a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0498aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0498ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0498b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e0498bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0498bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0498bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101476 td 0xfffffe00dffd8700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e03eea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e03eeaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e03eeae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e03eeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e03eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e03eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e03eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101502 td 0xfffffe00dffd8000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037762a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037762aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037762ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037762b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037762bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037762bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037762bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101532 td 0xfffffe00d39ee800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0822a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0822aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0822ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0822b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e0822bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0822bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0822bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101534 td 0xfffffe00d39eb700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e075da80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e075daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e075dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e075db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e075dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e075dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e075dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101535 td 0xfffffe00dffa9500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0818a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0818aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0818ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0818b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e0818bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0818bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0818bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101539 td 0xfffffe00d39fa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e07eea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e07eeaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e07eeae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e07eeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e07eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e07eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e07eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101540 td 0xfffffe00e0018700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0888a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0888aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0888ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0888b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e0888bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0888bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0888bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101544 td 0xfffffe00e0018000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e088da80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e088daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e088dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e088db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e088dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e088dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e088dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101550 td 0xfffffe00e0007800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e0892a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e0892aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e0892ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e0892b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e0892bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e0892bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e0892bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 103296 (pid 67095, top) is sleeping on 0xfffff803873ebcc0 "select" chain 2: thread 104429 (pid 67088, bash) is sleeping on 0xfffff8000650ea40 "wait" chain 3: thread 103640 (pid 67087, sshd) is sleeping on 0xfffff80305506540 "select" chain 4: thread 102708 (pid 67086, sleep) is sleeping on 0xffffffff81cab9cb "nanslp" chain 5: thread 102586 (pid 65922, sshd) is sleeping on 0xfffff804c9ead5c0 "select" chain 6: thread 103420 (pid 44593, grep) is sleeping on 0xfffff801f3f108e8 "piperd" chain 7: thread 101000 (pid 44592, ls) is blocked on lockmgr ufsEXCL thread 100045 (pid 0, thread taskq) is running on CPU 3 chain 8: thread 102346 (pid 44591, sh) is sleeping on 0xfffff802dc0a1000 "wait" chain 9: thread 102602 (pid 44580, sh) is sleeping on 0xfffff806dd8002f8 "piperd" chain 10: thread 104439 (pid 31560, ls) is blocked on lockmgr ufsEXCL thread 100045 (pid 0, thread taskq) is running on CPU 3 chain 11: thread 100414 (pid 31559, sh) is sleeping on 0xfffff8056d5e1a40 "wait" chain 12: thread 103942 (pid 29423, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 13: thread 102282 (pid 29079, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 14: thread 101874 (pid 29076, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 15: thread 103819 (pid 29066, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 16: thread 102965 (pid 29064, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 17: thread 102949 (pid 29060, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 18: thread 100915 (pid 29058, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 19: thread 104403 (pid 29053, mkdir) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 20: thread 101760 (pid 29052, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 21: thread 102784 (pid 29050, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 22: thread 102438 (pid 29049, mkfifo) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 23: thread 100427 (pid 29047, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 24: thread 103522 (pid 29040, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 25: thread 101542 (pid 29034, mkdir) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 26: thread 104398 (pid 29031, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 27: thread 101344 (pid 29028, mkdir) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 28: thread 102756 (pid 29024, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 29: thread 100393 (pid 29023, mkdir) is sleeping on 0xfffffe00d5dedb80 "vfs_busy" chain 30: thread 102651 (pid 29022, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 31: thread 102257 (pid 29013, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 32: thread 103409 (pid 29006, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 33: thread 102768 (pid 28998, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 34: thread 104474 (pid 28990, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 35: thread 102403 (pid 28988, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 36: thread 101817 (pid 28986, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 37: thread 102884 (pid 28984, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 38: thread 100921 (pid 28981, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 39: thread 101038 (pid 28979, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 40: thread 102140 (pid 28974, fts) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 41: thread 103436 (pid 28971, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 42: thread 103752 (pid 28965, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 43: thread 102038 (pid 28964, lockf2) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 44: thread 103529 (pid 28963, rw) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 45: thread 104063 (pid 28959, lockf2) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 46: thread 104409 (pid 28956, lockf2) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 47: thread 103471 (pid 14630, sh) is sleeping on 0xfffff8079a9f6520 "wait" chain 48: thread 100469 (pid 29371, ftcleanup) is sleeping on 0xffffffff82c114f4 "ftcl" chain 49: thread 100646 (pid 18640, sh) is sleeping on 0xfffff800187b7be0 "piperd" chain 50: thread 100384 (pid 18638, awk) is sleeping on 0xfffff804993ee2f8 "piperd" chain 51: thread 100206 (pid 18637, sh) is sleeping on 0xfffff800425c7000 "wait" chain 52: thread 100196 (pid 18628, sh) is sleeping on 0xfffff80018ee3520 "wait" chain 53: thread 100217 (pid 2454, bash) is sleeping on 0xfffff8027db50520 "wait" chain 54: thread 100153 (pid 2452, csh) is sleeping on 0xfffff80018b2b5c8 "pause" chain 55: thread 100156 (pid 2451, su) is sleeping on 0xfffff8001841c000 "wait" chain 56: thread 100190 (pid 2444, bash) is sleeping on 0xfffff8027d0b4520 "wait" chain 57: thread 100167 (pid 2443, sshd) is sleeping on 0xfffff80004181840 "select" chain 58: thread 100157 (pid 2440, sshd) is sleeping on 0xfffff80003f2b3c0 "select" chain 59: thread 100200 (pid 2437, csh) is sleeping on 0xfffff800041d20b0 "ttyin" chain 60: thread 100142 (pid 2436, login) is sleeping on 0xfffff8000411aa40 "wait" chain 61: thread 100223 (pid 2435, getty) is sleeping on 0xfffff800041d24b0 "ttyin" chain 62: thread 100222 (pid 2434, getty) is sleeping on 0xfffff800183680b0 "ttyin" chain 63: thread 100221 (pid 2433, getty) is sleeping on 0xfffff800183684b0 "ttyin" chain 64: thread 100220 (pid 2432, getty) is sleeping on 0xfffff800183688b0 "ttyin" chain 65: thread 100219 (pid 2431, getty) is sleeping on 0xfffff80018368cb0 "ttyin" chain 66: thread 100218 (pid 2430, getty) is sleeping on 0xfffff800183670b0 "ttyin" chain 67: thread 100208 (pid 2429, getty) is sleeping on 0xfffff800183674b0 "ttyin" chain 68: thread 100209 (pid 2428, getty) is sleeping on 0xfffff800183678b0 "ttyin" chain 69: thread 100141 (pid 2427, getty) is sleeping on 0xfffff80018367cb0 "ttyin" chain 70: thread 100148 (pid 2378, cron) is sleeping on 0xffffffff81cab9c1 "nanslp" chain 71: thread 100203 (pid 2374, sshd) is sleeping on 0xfffff80018be8840 "select" chain 72: thread 100195 (pid 2346, powerd) is sleeping on 0xfffff800425c89c0 "select" chain 73: thread 100207 (pid 2343, ntpd) is sleeping on 0xfffff80018be88c0 "select" chain 74: thread 100202 (pid 2278, NLM: master) is sleeping on 0xfffff8018b6bb260 "rpcsvc" chain 75: thread 100161 (pid 2275, rpc.statd) is sleeping on 0xfffff80003eb05c0 "select" chain 76: thread 100199 (pid 2229, watchdogd) is sleeping on 0xfffff80018edca40 "wait" chain 77: thread 100143 (pid 2081, rpcbind) is sleeping on 0xfffff80003ef9240 "select" chain 78: thread 100182 (pid 2071, syslogd) is sleeping on 0xfffffe003901aa1c "getbuf" chain 79: thread 100160 (pid 2000, devd) is sleeping on 0xfffff800185d65c0 "select" chain 80: thread 100171 (pid 1989, dhclient) is sleeping on 0xfffff800041736c0 "select" chain 81: thread 100185 (pid 1930, dhclient) is sleeping on 0xfffff80003f2b340 "select" chain 82: thread 100147 (pid 1927, dhclient) is sleeping on 0xfffff800425c8bc0 "select" chain 83: thread 100134 (pid 33, syncer) is sleeping on 0xffffffff81d96908 "syncer" chain 84: thread 100135 (pid 32, enc_daemon1) is sleeping on 0xfffff8001841c520 "idle" chain 85: thread 100131 (pid 31, vnlru) is sleeping on 0xfffff8001835ba40 "vlruwt" chain 86: thread 100128 (pid 30, bufdaemon) is sleeping on 0xffffffff81d95c30 "qsleep" chain 87: thread 100129 (pid 30, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 88: thread 100132 (pid 30, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 89: thread 100136 (pid 30, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 90: thread 100137 (pid 30, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 91: thread 100138 (pid 30, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 92: thread 100139 (pid 30, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 93: thread 100140 (pid 30, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 94: thread 100150 (pid 30, / worker) is sleeping on 0xfffff800188f9ce8 "sdflush" chain 95: thread 100205 (pid 30, /tmp worker) is sleeping on 0xfffff800183128e8 "sdflush" chain 96: thread 101686 (pid 30, /mnt worker) is sleeping on 0xfffff8042f2760e8 "sdflush" chain 97: thread 100126 (pid 29, enc_daemon0) is sleeping on 0xfffff8001841ca40 "idle" chain 98: thread 100127 (pid 28, vmdaemon) is sleeping on 0xffffffff81dbaa88 "psleep" chain 99: thread 100125 (pid 27, dom0) is sleeping on 0xffffffff81daef18 "psleep" chain 100: thread 100130 (pid 27, laundry: dom0) is sleeping on 0xffffffff81daef24 "launds" chain 101: thread 100133 (pid 27, uma) is sleeping on 0xffffffff80ea67f0 "umarcl" chain 102: thread 100122 (pid 26, rand_harvestq) is sleeping on 0xffffffff81adf578 "-" chain 103: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d9556c "-" chain 104: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d9556c "-" chain 105: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d9556c "-" chain 106: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d9556c "-" chain 107: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 108: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 109: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 110: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 111: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 112: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4afcf0 "-" chain 113: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4afd48 "-" chain 114: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4afda0 "-" chain 115: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4afdf8 "-" chain 116: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4afe50 "-" chain 117: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34cf0 "-" chain 118: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34d48 "-" chain 119: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34da0 "-" chain 120: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34df8 "-" chain 121: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34e50 "-" chain 122: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b72c0 "-" chain 123: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b73c0 "-" chain 124: thread 100124 (pid 20, scanner) is sleeping on 0xffffffff819b7190 "-" chain 125: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003adac50 "crypto_ret_wait" chain 126: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003adabf0 "crypto_ret_wait" chain 127: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003adab90 "crypto_ret_wait" chain 128: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003adab30 "crypto_ret_wait" chain 129: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003adaad0 "crypto_ret_wait" chain 130: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003adaa70 "crypto_ret_wait" chain 131: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003adaa10 "crypto_ret_wait" chain 132: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003ada9b0 "crypto_ret_wait" chain 133: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003ada950 "crypto_ret_wait" chain 134: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003ada8f0 "crypto_ret_wait" chain 135: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003ada890 "crypto_ret_wait" chain 136: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003ada830 "crypto_ret_wait" chain 137: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81dac7d0 "crypto_wait" chain 138: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003ab4c88 "seqstate" chain 139: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8a950 "-" chain 140: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8a958 "-" chain 141: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8a960 "-" chain 142: thread 100002 (pid 1, init) is sleeping on 0xfffff800038d5000 "wait" chain 143: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dacbe8 "audit_worker_cv" chain 144: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8aef0 "swapin" chain 145: thread 100015 (pid 0, if_config_tqg_0) is sleeping on 0xfffff800037d8000 "-" chain 146: thread 100016 (pid 0, softirq_0) is sleeping on 0xfffff800037d7e00 "-" chain 147: thread 100017 (pid 0, softirq_1) is sleeping on 0xfffff800037d7d00 "-" chain 148: thread 100018 (pid 0, softirq_2) is sleeping on 0xfffff800037d7c00 "-" chain 149: thread 100019 (pid 0, softirq_3) is sleeping on 0xfffff800037d7b00 "-" chain 150: thread 100020 (pid 0, softirq_4) is sleeping on 0xfffff800037d7a00 "-" chain 151: thread 100021 (pid 0, softirq_5) is sleeping on 0xfffff800037d7900 "-" chain 152: thread 100022 (pid 0, softirq_6) is sleeping on 0xfffff800037d7800 "-" chain 153: thread 100023 (pid 0, softirq_7) is sleeping on 0xfffff800037d7700 "-" chain 154: thread 100024 (pid 0, softirq_8) is sleeping on 0xfffff800037d7600 "-" chain 155: thread 100025 (pid 0, softirq_9) is sleeping on 0xfffff800037d7500 "-" chain 156: thread 100026 (pid 0, softirq_10) is sleeping on 0xfffff800037d7400 "-" chain 157: thread 100027 (pid 0, softirq_11) is sleeping on 0xfffff800037d7300 "-" chain 158: thread 100028 (pid 0, if_io_tqg_0) is sleeping on 0xfffff800037d7200 "-" chain 159: thread 100029 (pid 0, if_io_tqg_1) is sleeping on 0xfffff800037d7100 "-" chain 160: thread 100030 (pid 0, if_io_tqg_2) is sleeping on 0xfffff800037d7000 "-" chain 161: thread 100031 (pid 0, if_io_tqg_3) is sleeping on 0xfffff800037d6e00 "-" chain 162: thread 100032 (pid 0, if_io_tqg_4) is sleeping on 0xfffff800037d6d00 "-" chain 163: thread 100033 (pid 0, if_io_tqg_5) is sleeping on 0xfffff800037d6c00 "-" chain 164: thread 100034 (pid 0, if_io_tqg_6) is sleeping on 0xfffff800037d6b00 "-" chain 165: thread 100035 (pid 0, if_io_tqg_7) is sleeping on 0xfffff800037d6a00 "-" chain 166: thread 100036 (pid 0, if_io_tqg_8) is sleeping on 0xfffff800037d6900 "-" chain 167: thread 100037 (pid 0, if_io_tqg_9) is sleeping on 0xfffff800037d6800 "-" chain 168: thread 100038 (pid 0, if_io_tqg_10) is sleeping on 0xfffff800037d6700 "-" chain 169: thread 100039 (pid 0, if_io_tqg_11) is sleeping on 0xfffff800037d6600 "-" chain 170: thread 100041 (pid 0, aiod_kick taskq) is sleeping on 0xfffff800037c3200 "-" chain 171: thread 100042 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff800037c3000 "-" chain 172: thread 100046 (pid 0, in6m_free taskq) is sleeping on 0xfffff800037c2700 "-" chain 173: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff800039f4400 "-" chain 174: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff800039f1b00 "-" chain 175: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff800039f1b00 "-" chain 176: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff800039f1b00 "-" chain 177: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff800039f1b00 "-" chain 178: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff800039f1b00 "-" chain 179: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff800039f1b00 "-" chain 180: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff800039f1b00 "-" chain 181: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff800039f1b00 "-" chain 182: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff800039f1b00 "-" chain 183: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff800039f1b00 "-" chain 184: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff800039f1b00 "-" chain 185: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff800039f1b00 "-" chain 186: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff80014086100 "-" chain 187: thread 100119 (pid 0, acpi_task_0) is sleeping on 0xfffff8001834b600 "-" chain 188: thread 100120 (pid 0, acpi_task_1) is sleeping on 0xfffff8001834b600 "-" chain 189: thread 100121 (pid 0, acpi_task_2) is sleeping on 0xfffff8001834b600 "-" chain 190: thread 100123 (pid 0, CAM taskq) is sleeping on 0xfffff800037c6d00 "-" chain 191: thread 100500 (pid 0, dtrace_taskq) is sleeping on 0xfffff80663c85300 "-" chain 192: thread 100567 (pid 0, system_taskq_0) is sleeping on 0xfffff80281eb5b00 "-" chain 193: thread 100570 (pid 0, system_taskq_1) is sleeping on 0xfffff80281eb5b00 "-" chain 194: thread 101472 (pid 0, system_taskq_2) is sleeping on 0xfffff80281eb5b00 "-" chain 195: thread 101476 (pid 0, system_taskq_3) is sleeping on 0xfffff80281eb5b00 "-" chain 196: thread 101502 (pid 0, system_taskq_4) is sleeping on 0xfffff80281eb5b00 "-" chain 197: thread 101532 (pid 0, system_taskq_5) is sleeping on 0xfffff80281eb5b00 "-" chain 198: thread 101534 (pid 0, system_taskq_6) is sleeping on 0xfffff80281eb5b00 "-" chain 199: thread 101535 (pid 0, system_taskq_7) is sleeping on 0xfffff80281eb5b00 "-" chain 200: thread 101539 (pid 0, system_taskq_8) is sleeping on 0xfffff80281eb5b00 "-" chain 201: thread 101540 (pid 0, system_taskq_9) is sleeping on 0xfffff80281eb5b00 "-" chain 202: thread 101544 (pid 0, system_taskq_10) is sleeping on 0xfffff80281eb5b00 "-" chain 203: thread 101550 (pid 0, system_taskq_11) is sleeping on 0xfffff80281eb5b00 "-" db:0:pho> chain 1: thread 103296 (pid 67095, top) is sleeping on 0xfffff803873ebcc0 "select" chain 2: thread 104429 (pid 67088, bash) is sleeping on 0xfffff8000650ea40 "wait" chain 3: thread 103640 (pid 67087, sshd) is sleeping on 0xfffff80305506540 "select" chain 4: thread 102708 (pid 67086, sleep) is sleeping on 0xffffffff81cab9cb "nanslp" chain 5: thread 102586 (pid 65922, sshd) is sleeping on 0xfffff804c9ead5c0 "select" chain 6: thread 103420 (pid 44593, grep) is sleeping on 0xfffff801f3f108e8 "piperd" chain 7: thread 101000 (pid 44592, ls) is blocked on lockmgr ufsEXCL thread 100045 (pid 0, thread taskq) is running on CPU 3 chain 8: thread 102346 (pid 44591, sh) is sleeping on 0xfffff802dc0a1000 "wait" chain 9: thread 102602 (pid 44580, sh) is sleeping on 0xfffff806dd8002f8 "piperd" chain 10: thread 104439 (pid 31560, ls) is blocked on lockmgr ufsEXCL thread 100045 (pid 0, thread taskq) is running on CPU 3 chain 11: thread 100414 (pid 31559, sh) is sleeping on 0xfffff8056d5e1a40 "wait" chain 12: thread 103942 (pid 29423, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 13: thread 102282 (pid 29079, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 14: thread 101874 (pid 29076, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 15: thread 103819 (pid 29066, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 16: thread 102965 (pid 29064, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 17: thread 102949 (pid 29060, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 18: thread 100915 (pid 29058, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 19: thread 104403 (pid 29053, mkdir) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 20: thread 101760 (pid 29052, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 21: thread 102784 (pid 29050, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 22: thread 102438 (pid 29049, mkfifo) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 23: thread 100427 (pid 29047, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 24: thread 103522 (pid 29040, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 25: thread 101542 (pid 29034, mkdir) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 26: thread 104398 (pid 29031, creat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 27: thread 101344 (pid 29028, mkdir) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 28: thread 102756 (pid 29024, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 29: thread 100393 (pid 29023, mkdir) is sleeping on 0xfffffe00d5dedb80 "vfs_busy" chain 30: thread 102651 (pid 29022, rename) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 31: thread 102257 (pid 29013, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 32: thread 103409 (pid 29006, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 33: thread 102768 (pid 28998, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 34: thread 104474 (pid 28990, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 35: thread 102403 (pid 28988, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 36: thread 101817 (pid 28986, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 37: thread 102884 (pid 28984, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 38: thread 100921 (pid 28981, lockf) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 39: thread 101038 (pid 28979, symlink) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 40: thread 102140 (pid 28974, fts) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 41: thread 103436 (pid 28971, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 42: thread 103752 (pid 28965, openat) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 43: thread 102038 (pid 28964, lockf2) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 44: thread 103529 (pid 28963, rw) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 45: thread 104063 (pid 28959, lockf2) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 46: thread 104409 (pid 28956, lockf2) is sleeping on 0xfffffe00d5dedc00 "suspfs" chain 47: thread 103471 (pid 14630, sh) is sleeping on 0xfffff8079a9f6520 "wait" chain 48: thread 100469 (pid 29371, ftcleanup) is sleeping on 0xffffffff82c114f4 "ftcl" chain 49: thread 100646 (pid 18640, sh) is sleeping on 0xfffff800187b7be0 "piperd" chain 50: thread 100384 (pid 18638, awk) is sleeping on 0xfffff804993ee2f8 "piperd" chain 51: thread 100206 (pid 18637, sh) is sleeping on 0xfffff800425c7000 "wait" chain 52: thread 100196 (pid 18628, sh) is sleeping on 0xfffff80018ee3520 "wait" chain 53: thread 100217 (pid 2454, bash) is sleeping on 0xfffff8027db50520 "wait" chain 54: thread 100153 (pid 2452, csh) is sleeping on 0xfffff80018b2b5c8 "pause" chain 55: thread 100156 (pid 2451, su) is sleeping on 0xfffff8001841c000 "wait" chain 56: thread 100190 (pid 2444, bash) is sleeping on 0xfffff8027d0b4520 "wait" chain 57: thread 100167 (pid 2443, sshd) is sleeping on 0xfffff80004181840 "select" chain 58: thread 100157 (pid 2440, sshd) is sleeping on 0xfffff80003f2b3c0 "select" chain 59: thread 100200 (pid 2437, csh) is sleeping on 0xfffff800041d20b0 "ttyin" chain 60: thread 100142 (pid 2436, login) is sleeping on 0xfffff8000411aa40 "wait" chain 61: thread 100223 (pid 2435, getty) is sleeping on 0xfffff800041d24b0 "ttyin" chain 62: thread 100222 (pid 2434, getty) is sleeping on 0xfffff800183680b0 "ttyin" chain 63: thread 100221 (pid 2433, getty) is sleeping on 0xfffff800183684b0 "ttyin" chain 64: thread 100220 (pid 2432, getty) is sleeping on 0xfffff800183688b0 "ttyin" chain 65: thread 100219 (pid 2431, getty) is sleeping on 0xfffff80018368cb0 "ttyin" chain 66: thread 100218 (pid 2430, getty) is sleeping on 0xfffff800183670b0 "ttyin" chain 67: thread 100208 (pid 2429, getty) is sleeping on 0xfffff800183674b0 "ttyin" chain 68: thread 100209 (pid 2428, getty) is sleeping on 0xfffff800183678b0 "ttyin" chain 69: thread 100141 (pid 2427, getty) is sleeping on 0xfffff80018367cb0 "ttyin" chain 70: thread 100148 (pid 2378, cron) is sleeping on 0xffffffff81cab9c1 "nanslp" chain 71: thread 100203 (pid 2374, sshd) is sleeping on 0xfffff80018be8840 "select" chain 72: thread 100195 (pid 2346, powerd) is sleeping on 0xfffff800425c89c0 "select" chain 73: thread 100207 (pid 2343, ntpd) is sleeping on 0xfffff80018be88c0 "select" chain 74: thread 100202 (pid 2278, NLM: master) is sleeping on 0xfffff8018b6bb260 "rpcsvc" chain 75: thread 100161 (pid 2275, rpc.statd) is sleeping on 0xfffff80003eb05c0 "select" chain 76: thread 100199 (pid 2229, watchdogd) is sleeping on 0xfffff80018edca40 "wait" chain 77: thread 100143 (pid 2081, rpcbind) is sleeping on 0xfffff80003ef9240 "select" chain 78: thread 100182 (pid 2071, syslogd) is sleeping on 0xfffffe003901aa1c "getbuf" chain 79: thread 100160 (pid 2000, devd) is sleeping on 0xfffff800185d65c0 "select" chain 80: thread 100171 (pid 1989, dhclient) is sleeping on 0xfffff800041736c0 "select" chain 81: thread 100185 (pid 1930, dhclient) is sleeping on 0xfffff80003f2b340 "select" chain 82: thread 100147 (pid 1927, dhclient) is sleeping on 0xfffff800425c8bc0 "select" chain 83: thread 100134 (pid 33, syncer) is sleeping on 0xffffffff81d96908 "syncer" chain 84: thread 100135 (pid 32, enc_daemon1) is sleeping on 0xfffff8001841c520 "idle" chain 85: thread 100131 (pid 31, vnlru) is sleeping on 0xfffff8001835ba40 "vlruwt" chain 86: thread 100128 (pid 30, bufdaemon) is sleeping on 0xffffffff81d95c30 "qsleep" chain 87: thread 100129 (pid 30, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 88: thread 100132 (pid 30, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 89: thread 100136 (pid 30, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 90: thread 100137 (pid 30, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 91: thread 100138 (pid 30, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 92: thread 100139 (pid 30, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 93: thread 100140 (pid 30, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 94: thread 100150 (pid 30, / worker) is sleeping on 0xfffff800188f9ce8 "sdflush" chain 95: thread 100205 (pid 30, /tmp worker) is sleeping on 0xfffff800183128e8 "sdflush" chain 96: thread 101686 (pid 30, /mnt worker) is sleeping on 0xfffff8042f2760e8 "sdflush" chain 97: thread 100126 (pid 29, enc_daemon0) is sleeping on 0xfffff8001841ca40 "idle" chain 98: thread 100127 (pid 28, vmdaemon) is sleeping on 0xffffffff81dbaa88 "psleep" chain 99: thread 100125 (pid 27, dom0) is sleeping on 0xffffffff81daef18 "psleep" chain 100: thread 100130 (pid 27, laundry: dom0) is sleeping on 0xffffffff81daef24 "launds" chain 101: thread 100133 (pid 27, uma) is sleeping on 0xffffffff80ea67f0 "umarcl" chain 102: thread 100122 (pid 26, rand_harvestq) is sleeping on 0xffffffff81adf578 "-" chain 103: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d9556c "-" chain 104: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d9556c "-" chain 105: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d9556c "-" chain 106: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d9556c "-" chain 107: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 108: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 109: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 110: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 111: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 112: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4afcf0 "-" chain 113: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4afd48 "-" chain 114: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4afda0 "-" chain 115: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4afdf8 "-" chain 116: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4afe50 "-" chain 117: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34cf0 "-" chain 118: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34d48 "-" chain 119: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34da0 "-" chain 120: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34df8 "-" chain 121: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e34e50 "-" chain 122: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b72c0 "-" chain 123: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b73c0 "-" chain 124: thread 100124 (pid 20, scanner) is sleeping on 0xffffffff819b7190 "-" chain 125: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003adac50 "crypto_ret_wait" chain 126: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003adabf0 "crypto_ret_wait" chain 127: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003adab90 "crypto_ret_wait" chain 128: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003adab30 "crypto_ret_wait" chain 129: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003adaad0 "crypto_ret_wait" chain 130: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003adaa70 "crypto_ret_wait" chain 131: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003adaa10 "crypto_ret_wait" chain 132: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003ada9b0 "crypto_ret_wait" chain 133: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003ada950 "crypto_ret_wait" chain 134: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003ada8f0 "crypto_ret_wait" chain 135: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003ada890 "crypto_ret_wait" chain 136: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003ada830 "crypto_ret_wait" chain 137: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81dac7d0 "crypto_wait" chain 138: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003ab4c88 "seqstate" chain 139: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8a950 "-" chain 140: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8a958 "-" chain 141: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8a960 "-" chain 142: thread 100002 (pid 1, init) is sleeping on 0xfffff800038d5000 "wait" chain 143: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dacbe8 "audit_worker_cv" chain 144: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8aef0 "swapin" chain 145: thread 100015 (pid 0, if_config_tqg_0) is sleeping on 0xfffff800037d8000 "-" chain 146: thread 100016 (pid 0, softirq_0) is sleeping on 0xfffff800037d7e00 "-" chain 147: thread 100017 (pid 0, softirq_1) is sleeping on 0xfffff800037d7d00 "-" chain 148: thread 100018 (pid 0, softirq_2) is sleeping on 0xfffff800037d7c00 "-" chain 149: thread 100019 (pid 0, softirq_3) is sleeping on 0xfffff800037d7b00 "-" chain 150: thread 100020 (pid 0, softirq_4) is sleeping on 0xfffff800037d7a00 "-" chain 151: thread 100021 (pid 0, softirq_5) is sleeping on 0xfffff800037d7900 "-" chain 152: thread 100022 (pid 0, softirq_6) is sleeping on 0xfffff800037d7800 "-" chain 153: thread 100023 (pid 0, softirq_7) is sleeping on 0xfffff800037d7700 "-" chain 154: thread 100024 (pid 0, softirq_8) is sleeping on 0xfffff800037d7600 "-" chain 155: thread 100025 (pid 0, softirq_9) is sleeping on 0xfffff800037d7500 "-" chain 156: thread 100026 (pid 0, softirq_10) is sleeping on 0xfffff800037d7400 "-" chain 157: thread 100027 (pid 0, softirq_11) is sleeping on 0xfffff800037d7300 "-" chain 158: thread 100028 (pid 0, if_io_tqg_0) is sleeping on 0xfffff800037d7200 "-" chain 159: thread 100029 (pid 0, if_io_tqg_1) is sleeping on 0xfffff800037d7100 "-" chain 160: thread 100030 (pid 0, if_io_tqg_2) is sleeping on 0xfffff800037d7000 "-" chain 161: thread 100031 (pid 0, if_io_tqg_3) is sleeping on 0xfffff800037d6e00 "-" chain 162: thread 100032 (pid 0, if_io_tqg_4) is sleeping on 0xfffff800037d6d00 "-" chain 163: thread 100033 (pid 0, if_io_tqg_5) is sleeping on 0xfffff800037d6c00 "-" chain 164: thread 100034 (pid 0, if_io_tqg_6) is sleeping on 0xfffff800037d6b00 "-" chain 165: thread 100035 (pid 0, if_io_tqg_7) is sleeping on 0xfffff800037d6a00 "-" chain 166: thread 100036 (pid 0, if_io_tqg_8) is sleeping on 0xfffff800037d6900 "-" chain 167: thread 100037 (pid 0, if_io_tqg_9) is sleeping on 0xfffff800037d6800 "-" chain 168: thread 100038 (pid 0, if_io_tqg_10) is sleeping on 0xfffff800037d6700 "-" chain 169: thread 100039 (pid 0, if_io_tqg_11) is sleeping on 0xfffff800037d6600 "-" chain 170: thread 100041 (pid 0, aiod_kick taskq) is sleeping on 0xfffff800037c3200 "-" chain 171: thread 100042 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff800037c3000 "-" chain 172: thread 100046 (pid 0, in6m_free taskq) is sleeping on 0xfffff800037c2700 "-" chain 173: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff800039f4400 "-" chain 174: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff800039f1b00 "-" chain 175: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff800039f1b00 "-" chain 176: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff800039f1b00 "-" chain 177: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff800039f1b00 "-" chain 178: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff800039f1b00 "-" chain 179: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff800039f1b00 "-" chain 180: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff800039f1b00 "-" chain 181: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff800039f1b00 "-" chain 182: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff800039f1b00 "-" chain 183: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff800039f1b00 "-" chain 184: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff800039f1b00 "-" chain 185: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff800039f1b00 "-" chain 186: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff80014086100 "-" chain 187: thread 100119 (pid 0, acpi_task_0) is sleeping on 0xfffff8001834b600 "-" chain 188: thread 100120 (pid 0, acpi_task_1) is sleeping on 0xfffff8001834b600 "-" chain 189: thread 100121 (pid 0, acpi_task_2) is sleeping on 0xfffff8001834b600 "-" chain 190: thread 100123 (pid 0, CAM taskq) is sleeping on 0xfffff800037c6d00 "-" chain 191: thread 100500 (pid 0, dtrace_taskq) is sleeping on 0xfffff80663c85300 "-" chain 192: thread 100567 (pid 0, system_taskq_0) is sleeping on 0xfffff80281eb5b00 "-" chain 193: thread 100570 (pid 0, system_taskq_1) is sleeping on 0xfffff80281eb5b00 "-" chain 194: thread 101472 (pid 0, system_taskq_2) is sleeping on 0xfffff80281eb5b00 "-" chain 195: thread 101476 (pid 0, system_taskq_3) is sleeping on 0xfffff80281eb5b00 "-" chain 196: thread 101502 (pid 0, system_taskq_4) is sleeping on 0xfffff80281eb5b00 "-" chain 197: thread 101532 (pid 0, system_taskq_5) is sleeping on 0xfffff80281eb5b00 "-" chain 198: thread 101534 (pid 0, system_taskq_6) is sleeping on 0xfffff80281eb5b00 "-" chain 199: thread 101535 (pid 0, system_taskq_7) is sleeping on 0xfffff80281eb5b00 "-" chain 200: thread 101539 (pid 0, system_taskq_8) is sleeping on 0xfffff80281eb5b00 "-" chain 201: thread 101540 (pid 0, system_taskq_9) is sleeping on 0xfffff80281eb5b00 "-" chain 202: thread 101544 (pid 0, system_taskq_10) is sleeping on 0xfffff80281eb5b00 "-" chain 203: thread 101550 (pid 0, system_taskq_11) is sleeping on 0xfffff80281eb5b00 "-" db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) proc 29423 [Switching to thread 236 (Thread 103942)]#0 sched_switch (td=0xfffffe015bc9aa00, flags=) at ../../../kern/sched_ule.c:2147 2147 cpuid = td->td_oncpu = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xfffffe015bc9aa00, flags=) at ../../../kern/sched_ule.c:2147 #1 0xffffffff80bdd635 in mi_switch (flags=0x104) at ../../../kern/kern_synch.c:542 #2 0xffffffff80c2b6ba in sleepq_switch (wchan=0xfffffe00d5dedc00, pri=0x77) at ../../../kern/subr_sleepqueue.c:625 #3 0xffffffff80bdcb8d in _sleep (ident=0xfffffe00d5dedc00, lock=, priority=0x77, wmesg=0xffffffff8110f7ce "suspfs", sbt=, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:221 #4 0xffffffff80cc61b0 in vn_start_write_refed (mp=0xfffffe00d5dedb80, flags=0x1, mplocked=0x0) at ../../../kern/vfs_vnops.c:1773 #5 0xffffffff80cc4cab in vn_close1 (vp=0xfffff807af424000, flags=0x3, file_cred=0xfffff8081549ac00, td=0xfffffe015bc9aa00, keep_ref=) at ../../../kern/vfs_vnops.c:1824 #6 0xffffffff80cc35bc in vn_closefile (fp=0xfffff80018a986e0, td=) at ../../../kern/vfs_vnops.c:1722 #7 0xffffffff80b750fa in _fdrop (fp=0xfffff80018a986e0, td=) at file.h:362 #8 0xffffffff80b7839b in closef (fp=0xfffff80018a986e0, td=0xfffffe015bc9aa00) at ../../../kern/kern_descrip.c:2606 #9 0xffffffff80b77e4c in fdescfree_fds (td=0xfffffe015bc9aa00, fdp=0xfffffe0141d99ca8, needclose=0x1) at ../../../kern/kern_descrip.c:2336 #10 0xffffffff80b77913 in fdescfree (td=) at ../../../kern/kern_descrip.c:2387 #11 0xffffffff80b88187 in exit1 (td=0xfffffe015bc9aa00, rval=, signo=0x9) at ../../../kern/kern_exit.c:369 #12 0xffffffff80bd517c in sigexit (td=0xfffffe015bc9aa00, sig=0x9) at ../../../kern/kern_sig.c:3223 #13 0xffffffff80bd64cc in postsig (sig=0x9) at ../../../kern/kern_sig.c:3109 #14 0xffffffff80c3386b in ast (framep=0xfffffe0337e9fc00) at ../../../kern/subr_trap.c:336 #15 0xffffffff80fe8af9 in doreti_ast () at ../../../amd64/amd64/exception.S:1154 #16 0x0000000000000003 in ?? () #17 0x00007fffffffe474 in ?? () #18 0x0000000000000004 in ?? () #19 0x000000080044413a in ?? () #20 0x0000000000000000 in ?? () (kgdb) f 4 #4 0xffffffff80cc61b0 in vn_start_write_refed (mp=0xfffffe00d5dedb80, flags=0x1, mplocked=0x0) at ../../../kern/vfs_vnops.c:1773 1773 error = msleep(&mp->mnt_flag, MNT_MTX(mp), mflags, (kgdb) l 1768 while ((mp->mnt_kern_flag & MNTK_SUSPEND) != 0) { 1769 if (flags & V_NOWAIT) { 1770 error = EWOULDBLOCK; 1771 goto unlock; 1772 } 1773 error = msleep(&mp->mnt_flag, MNT_MTX(mp), mflags, 1774 "suspfs", 0); 1775 if (error) 1776 goto unlock; 1777 } (kgdb) info loc _retval = error = 0x0 mflags = 0x77 (kgdb) p *mp $1 = {mnt_mtx = {lock_object = {lo_name = 0xffffffff810cd5b2 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75c00}, mtx_lock = 0x0}, mnt_gen = 0x292, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffffe00e0ac7728}, mnt_op = 0xffffffff81956d80, mnt_vfc = 0xffffffff81956ea0, mnt_vnodecovered = 0xfffff805e599f000, mnt_syncer = 0x0, mnt_ref = 0x67e0, mnt_nvnodelist = {tqh_first = 0xfffff802feaf9288, tqh_last = 0xfffff80137681cc8}, mnt_nvnodelistsize = 0x67bb, mnt_writeopcount = 0x0, mnt_kern_flag = 0x4b846145, mnt_flag = 0x100001000, mnt_opt = 0xfffff80018299910, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20140518, f_type = 0x35, f_flags = 0x100001000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x3df87, f_bfree = 0x3d776, f_bavail = 0x38824, f_files = 0x201fe, f_ffree = 0x201fb, f_syncwrites = 0x11d96, f_asyncwrites = 0x84b8, f_syncreads = 0x12, f_asyncreads = 0x0, f_spare = 0xfffffe00d5dedc88, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = 0xfffffe00d5dedce0}, f_charspare = 0xfffffe00d5dedce8 "", f_fstypename = 0xfffffe00d5dedd38 "ufs", f_mntfromname = 0xfffffe00d5dedd48 "/dev/md10", f_mntonname = 0xfffffe00d5dee148 "/mnt"}, mnt_cred = 0xfffff803236e5c00, mnt_data = 0xfffff807b7c86400, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xc6d1a48a, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x7bc3a, mnt_susp_owner = 0xfffffe003e46f100, mnt_gjprovider = 0x0, mnt_listmtx = {lock_object = {lo_name = 0xffffffff8115cc2e "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd82280}, mtx_lock = 0x0}, mnt_lazyvnodelist = {tqh_first = 0xfffff802feaf9288, tqh_last = 0xfffff80137681e10}, mnt_lazyvnodelistsize = 0x343, mnt_explock = {lock_object = {lo_name = 0xffffffff811914a1 "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd80780}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x0, pcs = 0xfffffe00d5dee608}}, mnt_upper_link = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffffe00d5dee6a8}, mnt_vfs_ops = 0x2, mnt_thread_in_ops_pcpu = 0xfffffe012bb1cfb8, mnt_ref_pcpu = 0xfffffe012bb1cfb0, mnt_lockref_pcpu = 0xfffffe012bb1cfa8, mnt_writeopcount_pcpu = 0xfffffe012bb1cfa0, mnt_rootvnode = 0x0} (kgdb) -- Test scenario: misc/force.sh