Watchdog fired, vmcore.83 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #2 r352067M: Wed Sep 11 09:44:14 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33160585216 (31624 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 8 11 4 3 2 10 7 9 6 5 Timecounter "TSC-low" frequency 1750037580 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 000.000054 [4335] netmap_init netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff811e8150, 0) error 19 [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality overrideAutoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800045bd000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 11 Sep 09:48:02 ntpdate[2045]: step time server 192.168.5.1 offset -0.184408 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff800070ed068 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff80006176068 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c43893 at witness_debugger+0x73 #1 0xffffffff80c435de at witness_checkorder+0xa9e #2 0xffffffff80ba9299 at lockmgr_lock_fast_path+0x179 #3 0xffffffff8125e230 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc576b at VOP_LOCK1+0x4b #5 0xffffffff80cc34e1 at _vn_lock+0xd1 #6 0xffffffff80eda42f at softdep_flushworklist+0x7f #7 0xffffffff80f0bf66 at ffs_sync+0x3d6 #8 0xffffffff80ca86e1 at dounmount+0x4f1 #9 0xffffffff80ca8139 at sys_unmount+0x339 #10 0xffffffff811c0894 at amd64_syscall+0x2d4 #11 0xffffffff81197be0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 327 files, 3400 used, 1262007 free (103 frags, 157738 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Wed Sep 11 09:48 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Sep 11 09:48:09 mercat1 login[2327]: ROOT LOGIN (root) ON ttyu1 Last login: Wed Sep 11 09:17:11 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #2 r352067M: Wed Sep 11 09:44:14 CEST 2019 root@mercat1:~ # Sep 11 09:48:25 mercat1 su[2342]: pho to root on /dev/pts/0 20190911 09:48:57 all (1/3): force.sh 20190911 09:51:58 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=272596992, length=32768)]error =g_vfs_done():md10[WRITE(offset=273285120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272891904, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=273285120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543588352, length=32768)]error =g_vfs_done():md10[WRITE(offset=272891904, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=273285120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272891904, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=273317888, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272596992, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543588352, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272596992, length=32768)]error =g_vfs_done():md10[WRITE(offset=268599296, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=273317888, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=273285120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=3899392, length=32768)]error = 6g_vfs_done():md10[WRITE(offset=272891904, length=32768)]error =g_vfs_done():md10[WRITE(offset=809697280, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=273285120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=131072, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=273317888, length=32768)]error = 6 6 20190911 09:55:35 all (3/3): force3.sh Sep 11 09:55:46 mercat1 kernel: pid 59082 (link), uid 2007 inumber 32918 on /mnt: filesystem full Sep 11 09:55:47 mercat1 kernel: pid 59065 (creat), uid 2007 inumber 32913 on /mnt: filesystem full 20190911 09:56:05 all (1/3): force.sh Sep 11 09:55:48 mercat1 syslogd: last message repeated 1 times 20190911 09:59:06 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=805568512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=131072, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=9695744, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=805568512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805601280, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805568512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=9696256, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=805568512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805535744, length=16384)]error =g_vfs_done():md10[WRITE(offset=805568512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=807501824, length=32768)]error =g_vfs_done():md10[WRITE(offset=825098240, length=4096)]error = g_vfs_done():md10[WRITE(offset=807337984, length=32768)]error =6 6 6 g_vfs_done():md10[WRITE(offset=807370752, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=807501824, length=32768)]error =g_vfs_done():md10[WRITE(offset=824971264, length=4096)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=807567360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805568512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=9696768, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=807731200, length=32768)]error =g_vfs_done():md10[WRITE(offset=825319424, length=4096)]error = 6 6 20190911 10:02:15 all (3/3): force3.sh Sep 11 10:02:27 mercat1 kernel: pid 14333 (rw), uid 2007 inumber 106748 on /mnt: filesystem full 20190911 10:03:12 all (1/3): force.sh 20190911 10:06:13 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=1005027328, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=981893120, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=1005486080, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=982220800, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=982614016, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=1005944832, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=919240704, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=982908928, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=979009536, length=98304)]error =g_vfs_done():md10[WRITE(offset=979566592, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=556597248, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 20190911 10:09:21 all (3/3): force3.sh Sep 11 10:09:28 mercat1 kernel: pid 73613 (rw), uid 2007 inumber 52505 on /mnt: filesystem full Sep 11 10:09:30 mercat1 kernel: pid 73587 (rw), uid 2007 inumber 59631 on /mnt: filesystem full Sep 11 10:09:33 mercat1 kernel: pid 73579 (rw), uid 2007 inumber 61301 on /mnt: filesystem full Sep 11 10:09:36 mercat1 kernel: pid 73648 (rw), uid 2007 inumber 69089 on /mnt: filesystem full Sep 11 10:09:45 mercat1 kernel: pid 73642 (creat), uid 2007 inumber 32973 on /mnt: out of inodes Sep 11 10:09:55 mercat1 kernel: pid 73611 (swap), jid 0, uid 2007, was killed: out of swap space 20190911 10:10:09 all (1/3): force.sh 20190911 10:13:10 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=451280896, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=441614336, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=451543040, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=287506432, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=452067328, length=131072)]error g_vfs_done():md10[WRITE(offset=562724864, length=131072)]error g_vfs_done():md10[WRITE(offset=287637504, length=131072)]error g_vfs_done():md10[WRITE(offset=451805184, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=452329472, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=562855936, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=292585472, length=131072)]error g_vfs_done():md10[WRITE(offset=452591616, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=562987008, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=453115904, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=563118080, length=131072)]error g_vfs_done():md10[WRITE(offset=293306368, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=453378048, length=131072)]error g_vfs_done():md10[WRITE(offset=452853760, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=563249152, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=453640192, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=453902336, length=131072)]error g_vfs_done():md10[WRITE(offset=563380224, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=563511296, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=293437440, length=131072)]error g_vfs_done():md10[WRITE(offset=454164480, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=563642368, length=131072)]error g_vfs_done():md10[WRITE(offset=454426624, length=131072)]error g_vfs_done():md10[WRITE(offset=301367296, length=98304)]error == 6 6 g_vfs_done():md10[WRITE(offset=454688768, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=454950912, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=455475200, length=131072)]error g_vfs_done():md10[WRITE(offset=455737344, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=563773440, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=455999488, length=131072)]error g_vfs_done():md10[WRITE(offset=455213056, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=456261632, length=131072)]error g_vfs_done():md10[WRITE(offset=456523776, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=456818688, length=98304)]error =g_vfs_done():md10[WRITE(offset=457342976, length=98304)]error =g_vfs_done():md10[WRITE(offset=563904512, length=131072)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=457605120, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=564035584, length=131072)]error g_vfs_done():md10[WRITE(offset=457048064, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=458129408, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=458391552, length=98304)]error =g_vfs_done():md10[WRITE(offset=457834496, length=131072)]error g_vfs_done():md10[WRITE(offset=564166656, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=458915840, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=458653696, length=98304)]error =g_vfs_done():md10[WRITE(offset=459440128, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=564297728, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=459964416, length=98304)]error =g_vfs_done():md10[WRITE(offset=564428800, length=131072)]error g_vfs_done():md10[WRITE(offset=459145216, length=98304)]error = 6 = 6 6 6 g_vfs_done():md10[WRITE(offset=564559872, length=131072)]error g_vfs_done():md10[WRITE(offset=460750848, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=459669504, length=131072)]error g_vfs_done():md10[WRITE(offset=460226560, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=564690944, length=131072)]error 6 = 6 g_vfs_done():md10[WRITE(offset=460980224, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=564822016, length=131072)]error g_vfs_done():md10[WRITE(offset=461242368, length=131072)]error g_vfs_done():md10[WRITE(offset=461537280, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=460488704, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=564953088, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=462061568, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=565084160, length=131072)]error g_vfs_done():md10[WRITE(offset=462848000, length=98304)]error =g_vfs_done():md10[WRITE(offset=462323712, length=98304)]error == 6 6 6 g_vfs_done():md10[WRITE(offset=461766656, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=565215232, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=463077376, length=131072)]error g_vfs_done():md10[WRITE(offset=463339520, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=462585856, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=463601664, length=131072)]error g_vfs_done():md10[WRITE(offset=463863808, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=565346304, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=464158720, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=565477376, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=464683008, length=98304)]error =g_vfs_done():md10[WRITE(offset=464945152, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=464388096, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=465174528, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=565608448, length=131072)]error g_vfs_done():md10[WRITE(offset=465469440, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=465862656, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=8585216, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=466092032, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=15749120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=466616320, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=466386944, length=98304)]error =g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error =g_vfs_done():md10[WRITE(offset=270237696, length=32768)]error = 6 = 6 6 = 6 g_vfs_done():md10[WRITE(offset=15781888, length=32768)]error = g_vfs_done():md10[WRITE(offset=466911232, length=98304)]error =g_vfs_done():md10[WRITE(offset=277094400, length=4096)]error = g_vfs_done():md10[WRITE(offset=270270464, length=32768)]error =g_vfs_done():md10[WRITE(offset=65536, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=565739520, length=131072)]error 6 6 = 6 6 6 6 g_vfs_done():md10[WRITE(offset=268828672, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=15814656, length=32768)]error = g_vfs_done():md10[WRITE(offset=270303232, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=565870592, length=131072)]error g_vfs_done():md10[WRITE(offset=270139392, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=467435520, length=98304)]error == 6 6 g_vfs_done():md10[WRITE(offset=467664896, length=131072)]error g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=467927040, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=566001664, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=15847424, length=32768)]error = g_vfs_done():md10[WRITE(offset=270303232, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=468221952, length=98304)]error =g_vfs_done():md10[WRITE(offset=468713472, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=268894208, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=566132736, length=131072)]error g_vfs_done():md10[WRITE(offset=303431680, length=98304)]error =g_vfs_done():md10[WRITE(offset=467140608, length=131072)]error g_vfs_done():md10[WRITE(offset=302678016, length=131072)]error g_vfs_done():md10[WRITE(offset=277123072, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=468975616, length=131072)]error 6 = 6 g_vfs_done():md10[WRITE(offset=15880192, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270336000, length=32768)]error = 6 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=15912960, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=15945728, length=32768)]error = g_vfs_done():md10[WRITE(offset=15978496, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=566263808, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16011264, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=469270528, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=16044032, length=32768)]error = g_vfs_done():md10[WRITE(offset=270368768, length=32768)]error =g_vfs_done():md10[WRITE(offset=305397760, length=131072)]error g_vfs_done():md10[WRITE(offset=470548480, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=470286336, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=469499904, length=65536)]error = 6 g_vfs_done():md10[WRITE(offset=16076800, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=470024192, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=566394880, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=470810624, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=16109568, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=305135616, length=131072)]error g_vfs_done():md10[WRITE(offset=471072768, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16142336, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=297959424, length=98304)]error =g_vfs_done():md10[WRITE(offset=16175104, length=32768)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=270401536, length=32768)]error =g_vfs_done():md10[WRITE(offset=566525952, length=131072)]error g_vfs_done():md10[WRITE(offset=16240640, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=471334912, length=131072)]error g_vfs_done():md10[WRITE(offset=305561600, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=471891968, length=98304)]error =g_vfs_done():md10[WRITE(offset=16207872, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=16273408, length=32768)]error = g_vfs_done():md10[WRITE(offset=472154112, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=16306176, length=32768)]error = = 6 6 = 6 g_vfs_done():md10[WRITE(offset=305987584, length=32768)]error =g_vfs_done():md10[WRITE(offset=307167232, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=472645632, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=471597056, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=270434304, length=32768)]error =g_vfs_done():md10[WRITE(offset=472907776, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16338944, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=566657024, length=131072)]error g_vfs_done():md10[WRITE(offset=473432064, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=473169920, length=131072)]error g_vfs_done():md10[WRITE(offset=16371712, length=32768)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=270434304, length=32768)]error =g_vfs_done():md10[WRITE(offset=16404480, length=32768)]error = g_vfs_done():md10[WRITE(offset=16437248, length=32768)]error = g_vfs_done():md10[WRITE(offset=307986432, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=566788096, length=131072)]error = 6 = 6 6 6 6 g_vfs_done():md10[WRITE(offset=16470016, length=32768)]error = g_vfs_done():md10[WRITE(offset=473694208, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16502784, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=473956352, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16568320, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=566919168, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16601088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=16535552, length=32768)]error = g_vfs_done():md10[WRITE(offset=567050240, length=131072)]error g_vfs_done():md10[WRITE(offset=16633856, length=32768)]error = = 6 6 g_vfs_done():md10[WRITE(offset=270467072, length=32768)]error =g_vfs_done():md10[WRITE(offset=475004928, length=131072)]error g_vfs_done():md10[WRITE(offset=309919744, length=98304)]error =g_vfs_done():md10[WRITE(offset=474218496, length=131072)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=310542336, length=131072)]error g_vfs_done():md10[WRITE(offset=475267072, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=474480640, length=131072)]error g_vfs_done():md10[WRITE(offset=474742784, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=567181312, length=131072)]error g_vfs_done():md10[WRITE(offset=16666624, length=32768)]error = g_vfs_done():md10[WRITE(offset=311033856, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=311164928, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=268599296, length=16384)]error == 6 g_vfs_done():md10[WRITE(offset=16699392, length=32768)]error = g_vfs_done():md10[WRITE(offset=475529216, length=131072)]error = 6 = 6 = 6 6 6 6 = 6 g_vfs_done():md10[WRITE(offset=16732160, length=32768)]error = g_vfs_done():md10[WRITE(offset=16797696, length=32768)]error = g_vfs_done():md10[WRITE(offset=311394304, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=472383488, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16764928, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=16830464, length=32768)]error = g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=16896000, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=567312384, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=16928768, length=32768)]error = g_vfs_done():md10[WRITE(offset=476086272, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=16863232, length=32768)]error = g_vfs_done():md10[WRITE(offset=567443456, length=131072)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=476348416, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=16961536, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=17027072, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=17059840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=16994304, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=8683520, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270532608, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=476577792, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=8749056, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=8716288, length=32768)]error = 6g_vfs_done():md10[WRITE(offset=17092608, length=12288)]error = g_vfs_done():md10[WRITE(offset=8781824, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=567574528, length=131072)]error g_vfs_done():md10[WRITE(offset=476839936, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=8814592, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=8847360, length=31232)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=270565376, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=8878592, length=32768)]error = 66 g_vfs_done():md10[WRITE(offset=311689216, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=312672256, length=131072)]error g_vfs_done():md10[WRITE(offset=567705600, length=131072)]error g_vfs_done():md10[WRITE(offset=8911360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=8944128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=477396992, length=98304)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=9009664, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=477102080, length=131072)]error g_vfs_done():md10[WRITE(offset=8976896, length=32768)]error = 6g_vfs_done():md10[WRITE(offset=9075200, length=1536)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=477626368, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=567836672, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=9042432, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270630912, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=312049664, length=65536)]error = 6 20190911 10:16:18 all (3/3): force3.sh 20190911 10:16:31 all (1/3): force.sh 20190911 10:19:33 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=920125440, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=920256512, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=920387584, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=920518656, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=920649728, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=920780800, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=920911872, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921042944, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921174016, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921305088, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921436160, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921567232, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921698304, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921829376, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=921960448, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922091520, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922222592, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922353664, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922484736, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922615808, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922746880, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=922877952, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923009024, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923140096, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923271168, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923402240, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923533312, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923664384, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923795456, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=923926528, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924057600, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924188672, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924319744, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924450816, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924581888, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924712960, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924844032, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=924975104, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925106176, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925237248, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925368320, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925499392, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925630464, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925761536, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=925892608, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926023680, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926154752, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926285824, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926416896, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926547968, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926679040, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926810112, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=926941184, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927072256, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927203328, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927334400, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927465472, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927596544, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927727616, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927858688, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=927989760, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928120832, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928251904, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928382976, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928514048, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928645120, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928776192, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=928907264, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929038336, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929169408, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929300480, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929431552, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929562624, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929693696, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929824768, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=929955840, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930086912, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930217984, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930349056, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930480128, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930611200, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930742272, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=930873344, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931004416, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931135488, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931266560, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931397632, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931528704, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931659776, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931790848, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=931921920, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=932052992, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=932184064, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=932315136, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=932446208, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=932577280, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=268894208, length=32768)]error =g_vfs_done():md10[WRITE(offset=271253504, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=278626304, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=932708352, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=278691840, length=32768)]error =g_vfs_done():md10[WRITE(offset=271286272, length=32768)]error =g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=271253504, length=32768)]error == 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=932839424, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=271286272, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=278724608, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=271319040, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=271319040, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=932970496, length=131072)]error g_vfs_done():md10[WRITE(offset=278790144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=271351808, length=32768)]error =g_vfs_done():md10[WRITE(offset=278855680, length=32768)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=278163456, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=933101568, length=131072)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=933232640, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=277774336, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=933363712, length=131072)]error g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=268894208, length=32768)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=933494784, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=933625856, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=277544960, length=32768)]error =g_vfs_done():md10[WRITE(offset=933756928, length=131072)]error g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=278888448, length=32768)]error = 6 g_vfs_done():md10[READ(offset=277774336, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=271384576, length=32768)]error = 6 g_vfs_done():md10[READ(offset=277774336, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=805666816, length=32768)]error =g_vfs_done():md10[WRITE(offset=933888000, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[READ(offset=277774336, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=278953984, length=32768)]error =g_vfs_done():md10[WRITE(offset=934019072, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=271384576, length=32768)]error =g_vfs_done():md10[READ(offset=277774336, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=279019520, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=279150592, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=271417344, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=279183360, length=32768)]error =g_vfs_done():md10[WRITE(offset=271450112, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=271417344, length=32768)]error =g_vfs_done():md10[WRITE(offset=934150144, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=934281216, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=279216128, length=32768)]error =g_vfs_done():md10[WRITE(offset=934412288, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=271450112, length=32768)]error =g_vfs_done():md10[WRITE(offset=934543360, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=271482880, length=32768)]error = 6 = 6 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=279281664, length=32768)]error =g_vfs_done():md10[WRITE(offset=934674432, length=131072)]error 6 6 = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=934805504, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=271482880, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=934936576, length=131072)]error g_vfs_done():md10[WRITE(offset=279347200, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=277663744, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=271515648, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=935067648, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=271515648, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=935198720, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=277544960, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=935329792, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=935460864, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=935591936, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=271548416, length=32768)]error == 6 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=271548416, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=935723008, length=131072)]error g_vfs_done():md10[WRITE(offset=292028416, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=935854080, length=131072)]error g_vfs_done():md10[WRITE(offset=271581184, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error == 6 g_vfs_done():md10[WRITE(offset=341344256, length=131072)]error 6 g_vfs_done():md10[READ(offset=277544960, length=4096)]error = 6= 6 6 g_vfs_done():md10[WRITE(offset=935985152, length=131072)]error g_vfs_done():md10[WRITE(offset=341671936, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=271613952, length=32768)]error = g_vfs_done():md10[WRITE(offset=936116224, length=131072)]error g_vfs_done():md10[WRITE(offset=537198592, length=32768)]error == 6 6 g_vfs_done():md10[READ(offset=277544960, length=4096)]error = 6g_vfs_done():md10[WRITE(offset=342392832, length=65536)]error = 6 6 g_vfs_done():md10[WRITE(offset=936247296, length=131072)]error g_vfs_done():md10[READ(offset=277544960, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=271613952, length=32768)]error = 6 = 6 g_vfs_done():md10[READ(offset=277544960, length=4096)]error = 6g_vfs_done():md10[WRITE(offset=342786048, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=271646720, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=936378368, length=131072)]error g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=371261440, length=98304)]error =g_vfs_done():md10[WRITE(offset=271646720, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=271679488, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=936509440, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=271712256, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=936640512, length=131072)]error g_vfs_done():md10[WRITE(offset=537231360, length=32768)]error == 6 6 g_vfs_done():md10[WRITE(offset=271745024, length=32768)]error =g_vfs_done():md10[WRITE(offset=271712256, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268861440, length=32768)]error =g_vfs_done():md10[WRITE(offset=371589120, length=98304)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=271745024, length=32768)]error = 6 20190911 10:22:40 all (3/3): force3.sh Sep 11 10:22:55 mercat1 kernel: pid 96215 (creat), uid 2007 inumber 32928 on /mnt: out of inodes 20190911 10:23:35 all (1/3): force.sh 20190911 10:26:36 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=953417728, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=953548800, length=131072)]error g_vfs_done():md10[WRITE(offset=953679872, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=953810944, length=131072)]error g_vfs_done():md10[WRITE(offset=953942016, length=131072)]error g_vfs_done():md10[WRITE(offset=954073088, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=954302464, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=954466304, length=131072)]error g_vfs_done():md10[WRITE(offset=950239232, length=131072)]error g_vfs_done():md10[WRITE(offset=954630144, length=131072)]error g_vfs_done():md10[WRITE(offset=951681024, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=954761216, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=954204160, length=98304)]error == 6 = 6 6 g_vfs_done():md10[WRITE(offset=954892288, length=131072)]error g_vfs_done():md10[WRITE(offset=955056128, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=955187200, length=131072)]error = 6 = 6 20190911 10:29:44 all (3/3): force3.sh 20190911 10:31:06 all (1/3): force.sh Sep 11 10:31:19 mercat1 kernel: pid 38999 (rw), uid 2007 inumber 32970 on /mnt: filesystem full Sep 11 10:31:31 mercat1 kernel: pid 39020 (mkdir), uid 2007 inumber 65788 on /mnt: out of inodes Sep 11 10:31:43 mercat1 kernel: pid 39034 (swap), jid 0, uid 2007, was killed: out of swap space 20190911 10:34:07 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=771686400, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=759562240, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=14322688, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=556728320, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=586383360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=588218368, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=591495168, length=65536)]error = 6 g_vfs_done():md10[WRITE(offset=813989888, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=589791232, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=590446592, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=545976320, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=813998080, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=579829760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=583467008, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=545525760, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=545542144, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=545554432, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=556294144, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=557838336, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=590577664, length=65536)]error = 6 g_vfs_done():md10[WRITE(offset=580222976, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=545529856, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=545546240, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=556281856, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=558788608, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=131072, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=163840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=584876032, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537133056, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537165824, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537198592, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537231360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537296896, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537329664, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537362432, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537395200, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537493504, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537526272, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537559040, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537591808, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537624576, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537657344, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537690112, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537722880, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537755648, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537788416, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537821184, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537853952, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537886720, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537919488, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537952256, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537985024, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538050560, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538083328, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538116096, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538148864, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538181632, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538214400, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538247168, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538279936, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538312704, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538345472, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=559738880, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=560754688, length=4096)]error = g_vfs_done():md10[WRITE(offset=563691520, length=4096)]error = g_vfs_done():md10[WRITE(offset=538411008, length=32768)]error =6 g_vfs_done():md10[WRITE(offset=559734784, length=4096)]error = g_vfs_done():md10[WRITE(offset=560558080, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=558583808, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=560062464, length=4096)]error = g_vfs_done():md10[WRITE(offset=545562624, length=4096)]error = g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =6 g_vfs_done():md10[WRITE(offset=557568000, length=4096)]error = g_vfs_done():md10[WRITE(offset=559308800, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=563113984, length=4096)]error = g_vfs_done():md10[WRITE(offset=564195328, length=4096)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=538476544, length=32768)]error =g_vfs_done():md10[WRITE(offset=562094080, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =6 6 g_vfs_done():md10[WRITE(offset=14323200, length=512)]error = 6 6 g_vfs_done():md10[WRITE(offset=538443776, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=561278976, length=4096)]error = g_vfs_done():md10[WRITE(offset=14323712, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=537427968, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537460736, length=32768)]error =g_vfs_done():md10[WRITE(offset=14324736, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=538509312, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=14324224, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537264128, length=32768)]error =g_vfs_done():md10[WRITE(offset=14325248, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=538542080, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=538574848, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=545849344, length=32768)]error =g_vfs_done():md10[WRITE(offset=14325760, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=538607616, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=14326272, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=14326784, length=512)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=538673152, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=538771456, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=14327296, length=512)]error = 6 6 g_vfs_done():md10[WRITE(offset=538804224, length=32768)]error =g_vfs_done():md10[WRITE(offset=14327808, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=538836992, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=14328320, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=538869760, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=14328832, length=512)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=538902528, length=32768)]error =g_vfs_done():md10[WRITE(offset=14329344, length=512)]error = 6 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=538935296, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=538968064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=539000832, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=545595392, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=573603840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=14330368, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=14329856, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=584253440, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=14330880, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=588677120, length=65536)]error =g_vfs_done():md10[WRITE(offset=537264128, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=588644352, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537427968, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=546365440, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=537460736, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=575176704, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=538378240, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=576520192, length=32768)]error =g_vfs_done():md10[WRITE(offset=14331392, length=512)]error = 6 6 g_vfs_done():md10[WRITE(offset=538640384, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=545558528, length=4096)]error = g_vfs_done():md10[WRITE(offset=538705920, length=32768)]error =6 6 g_vfs_done():md10[WRITE(offset=557707264, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=538738688, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=558198784, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=539033600, length=32768)]error =g_vfs_done():md10[WRITE(offset=558755840, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=560779264, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=539066368, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=578420736, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539099136, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=587202560, length=65536)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=591429632, length=32768)]error =g_vfs_done():md10[WRITE(offset=539131904, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=539164672, length=32768)]error =g_vfs_done():md10[WRITE(offset=558047232, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=571801600, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539197440, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=582647808, length=32768)]error =g_vfs_done():md10[WRITE(offset=539230208, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=539262976, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=545533952, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=538443776, length=32768)]error =g_vfs_done():md10[WRITE(offset=558100480, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=561274880, length=4096)]error = g_vfs_done():md10[WRITE(offset=539295744, length=32768)]error =6 6 g_vfs_done():md10[WRITE(offset=587923456, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=539328512, length=32768)]error =g_vfs_done():md10[WRITE(offset=590020608, length=65536)]error = 6 6 g_vfs_done():md10[WRITE(offset=814002176, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=539361280, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=576585728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539394048, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=579043328, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539426816, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539459584, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539492352, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539525120, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539557888, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539590656, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=671580160, length=32768)]error =g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=539656192, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=776863744, length=32768)]error =g_vfs_done():md10[WRITE(offset=539590656, length=32768)]error =g_vfs_done():md10[WRITE(offset=772734976, length=32768)]error =g_vfs_done():md10[WRITE(offset=560017408, length=4096)]error = g_vfs_done():md10[WRITE(offset=539623424, length=32768)]error =g_vfs_done():md10[WRITE(offset=539525120, length=32768)]error =g_vfs_done():md10[WRITE(offset=727384064, length=32768)]error = 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=539754496, length=32768)]error =g_vfs_done():md10[WRITE(offset=772079616, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=575111168, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=539656192, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539262976, length=32768)]error = 6 20190911 10:37:16 all (3/3): force3.sh 20190911 10:37:37 all (1/3): force.sh g_vfs_done():md10[WRITE(offset=679149568, length=20480)]error = 6 g_vfs_done():md10[WRITE(offset=537133056, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540213248, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=557375488, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=11573760, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=541130752, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=665108480, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=550133760, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540966912, length=32768)]error =g_vfs_done():md10[WRITE(offset=665112576, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=11574272, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=11574784, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=679575552, length=12288)]error =g_vfs_done():md10[WRITE(offset=546861056, length=4096)]error = g_vfs_done():md10[WRITE(offset=557076480, length=4096)]error = g_vfs_done():md10[WRITE(offset=560685056, length=4096)]error = g_vfs_done():md10[WRITE(offset=540999680, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541065216, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541130752, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=665116672, length=4096)]error = g_vfs_done():md10[WRITE(offset=557543424, length=4096)]error = 6 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=667222016, length=32768)]error =g_vfs_done():md10[WRITE(offset=547028992, length=32768)]error = 6 6 20190911 10:40:38 all (2/3): force2.sh Sep 11 10:40:58 mercat1 kernel: pid 49523 (mkdir), uid 2007 inumber 36923 on /mnt: out of inodes g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272400384, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272662528, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272465920, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272662528, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272662528, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272564224, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272662528, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272498688, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272662528, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=276627456, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272465920, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543031296, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272400384, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543031296, length=32768)]error =g_vfs_done():md10[WRITE(offset=272564224, length=32768)]error =g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=276627456, length=32768)]error =g_vfs_done():md10[WRITE(offset=272465920, length=32768)]error =g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error =g_vfs_done():md10[WRITE(offset=543031296, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=543031296, length=32768)]error =g_vfs_done():md10[WRITE(offset=276627456, length=32768)]error =g_vfs_done():md10[WRITE(offset=543129600, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=276627456, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272302080, length=32768)]error =g_vfs_done():md10[WRITE(offset=272007168, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=543129600, length=32768)]error =g_vfs_done():md10[WRITE(offset=544505856, length=32768)]error =g_vfs_done():md10[WRITE(offset=276660224, length=32768)]error =g_vfs_done():md10[WRITE(offset=543031296, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=272564224, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=272629760, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=276627456, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544440320, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=276234240, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544374784, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269811712, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=3735552, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269058048, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=1671168, length=32768)]error = 6 20190911 10:43:57 all (3/3): force3.sh g_vfs_done():md10[WRITE(offset=537165824, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805928960, length=32768)]error =g_vfs_done():md10[WRITE(offset=751239168, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=12740608, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=762642432, length=32768)]error =g_vfs_done():md10[WRITE(offset=546594816, length=4096)]error = g_vfs_done():md10[WRITE(offset=539525120, length=32768)]error =g_vfs_done():md10[WRITE(offset=539852800, length=32768)]error =g_vfs_done():md10[WRITE(offset=762675200, length=32768)]error =g_vfs_done():md10[WRITE(offset=762707968, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=8585216, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=539951104, length=32768)]error =g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=537198592, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=65536, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=539721728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=814305280, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=537427968, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=546594816, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=539951104, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=12741120, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=538607616, length=32768)]error =g_vfs_done():md10[WRITE(offset=539820032, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=752091136, length=32768)]error =g_vfs_done():md10[WRITE(offset=540311552, length=32768)]error =g_vfs_done():md10[WRITE(offset=540278784, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805928960, length=32768)]error =g_vfs_done():md10[WRITE(offset=539721728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=805666816, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539492352, length=32768)]error =g_vfs_done():md10[WRITE(offset=547094528, length=28672)]error =g_vfs_done():md10[WRITE(offset=546172928, length=4096)]error = 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=550600704, length=12288)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=651722752, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=719585280, length=32768)]error =g_vfs_done():md10[WRITE(offset=676888576, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=539623424, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=547160064, length=28672)]error = 6 6 6 6 6 20190911 10:44:21 all (1/3): force.sh 20190911 10:47:23 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=807075840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=807108608, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=807141376, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=807174144, length=32768)]error = 6 20190911 10:50:34 all (3/3): force3.sh 20190911 10:51:10 all (1/3): force.sh 20190911 10:54:11 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=541392896, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=279576576, length=24576)]error = 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=269975552, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269975552, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270532608, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=270532608, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=269484032, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error =g_vfs_done():md10[WRITE(offset=269484032, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=270532608, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270073856, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270073856, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error = 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270073856, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=543817728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270106624, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=270106624, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269451264, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=270106624, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544505856, length=32768)]error =g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error =g_vfs_done():md10[WRITE(offset=269451264, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269451264, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=544505856, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544505856, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=544505856, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error =g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544866304, length=32768)]error =g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541360128, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544243712, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=280002560, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270794752, length=32768)]error =g_vfs_done():md10[WRITE(offset=544866304, length=32768)]error = 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error =g_vfs_done():md10[WRITE(offset=543850496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=544866304, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543850496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544866304, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=543850496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error =g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544047104, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=808779776, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[READ(offset=280002560, length=4096)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error =g_vfs_done():md10[WRITE(offset=544047104, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=544047104, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error = 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error =g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error =g_vfs_done():md10[WRITE(offset=270565376, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=544210944, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270499840, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=544210944, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544440320, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540803072, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=544210944, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270598144, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error =g_vfs_done():md10[WRITE(offset=270467072, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544178176, length=32768)]error =g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=544440320, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=808779776, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=544440320, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268894208, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error =g_vfs_done():md10[WRITE(offset=544178176, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=268894208, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269549568, length=32768)]error =g_vfs_done():md10[WRITE(offset=808779776, length=32768)]error =g_vfs_done():md10[WRITE(offset=270761984, length=32768)]error =g_vfs_done():md10[WRITE(offset=269385728, length=32768)]error =g_vfs_done():md10[WRITE(offset=541327360, length=32768)]error =g_vfs_done():md10[WRITE(offset=269418496, length=32768)]error =g_vfs_done():md10[WRITE(offset=268894208, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270565376, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544473088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544833536, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=808779776, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=544178176, length=32768)]error = 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=270467072, length=32768)]error = 6 20190911 10:57:41 all (3/3): force3.sh g_vfs_done():md10[WRITE(offset=574324736, length=28672)]error =g_vfs_done():md10[WRITE(offset=543129600, length=32768)]error =g_vfs_done():md10[WRITE(offset=760872960, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543752192, length=32768)]error =g_vfs_done():md10[WRITE(offset=760938496, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=760807424, length=32768)]error =g_vfs_done():md10[WRITE(offset=575799296, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543293440, length=32768)]error =g_vfs_done():md10[WRITE(offset=760840192, length=32768)]error =g_vfs_done():md10[WRITE(offset=12166144, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=760971264, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=760905728, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=12166656, length=512)]error = 6 6 g_vfs_done():md10[WRITE(offset=12167168, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=543719424, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=543752192, length=32768)]error =g_vfs_done():md10[WRITE(offset=12167680, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=543129600, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error =g_vfs_done():md10[WRITE(offset=543490048, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=543555584, length=32768)]error = 6 6 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=545550336, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=564154368, length=4096)]error = 6 20190911 10:57:57 all (1/3): force.sh Sep 11 10:58:05 mercat1 kernel: pid 19328 (rw), uid 2007 inumber 89321 on /mnt: filesystem full Sep 11 10:58:09 mercat1 kernel: pid 19335 (rw), uid 2007 inumber 56977 on /mnt: filesystem full 20190911 11:00:58 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=487161856, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=487292928, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=487424000, length=131072)]error g_vfs_done():md10[WRITE(offset=593199104, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=487587840, length=131072)]error g_vfs_done():md10[WRITE(offset=487751680, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=487882752, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=488144896, length=131072)]error g_vfs_done():md10[WRITE(offset=488013824, length=131072)]error g_vfs_done():md10[WRITE(offset=593330176, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=488275968, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=488439808, length=131072)]error g_vfs_done():md10[WRITE(offset=488734720, length=131072)]error g_vfs_done():md10[WRITE(offset=488996864, length=131072)]error g_vfs_done():md10[WRITE(offset=488570880, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=593461248, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=489160704, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=379912192, length=98304)]error =g_vfs_done():md10[WRITE(offset=493060096, length=131072)]error g_vfs_done():md10[WRITE(offset=488898560, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=566099968, length=98304)]error =g_vfs_done():md10[WRITE(offset=527106048, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=494403584, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=489422848, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=489291776, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=493813760, length=98304)]error =g_vfs_done():md10[WRITE(offset=566001664, length=98304)]error =g_vfs_done():md10[WRITE(offset=493584384, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=494632960, length=131072)]error g_vfs_done():md10[WRITE(offset=576356352, length=65536)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=593723392, length=131072)]error g_vfs_done():md10[WRITE(offset=527302656, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=494764032, length=98304)]error =g_vfs_done():md10[WRITE(offset=523042816, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=593592320, length=131072)]error 6 = 6 6 g_vfs_done():md10[WRITE(offset=523993088, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=419889152, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=593854464, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=495321088, length=98304)]error =g_vfs_done():md10[WRITE(offset=413892608, length=131072)]error g_vfs_done():md10[WRITE(offset=509509632, length=98304)]error =g_vfs_done():md10[WRITE(offset=527990784, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=594378752, length=131072)]error g_vfs_done():md10[WRITE(offset=571506688, length=32768)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=528678912, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=592150528, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=593985536, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=420446208, length=131072)]error g_vfs_done():md10[WRITE(offset=594706432, length=98304)]error = 6 6 = 6 g_vfs_done():md10[WRITE(offset=594247680, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=378077184, length=98304)]error =g_vfs_done():md10[WRITE(offset=557088768, length=98304)]error =g_vfs_done():md10[WRITE(offset=573210624, length=32768)]error =g_vfs_done():md10[WRITE(offset=523632640, length=131072)]error = 6 = 6 6 6 g_vfs_done():md10[WRITE(offset=594509824, length=131072)]error g_vfs_done():md10[WRITE(offset=595984384, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=596115456, length=131072)]error g_vfs_done():md10[WRITE(offset=595427328, length=131072)]error g_vfs_done():md10[WRITE(offset=595689472, length=131072)]error g_vfs_done():md10[WRITE(offset=594116608, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=594837504, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=596377600, length=131072)]error g_vfs_done():md10[WRITE(offset=595132416, length=131072)]error g_vfs_done():md10[WRITE(offset=596246528, length=131072)]error = 6 = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=373391360, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=597164032, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=596508672, length=131072)]error g_vfs_done():md10[WRITE(offset=373948416, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=596901888, length=131072)]error g_vfs_done():md10[WRITE(offset=556597248, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=579436544, length=65536)]error == 6 6 g_vfs_done():md10[WRITE(offset=596738048, length=131072)]error g_vfs_done():md10[WRITE(offset=596639744, length=98304)]error =g_vfs_done():md10[WRITE(offset=595001344, length=131072)]error = 6 6 6 = 6 g_vfs_done():md10[WRITE(offset=597032960, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=597950464, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=597360640, length=131072)]error g_vfs_done():md10[WRITE(offset=579108864, length=65536)]error =g_vfs_done():md10[WRITE(offset=595296256, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=598114304, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=598409216, length=131072)]error g_vfs_done():md10[WRITE(offset=597229568, length=131072)]error g_vfs_done():md10[WRITE(offset=597688320, length=131072)]error g_vfs_done():md10[WRITE(offset=595853312, length=131072)]error g_vfs_done():md10[WRITE(offset=578224128, length=32768)]error == 6 = 6 g_vfs_done():md10[WRITE(offset=598278144, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=594870272, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=599523328, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=598835200, length=131072)]error g_vfs_done():md10[WRITE(offset=599359488, length=32768)]error =g_vfs_done():md10[WRITE(offset=598966272, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=556367872, length=131072)]error g_vfs_done():md10[WRITE(offset=599228416, length=131072)]error 6 = 6 6 g_vfs_done():md10[WRITE(offset=600309760, length=98304)]error =g_vfs_done():md10[WRITE(offset=599392256, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=381190144, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=601260032, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=598573056, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=597524480, length=131072)]error g_vfs_done():md10[WRITE(offset=601391104, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=601128960, length=131072)]error g_vfs_done():md10[WRITE(offset=577732608, length=65536)]error =g_vfs_done():md10[WRITE(offset=600604672, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=599785472, length=131072)]error g_vfs_done():md10[WRITE(offset=598704128, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=599654400, length=131072)]error g_vfs_done():md10[WRITE(offset=601522176, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=599916544, length=131072)]error g_vfs_done():md10[WRITE(offset=599097344, length=131072)]error g_vfs_done():md10[WRITE(offset=569901056, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=600440832, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=600866816, length=131072)]error g_vfs_done():md10[WRITE(offset=600735744, length=131072)]error g_vfs_done():md10[WRITE(offset=597819392, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=578584576, length=32768)]error == 6 g_vfs_done():md10[WRITE(offset=600997888, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=602112000, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=601653248, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=603062272, length=131072)]error g_vfs_done():md10[WRITE(offset=600571904, length=32768)]error == 6 = 6 6 = 6 g_vfs_done():md10[WRITE(offset=603193344, length=131072)]error g_vfs_done():md10[WRITE(offset=602374144, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=603455488, length=131072)]error g_vfs_done():md10[WRITE(offset=602931200, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=603324416, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=602243072, length=131072)]error g_vfs_done():md10[WRITE(offset=603586560, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=602636288, length=131072)]error g_vfs_done():md10[WRITE(offset=602767360, length=131072)]error g_vfs_done():md10[WRITE(offset=576323584, length=32768)]error == 6 6 g_vfs_done():md10[WRITE(offset=602505216, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=603848704, length=131072)]error g_vfs_done():md10[WRITE(offset=603717632, length=131072)]error g_vfs_done():md10[WRITE(offset=601817088, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=600211456, length=98304)]error =g_vfs_done():md10[WRITE(offset=603979776, length=131072)]error g_vfs_done():md10[WRITE(offset=601948160, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=604110848, length=131072)]error g_vfs_done():md10[WRITE(offset=575766528, length=65536)]error == 6 = 6 g_vfs_done():md10[WRITE(offset=604962816, length=131072)]error = 6 = 6 = 6 6 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=604504064, length=131072)]error g_vfs_done():md10[WRITE(offset=604372992, length=131072)]error g_vfs_done():md10[WRITE(offset=605913088, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=606076928, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=604667904, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=605782016, length=131072)]error g_vfs_done():md10[WRITE(offset=604831744, length=131072)]error g_vfs_done():md10[WRITE(offset=604241920, length=131072)]error g_vfs_done():md10[WRITE(offset=605257728, length=131072)]error g_vfs_done():md10[WRITE(offset=605388800, length=131072)]error g_vfs_done():md10[WRITE(offset=605093888, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=605519872, length=131072)]error g_vfs_done():md10[WRITE(offset=606502912, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=606371840, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=606240768, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=606633984, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=606896128, length=131072)]error g_vfs_done():md10[WRITE(offset=607191040, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=605650944, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=607846400, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=606765056, length=131072)]error g_vfs_done():md10[WRITE(offset=607059968, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=608206848, length=131072)]error g_vfs_done():md10[WRITE(offset=607584256, length=131072)]error g_vfs_done():md10[WRITE(offset=607322112, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=608731136, length=131072)]error g_vfs_done():md10[WRITE(offset=608600064, length=131072)]error g_vfs_done():md10[WRITE(offset=607715328, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=609517568, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=608993280, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=609255424, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=608337920, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=608862208, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=607453184, length=131072)]error g_vfs_done():md10[WRITE(offset=610172928, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=609124352, length=131072)]error g_vfs_done():md10[WRITE(offset=610041856, length=131072)]error g_vfs_done():md10[WRITE(offset=609910784, length=131072)]error g_vfs_done():md10[WRITE(offset=609386496, length=131072)]error g_vfs_done():md10[WRITE(offset=609648640, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=610435072, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=609779712, length=131072)]error g_vfs_done():md10[WRITE(offset=608468992, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=610304000, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=610729984, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=608108544, length=98304)]error == 6 = 6 g_vfs_done():md10[WRITE(offset=610566144, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=612106240, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=612237312, length=131072)]error g_vfs_done():md10[WRITE(offset=610861056, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=610992128, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=612368384, length=131072)]error g_vfs_done():md10[WRITE(offset=611254272, length=131072)]error 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=612499456, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=611516416, length=131072)]error g_vfs_done():md10[WRITE(offset=611385344, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=612761600, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=612630528, length=131072)]error g_vfs_done():md10[WRITE(offset=611647488, length=131072)]error g_vfs_done():md10[WRITE(offset=611778560, length=131072)]error = 6 = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=613089280, length=131072)]error g_vfs_done():md10[WRITE(offset=613220352, length=131072)]error g_vfs_done():md10[WRITE(offset=607977472, length=131072)]error g_vfs_done():md10[WRITE(offset=612925440, length=131072)]error g_vfs_done():md10[WRITE(offset=611123200, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=613875712, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=611909632, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=613744640, length=131072)]error g_vfs_done():md10[WRITE(offset=614268928, length=131072)]error g_vfs_done():md10[WRITE(offset=613351424, length=131072)]error g_vfs_done():md10[WRITE(offset=613613568, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=613482496, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=614006784, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=614137856, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=615251968, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=614727680, length=131072)]error g_vfs_done():md10[WRITE(offset=614563840, length=131072)]error g_vfs_done():md10[WRITE(offset=614432768, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=614989824, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=615645184, length=131072)]error g_vfs_done():md10[WRITE(offset=615383040, length=131072)]error g_vfs_done():md10[WRITE(offset=614858752, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=615514112, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=615120896, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=616267776, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=616136704, length=131072)]error g_vfs_done():md10[WRITE(offset=615809024, length=131072)]error g_vfs_done():md10[WRITE(offset=617054208, length=131072)]error g_vfs_done():md10[WRITE(offset=615972864, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=616398848, length=131072)]error = 6 = 6 = 6 = 6 = 6 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=617611264, length=131072)]error g_vfs_done():md10[WRITE(offset=616529920, length=131072)]error g_vfs_done():md10[WRITE(offset=616660992, length=131072)]error g_vfs_done():md10[WRITE(offset=616923136, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=617185280, length=131072)]error g_vfs_done():md10[WRITE(offset=618201088, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=618070016, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=617906176, length=131072)]error g_vfs_done():md10[WRITE(offset=616792064, length=131072)]error g_vfs_done():md10[WRITE(offset=617480192, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=617775104, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=617316352, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=618463232, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=618856448, length=131072)]error g_vfs_done():md10[WRITE(offset=618594304, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=618332160, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=618987520, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=619151360, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=618725376, length=131072)]error g_vfs_done():md10[WRITE(offset=620003328, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=620134400, length=131072)]error g_vfs_done():md10[WRITE(offset=620396544, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=619446272, length=131072)]error g_vfs_done():md10[WRITE(offset=619839488, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=619282432, length=131072)]error g_vfs_done():md10[WRITE(offset=619708416, length=131072)]error g_vfs_done():md10[WRITE(offset=619577344, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=620265472, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=621379584, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=620920832, length=131072)]error g_vfs_done():md10[WRITE(offset=620789760, length=131072)]error g_vfs_done():md10[WRITE(offset=620527616, length=131072)]error g_vfs_done():md10[WRITE(offset=620658688, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=621772800, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=622297088, length=131072)]error g_vfs_done():md10[WRITE(offset=621084672, length=131072)]error g_vfs_done():md10[WRITE(offset=621215744, length=131072)]error g_vfs_done():md10[WRITE(offset=621641728, length=131072)]error g_vfs_done():md10[WRITE(offset=622166016, length=131072)]error g_vfs_done():md10[WRITE(offset=621903872, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=621510656, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=622034944, length=131072)]error g_vfs_done():md10[WRITE(offset=622428160, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=623017984, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=623411200, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=622559232, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=623804416, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=623673344, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=623935488, length=131072)]error g_vfs_done():md10[WRITE(offset=622690304, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=622854144, length=131072)]error g_vfs_done():md10[WRITE(offset=623149056, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=623542272, length=131072)]error g_vfs_done():md10[WRITE(offset=624328704, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=623280128, length=131072)]error g_vfs_done():md10[WRITE(offset=624066560, length=131072)]error g_vfs_done():md10[WRITE(offset=624197632, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=624590848, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=624852992, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=624459776, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=625115136, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=625573888, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=624984064, length=131072)]error g_vfs_done():md10[WRITE(offset=624721920, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=626098176, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=625704960, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=626229248, length=131072)]error g_vfs_done():md10[WRITE(offset=625278976, length=131072)]error g_vfs_done():md10[WRITE(offset=625442816, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=625967104, length=131072)]error g_vfs_done():md10[WRITE(offset=626393088, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=627343360, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=626556928, length=131072)]error g_vfs_done():md10[WRITE(offset=627474432, length=131072)]error g_vfs_done():md10[WRITE(offset=626819072, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=626950144, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=626688000, length=131072)]error g_vfs_done():md10[WRITE(offset=627081216, length=131072)]error g_vfs_done():md10[WRITE(offset=627605504, length=131072)]error g_vfs_done():md10[WRITE(offset=627212288, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=628129792, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=627736576, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=625836032, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=628523008, length=131072)]error g_vfs_done():md10[WRITE(offset=627867648, length=131072)]error g_vfs_done():md10[WRITE(offset=628948992, length=131072)]error g_vfs_done():md10[WRITE(offset=627998720, length=131072)]error g_vfs_done():md10[WRITE(offset=628654080, length=131072)]error g_vfs_done():md10[WRITE(offset=628260864, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=628391936, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=629506048, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=629112832, length=131072)]error g_vfs_done():md10[WRITE(offset=628785152, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=629374976, length=131072)]error g_vfs_done():md10[WRITE(offset=629637120, length=131072)]error g_vfs_done():md10[WRITE(offset=629243904, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=630161408, length=131072)]error g_vfs_done():md10[WRITE(offset=630292480, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=629768192, length=131072)]error g_vfs_done():md10[WRITE(offset=629899264, length=131072)]error g_vfs_done():md10[WRITE(offset=630489088, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=630030336, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=630620160, length=131072)]error = 6 = 6 6 g_vfs_done():md10[WRITE(offset=630751232, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=631603200, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=630915072, length=131072)]error g_vfs_done():md10[WRITE(offset=632029184, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=631177216, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=631898112, length=131072)]error g_vfs_done():md10[WRITE(offset=631046144, length=131072)]error g_vfs_done():md10[WRITE(offset=631734272, length=131072)]error g_vfs_done():md10[WRITE(offset=631472128, length=131072)]error g_vfs_done():md10[WRITE(offset=631308288, length=131072)]error g_vfs_done():md10[WRITE(offset=632193024, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=632324096, length=131072)]error g_vfs_done():md10[WRITE(offset=632586240, length=131072)]error g_vfs_done():md10[WRITE(offset=632750080, length=131072)]error g_vfs_done():md10[WRITE(offset=632455168, length=131072)]error = 6 = 6 = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=633569280, length=131072)]error g_vfs_done():md10[WRITE(offset=633438208, length=131072)]error g_vfs_done():md10[WRITE(offset=633700352, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=634191872, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=632881152, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=634060800, length=131072)]error g_vfs_done():md10[WRITE(offset=634617856, length=131072)]error g_vfs_done():md10[WRITE(offset=633143296, length=131072)]error g_vfs_done():md10[WRITE(offset=633012224, length=131072)]error g_vfs_done():md10[WRITE(offset=634322944, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=634486784, length=131072)]error g_vfs_done():md10[WRITE(offset=633864192, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=634748928, length=131072)]error g_vfs_done():md10[WRITE(offset=635305984, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=635011072, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=634880000, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=635142144, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=635600896, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=635863040, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=635469824, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=635731968, length=131072)]error g_vfs_done():md10[WRITE(offset=636256256, length=131072)]error g_vfs_done():md10[WRITE(offset=633339904, length=98304)]error =g_vfs_done():md10[WRITE(offset=636125184, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=635994112, length=131072)]error g_vfs_done():md10[WRITE(offset=636551168, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=636846080, length=131072)]error g_vfs_done():md10[WRITE(offset=636420096, length=131072)]error g_vfs_done():md10[WRITE(offset=636977152, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=637108224, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=636682240, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=637370368, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=637501440, length=131072)]error g_vfs_done():md10[WRITE(offset=637632512, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=637927424, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=638058496, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=637796352, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=637239296, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=638451712, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=638320640, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=638615552, length=131072)]error g_vfs_done():md10[WRITE(offset=638779392, length=131072)]error g_vfs_done():md10[WRITE(offset=638189568, length=131072)]error = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=638910464, length=131072)]error g_vfs_done():md10[WRITE(offset=639860736, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=639696896, length=131072)]error g_vfs_done():md10[WRITE(offset=639991808, length=131072)]error g_vfs_done():md10[WRITE(offset=639533056, length=98304)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=639270912, length=98304)]error =g_vfs_done():md10[WRITE(offset=639041536, length=98304)]error =g_vfs_done():md10[WRITE(offset=639139840, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=640155648, length=131072)]error = 6 = 6 = 6 6 g_vfs_done():md10[WRITE(offset=640843776, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=640286720, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=640679936, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=640417792, length=131072)]error g_vfs_done():md10[WRITE(offset=641499136, length=131072)]error g_vfs_done():md10[WRITE(offset=640974848, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=641368064, length=131072)]error g_vfs_done():md10[WRITE(offset=640548864, length=131072)]error g_vfs_done():md10[WRITE(offset=641105920, length=131072)]error g_vfs_done():md10[WRITE(offset=641236992, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=641630208, length=131072)]error = 6 = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=641957888, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=642220032, length=131072)]error g_vfs_done():md10[WRITE(offset=642613248, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=642088960, length=131072)]error g_vfs_done():md10[WRITE(offset=642744320, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=641794048, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=643235840, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=642940928, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=643366912, length=131072)]error g_vfs_done():md10[WRITE(offset=642449408, length=98304)]error =g_vfs_done():md10[WRITE(offset=639434752, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=642351104, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=643792896, length=131072)]error g_vfs_done():md10[WRITE(offset=643104768, length=131072)]error g_vfs_done():md10[WRITE(offset=643497984, length=131072)]error g_vfs_done():md10[WRITE(offset=643661824, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=643923968, length=131072)]error g_vfs_done():md10[WRITE(offset=644513792, length=131072)]error g_vfs_done():md10[WRITE(offset=644349952, length=131072)]error g_vfs_done():md10[WRITE(offset=644055040, length=131072)]error 6 = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=644644864, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=644808704, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=644186112, length=131072)]error g_vfs_done():md10[WRITE(offset=645267456, length=131072)]error g_vfs_done():md10[WRITE(offset=644939776, length=131072)]error g_vfs_done():md10[WRITE(offset=645627904, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=645890048, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=645758976, length=131072)]error g_vfs_done():md10[WRITE(offset=645398528, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=646283264, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=646610944, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=646742016, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=646873088, length=131072)]error g_vfs_done():md10[WRITE(offset=646021120, length=131072)]error g_vfs_done():md10[WRITE(offset=646152192, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=646447104, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=645529600, length=98304)]error == 6 = 6 g_vfs_done():md10[WRITE(offset=647004160, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=647135232, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=647397376, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=647528448, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=647987200, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=647659520, length=131072)]error g_vfs_done():md10[WRITE(offset=647266304, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=648249344, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=647823360, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=648380416, length=131072)]error g_vfs_done():md10[WRITE(offset=648642560, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=648904704, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=649035776, length=131072)]error g_vfs_done():md10[WRITE(offset=648118272, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=648511488, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=648773632, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=649625600, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=649920512, length=131072)]error g_vfs_done():md10[WRITE(offset=649330688, length=131072)]error g_vfs_done():md10[WRITE(offset=649461760, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=650051584, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=650575872, length=131072)]error g_vfs_done():md10[WRITE(offset=650444800, length=131072)]error g_vfs_done():md10[WRITE(offset=650313728, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=650838016, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=650969088, length=131072)]error g_vfs_done():md10[WRITE(offset=649166848, length=131072)]error g_vfs_done():md10[WRITE(offset=650706944, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=645070848, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=651264000, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=651132928, length=131072)]error g_vfs_done():md10[WRITE(offset=651395072, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=645169152, length=98304)]error == 6 = 6 6 g_vfs_done():md10[WRITE(offset=651657216, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=652083200, length=131072)]error g_vfs_done():md10[WRITE(offset=652247040, length=131072)]error g_vfs_done():md10[WRITE(offset=651952128, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=652476416, length=131072)]error g_vfs_done():md10[WRITE(offset=539885568, length=32768)]error == 6 = 6 g_vfs_done():md10[WRITE(offset=652738560, length=131072)]error g_vfs_done():md10[WRITE(offset=652607488, length=131072)]error g_vfs_done():md10[WRITE(offset=652869632, length=131072)]error g_vfs_done():md10[WRITE(offset=651558912, length=98304)]error =g_vfs_done():md10[WRITE(offset=653000704, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=653131776, length=131072)]error 6 = 6 6 g_vfs_done():md10[WRITE(offset=653459456, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=651821056, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=652378112, length=98304)]error =g_vfs_done():md10[WRITE(offset=653623296, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=653754368, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=653885440, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=653295616, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=654147584, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=654016512, length=131072)]error = 6 6 g_vfs_done():md10[WRITE(offset=654409728, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=654278656, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=655032320, length=131072)]error g_vfs_done():md10[WRITE(offset=654573568, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=654737408, length=131072)]error g_vfs_done():md10[WRITE(offset=654901248, length=131072)]error g_vfs_done():md10[WRITE(offset=655163392, length=131072)]error = 6 = 6 = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=655753216, length=131072)]error g_vfs_done():md10[WRITE(offset=655622144, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=656015360, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=655884288, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=655327232, length=131072)]error g_vfs_done():md10[WRITE(offset=656408576, length=131072)]error g_vfs_done():md10[WRITE(offset=656146432, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=656539648, length=131072)]error g_vfs_done():md10[WRITE(offset=656801792, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=657063936, length=131072)]error g_vfs_done():md10[WRITE(offset=656670720, length=131072)]error g_vfs_done():md10[WRITE(offset=656277504, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=656932864, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=657457152, length=131072)]error g_vfs_done():md10[WRITE(offset=657326080, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=657195008, length=131072)]error g_vfs_done():md10[WRITE(offset=657588224, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=655458304, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=657719296, length=131072)]error g_vfs_done():md10[WRITE(offset=658046976, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=657883136, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=658472960, length=131072)]error 6 = 6 g_vfs_done():md10[WRITE(offset=658210816, length=131072)]error g_vfs_done():md10[WRITE(offset=658341888, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=658604032, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=658735104, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=658866176, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=659128320, length=131072)]error g_vfs_done():md10[WRITE(offset=659259392, length=131072)]error g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error == 6 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=659521536, length=131072)]error g_vfs_done():md10[WRITE(offset=659685376, length=98304)]error =g_vfs_done():md10[WRITE(offset=659783680, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=538050560, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=659881984, length=98304)]error = 6 g_vfs_done():md10[WRITE(offset=546209792, length=32768)]error =g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error =g_vfs_done():md10[WRITE(offset=539918336, length=32768)]error = 6 6 6 6 6 g_vfs_done():md10[WRITE(offset=546537472, length=32768)]error =g_vfs_done():md10[WRITE(offset=539852800, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=539852800, length=32768)]error =g_vfs_done():md10[WRITE(offset=539951104, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=660373504, length=131072)]error g_vfs_done():md10[WRITE(offset=539951104, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=545685504, length=32768)]error =g_vfs_done():md10[WRITE(offset=549257216, length=32768)]error =g_vfs_done():md10[WRITE(offset=660111360, length=131072)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=546570240, length=32768)]error =g_vfs_done():md10[WRITE(offset=549617664, length=32768)]error = 6 = 6 6 g_vfs_done():md10[WRITE(offset=545587200, length=32768)]error =g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error =g_vfs_done():md10[WRITE(offset=660504576, length=131072)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=660635648, length=131072)]error 6 = 6 g_vfs_done():md10[WRITE(offset=549748736, length=32768)]error =g_vfs_done():md10[WRITE(offset=546603008, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=539885568, length=32768)]error =g_vfs_done():md10[WRITE(offset=549421056, length=32768)]error =g_vfs_done():md10[WRITE(offset=549519360, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=661159936, length=131072)]error g_vfs_done():md10[WRITE(offset=539983872, length=32768)]error =g_vfs_done():md10[WRITE(offset=660897792, length=131072)]error 6 6 g_vfs_done():md10[WRITE(offset=660766720, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=549584896, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=661422080, length=131072)]error g_vfs_done():md10[WRITE(offset=539983872, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=555974656, length=32768)]error == 6 6 6 g_vfs_done():md10[WRITE(offset=540016640, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=549847040, length=32768)]error == 6 g_vfs_done():md10[WRITE(offset=540016640, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540049408, length=32768)]error =g_vfs_done():md10[WRITE(offset=661028864, length=131072)]error g_vfs_done():md10[WRITE(offset=545947648, length=32768)]error =g_vfs_done():md10[WRITE(offset=556171264, length=32768)]error =g_vfs_done():md10[WRITE(offset=549552128, length=32768)]error =g_vfs_done():md10[WRITE(offset=661716992, length=131072)]error g_vfs_done():md10[WRITE(offset=661553152, length=131072)]error 6 6 g_vfs_done():md10[WRITE(offset=555876352, length=20480)]error = 6 6 = 6 6 = 6 g_vfs_done():md10[WRITE(offset=546308096, length=32768)]error =g_vfs_done():md10[WRITE(offset=540082176, length=32768)]error =g_vfs_done():md10[WRITE(offset=661880832, length=131072)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=556204032, length=20480)]error =g_vfs_done():md10[WRITE(offset=662011904, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=538050560, length=32768)]error =g_vfs_done():md10[WRITE(offset=662274048, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=549126144, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=540049408, length=32768)]error =g_vfs_done():md10[WRITE(offset=555909120, length=32768)]error =g_vfs_done():md10[WRITE(offset=540082176, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=662142976, length=131072)]error g_vfs_done():md10[WRITE(offset=662405120, length=131072)]error 6 6 = 6 6 = 6 g_vfs_done():md10[WRITE(offset=549289984, length=32768)]error == 6 g_vfs_done():md10[WRITE(offset=662536192, length=131072)]error g_vfs_done():md10[WRITE(offset=662667264, length=131072)]error 6 6 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=662798336, length=131072)]error g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error =g_vfs_done():md10[WRITE(offset=663060480, length=131072)]error g_vfs_done():md10[WRITE(offset=662929408, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=540114944, length=32768)]error == 6 6 g_vfs_done():md10[WRITE(offset=549683200, length=32768)]error == 6 6 6 g_vfs_done():md10[WRITE(offset=658997248, length=131072)]error g_vfs_done():md10[WRITE(offset=556072960, length=32768)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=556105728, length=20480)]error = 6 g_vfs_done():md10[WRITE(offset=546209792, length=4096)]error = g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error =6 g_vfs_done():md10[WRITE(offset=540147712, length=32768)]error =g_vfs_done():md10[WRITE(offset=540114944, length=32768)]error =g_vfs_done():md10[WRITE(offset=555941888, length=32768)]error =g_vfs_done():md10[WRITE(offset=663191552, length=131072)]error g_vfs_done():md10[WRITE(offset=663617536, length=131072)]error g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=660013056, length=98304)]error = 6 = 6 6 6 g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error =g_vfs_done():md10[WRITE(offset=663748608, length=131072)]error 6 6 g_vfs_done():md10[WRITE(offset=556040192, length=20480)]error =g_vfs_done():md10[WRITE(offset=663388160, length=98304)]error == 6 g_vfs_done():md10[WRITE(offset=540180480, length=32768)]error = 6 6 6 = 6 6 = 6 g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error =g_vfs_done():md10[WRITE(offset=540213248, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=664010752, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=664141824, length=98304)]error = 6 6 g_vfs_done():md10[WRITE(offset=664240128, length=131072)]error g_vfs_done():md10[WRITE(offset=659390464, length=131072)]error g_vfs_done():md10[WRITE(offset=664666112, length=131072)]error g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error =g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=540180480, length=32768)]error =g_vfs_done():md10[WRITE(offset=664535040, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=545685504, length=4096)]error = g_vfs_done():md10[WRITE(offset=664961024, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=664371200, length=98304)]error =g_vfs_done():md10[WRITE(offset=664797184, length=131072)]error = 6 g_vfs_done():md10[WRITE(offset=665092096, length=131072)]error 6 6 6 g_vfs_done():md10[WRITE(offset=665354240, length=131072)]error 6 g_vfs_done():md10[WRITE(offset=665485312, length=131072)]error g_vfs_done():md10[WRITE(offset=665223168, length=131072)]error = 6 = 6 6 g_vfs_done():md10[WRITE(offset=665649152, length=131072)]error = 6 = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[READ(offset=546209792, length=4096)]error = 6= 6 g_vfs_done():md10[WRITE(offset=540246016, length=32768)]error =g_vfs_done():md10[WRITE(offset=538017792, length=32768)]error = 6 = 6 = 6 6 = 6 g_vfs_done():md10[WRITE(offset=666009600, length=131072)]error g_vfs_done():md10[WRITE(offset=666533888, length=131072)]error g_vfs_done():md10[WRITE(offset=665845760, length=98304)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=663879680, length=131072)]error = 6 = 6 = 6 g_vfs_done():md10[WRITE(offset=661291008, length=131072)]error = 6 = 6 20190911 11:04:06 all (3/3): force3.sh 20190911 11:05:15 all (1/3): force.sh Sep 11 11:05:29 mercat1 kernel: pid 59027 (rw), uid 2007 inumber 51280 on /mnt: filesystem full Sep 11 11:05:41 mercat1 kernel: pid 59064 (creat), uid 2007 inumber 32931 on /mnt: filesystem full 20190911 11:08:16 all (2/3): force2.sh g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error =g_vfs_done():md10[WRITE(offset=268599296, length=16384)]error = 6 6 g_vfs_done():md10[WRITE(offset=537526272, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=269058048, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=280985600, length=32768)]error =g_vfs_done():md10[WRITE(offset=270860288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=278364160, length=32768)]error =g_vfs_done():md10[WRITE(offset=281116672, length=20480)]error = 6 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=278855680, length=20480)]error = 6 g_vfs_done():md10[WRITE(offset=270893056, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270860288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=277282816, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=268599296, length=16384)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=270860288, length=32768)]error = 6 20190911 11:12:00 all (3/3): force3.sh g_vfs_done():md10[WRITE(offset=794492928, length=32768)]error =g_vfs_done():md10[WRITE(offset=270958592, length=32768)]error =g_vfs_done():md10[WRITE(offset=686391296, length=32768)]error =g_vfs_done():md10[WRITE(offset=587595776, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=587563008, length=32768)]error =g_vfs_done():md10[WRITE(offset=8585216, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=667353088, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=65536, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=635437056, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=714178560, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=9455616, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=794525696, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=270958592, length=32768)]error =g_vfs_done():md10[WRITE(offset=540934144, length=32768)]error =g_vfs_done():md10[WRITE(offset=276856832, length=32768)]error =g_vfs_done():md10[WRITE(offset=538804224, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537427968, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=310935552, length=28672)]error =g_vfs_done():md10[WRITE(offset=539688960, length=32768)]error =g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error = 6 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=9456128, length=512)]error = 6 6 g_vfs_done():md10[WRITE(offset=271056896, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=274595840, length=32768)]error = 6 6 6 6 g_vfs_done():md10[WRITE(offset=277348352, length=16384)]error =g_vfs_done():md10[WRITE(offset=537460736, length=32768)]error =g_vfs_done():md10[WRITE(offset=540999680, length=32768)]error =g_vfs_done():md10[WRITE(offset=540934144, length=32768)]error =g_vfs_done():md10[WRITE(offset=711753728, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=9456640, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537100288, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=269582336, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=278888448, length=20480)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=276856832, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537362432, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=277970944, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=537493504, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error = 6 6 20190911 11:12:32 all (1/3): force.sh g_vfs_done():md10[WRITE(offset=271286272, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=10955264, length=1024)]error = 6g_vfs_done():md10[WRITE(offset=10954752, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=908230656, length=131072)]error = 6 20190911 11:15:34 all (2/3): force2.sh 20190911 11:18:45 all (3/3): force3.sh g_vfs_done():md10[WRITE(offset=272072704, length=32768)]error =g_vfs_done():md10[WRITE(offset=568459264, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=539328512, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=537067520, length=16384)]error = 6 g_vfs_done():md10[WRITE(offset=539394048, length=32768)]error = 6 20190911 11:19:40 all (1/3): force.sh g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=541851648, length=32768)]error =g_vfs_done():md10[WRITE(offset=277110784, length=4096)]error = g_vfs_done():md10[WRITE(offset=542834688, length=32768)]error = 6 6 g_vfs_done():md10[WRITE(offset=277114880, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=277106688, length=4096)]error = 6 6 g_vfs_done():md10[WRITE(offset=277131264, length=4096)]error = g_vfs_done():md10[WRITE(offset=277151744, length=4096)]error = g_vfs_done():md10[WRITE(offset=545525760, length=4096)]error = g_vfs_done():md10[WRITE(offset=268599296, length=16384)]error =6 6 6 g_vfs_done():md10[WRITE(offset=542900224, length=32768)]error =6 g_vfs_done():md10[WRITE(offset=271450112, length=32768)]error =g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=273547264, length=32768)]error =g_vfs_done():md10[WRITE(offset=12621312, length=512)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=268599296, length=16384)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=268926976, length=32768)]error = 6 g_vfs_done():md10[WRITE(offset=277151744, length=4096)]error = g_vfs_done():md10[WRITE(offset=541458432, length=32768)]error =g_vfs_done():md10[WRITE(offset=8585216, length=4096)]error = 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =g_vfs_done():md10[WRITE(offset=12621824, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=278032384, length=4096)]error = g_vfs_done():md10[WRITE(offset=545525760, length=4096)]error = g_vfs_done():md10[WRITE(offset=269025280, length=32768)]error =g_vfs_done():md10[WRITE(offset=279281664, length=28672)]error = 6 g_vfs_done():md10[WRITE(offset=65536, length=4096)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=542474240, length=32768)]error =g_vfs_done():md10[WRITE(offset=273547264, length=32768)]error = 6 6 6 g_vfs_done():md10[WRITE(offset=268632064, length=32768)]error =6 6 g_vfs_done():md10[WRITE(offset=12622336, length=512)]error = 6 g_vfs_done():md10[WRITE(offset=537296896, length=32768)]error = 6 6 6 interrupt total irq3: uart1 588 irq4: uart0 5 irq9: acpi0 4 irq18: ehci0 ehci1 19437 irq19: xhci0 12162 cpu0:timer 4571705 cpu1:timer 5257467 cpu2:timer 4638462 cpu3:timer 4651762 cpu4:timer 4712029 cpu5:timer 5610726 cpu6:timer 4697554 cpu7:timer 7371323 cpu8:timer 4654007 cpu9:timer 4693029 cpu10:timer 4709784 cpu11:timer 4845194 irq56: ahci0 1588490 irq57: igb0:rxq0 22961 irq58: igb0:rxq1 307 irq59: igb0:rxq2 398 irq60: igb0:rxq3 3845 irq61: igb0:rxq4 213 irq62: igb0:rxq5 1264 irq63: igb0:aq 2 Total 62062719 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1db/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 0 tid 100017 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 0 tid 100017 td 0xfffff80003790000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0xb9c380 curthread = 0xfffff8000379e000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe00adb66b80 fpcurthread = none idlethread = 0xfffff8000379e000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff820082a0 commontssp = 0xffffffff820082a0 rsp0 = 0xfffffe00adb66b80 gs32p = 0xffffffff8200eae8 ldt = 0xffffffff8200eb28 tss = 0xffffffff8200eb18 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc3eb380 curthread = 0xfffff8000379f5a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe00adb6bb80 fpcurthread = none idlethread = 0xfffff8000379f5a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008308 commontssp = 0xffffffff82008308 rsp0 = 0xfffffe00adb6bb80 gs32p = 0xffffffff8200eb50 ldt = 0xffffffff8200eb90 tss = 0xffffffff8200eb80 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc3f7380 curthread = 0xfffff8000379f000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe00adb70b80 fpcurthread = none idlethread = 0xfffff8000379f000: tid 100005 "idle: cpu2" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008370 commontssp = 0xffffffff82008370 rsp0 = 0xfffffe00adb70b80 gs32p = 0xffffffff8200ebb8 ldt = 0xffffffff8200ebf8 tss = 0xffffffff8200ebe8 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc403380 curthread = 0xfffff800037a05a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe00adb75b80 fpcurthread = none idlethread = 0xfffff800037a05a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff820083d8 commontssp = 0xffffffff820083d8 rsp0 = 0xfffffe00adb75b80 gs32p = 0xffffffff8200ec20 ldt = 0xffffffff8200ec60 tss = 0xffffffff8200ec50 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc40f380 curthread = 0xfffff800037a0000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe00adb7ab80 fpcurthread = none idlethread = 0xfffff800037a0000: tid 100007 "idle: cpu4" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008440 commontssp = 0xffffffff82008440 rsp0 = 0xfffffe00adb7ab80 gs32p = 0xffffffff8200ec88 ldt = 0xffffffff8200ecc8 tss = 0xffffffff8200ecb8 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc41b380 curthread = 0xfffff80003790000: pid 0 tid 100017 "thread taskq" curpcb = 0xfffffe00adbb8b80 fpcurthread = none idlethread = 0xfffff800037a15a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff820084a8 commontssp = 0xffffffff820084a8 rsp0 = 0xfffffe00adbb8b80 gs32p = 0xffffffff8200ecf0 ldt = 0xffffffff8200ed30 tss = 0xffffffff8200ed20 tlb gen = 37943728 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc427380 curthread = 0xfffff800037a1000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe00adb84b80 fpcurthread = none idlethread = 0xfffff800037a1000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008510 commontssp = 0xffffffff82008510 rsp0 = 0xfffffe00adb84b80 gs32p = 0xffffffff8200ed58 ldt = 0xffffffff8200ed98 tss = 0xffffffff8200ed88 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc433380 curthread = 0xfffff8000378d5a0: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe00adb89b80 fpcurthread = none idlethread = 0xfffff8000378d5a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008578 commontssp = 0xffffffff82008578 rsp0 = 0xfffffe00adb89b80 gs32p = 0xffffffff8200edc0 ldt = 0xffffffff8200ee00 tss = 0xffffffff8200edf0 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc43f380 curthread = 0xfffff8000378d000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe00adb8eb80 fpcurthread = none idlethread = 0xfffff8000378d000: tid 100011 "idle: cpu8" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff820085e0 commontssp = 0xffffffff820085e0 rsp0 = 0xfffffe00adb8eb80 gs32p = 0xffffffff8200ee28 ldt = 0xffffffff8200ee68 tss = 0xffffffff8200ee58 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc44b380 curthread = 0xfffff80003d87000: pid 20 tid 100092 "doneq1" curpcb = 0xfffffe003e227b80 fpcurthread = none idlethread = 0xfffff8000378e5a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008648 commontssp = 0xffffffff82008648 rsp0 = 0xfffffe003e227b80 gs32p = 0xffffffff8200ee90 ldt = 0xffffffff8200eed0 tss = 0xffffffff8200eec0 tlb gen = 37943726 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc457380 curthread = 0xfffff8000378e000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe00adb98b80 fpcurthread = none idlethread = 0xfffff8000378e000: tid 100013 "idle: cpu10" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff820086b0 commontssp = 0xffffffff820086b0 rsp0 = 0xfffffe00adb98b80 gs32p = 0xffffffff8200eef8 ldt = 0xffffffff8200ef38 tss = 0xffffffff8200ef28 tlb gen = 37943729 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc463380 curthread = 0xfffff8000378f5a0: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe00adb9db80 fpcurthread = none idlethread = 0xfffff8000378f5a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff81fbae30 tssp = 0xffffffff82008718 commontssp = 0xffffffff82008718 rsp0 = 0xfffffe00adb9db80 gs32p = 0xffffffff8200ef60 ldt = 0xffffffff8200efa0 tss = 0xffffffff8200ef90 tlb gen = 37943729 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 33776 (ls) thread 0xfffff80007403000 (100157) shared lockmgr ufs (ufs) r = 0 (0xfffff80004138558) locked @ kern/vfs_lookup.c:713 Process 2038 (syslogd) thread 0xfffff80007a6a000 (100191) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8002b7af2e0) locked @ kern/vfs_syscalls.c:3424 Process 0 (kernel) thread 0xfffff80003790000 (100017) exclusive sleep mutex struct mount mtx (struct mount mtx) r = 0 (0xfffff80333dd7000) locked @ kern/vfs_subr.c:5569 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80007dd5cc0) locked @ kern/vfs_mount.c:1354 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff800041384f0: tag ufs, type VDIR usecount 134, writecount 0, refcount 4 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff80003da8400 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80ba974b at lockmgr_slock_hard+0x36b #1 0xffffffff80baa5e8 at __lockmgr_args+0x788 #2 0xffffffff80f0fe8f at _lockmgr_args+0x8f #3 0xffffffff80f0e045 at ffs_lock+0x115 #4 0xffffffff8125e230 at VOP_LOCK1_APV+0x70 #5 0xffffffff80cc576b at VOP_LOCK1+0x4b #6 0xffffffff80cc34e1 at _vn_lock+0xd1 #7 0xffffffff80ca3cb1 at lookup+0xe1 #8 0xffffffff80ca3662 at namei+0x502 #9 0xffffffff80cbcf04 at kern_readlinkat+0x74 #10 0xffffffff80cbce86 at sys_readlink+0x26 #11 0xffffffff811c0894 at amd64_syscall+0x2d4 #12 0xffffffff81197be0 at fast_syscall_common+0x101 nlink=28, effnlink=28, size=2048, extsize 0 generation=56909bb9, uid=0, gid=0, flags=0x0 ino 2, on dev gpt/work vnode 0xfffff8002b7af278: tag ufs, type VREG usecount 1, writecount 1, refcount 5 flags (VI_ACTIVE) v_object 0xfffff80007341b00 ref 0 pages 21 cleanbuf 2 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80007a6a000 (pid 2038, syslogd, tid 100191) #0 0xffffffff80ba9c72 at lockmgr_xlock_hard+0x432 #1 0xffffffff80baa465 at __lockmgr_args+0x605 #2 0xffffffff80f0fe8f at _lockmgr_args+0x8f #3 0xffffffff80f0e045 at ffs_lock+0x115 #4 0xffffffff8125e230 at VOP_LOCK1_APV+0x70 #5 0xffffffff80cc576b at VOP_LOCK1+0x4b #6 0xffffffff80cc34e1 at _vn_lock+0xd1 #7 0xffffffff80cbea53 at kern_fsync+0x113 #8 0xffffffff811c0894 at amd64_syscall+0x2d4 #9 0xffffffff81197be0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=345024, extsize 0 generation=dc2abfd0, uid=0, gid=0, flags=0x0 ino 9951884, on dev gpt/work vnode 0xfffff80007dd5c58: tag ufs, type VDIR usecount 2, writecount 0, refcount 1 mountedhere 0xfffff80333dd7000 flags (VI_ACTIVE) v_object 0xfffff80007ef4100 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80003790000 (pid 0, kernel, tid 100017) with shared waiters pending #0 0xffffffff80ba9c72 at lockmgr_xlock_hard+0x432 #1 0xffffffff80baa465 at __lockmgr_args+0x605 #2 0xffffffff80f0fe8f at _lockmgr_args+0x8f #3 0xffffffff80f0e045 at ffs_lock+0x115 #4 0xffffffff8125e230 at VOP_LOCK1_APV+0x70 #5 0xffffffff80cc576b at VOP_LOCK1+0x4b #6 0xffffffff80cc34e1 at _vn_lock+0xd1 #7 0xffffffff80ca825c at dounmount+0x6c #8 0xffffffff80f06e89 at ffs_fsfail_unmount+0x59 #9 0xffffffff80c35bac at taskqueue_run_locked+0x10c #10 0xffffffff80c36b28 at taskqueue_thread_loop+0x88 #11 0xffffffff80b94654 at fork_exit+0x84 #12 0xffffffff811982fe at fork_trampoline+0xe nlink=2, effnlink=2, size=512, extsize 0 generation=74d5cf41, uid=0, gid=0, flags=0x0 ino 37078272, on dev gpt/work db:1:pho1> show mount 0xfffff8000413a000 /dev/gpt/work on / (ufs) 0xfffff80004139000 devfs on /dev (devfs) 0xfffff802584b1000 /dev/gpt/tmp on /tmp (ufs) 0xfffff80333dd7000 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 91478 Buf domain 0 freebufs 14236 lofreebufs 219 hifreebufs 329 bufspace 7151616 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 811 (5783552) dirtyq count 3 (98304) wakeup 0 lim 25 CPU 3, 6, 9, 0, 9, 0, 0, 3, 4, 19, 19, 10, Locked buffers: 1 space 32768 Total buffers: 52059 space 7151616 Buf domain 1 freebufs 14259 lofreebufs 219 hifreebufs 329 bufspace 6275072 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 732 (5046272) dirtyq count 0 (0) wakeup 0 lim 25 CPU 24, 16, 17, 10, 18, 4, 4, 10, 7, 22, 3, 7, Locked buffers: 0 space 0 Total buffers: 5549 space 6275072 Buf domain 2 freebufs 14252 lofreebufs 219 hifreebufs 329 bufspace 6164480 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 723 (5066752) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 1, 5, 14, 9, 13, 24, 1, 5, 23, 17, 23, 22, Locked buffers: 0 space 0 Total buffers: 7744 space 6164480 Buf domain 3 freebufs 14331 lofreebufs 219 hifreebufs 329 bufspace 4251648 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 674 (3375104) dirtyq count 2 (12288) wakeup 0 lim 25 CPU 6, 2, 13, 8, 17, 20, 6, 6, 22, 1, 23, 2, Locked buffers: 0 space 0 Total buffers: 18344 space 4251648 Buf domain 4 freebufs 10849 lofreebufs 219 hifreebufs 329 bufspace 118190080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4114 (115716096) dirtyq count 1 (20480) wakeup 0 lim 25 CPU 13, 17, 14, 24, 20, 1, 15, 19, 24, 17, 1, 4, Locked buffers: 0 space 0 Total buffers: 13232 space 118190080 Buf domain 5 freebufs 14311 lofreebufs 219 hifreebufs 329 bufspace 4841472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 716 (4239360) dirtyq count 0 (0) wakeup 0 lim 25 CPU 6, 0, 18, 10, 16, 21, 0, 5, 17, 0, 4, 9, Locked buffers: 0 space 0 Total buffers: 3159 space 4841472 Buf domain 6 freebufs 13848 lofreebufs 219 hifreebufs 329 bufspace 20549632 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1129 (18505728) dirtyq count 0 (0) wakeup 0 lim 25 CPU 11, 10, 18, 12, 2, 21, 10, 6, 24, 21, 0, 20, Locked buffers: 1 space 32768 Total buffers: 5844 space 20549632 db:1:pho1> show page vm_cnt.v_free_count: 7875646 vm_cnt.v_inactive_count: 760 vm_cnt.v_active_count: 1417 vm_cnt.v_laundry_count: 2558 vm_cnt.v_wire_count: 234794 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51256 vm_cnt.v_free_target: 173098 vm_cnt.v_inactive_target: 259647 db:1:pho1> show pageq pq_free 7875646 dom 0 page_cnt 8123034 free 7875646 pq_act 1417 pq_inact 760 pq_laund 2558 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000870 | 000000 11 (008192K) | 000678 | 000004 10 (004096K) | 000915 | 000000 09 (002048K) | 001300 | 000001 08 (001024K) | 001438 | 000001 07 (000512K) | 002056 | 000005 06 (000256K) | 002973 | 000028 05 (000128K) | 003997 | 000083 04 (000064K) | 006883 | 000173 03 (000032K) | 010522 | 000352 02 (000016K) | 017261 | 000805 01 (000008K) | 023209 | 001825 00 (000004K) | 009810 | 000130 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket XFree FFS2 dinode 256 139728 5172 8614142 0 61 0 FFS1 dinode 128 0 0 0 0 125 0 FFS inode 160 139728 5184 8615073 0 61 0 swblk 136 1944 136038 749159 0 69 0 swpctrie 144 245 12256 68281 0 61 0 selfd 64 107 2063 125249 0 253 0 rtentry 208 12 121 15 0 61 0 IPsec SA lft_c 16 0 0 0 0 253 0 ripcb 488 1 7 3 0 29 0 udplite_inpcb 488 0 0 0 0 29 0 sctp_asconf_ack 48 0 0 0 0 253 0 sctp_asconf 40 0 0 0 0 253 0 sctp_stream_msg_out 112 0 0 0 0 125 0 sctp_readq 152 0 0 0 0 61 0 sctp_chunk 152 0 0 0 0 61 0 sctp_raddr 736 0 0 0 0 13 0 sctp_laddr 48 0 0 4 0 253 0 sctp_asoc 2408 0 0 0 0 3 0 sctp_ep 1280 0 0 0 0 9 0 tcp_log_node 120 0 0 0 0 125 0 tcp_log_bucket 144 0 0 0 0 61 0 tcp_log 408 0 0 0 0 29 0 tcpreass 48 0 0 0 0 253 0 tfo_ccache_entries 80 0 0 0 0 125 0 tfo 4 0 0 0 0 253 0 sackhole 32 0 0 0 0 253 0 hostcache 96 0 0 0 0 125 0 syncache 168 0 69 2 0 61 0 tcptw 88 0 0 0 0 125 0 tcpcb 976 10 14 15 0 13 0 tcp_inpcb 488 10 30 15 0 29 0 udpcb 32 20 2584 878 0 253 0 udp_inpcb 488 20 324 878 0 29 0 ipq 56 0 0 0 0 253 0 unpcb 256 20 550 5102 0 61 0 socket 904 53 2983 6039 0 13 0 KNOTE 160 0 0 0 0 61 0 itimer 352 0 0 0 0 29 0 ksiginfo 112 372 1973 13384 0 125 0 AIOLIO 280 0 0 0 0 29 0 AIOCB 752 0 0 0 0 13 0 AIOP 32 0 0 0 0 253 0 AIO 208 0 0 0 0 61 0 Mountpoints 2896 4 12 57 0 3 0 procdesc 136 1 28 10 0 61 0 pipe 760 8 277 412931 0 13 0 DIRHASH 1024 485 255 344534 0 13 0 NCLNODE 744 0 0 0 0 13 0 LTS VFS Cache 368 0 0 0 0 29 0 L VFS Cache 328 308 28 308 0 29 0 STS VFS Cache 148 0 0 0 0 61 0 S VFS Cache 108 83437 20478 8776998 0 125 0 rentr 24 0 0 55 0 253 0 NAMEI 1024 14 170 2256906251 0 13 0 BUF TRIE 144 524 105424 3362608 0 61 0 VNODEPOLL 120 0 0 0 0 125 0 VNODE 632 139894 4694 8615348 0 13 0 vtnet_tx_hdr 24 0 0 0 0 253 0 crypto_session 24 0 0 0 0 253 0 cryptodesc 120 0 0 0 0 125 0 cryptop 128 0 0 0 0 125 0 nvme_request 128 0 0 0 0 125 0 g_bio 408 1 539 10801613 0 29 0 FPU_save_area 832 0 0 0 0 13 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 ttyoutq 256 181 119 290 0 61 0 ttyinq 160 345 159 555 0 61 0 epoch_record pcpu 256 4 12 4 0 61 0 mbuf_extpgs 256 0 0 0 0 61 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 mbuf_jumbo_page 4096 0 2 4 0 1 0 mbuf_cluster 2048 8291 41 45285 0 5 0 mbuf 256 5581 2661 44514 0 253 0 mbuf_packet 256 33 2780 4673 0 253 0 audit_record 1280 0 0 0 0 9 0 domainset 40 0 0 0 0 253 0 cpuset 104 27 438 27 0 125 0 THREAD 1440 484 64 574 0 9 0 PROC 1328 137 229 5134031 0 9 0 MAC labels 40 0 0 0 0 253 0 pbuf 984 0 886 0 0 1 0 vnpbuf 984 0 0 0 0 13 0 clpbuf 984 0 20 552766 149903 5 0 mdpbuf 984 0 0 116930 0 1 0 nfspbuf 984 0 0 0 0 5 0 swwbuf 984 0 22 420957 0 1 0 swrbuf 984 0 83 181253 0 5 0 umtx_shm 88 0 0 0 0 125 0 umtx pi 96 0 0 0 0 125 0 rl_entry 40 353 1726 353 0 253 0 TURNSTILE 136 549 311 549 0 61 0 rangeset pctrie nodes 144 0 0 0 0 61 0 filedesc0 1104 130 191 5134032 0 9 0 Files 80 150 2643 712417929 0 125 0 SLEEPQUEUE 88 549 412 549 0 125 0 65536 65536 3 0 3 0 1 0 65536 65536 1 10 162 0 1 0 65536 65536 0 9 121 0 1 0 65536 65536 3 4 651 0 1 0 65536 65536 4 0 2159 0 1 0 65536 65536 0 0 0 0 1 0 65536 65536 0 0 0 0 1 0 65536 65536 2 0 2 0 1 0 32768 32768 13 0 22 0 1 0 32768 32768 21 34 985 0 2 0 32768 32768 1 0 259 0 1 0 32768 32768 0 0 0 0 1 0 32768 32768 1 0 2491 0 1 0 32768 32768 0 0 0 0 1 0 32768 32768 1 0 1 0 1 0 32768 32768 2 1 3 0 1 0 16384 16384 2 0 14 0 1 0 16384 16384 4 0 4 0 1 0 16384 16384 3 2 387 0 1 0 16384 16384 1 0 1 0 1 0 16384 16384 55 0 2887 0 1 0 16384 16384 0 0 0 0 1 0 16384 16384 1 0 1 0 1 0 16384 16384 1 0 2 0 1 0 8192 8192 19 0 869 0 1 0 8192 8192 92 0 92 0 1 0 8192 8192 9 0 64 0 1 0 8192 8192 0 0 0 0 1 0 8192 8192 12 0 1672 0 1 0 8192 8192 2 0 2 0 1 0 8192 8192 0 0 0 0 1 0 8192 8192 1 0 2 0 1 0 4096 4096 2 0 255 0 1 0 4096 4096 47 0 51 0 1 0 4096 4096 2 3 792 0 1 0 4096 4096 16 0 27 0 1 0 4096 4096 147 28 5226093 0 1 0 4096 4096 363 0 2706 0 1 0 4096 4096 3 12 1743495 0 1 0 4096 4096 1 0 13 0 1 0 2048 2048 1 1 255 0 5 0 2048 2048 117 13 137 0 5 0 2048 2048 1 1 122 0 5 0 2048 2048 2 2 5 0 5 0 2048 2048 5 5 503 0 5 0 2048 2048 4 80 1590864 0 5 0 2048 2048 2 2 2 0 5 0 2048 2048 3 3 5 0 5 0 1024 1024 2 6 673 0 13 0 1024 1024 217 143 228158 0 13 0 1024 1024 7 157 15380691 0 13 0 1024 1024 1 15 375 0 13 0 1024 1024 30 46 3409 0 13 0 1024 1024 11 9 11 0 13 0 1024 1024 19 13 19 0 13 0 1024 1024 6 6 5655 0 13 0 512 512 24 32 3228 0 29 0 512 512 139 29 300 0 29 0 512 512 123 9222 14473493 0 29 0 512 512 1 6 15 0 29 0 512 512 385 49 6587 0 29 0 512 512 65 68 65 0 29 0 512 512 21 28 21 0 29 0 512 512 18 234 420 0 29 0 256 256 33 1947 4263471 0 61 0 256 256 429 1131 31549731 0 61 0 256 256 392 748 14427919 0 61 0 256 256 100 740 7346 0 61 0 256 256 406 1199 1033327 0 61 0 256 256 12 633 1156817 0 61 0 256 256 42 498 1763 0 61 0 256 256 33 702 1258619 0 61 0 128 128 88 1524 201938896 0 125 0 128 128 479 1257 707771 0 125 0 128 128 107 2807 5373875 0 125 0 128 128 3938 7935 7193184 0 125 0 128 128 345 1143 3243385 0 125 0 128 128 165 28789 34117662 0 125 0 128 128 355 761 1336562 0 125 0 128 128 14280 73 882511 0 125 0 64 64 66 2290 113381589 0 253 0 64 64 8879 3087 169147920 0 253 0 64 64 385 3087 10561289 0 253 0 64 64 515 663 520 0 253 0 64 64 628 735 1359 0 253 0 64 64 40 2812 1105473 0 253 0 64 64 51 3297 4248534 0 253 0 64 64 9296 57292 10804363 0 253 0 32 32 5 367 1517 0 253 0 32 32 459 1277 1009 0 253 0 32 32 87 657 18997 0 253 0 32 32 3273 2555 3795 0 253 0 32 32 128 2848 17263 0 253 0 32 32 16 2092 110 0 253 0 32 32 217 3131 3537612 0 253 0 32 32 1086 3130 28160 0 253 0 16 16 43 1700 1314 0 253 0 16 16 196 3041 6624 0 253 0 16 16 147 2592 30906 0 253 0 16 16 2807 2422 2963 0 253 0 16 16 307 2930 21008 0 253 0 16 16 27 1965 28 0 253 0 16 16 10 1484 680585 0 253 0 16 16 468 1524 848692 0 253 0 mt_zone 24 429 401 429 0 253 0 mt_stats_zone 64 429 83 429 0 253 0 64 pcpu 8 3017 1847 3207 0 253 0 fakepg 104 0 1254 640 0 125 0 VMSPACE 2552 96 639 5133946 0 3 0 MAP ENTRY 112 3472 5768 306248401 0 132 0 KMAP ENTRY 112 7 165 7 0 125 0 MAP 232 2 65 2 0 61 0 RADIX NODE 144 9975 524694 125868933 0 253 0 VM OBJECT 256 7970 104410 88443771 0 61 0 vmem btag 56 17963 2608 38078 0 253 0 vmem 1856 0 1 0 0 5 0 256 Bucket 2048 743 3434 1195645 0 253 0 128 Bucket 1024 665 667 508760 0 34 0 64 Bucket 512 399 1575 506743 0 39 0 32 Bucket 256 364 1690 620188 0 61 0 16 Bucket 128 254 1636 395579 0 125 0 12 Bucket 96 93 1711 245316 0 125 0 8 Bucket 64 81 2894 247495 0 253 0 6 Bucket 48 60 3509 531469 0 253 0 4 Bucket 32 141 2959 1982700 0 253 0 UMA Hash 256 1 10 7 0 0 0 UMA Slabs 112 8515 14 102209 0 0 0 UMA Zones 1968 83 1 83 0 0 0 UMA Kegs 216 75 4 75 0 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket kstack_cache 16384 357 12 447 1 vm pgcache 104 91150 4114 167674298 253 vm pgcache 104 25636 3903 392441011 253 buf free cache 984 39831 4608 12913490 20 buffer arena-65 65536 0 0 6850229 1 buffer arena-61 61440 0 0 6850229 1 buffer arena-57 57344 0 0 6850229 1 buffer arena-53 53248 0 0 6850229 1 buffer arena-49 49152 0 0 6850229 1 buffer arena-45 45056 0 0 6850229 1 buffer arena-40 40960 0 0 6850229 1 buffer arena-36 36864 0 0 6850229 1 buffer arena-32 32768 14895 54 10250625 6 buffer arena-28 28672 0 0 6850229 1 buffer arena-24 24576 0 0 6850229 1 buffer arena-20 20480 0 0 6850229 1 buffer arena-16 16384 133 27 6866189 2 buffer arena-12 12288 0 0 6850229 1 buffer arena-81 8192 0 0 6850229 1 buffer arena-40 4096 0 0 6850229 1 db:0:pho> acttrace Tracing command cam pid 20 tid 100092 td 0xfffff80003d87000 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfd3e10 trap() at trap+0x46/frame 0xfffffe003dfd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfd3f20 --- trap 0x13, rip = 0xffffffff8118abd8, rsp = 0xfffffe003e2275e0, rbp = 0xfffffe003e227640 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x318/frame 0xfffffe003e227640 pmap_invalidate_range() at pmap_invalidate_range+0x1bc/frame 0xfffffe003e2276c0 allocbuf() at allocbuf+0x108/frame 0xfffffe003e227720 brelse() at brelse+0x1b9/frame 0xfffffe003e227780 bufdone() at bufdone+0x46f/frame 0xfffffe003e227800 ffs_backgroundwritedone() at ffs_backgroundwritedone+0xdb/frame 0xfffffe003e227830 bufdone() at bufdone+0x70/frame 0xfffffe003e2278b0 g_io_deliver() at g_io_deliver+0x298/frame 0xfffffe003e227900 g_io_deliver() at g_io_deliver+0x298/frame 0xfffffe003e227950 g_io_deliver() at g_io_deliver+0x298/frame 0xfffffe003e2279a0 g_disk_done() at g_disk_done+0x106/frame 0xfffffe003e2279e0 xpt_done_process() at xpt_done_process+0x388/frame 0xfffffe003e227a20 xpt_done_td() at xpt_done_td+0xf6/frame 0xfffffe003e227a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e227ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e227ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000379e000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81fa0810 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81fa0830 trap() at trap+0x46/frame 0xffffffff81fa0940 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fa0940 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb66910, rbp = 0xfffffe00adb66910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb66910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb66960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb66980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb669a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb66a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb66ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000379f5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df73e10 trap() at trap+0x46/frame 0xfffffe003df73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df73f20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb6b910, rbp = 0xfffffe00adb6b910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb6b910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb6b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb6b980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb6b9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb6ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb6bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb6bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000379f000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df7fe10 trap() at trap+0x46/frame 0xfffffe003df7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df7ff20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb70910, rbp = 0xfffffe00adb70910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb70910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb70960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb70980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb709a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb70a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb70ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb70ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037a05a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df8be10 trap() at trap+0x46/frame 0xfffffe003df8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df8bf20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb75910, rbp = 0xfffffe00adb75910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb75910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb75960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb75980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb759a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb75a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb75ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb75ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037a0000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df97e10 trap() at trap+0x46/frame 0xfffffe003df97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df97f20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb7a910, rbp = 0xfffffe00adb7a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb7a910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb7a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb7a980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb7a9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb7aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb7aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb7aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037a1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfafe10 trap() at trap+0x46/frame 0xfffffe003dfaff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfaff20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb84910, rbp = 0xfffffe00adb84910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb84910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb84960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb84980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb849a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb84a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb84ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000378d5a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfbbe10 trap() at trap+0x46/frame 0xfffffe003dfbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfbbf20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb89910, rbp = 0xfffffe00adb89910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb89910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb89960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb89980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb899a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb89ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000378d000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfc7e10 trap() at trap+0x46/frame 0xfffffe003dfc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfc7f20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb8e910, rbp = 0xfffffe00adb8e910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb8e910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb8e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb8e980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb8e9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb8eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000378e000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfdfe10 trap() at trap+0x46/frame 0xfffffe003dfdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfdff20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb98910, rbp = 0xfffffe00adb98910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb98910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb98960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb98980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb989a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb98a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb98ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000378f5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfebe10 trap() at trap+0x46/frame 0xfffffe003dfebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfebf20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb9d910, rbp = 0xfffffe00adb9d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb9d910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb9d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb9d980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb9d9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb9da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb9dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb9dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003790000 (CPU 5) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 38093 2478 2424 0 S nanslp 0xffffffff81e91be8 sleep 16488 15390 16488 2006 S+ select 0xfffff801973be140 top 15390 15389 15390 2006 Ss+ wait 0xfffff802589fca60 bash 15389 15386 15386 2006 S select 0xfffff8032bf89e40 sshd 15386 2268 15386 0 Ss select 0xfffff8070bf136c0 sshd 33776 33775 2127 0 D ufs 0xfffff80007dd5cc0 ls 33775 2127 2127 0 S wait 0xfffff80004569530 sh 32750 30769 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 32724 30776 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 32721 30760 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 30780 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30779 30758 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 30777 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30776 30758 30719 2007 S+ lockf 0xfffff8025854db00 lockf 30775 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30773 30761 30719 2007 D+ vfs_bus 0xfffff80333dd7000 mkdir 30772 30758 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 30771 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30770 30761 30719 2007 D+ vfs_bus 0xfffff80333dd7000 mkdir 30769 30758 30719 2007 S+ lockf 0xfffff807b1663000 lockf 30768 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30767 30761 30719 2007 D+ vfs_bus 0xfffff80333dd7000 mkdir 30766 30758 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 30765 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30764 30761 30719 2007 D+ vfs_bus 0xfffff80333dd7000 mkdir 30763 30758 30719 2007 DW+ suspfs 0xfffff80333dd7080 lockf 30762 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30761 30738 30719 2007 S+ wait 0xfffff802111cb000 mkdir 30760 30758 30719 2007 S+ lockf 0xfffff80003a12880 lockf 30759 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30758 30736 30719 2007 S+ wait 0xfffff802d0fae000 lockf 30757 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30756 30742 30719 2007 DW+ suspfs 0xfffff80333dd7080 openat 30755 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30754 30747 30719 2007 D+ vfs_bus 0xfffff80333dd7000 fts 30753 30742 30719 2007 DW+ suspfs 0xfffff80333dd7080 openat 30752 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30751 30746 30719 2007 DW+ suspfs 0xfffff80333dd7080 rw 30750 30747 30719 2007 D+ vfs_bus 0xfffff80333dd7000 fts 30749 30742 30719 2007 DW+ suspfs 0xfffff80333dd7080 openat 30748 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30747 30734 30719 2007 S+ wait 0xfffff800038b2000 fts 30746 30733 30719 2007 S+ wait 0xfffff801072c8000 rw 30745 30740 30719 2007 DW+ suspfs 0xfffff80333dd7080 symlink 30744 30742 30719 2007 DW+ suspfs 0xfffff80333dd7080 openat 30742 30732 30719 2007 S+ wait 0xfffff80007d49530 openat 30740 30731 30719 2007 S+ wait 0xfffff800077fd000 symlink 30738 30729 30719 2007 S+ wait 0xfffff80007511a60 mkdir 30736 30729 30719 2007 S+ wait 0xfffff802111cba60 lockf 30734 30729 30719 2007 S+ wait 0xfffff8032b0dda60 fts 30733 30729 30719 2007 S+ wait 0xfffff802d031da60 rw 30732 30729 30719 2007 S+ wait 0xfffff80006013000 openat 30731 30729 30719 2007 S+ wait 0xfffff8002b2f2000 symlink 30729 30728 30719 2007 S+ wait 0xfffff8032b1e5530 run 30728 30727 30719 2007 S+ wait 0xfffff802d0d75a60 run 30727 30719 30719 2007 S+ wait 0xfffff80007a9c530 run 30719 30716 30719 2007 SW+ wait 0xfffff801072c8530 sh 30716 30699 2346 0 SW+ wait 0xfffff802584ba000 su 30699 30697 2346 0 SW+ pause 0xfffff80007b2e5d8 sh 30698 2346 2346 0 S+ piperd 0xfffff803fa9f75f0 tee 30697 2346 2346 0 SW+ wait 0xfffff8060332b530 sh 2481 2424 2424 0 S piperd 0xfffff8000797e000 sh 2479 2424 2424 0 S piperd 0xfffff800045768e8 awk 2478 2424 2424 0 S wait 0xfffff80007d49a60 sh 2424 1 2424 0 SWs wait 0xfffff80007b2ea60 sh 2346 2344 2346 0 SW+ wait 0xfffff80007b7a000 sh 2344 2342 2344 0 SW+ wait 0xfffff80006013a60 bash 2342 2341 2342 0 SW+ pause 0xfffff800038b25d8 csh 2341 2336 2341 2006 SW+ wait 0xfffff8002b2f3a60 su 2336 2335 2336 2006 SWs+ wait 0xfffff80007516a60 bash 2335 2332 2332 2006 S select 0xfffff800062a8a40 sshd 2332 2268 2332 0 Ss select 0xfffff800045c90c0 sshd 2328 2327 2328 0 S+ ttyin 0xfffff800062e60b0 csh 2327 1 2327 0 SWs+ wait 0xfffff802589fb530 login 2326 1 2326 0 Ss+ ttyin 0xfffff800062e64b0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff800045a10b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff800045a14b0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff800045a18b0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff800045a1cb0 getty 2321 1 2321 0 Ss+ ttyin 0xfffff800045a00b0 getty 2320 1 2320 0 Ss+ ttyin 0xfffff800045a04b0 getty 2319 1 2319 0 Ss+ ttyin 0xfffff800045a08b0 getty 2318 1 2318 0 Ss+ ttyin 0xfffff800045a0cb0 getty 2272 1 2272 0 Ss nanslp 0xffffffff81e91be7 cron 2268 1 2268 0 Ss select 0xfffff80004177cc0 sshd 2239 1 2239 123 Ss (threaded) ntpd 100147 S select 0xfffff800044ab640 ntpd 2176 1 2176 0 Ss rpcsvc 0xfffff800044b4b60 NLM: master 2173 1 2173 0 Ss select 0xfffff8000757d140 rpc.statd 2127 1 2127 0 Ss wait 0xfffff800045e0530 watchdogd 2048 1 2048 0 Ss select 0xfffff800045c9340 rpcbind 2038 1 2038 0 Ds getbuf 0xfffffe003ca34aec syslogd 1967 1 1967 0 Ss select 0xfffff8000394f740 devd 1962 1 1962 65 Ss select 0xfffff800061ed140 dhclient 1918 1 1918 0 Ss select 0xfffff80004177e40 dhclient 1915 1 1915 0 Ss select 0xfffff800044ab6c0 dhclient 34 0 0 0 DL vlruwt 0xfffff80007308a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81f680c0 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81f67558 [bufdaemon] 100133 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100136 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100138 D - 0xffffffff81a33640 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b900 [bufspacedaemon-6] 100151 D sdflush 0xfffff800075e14e8 [/ worker] 100201 D sdflush 0xfffff8002b86a0e8 [/tmp worker] 100558 D sdflush 0xfffff8066ea6d8e8 [/mnt worker] 31 0 0 0 DL psleep 0xffffffff81f81888 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81feb658 [dom0] 100131 D launds 0xffffffff81feb664 [laundry: dom0] 100132 D umarcl 0xffffffff80f31260 [uma] 29 0 0 0 DL idle 0xfffff80003a63000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003a63530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cee920 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81fe9d30 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81f66f5c [soaiod4] 24 0 0 0 DL - 0xffffffff81f66f5c [soaiod3] 23 0 0 0 DL - 0xffffffff81f66f5c [soaiod2] 22 0 0 0 DL - 0xffffffff81f66f5c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d15aa460 [usbus0] 100097 D - 0xfffffe00d15aa4b8 [usbus0] 100098 D - 0xfffffe00d15aa510 [usbus0] 100099 D - 0xfffffe00d15aa568 [usbus0] 100100 D - 0xfffffe00d15aa5c0 [usbus0] 100102 D - 0xfffffe003e1e6d10 [usbus1] 100103 D - 0xfffffe003e1e6d68 [usbus1] 100104 D - 0xfffffe003e1e6dc0 [usbus1] 100105 D - 0xfffffe003e1e6e18 [usbus1] 100106 D - 0xfffffe003e1e6e70 [usbus1] 100107 D - 0xfffffe00d1a3dd10 [usbus2] 100108 D - 0xfffffe00d1a3dd68 [usbus2] 100109 D - 0xfffffe00d1a3ddc0 [usbus2] 100110 D - 0xfffffe00d1a3de18 [usbus2] 100111 D - 0xfffffe00d1a3de70 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff81bc9cc0 [doneq0] 100092 Run CPU 9 [doneq1] 100093 D - 0xffffffff81bc9dc0 [doneq2] 100125 D - 0xffffffff81bc9b88 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003d9d450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003d9d3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003d9d390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003d9d330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003d9d2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003d9d270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003d9d210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003d9d1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003d9d150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003d9d0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003d9d090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003d9d030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81f7beb8 [crypto] 14 0 0 0 DL seqstat 0xfffff800036fa888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81fba1b0 [g_event] 100063 D - 0xffffffff81fba1c0 [g_up] 100064 D - 0xffffffff81fba1a8 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi6: task queue] 100016 I [swi6: Giant taskq] 100018 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100060 I [swi1: netisr 0] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100178 I [irq72: ioat0] 100179 I [irq73: ioat1] 100180 I [irq74: ioat2] 100181 I [irq75: ioat3] 100182 I [irq76: ioat4] 100183 I [irq77: ioat5] 100184 I [irq78: ioat6] 100185 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800037a2530 [init] 10 0 0 0 DL audit_w 0xffffffff81feaa80 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff81fba1f0 [swapper] 100017 Run CPU 5 [thread taskq] 100019 D - 0xfffff8000368e500 [config_0] 100020 D - 0xfffff8000368e300 [kqueue_ctx taskq] 100021 D - 0xfffff8000368e100 [aiod_kick taskq] 100022 D - 0xfffff8000368de00 [softirq_0] 100023 D - 0xfffff8000368dc00 [softirq_1] 100024 D - 0xfffff8000368da00 [softirq_2] 100025 D - 0xfffff8000368d800 [softirq_3] 100026 D - 0xfffff8000368d600 [softirq_4] 100027 D - 0xfffff8000368d400 [softirq_5] 100028 D - 0xfffff8000368d200 [softirq_6] 100029 D - 0xfffff8000368d000 [softirq_7] 100030 D - 0xfffff8000368cd00 [softirq_8] 100031 D - 0xfffff8000368cb00 [softirq_9] 100032 D - 0xfffff8000368c900 [softirq_10] 100033 D - 0xfffff8000368c700 [softirq_11] 100034 D - 0xfffff8000368c500 [if_io_tqg_0] 100035 D - 0xfffff8000368c300 [if_io_tqg_1] 100036 D - 0xfffff8000368c100 [if_io_tqg_2] 100037 D - 0xfffff8000370f100 [if_io_tqg_3] 100038 D - 0xfffff80003710e00 [if_io_tqg_4] 100039 D - 0xfffff80003710c00 [if_io_tqg_5] 100040 D - 0xfffff8000395e200 [if_io_tqg_6] 100041 D - 0xfffff8000395e000 [if_io_tqg_7] 100042 D - 0xfffff8000395fd00 [if_io_tqg_8] 100043 D - 0xfffff8000395fb00 [if_io_tqg_9] 100044 D - 0xfffff8000395f900 [if_io_tqg_10] 100045 D - 0xfffff8000395f700 [if_io_tqg_11] 100046 D - 0xfffff80003710a00 [if_config_tqg_0] 100061 D - 0xfffff80003711900 [firmware taskq] 100066 D - 0xfffff80003711100 [crypto_0] 100067 D - 0xfffff80003711100 [crypto_1] 100068 D - 0xfffff80003711100 [crypto_2] 100069 D - 0xfffff80003711100 [crypto_3] 100070 D - 0xfffff80003711100 [crypto_4] 100071 D - 0xfffff80003711100 [crypto_5] 100072 D - 0xfffff80003711100 [crypto_6] 100073 D - 0xfffff80003711100 [crypto_7] 100074 D - 0xfffff80003711100 [crypto_8] 100075 D - 0xfffff80003711100 [crypto_9] 100076 D - 0xfffff80003711100 [crypto_10] 100077 D - 0xfffff80003711100 [crypto_11] 100114 D - 0xfffff80003b22600 [mca taskq] 100120 D - 0xfffff800072f2900 [acpi_task_0] 100121 D - 0xfffff800072f2900 [acpi_task_1] 100122 D - 0xfffff800072f2900 [acpi_task_2] 100124 D - 0xfffff80003690300 [CAM taskq] 30735 30729 30719 2007 Z+ link 30737 30729 30719 2007 Z+ creat 30739 30729 30719 2007 Z+ rename 30741 30729 30719 2007 Z+ swap 30743 30729 30719 2007 Z+ mkfifo 32745 30779 30719 2007 Z+ lockf 32749 30763 30719 2007 Z+ lockf 32751 30766 30719 2007 Z+ lockf db:0:pho> allt Tracing command sleep pid 38093 tid 100203 td 0xfffff80007d64000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3556710 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3556740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3556780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35567e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3556820 _sleep() at _sleep+0x265/frame 0xfffffe00e35568c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00e3556940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e3556980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3556ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3556ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a5a6a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command top pid 16488 tid 100254 td 0xfffff802d004f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e36505a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e36505d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3650610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3650670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e36506b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3650720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3650760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3650940 sys_select() at sys_select+0x56/frame 0xfffffe00e3650980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3650ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3650ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004f02da, rsp = 0x7fffffffe928, rbp = 0x7fffffffeb40 --- Tracing command bash pid 15390 tid 100225 td 0xfffff802589f95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e35bf560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e35bf590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35bf5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35bf630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e35bf660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e35bf700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e35bf790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e35bf980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e35bfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e35bfab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051690a, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 15389 tid 100234 td 0xfffff802d00505a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e35ec5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e35ec5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35ec630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35ec690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e35ec6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e35ec720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e35ec760 kern_select() at kern_select+0x95a/frame 0xfffffe00e35ec940 sys_select() at sys_select+0x56/frame 0xfffffe00e35ec980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e35ecab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e35ecab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009032da, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 15386 tid 100327 td 0xfffff80007662000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e37bd640 mi_switch() at mi_switch+0x172/frame 0xfffffe00e37bd670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e37bd6b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e37bd710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e37bd740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e37bd7a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e37bd7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e37bd960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e37bd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e37bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37bdab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a525a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command ls pid 33776 tid 100157 td 0xfffff80007403000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3404030 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3404060 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e34040a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e34040d0 sleeplk() at sleeplk+0x109/frame 0xfffffe00e3404130 lockmgr_slock_hard() at lockmgr_slock_hard+0x1e8/frame 0xfffffe00e34041c0 __lockmgr_args() at __lockmgr_args+0x788/frame 0xfffffe00e3404260 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe00e34042d0 ffs_lock() at ffs_lock+0x115/frame 0xfffffe00e3404360 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x70/frame 0xfffffe00e3404380 VOP_LOCK1() at VOP_LOCK1+0x4b/frame 0xfffffe00e34043e0 _vn_lock() at _vn_lock+0xd1/frame 0xfffffe00e3404420 vget_finish() at vget_finish+0x8b/frame 0xfffffe00e3404470 cache_lookup() at cache_lookup+0x565/frame 0xfffffe00e3404550 vfs_cache_lookup() at vfs_cache_lookup+0xac/frame 0xfffffe00e34045b0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe00e34045d0 lookup() at lookup+0x601/frame 0xfffffe00e3404670 namei() at namei+0x502/frame 0xfffffe00e3404760 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e3404880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e3404980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3404ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3404ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80049157a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe470 --- Tracing command sh pid 33775 tid 100227 td 0xfffff8002bd535a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e35c9560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e35c9590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35c95d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35c9630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e35c9660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e35c9700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e35c9790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e35c9980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e35c9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e35c9ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040690a, rsp = 0x7fffffffe858, rbp = 0x7fffffffe910 --- Tracing command lockf pid 32750 tid 100392 td 0xfffff80007b20000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf pid 32724 tid 100315 td 0xfffff802d0f035a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf pid 32721 tid 100164 td 0xfffff80003a5d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30780 tid 100145 td 0xfffff800060ff000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf pid 30779 tid 100317 td 0xfffff802d0f045a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30777 tid 100229 td 0xfffff802d004d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf pid 30776 tid 100316 td 0xfffff802d0f03000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e37864c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e37864f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3786530 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3786590 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e37865c0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3786660 lf_advlockasync() at lf_advlockasync+0xae0/frame 0xfffffe00e3786710 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00e3786760 vop_stdadvlock() at vop_stdadvlock+0xc7/frame 0xfffffe00e3786860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x88/frame 0xfffffe00e3786880 kern_fcntl() at kern_fcntl+0x990/frame 0xfffffe00e3786910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00e3786980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3786ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3786ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x800421eda, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- Tracing command symlink pid 30775 tid 100228 td 0xfffff802d004d5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkdir pid 30773 tid 100260 td 0xfffff80007d50000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e366e2c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e366e2f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e366e330 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e366e360 _sleep() at _sleep+0x2da/frame 0xfffffe00e366e400 vfs_busy() at vfs_busy+0xbf/frame 0xfffffe00e366e440 vn_vget_ino_gen() at vn_vget_ino_gen+0xd9/frame 0xfffffe00e366e4c0 vn_vget_ino() at vn_vget_ino+0x3b/frame 0xfffffe00e366e500 ufs_lookup_ino() at ufs_lookup_ino+0x4e6/frame 0xfffffe00e366e610 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x86/frame 0xfffffe00e366e630 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00e366e690 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe00e366e6b0 lookup() at lookup+0x601/frame 0xfffffe00e366e750 namei() at namei+0x502/frame 0xfffffe00e366e840 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe00e366e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e366eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e366eab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f2a4a, rsp = 0x7ffffffe6ad8, rbp = 0x7ffffffe6f10 --- Tracing command lockf pid 30772 tid 100330 td 0xfffff802d09dd000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30771 tid 100492 td 0xfffff80577a04000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkdir pid 30770 tid 100258 td 0xfffff80003c5c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e36642c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e36642f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3664330 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e3664360 _sleep() at _sleep+0x2da/frame 0xfffffe00e3664400 vfs_busy() at vfs_busy+0xbf/frame 0xfffffe00e3664440 vn_vget_ino_gen() at vn_vget_ino_gen+0xd9/frame 0xfffffe00e36644c0 vn_vget_ino() at vn_vget_ino+0x3b/frame 0xfffffe00e3664500 ufs_lookup_ino() at ufs_lookup_ino+0x4e6/frame 0xfffffe00e3664610 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x86/frame 0xfffffe00e3664630 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00e3664690 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe00e36646b0 lookup() at lookup+0x601/frame 0xfffffe00e3664750 namei() at namei+0x502/frame 0xfffffe00e3664840 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe00e3664980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3664ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3664ab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f2a4a, rsp = 0x7ffffffe6ad8, rbp = 0x7ffffffe6f10 --- Tracing command lockf pid 30769 tid 100190 td 0xfffff800072135a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e34fd4c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e34fd4f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e34fd530 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e34fd590 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e34fd5c0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e34fd660 lf_advlockasync() at lf_advlockasync+0xae0/frame 0xfffffe00e34fd710 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00e34fd760 vop_stdadvlock() at vop_stdadvlock+0xc7/frame 0xfffffe00e34fd860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x88/frame 0xfffffe00e34fd880 kern_fcntl() at kern_fcntl+0x990/frame 0xfffffe00e34fd910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00e34fd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e34fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e34fdab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x800421eda, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- Tracing command symlink pid 30768 tid 100491 td 0xfffff804f7bd4000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkdir pid 30767 tid 100465 td 0xfffff80588cf0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5e0c2c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5e0c2f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5e0c330 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e5e0c360 _sleep() at _sleep+0x2da/frame 0xfffffe00e5e0c400 vfs_busy() at vfs_busy+0xbf/frame 0xfffffe00e5e0c440 vn_vget_ino_gen() at vn_vget_ino_gen+0xd9/frame 0xfffffe00e5e0c4c0 vn_vget_ino() at vn_vget_ino+0x3b/frame 0xfffffe00e5e0c500 ufs_lookup_ino() at ufs_lookup_ino+0x4e6/frame 0xfffffe00e5e0c610 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x86/frame 0xfffffe00e5e0c630 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00e5e0c690 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe00e5e0c6b0 lookup() at lookup+0x601/frame 0xfffffe00e5e0c750 namei() at namei+0x502/frame 0xfffffe00e5e0c840 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe00e5e0c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5e0cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5e0cab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f2a4a, rsp = 0x7ffffffe6ad8, rbp = 0x7ffffffe6f10 --- Tracing command lockf pid 30766 tid 100370 td 0xfffff8033a1d5000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30765 tid 100205 td 0xfffff8002b16e000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkdir pid 30764 tid 100463 td 0xfffff80588cf05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbea2c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbea2f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adbea330 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00adbea360 _sleep() at _sleep+0x2da/frame 0xfffffe00adbea400 vfs_busy() at vfs_busy+0xbf/frame 0xfffffe00adbea440 vn_vget_ino_gen() at vn_vget_ino_gen+0xd9/frame 0xfffffe00adbea4c0 vn_vget_ino() at vn_vget_ino+0x3b/frame 0xfffffe00adbea500 ufs_lookup_ino() at ufs_lookup_ino+0x4e6/frame 0xfffffe00adbea610 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x86/frame 0xfffffe00adbea630 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00adbea690 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe00adbea6b0 lookup() at lookup+0x601/frame 0xfffffe00adbea750 namei() at namei+0x502/frame 0xfffffe00adbea840 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe00adbea980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00adbeaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00adbeaab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f2a4a, rsp = 0x7ffffffe6ad8, rbp = 0x7ffffffe6f10 --- Tracing command lockf pid 30763 tid 100369 td 0xfffff8033a1d55a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30762 tid 100163 td 0xfffff80007b255a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkdir pid 30761 tid 100472 td 0xfffff806030c9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5e2f560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5e2f590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5e2f5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5e2f630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5e2f660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5e2f700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5e2f790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5e2f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5e2fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5e2fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe528, rbp = 0x7fffffffe560 --- Tracing command lockf pid 30760 tid 100208 td 0xfffff8002b1775a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e356f4c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e356f4f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e356f530 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e356f590 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e356f5c0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e356f660 lf_advlockasync() at lf_advlockasync+0xae0/frame 0xfffffe00e356f710 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00e356f760 vop_stdadvlock() at vop_stdadvlock+0xc7/frame 0xfffffe00e356f860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x88/frame 0xfffffe00e356f880 kern_fcntl() at kern_fcntl+0x990/frame 0xfffffe00e356f910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00e356f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e356fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e356fab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x800421eda, rsp = 0x7fffffffe468, rbp = 0x7fffffffe4b0 --- Tracing command symlink pid 30759 tid 100162 td 0xfffff80007b26000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf pid 30758 tid 100314 td 0xfffff802d0f02000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e377c560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e377c590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e377c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e377c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e377c660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e377c700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e377c790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e377c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e377cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e377cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe528, rbp = 0x7fffffffe560 --- Tracing command symlink pid 30757 tid 100307 td 0xfffff802d0fc65a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command openat pid 30756 tid 100375 td 0xfffff80588b38000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30755 tid 100306 td 0xfffff802d0fc5000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 30754 tid 100268 td 0xfffff802d08e05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3696750 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3696780 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e36967c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e36967f0 _sleep() at _sleep+0x2da/frame 0xfffffe00e3696890 vfs_busy() at vfs_busy+0xbf/frame 0xfffffe00e36968d0 kern_do_statfs() at kern_do_statfs+0x27/frame 0xfffffe00e3696900 kern_fstatfs() at kern_fstatfs+0x105/frame 0xfffffe00e3696950 sys_fstatfs() at sys_fstatfs+0x37/frame 0xfffffe00e3696980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3696ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3696ab0 --- syscall (556, FreeBSD ELF64, sys_fstatfs), rip = 0x80033f5aa, rsp = 0x7fffffffd828, rbp = 0x7fffffffda30 --- Tracing command openat pid 30753 tid 100364 td 0xfffff8033ab465a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30752 tid 100297 td 0xfffff80258549000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 30751 tid 100193 td 0xfffff80006007000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 30750 tid 100433 td 0xfffff806030c85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5dd0750 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5dd0780 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5dd07c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e5dd07f0 _sleep() at _sleep+0x2da/frame 0xfffffe00e5dd0890 vfs_busy() at vfs_busy+0xbf/frame 0xfffffe00e5dd08d0 kern_do_statfs() at kern_do_statfs+0x27/frame 0xfffffe00e5dd0900 kern_fstatfs() at kern_fstatfs+0x105/frame 0xfffffe00e5dd0950 sys_fstatfs() at sys_fstatfs+0x37/frame 0xfffffe00e5dd0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5dd0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5dd0ab0 --- syscall (556, FreeBSD ELF64, sys_fstatfs), rip = 0x80033f5aa, rsp = 0x7fffffffd828, rbp = 0x7fffffffda30 --- Tracing command openat pid 30749 tid 100352 td 0xfffff802d08e1000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 30748 tid 100337 td 0xfffff802d09dc000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 30747 tid 100220 td 0xfffff800037065a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e35a6560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e35a6590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35a65d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35a6630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e35a6660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e35a6700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e35a6790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e35a6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e35a6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e35a6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003be90a, rsp = 0x7fffffffe538, rbp = 0x7fffffffe570 --- Tracing command rw pid 30746 tid 100520 td 0xfffff8028afe55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5e84560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5e84590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5e845d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5e84630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5e84660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5e84700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5e84790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5e84980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5e84ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5e84ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe538, rbp = 0x7fffffffe570 --- Tracing command symlink pid 30745 tid 100338 td 0xfffff802c96d95a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command openat pid 30744 tid 100207 td 0xfffff80007dbe000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command openat pid 30742 tid 100176 td 0xfffff80003c5a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3487560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3487590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e34875d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3487630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3487660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3487700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3487790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3487980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3487ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3487ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe528, rbp = 0x7fffffffe560 --- Tracing command symlink pid 30740 tid 100326 td 0xfffff800076625a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e37b8560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e37b8590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e37b85d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e37b8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e37b8660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e37b8700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e37b8790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e37b8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e37b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37b8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe528, rbp = 0x7fffffffe560 --- Tracing command mkdir pid 30738 tid 100168 td 0xfffff8000446b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e345f560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e345f590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e345f5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e345f630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e345f660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e345f700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e345f790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e345f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e345fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e345fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe568, rbp = 0x7fffffffe680 --- Tracing command lockf pid 30736 tid 100459 td 0xfffff806030ca000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbd6560 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbd6590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adbd65d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00adbd6630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00adbd6660 _sleep() at _sleep+0x2d0/frame 0xfffffe00adbd6700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00adbd6790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00adbd6980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00adbd6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00adbd6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe568, rbp = 0x7fffffffe680 --- Tracing command fts pid 30734 tid 100318 td 0xfffff802d0f04000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3790560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3790590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e37905d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3790630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3790660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3790700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3790790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3790980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3790ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3790ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003be90a, rsp = 0x7fffffffe578, rbp = 0x7fffffffe690 --- Tracing command rw pid 30733 tid 100334 td 0xfffff80258dec000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e37e0560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e37e0590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e37e05d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e37e0630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e37e0660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e37e0700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e37e0790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e37e0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e37e0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37e0ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe578, rbp = 0x7fffffffe690 --- Tracing command openat pid 30732 tid 100175 td 0xfffff800060075a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3482560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3482590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e34825d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3482630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3482660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3482700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3482790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3482980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3482ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3482ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe568, rbp = 0x7fffffffe680 --- Tracing command symlink pid 30731 tid 100196 td 0xfffff80007213000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3533560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3533590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35335d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3533630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3533660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3533700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3533790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3533980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3533ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3533ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c090a, rsp = 0x7fffffffe568, rbp = 0x7fffffffe680 --- Tracing command run pid 30729 tid 100402 td 0xfffff806030c7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5d35560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5d35590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5d355d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e5d35630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e5d35660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e5d35700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e5d35790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5d35980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e5d35ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d35ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003be90a, rsp = 0x7fffffffde68, rbp = 0x7fffffffe390 --- Tracing command run pid 30728 tid 100303 td 0xfffff802d066d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3745560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3745590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e37455d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3745630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3745660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e3745700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e3745790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e3745980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3745ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3745ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003be90a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe3f0 --- Tracing command run pid 30727 tid 100154 td 0xfffff80007a69000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1bf1560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1bf1590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1bf15d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1bf1630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1bf1660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e1bf1700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e1bf1790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e1bf1980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1bf1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bf1ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003be90a, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe510 --- Tracing command sh pid 30719 tid 100542 td 0xfffff802241bf5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 30716 tid 100263 td 0xfffff80258535000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 30699 tid 100240 td 0xfffff80007b23000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 30698 tid 100230 td 0xfffff80007dba5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e35d86a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e35d86d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35d8710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35d8770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e35d87a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e35d8840 pipe_read() at pipe_read+0x348/frame 0xfffffe00e35d88a0 dofileread() at dofileread+0x81/frame 0xfffffe00e35d88f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e35d8930 sys_read() at sys_read+0x84/frame 0xfffffe00e35d8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e35d8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e35d8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004162fa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 30697 tid 100411 td 0xfffff806033285a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2481 tid 100241 td 0xfffff80003c5a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e360f6a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e360f6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e360f710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e360f770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e360f7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e360f840 pipe_read() at pipe_read+0x348/frame 0xfffffe00e360f8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e360f8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e360f930 sys_read() at sys_read+0x84/frame 0xfffffe00e360f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e360fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e360fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004772fa, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2479 tid 100150 td 0xfffff80007b265a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1bdd6a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1bdd6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1bdd710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1bdd770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1bdd7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00e1bdd840 pipe_read() at pipe_read+0x348/frame 0xfffffe00e1bdd8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e1bdd8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1bdd930 sys_read() at sys_read+0x84/frame 0xfffffe00e1bdd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1bddab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bddab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a2fa, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2478 tid 100174 td 0xfffff80003c59000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e347d560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e347d590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e347d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e347d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e347d660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e347d700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e347d790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e347d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e347dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e347dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040690a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 2424 tid 100189 td 0xfffff80007b25000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2346 tid 100166 td 0xfffff80007e945a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2344 tid 100155 td 0xfffff800060065a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2342 tid 100165 td 0xfffff80003959000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2341 tid 100198 td 0xfffff80007d645a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2336 tid 100202 td 0xfffff80007dbe5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2335 tid 100156 td 0xfffff80006006000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1bfb5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1bfb5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1bfb630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1bfb690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1bfb6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e1bfb720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1bfb760 kern_select() at kern_select+0x95a/frame 0xfffffe00e1bfb940 sys_select() at sys_select+0x56/frame 0xfffffe00e1bfb980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1bfbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bfbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009032da, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2332 tid 100209 td 0xfffff8002b177000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3574640 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3574670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35746b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3574710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3574740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e35747a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e35747e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3574960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3574980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3574ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3574ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a525a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2328 tid 100197 td 0xfffff800045d0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3538620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3538650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3538690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35386f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3538720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3538780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e35387b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3538810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3538840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e35388a0 dofileread() at dofileread+0x81/frame 0xfffffe00e35388f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3538930 sys_read() at sys_read+0x84/frame 0xfffffe00e3538980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3538ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3538ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fb2fa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2327 tid 100218 td 0xfffff802589f85a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7d20 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7d30 trap() at trap+0x59/frame 0xfffffe00adbb7e40 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7e40 --- trap 0xc, rip = 0xffffffff81194fc6, rsp = 0xfffffe00adbb7f10, rbp = 0xfffffe00adbb7f20 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00adbb7f20 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2326 tid 100217 td 0xfffff802589f7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e359c620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e359c650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e359c690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e359c6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e359c720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e359c780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e359c7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e359c810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e359c840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e359c8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e359c8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e359c930 sys_read() at sys_read+0x84/frame 0xfffffe00e359c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e359cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e359cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2325 tid 100216 td 0xfffff802589f75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3597620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3597650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3597690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35976f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3597720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3597780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e35977b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3597810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3597840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e35978a0 dofileread() at dofileread+0x81/frame 0xfffffe00e35978f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3597930 sys_read() at sys_read+0x84/frame 0xfffffe00e3597980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3597ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3597ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2324 tid 100215 td 0xfffff802589f6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3592620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3592650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3592690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35926f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3592720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3592780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e35927b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3592810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3592840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e35928a0 dofileread() at dofileread+0x81/frame 0xfffffe00e35928f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3592930 sys_read() at sys_read+0x84/frame 0xfffffe00e3592980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3592ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3592ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2323 tid 100214 td 0xfffff802589f65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e358d620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e358d650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e358d690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e358d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e358d720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e358d780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e358d7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e358d810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e358d840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e358d8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e358d8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e358d930 sys_read() at sys_read+0x84/frame 0xfffffe00e358d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e358dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e358dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2322 tid 100143 td 0xfffff800074035a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00db1f8620 mi_switch() at mi_switch+0x172/frame 0xfffffe00db1f8650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00db1f8690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00db1f86f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00db1f8720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00db1f8780 tty_wait() at tty_wait+0x42/frame 0xfffffe00db1f87b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00db1f8810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00db1f8840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00db1f88a0 dofileread() at dofileread+0x81/frame 0xfffffe00db1f88f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00db1f8930 sys_read() at sys_read+0x84/frame 0xfffffe00db1f8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00db1f8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00db1f8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2321 tid 100159 td 0xfffff80007e9f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e340e620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e340e650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e340e690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e340e6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e340e720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e340e780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e340e7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e340e810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e340e840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e340e8a0 dofileread() at dofileread+0x81/frame 0xfffffe00e340e8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e340e930 sys_read() at sys_read+0x84/frame 0xfffffe00e340e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e340eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e340eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2320 tid 100213 td 0xfffff80007a685a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3588620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3588650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3588690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35886f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3588720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3588780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e35887b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3588810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3588840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e35888a0 dofileread() at dofileread+0x81/frame 0xfffffe00e35888f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3588930 sys_read() at sys_read+0x84/frame 0xfffffe00e3588980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3588ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3588ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2319 tid 100206 td 0xfffff80006012000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3565620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3565650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3565690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35656f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3565720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3565780 tty_wait() at tty_wait+0x42/frame 0xfffffe00e35657b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3565810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3565840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e35658a0 dofileread() at dofileread+0x81/frame 0xfffffe00e35658f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3565930 sys_read() at sys_read+0x84/frame 0xfffffe00e3565980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3565ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3565ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2318 tid 100142 td 0xfffff80003d88000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00db1f3620 mi_switch() at mi_switch+0x172/frame 0xfffffe00db1f3650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00db1f3690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00db1f36f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00db1f3720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00db1f3780 tty_wait() at tty_wait+0x42/frame 0xfffffe00db1f37b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00db1f3810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00db1f3840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00db1f38a0 dofileread() at dofileread+0x81/frame 0xfffffe00db1f38f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00db1f3930 sys_read() at sys_read+0x84/frame 0xfffffe00db1f3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00db1f3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00db1f3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004322fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2272 tid 100167 td 0xfffff80007e94000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3436710 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3436740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3436780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e34367e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3436820 _sleep() at _sleep+0x265/frame 0xfffffe00e34368c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00e3436940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e3436980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3436ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3436ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d5a6a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2268 tid 100177 td 0xfffff8000766c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e348c5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e348c5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e348c630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e348c690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e348c6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e348c720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e348c760 kern_select() at kern_select+0x95a/frame 0xfffffe00e348c940 sys_select() at sys_select+0x56/frame 0xfffffe00e348c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e348cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e348cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009032da, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2239 tid 100147 td 0xfffff800061005a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1bce5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1bce5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1bce630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1bce690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1bce6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e1bce720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1bce760 kern_select() at kern_select+0x95a/frame 0xfffffe00e1bce940 sys_select() at sys_select+0x56/frame 0xfffffe00e1bce980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1bceab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bceab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082e2da, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command rpc.lockd pid 2176 tid 100171 td 0xfffff80003d89000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e346e4e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e346e510 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e346e550 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e346e5b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e346e5f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e346e660 svc_run_internal() at svc_run_internal+0xa90/frame 0xfffffe00e346e7a0 svc_run() at svc_run+0x24e/frame 0xfffffe00e346e800 sys_nlm_syscall() at sys_nlm_syscall+0x763/frame 0xfffffe00e346e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e346eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e346eab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f162a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2173 tid 100200 td 0xfffff800060125a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e35475a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e35475d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3547610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3547670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e35476b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3547720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3547760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3547940 sys_select() at sys_select+0x56/frame 0xfffffe00e3547980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3547ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3547ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004262da, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2127 tid 100146 td 0xfffff800045cf000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1bc9560 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1bc9590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1bc95d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e1bc9630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1bc9660 _sleep() at _sleep+0x2d0/frame 0xfffffe00e1bc9700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00e1bc9790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e1bc9980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e1bc9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1bc9ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003be90a, rsp = 0x7fffffffea28, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2048 tid 100195 td 0xfffff800060085a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e352e620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e352e650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e352e690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e352e6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e352e730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e352e7a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e352e7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e352e960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e352e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e352eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e352eab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cd25a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2038 tid 100191 td 0xfffff80007a6a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3502450 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3502480 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35024c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e35024f0 _sleep() at _sleep+0x2da/frame 0xfffffe00e3502590 getdirtybuf() at getdirtybuf+0x390/frame 0xfffffe00e35026a0 flush_deplist() at flush_deplist+0xff/frame 0xfffffe00e3502700 flush_inodedep_deps() at flush_inodedep_deps+0x185/frame 0xfffffe00e3502770 softdep_sync_metadata() at softdep_sync_metadata+0xca/frame 0xfffffe00e35027a0 ffs_syncvnode() at ffs_syncvnode+0x86/frame 0xfffffe00e35028b0 ffs_fsync() at ffs_fsync+0x3e/frame 0xfffffe00e35028f0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00e3502910 kern_fsync() at kern_fsync+0x199/frame 0xfffffe00e3502980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3502ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3502ab0 --- syscall (95, FreeBSD ELF64, sys_fsync), rip = 0x80043541a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1967 tid 100173 td 0xfffff80007404000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e34785a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e34785d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3478610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3478670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e34786b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e3478720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3478760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3478940 sys_select() at sys_select+0x56/frame 0xfffffe00e3478980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3478ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3478ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f542a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1962 tid 100194 td 0xfffff80007405000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3511620 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3511650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3511690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e35116f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3511730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00e35117a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e35117e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3511960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3511980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3511ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3511ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f025a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1918 tid 100192 td 0xfffff800074055a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e3507640 mi_switch() at mi_switch+0x172/frame 0xfffffe00e3507670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e35076b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3507710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3507740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e35077a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e35077e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00e3507960 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3507980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3507ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3507ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f025a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1915 tid 100169 td 0xfffff800045d05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e34645c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e34645f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e3464630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00e3464690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e34646c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00e3464720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3464760 kern_select() at kern_select+0x95a/frame 0xfffffe00e3464940 sys_select() at sys_select+0x56/frame 0xfffffe00e3464980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00e3464ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3464ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044e2da, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff80007402000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00db1ee890 mi_switch() at mi_switch+0x172/frame 0xfffffe00db1ee8c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00db1ee900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00db1ee940 _sleep() at _sleep+0x279/frame 0xfffffe00db1ee9e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00db1eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00db1eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00db1eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff800074025a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00db1e98c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00db1e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00db1e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00db1e9970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00db1e99e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00db1e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00db1e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00db1e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff80007401000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e3158d0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e315900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e315940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e315980 _sleep() at _sleep+0x279/frame 0xfffffe003e315a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe003e315a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e315ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e315ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff800044615a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00da7248c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00da7248f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00da724930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da724970 _sleep() at _sleep+0x279/frame 0xfffffe00da724a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00da724a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00da724ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da724ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff80004461000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00da7e98c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00da7e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00da7e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da7e9970 _sleep() at _sleep+0x279/frame 0xfffffe00da7e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00da7e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00da7e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da7e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff800044625a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00da7ee8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00da7ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00da7ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da7ee970 _sleep() at _sleep+0x279/frame 0xfffffe00da7eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00da7eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00da7eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da7eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff80004462000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00da7f38c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00da7f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00da7f3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da7f3970 _sleep() at _sleep+0x279/frame 0xfffffe00da7f3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00da7f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00da7f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da7f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800044635a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00da7f88c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00da7f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00da7f8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da7f8970 _sleep() at _sleep+0x279/frame 0xfffffe00da7f8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00da7f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00da7f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da7f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff80004463000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00da7fd8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00da7fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00da7fd930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da7fd970 _sleep() at _sleep+0x279/frame 0xfffffe00da7fda10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00da7fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00da7fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da7fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000446b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00db0048c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00db0048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00db004930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00db004970 _sleep() at _sleep+0x279/frame 0xfffffe00db004a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00db004a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00db004ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00db004ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100151 td 0xfffff80007a68000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e1be28b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e1be28e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e1be2920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e1be2960 _sleep() at _sleep+0x279/frame 0xfffffe00e1be2a00 softdep_flush() at softdep_flush+0x287/frame 0xfffffe00e1be2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00e1be2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1be2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100201 td 0xfffff80007b235a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e354c8b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e354c8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e354c920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e354c960 _sleep() at _sleep+0x279/frame 0xfffffe00e354ca00 softdep_flush() at softdep_flush+0x287/frame 0xfffffe00e354ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00e354cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e354cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100558 td 0xfffff802241bf000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00e5e668b0 mi_switch() at mi_switch+0x172/frame 0xfffffe00e5e668e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00e5e66920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e5e66960 _sleep() at _sleep+0x279/frame 0xfffffe00e5e66a00 softdep_flush() at softdep_flush+0x287/frame 0xfffffe00e5e66a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00e5e66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e5e66ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff80003a505a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e3108c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e3108f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e310930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e310960 _sleep() at _sleep+0x2da/frame 0xfffffe003e310a00 vm_daemon() at vm_daemon+0xabf/frame 0xfffffe003e310a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e310ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e310ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff80007301000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e30b520 mi_switch() at mi_switch+0x172/frame 0xfffffe003e30b550 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e30b590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e30b5d0 _sleep() at _sleep+0x279/frame 0xfffffe003e30b670 vm_pageout_worker() at vm_pageout_worker+0x26e/frame 0xfffffe003e30ba30 vm_pageout() at vm_pageout+0x176/frame 0xfffffe003e30ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e30bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e30bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff800045ce000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e31a6b0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e31a6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e31a720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e31a750 _sleep() at _sleep+0x2da/frame 0xfffffe003e31a7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xbe6/frame 0xfffffe003e31aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e31aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e31aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff800045cf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e33f8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e33f920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e33f960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e33f9a0 _sleep() at _sleep+0x279/frame 0xfffffe003e33fa40 uma_reclaim_worker() at uma_reclaim_worker+0xaa/frame 0xfffffe003e33fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e33fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e33fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff80003a535a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e3068b0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e3068e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e306920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e306950 _sleep() at _sleep+0x2da/frame 0xfffffe003e3069f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe003e306a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e306ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e306ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff80003a52000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e3018b0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e3018e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e301920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e301950 _sleep() at _sleep+0x2da/frame 0xfffffe003e3019f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe003e301a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e301ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e301ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff800072f75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2f28c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2f28f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2f2930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e2f2970 _sleep() at _sleep+0x279/frame 0xfffffe003e2f2a10 random_kthread() at random_kthread+0x26a/frame 0xfffffe003e2f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800072f55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2d2910 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2d2940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2d2980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2d29b0 _sleep() at _sleep+0x2da/frame 0xfffffe003e2d2a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe003e2d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff80003a525a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2c18e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2c1910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2c1950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e2c1990 _sleep() at _sleep+0x279/frame 0xfffffe003e2c1a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e2c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80003a51000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2bc8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2bc910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2bc950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e2bc990 _sleep() at _sleep+0x279/frame 0xfffffe003e2bca30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e2bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff80003a515a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2b78e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2b7910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2b7950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e2b7990 _sleep() at _sleep+0x279/frame 0xfffffe003e2b7a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e2b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80003a50000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2b28e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2b2910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2b2950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e2b2990 _sleep() at _sleep+0x279/frame 0xfffffe003e2b2a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe003e2b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff800042475a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e23b930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e23b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e23b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e23b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e23ba30 usb_process() at usb_process+0x13b/frame 0xfffffe003e23ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e23bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e23bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80004247000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e240930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e240960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2409d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e240a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e240a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e240ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e240ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff800042485a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e245930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e245960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e245a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e245a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e245ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e245ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80004248000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e24a930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e24a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e24a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e24a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e24aa30 usb_process() at usb_process+0x13b/frame 0xfffffe003e24aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e24aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e24aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff800042505a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e24f930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e24f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e24f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e24f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e24fa30 usb_process() at usb_process+0x13b/frame 0xfffffe003e24fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e24fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e24fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003d855a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e259930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e259960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e259a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e259a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e259ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e259ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff800045cc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e25e930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e25e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e25e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e25e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e25ea30 usb_process() at usb_process+0x13b/frame 0xfffffe003e25ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e25eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e25eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800045cd5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e263930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e263960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e263a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e263a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e263ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e263ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff800045cd000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e268930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e268960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e268a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e268a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e268ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e268ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff800045ce5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e26d930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e26d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e26d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e26d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e26da30 usb_process() at usb_process+0x13b/frame 0xfffffe003e26da70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e26dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e26dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff80003b255a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e28a930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e28a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e28a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e28a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e28aa30 usb_process() at usb_process+0x13b/frame 0xfffffe003e28aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e28aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e28aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff80003b25000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e28f930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e28f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e28f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e28f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e28fa30 usb_process() at usb_process+0x13b/frame 0xfffffe003e28fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e28fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e28fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff80003b265a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e294930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e294960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2949d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e294a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e294a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e294ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e294ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff80003b26000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e299930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e299960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2999d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e299a30 usb_process() at usb_process+0x13b/frame 0xfffffe003e299a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e299ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e299ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff80003b275a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e29e930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e29e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e29e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e29e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003e29ea30 usb_process() at usb_process+0x13b/frame 0xfffffe003e29ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e29eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e29eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003d875a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2228e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e222910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e222950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e222980 _sleep() at _sleep+0x2da/frame 0xfffffe003e222a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe003e222a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e222ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e222ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003d87000 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfd3e10 trap() at trap+0x46/frame 0xfffffe003dfd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfd3f20 --- trap 0x13, rip = 0xffffffff8118abd8, rsp = 0xfffffe003e2275e0, rbp = 0xfffffe003e227640 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x318/frame 0xfffffe003e227640 pmap_invalidate_range() at pmap_invalidate_range+0x1bc/frame 0xfffffe003e2276c0 allocbuf() at allocbuf+0x108/frame 0xfffffe003e227720 brelse() at brelse+0x1b9/frame 0xfffffe003e227780 bufdone() at bufdone+0x46f/frame 0xfffffe003e227800 ffs_backgroundwritedone() at ffs_backgroundwritedone+0xdb/frame 0xfffffe003e227830 bufdone() at bufdone+0x70/frame 0xfffffe003e2278b0 g_io_deliver() at g_io_deliver+0x298/frame 0xfffffe003e227900 g_io_deliver() at g_io_deliver+0x298/frame 0xfffffe003e227950 g_io_deliver() at g_io_deliver+0x298/frame 0xfffffe003e2279a0 g_disk_done() at g_disk_done+0x106/frame 0xfffffe003e2279e0 xpt_done_process() at xpt_done_process+0x388/frame 0xfffffe003e227a20 xpt_done_td() at xpt_done_td+0xf6/frame 0xfffffe003e227a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e227ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e227ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003d885a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e22c8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e22c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e22c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e22c980 _sleep() at _sleep+0x2da/frame 0xfffffe003e22ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe003e22ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e22cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e22cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff800073015a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2fc8d0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2fc900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2fc940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2fc970 _sleep() at _sleep+0x2da/frame 0xfffffe003e2fca10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe003e2fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003d86000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e21d8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e21d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e21d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e21d960 _sleep() at _sleep+0x2da/frame 0xfffffe003e21da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e21da70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e21dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e21dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80003d865a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2188c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e218930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e218960 _sleep() at _sleep+0x2da/frame 0xfffffe003e218a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e218a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e218ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e218ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff80003d85000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2138c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e213930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e213960 _sleep() at _sleep+0x2da/frame 0xfffffe003e213a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e213a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e213ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e213ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80003da15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e20e8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e20e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e20e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e20e960 _sleep() at _sleep+0x2da/frame 0xfffffe003e20ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e20ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e20eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e20eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff80003d9c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2098c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e209930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e209960 _sleep() at _sleep+0x2da/frame 0xfffffe003e209a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e209a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e209ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e209ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003d9c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2048c0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e204930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e204960 _sleep() at _sleep+0x2da/frame 0xfffffe003e204a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe003e204a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e204ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e204ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003d9b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379fb8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379fb8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379fb930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379fb960 _sleep() at _sleep+0x2da/frame 0xfffffe00379fba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00379fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003d9b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379f68c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379f68f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379f6930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379f6960 _sleep() at _sleep+0x2da/frame 0xfffffe00379f6a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00379f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003d9a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379f18c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379f18f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379f1930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379f1960 _sleep() at _sleep+0x2da/frame 0xfffffe00379f1a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00379f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003d9a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379ec8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379ec8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379ec930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379ec960 _sleep() at _sleep+0x2da/frame 0xfffffe00379eca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00379eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff80003d99000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379e78c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379e78f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379e7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379e7960 _sleep() at _sleep+0x2da/frame 0xfffffe00379e7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00379e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80003d995a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379e28c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379e28f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379e2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379e2960 _sleep() at _sleep+0x2da/frame 0xfffffe00379e2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00379e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff80003da5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379dd8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00379dd920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379dd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379dd990 _sleep() at _sleep+0x2da/frame 0xfffffe00379dda30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00379dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003e0f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003799c8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003799c920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003799c960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003799c990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe003799c9f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe003799ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003799cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003799cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003e0a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379818f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0037981920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0037981960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037981990 _sleep() at _sleep+0x2da/frame 0xfffffe0037981a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0037981a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037981ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037981ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003e0e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379868f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0037986920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0037986960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037986990 _sleep() at _sleep+0x2da/frame 0xfffffe0037986a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037986a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0037986a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037986ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037986ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003e0e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003798b8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe003798b920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003798b960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003798b990 _sleep() at _sleep+0x2da/frame 0xfffffe003798ba30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe003798ba60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe003798ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003798bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003798bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff8000378f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbae9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbaea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00adbaea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbaeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbaeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff800037905a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbb39e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbb3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00adbb3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff8000379d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000370c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378ee9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00378eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00378eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff8000370d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff8000370d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000370e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000370e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003701000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800037025a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003702000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff800037035a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003703000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff800037045a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003704000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff800037055a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003705000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003792f9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003792fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003792fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003792fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003792fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff800042465a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2319e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e231a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e231a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e231ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e231ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80004246000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2369e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e236a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e236a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e236ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e236ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80004250000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2549e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e254a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e254a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e254ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e254ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff80003b27000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80003b385a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2a89e0 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2a8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe003e2a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100178 td 0xfffff8002b04e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff8002b04e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff8002bab55a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff8002bab5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8002bb1e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8002bb1e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8002b2405a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff8002b240000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff8000379e000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81fa0810 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81fa0830 trap() at trap+0x46/frame 0xffffffff81fa0940 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fa0940 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb66910, rbp = 0xfffffe00adb66910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb66910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb66960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb66980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb669a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb66a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb66ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000379f5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df73e10 trap() at trap+0x46/frame 0xfffffe003df73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df73f20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb6b910, rbp = 0xfffffe00adb6b910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb6b910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb6b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb6b980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb6b9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb6ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb6bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb6bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000379f000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df7fe10 trap() at trap+0x46/frame 0xfffffe003df7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df7ff20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb70910, rbp = 0xfffffe00adb70910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb70910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb70960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb70980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb709a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb70a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb70ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb70ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037a05a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df8be10 trap() at trap+0x46/frame 0xfffffe003df8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df8bf20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb75910, rbp = 0xfffffe00adb75910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb75910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb75960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb75980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb759a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb75a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb75ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb75ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037a0000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003df97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003df97e10 trap() at trap+0x46/frame 0xfffffe003df97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003df97f20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb7a910, rbp = 0xfffffe00adb7a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb7a910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb7a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb7a980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb7a9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb7aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb7aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb7aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800037a15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adb7f970 mi_switch() at mi_switch+0x172/frame 0xfffffe00adb7f9a0 sched_idletd() at sched_idletd+0x490/frame 0xfffffe00adb7fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb7fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb7fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037a1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfafe10 trap() at trap+0x46/frame 0xfffffe003dfaff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfaff20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb84910, rbp = 0xfffffe00adb84910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb84910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb84960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb84980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb849a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb84a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb84ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000378d5a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfbbe10 trap() at trap+0x46/frame 0xfffffe003dfbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfbbf20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb89910, rbp = 0xfffffe00adb89910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb89910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb89960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb89980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb899a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb89ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000378d000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfc7e10 trap() at trap+0x46/frame 0xfffffe003dfc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfc7f20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb8e910, rbp = 0xfffffe00adb8e910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb8e910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb8e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb8e980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb8e9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb8eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000378e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adb93950 mi_switch() at mi_switch+0x172/frame 0xfffffe00adb93980 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00adb939a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb93a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb93ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000378e000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfdfe10 trap() at trap+0x46/frame 0xfffffe003dfdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfdff20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb98910, rbp = 0xfffffe00adb98910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb98910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb98960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb98980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb989a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb98a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb98ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000378f5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe003dfebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe003dfebe10 trap() at trap+0x46/frame 0xfffffe003dfebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003dfebf20 --- trap 0x13, rip = 0xffffffff811803e6, rsp = 0xfffffe00adb9d910, rbp = 0xfffffe00adb9d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adb9d910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe00adb9d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00adb9d980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00adb9d9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe00adb9da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb9dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb9dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000379e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adb61560 mi_switch() at mi_switch+0x172/frame 0xfffffe00adb61590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adb615d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00adb61630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00adb61660 _sleep() at _sleep+0x2d0/frame 0xfffffe00adb61700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00adb61790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00adb61980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00adb61ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00adb61ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0f9a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000379d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adb5c910 mi_switch() at mi_switch+0x172/frame 0xfffffe00adb5c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adb5c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00adb5c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00adb5ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe00adb5ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adb5cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adb5cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81fba740 sched_switch() at sched_switch+0x3f0/frame 0xffffffff82725980 mi_switch() at mi_switch+0x172/frame 0xffffffff827259b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff827259f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff82725a30 _sleep() at _sleep+0x279/frame 0xffffffff82725ad0 swapper() at swapper+0x77/frame 0xffffffff82725b20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff82725b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100017 td 0xfffff80003790000 (CPU 5) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003749000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbc2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbc2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adbc29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00adbc29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00adbc2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00adbc2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbc2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbc2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff8000374a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbc7900 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbc7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adbc7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00adbc79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00adbc7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00adbc7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbc7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbc7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000374a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00adbcc900 mi_switch() at mi_switch+0x172/frame 0xfffffe00adbcc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00adbcc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00adbcc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00adbcca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00adbcca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000374b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037871930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037871960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037871a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037871a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037871ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037871ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff8000374b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037876930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037876960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037876a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037876a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037876ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037876ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff8000374c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003787b930 mi_switch() at mi_switch+0x172/frame 0xfffffe003787b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003787b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003787b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003787ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003787ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe003787bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003787bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff8000374c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037880930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037880960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037880a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037880a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037880ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037880ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff8000374d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037885930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037885960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037885a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037885a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037885ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037885ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff8000374d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003788a930 mi_switch() at mi_switch+0x172/frame 0xfffffe003788a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003788a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003788a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003788aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003788aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003788aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003788aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037135a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003788f930 mi_switch() at mi_switch+0x172/frame 0xfffffe003788f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003788f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003788f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003788fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003788fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe003788fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003788fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003713000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037894930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037894960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037894a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037894a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037894ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037894ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800037145a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0037899930 mi_switch() at mi_switch+0x172/frame 0xfffffe0037899960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0037899a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0037899a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0037899ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037899ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003714000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003789e930 mi_switch() at mi_switch+0x172/frame 0xfffffe003789e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003789e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003789e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003789ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe003789ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe003789eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003789eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800037155a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378a3930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003715000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378a8930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037165a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378ad930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003716000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378b2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800037495a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378b7930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003706000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378bc930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037075a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378c1930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003707000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378c6930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800039495a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378cb930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003949000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378d0930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000394a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378d5930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000394a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378da930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000394b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378df930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000394b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378e4930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff8000370c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00378e9930 mi_switch() at mi_switch+0x172/frame 0xfffffe00378e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00378e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00378e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00378e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00378e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00378e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00378e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003e0a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003797c900 mi_switch() at mi_switch+0x172/frame 0xfffffe003797c930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003797c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003797c9a0 _sleep() at _sleep+0x2da/frame 0xfffffe003797ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003797ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe003797cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003797cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003e0f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379a1900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379a1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379a1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379a19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379a1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003e105a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379a6900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379a6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379a6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379a69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379a6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003e10000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379ab900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379ab930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379ab970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379ab9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379aba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800037015a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379b0900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379b0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379b0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379b09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379b0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003da1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379b5900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379b5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379b5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379b59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379b5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003da25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379ba900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379ba930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379ba970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379ba9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379baa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003da2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379bf900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379bf930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379bf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379bf9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379bfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003da35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379c4900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379c4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379c4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379c49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379c4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003da3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379c9900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379c9930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379c9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379c99a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379c9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003da45a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379ce900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379ce930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379ce970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379ce9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379cea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003da4000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379d3900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379d3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379d3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379d39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379d3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003da55a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00379d8900 mi_switch() at mi_switch+0x172/frame 0xfffffe00379d8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00379d8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00379d89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00379d8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00379d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00379d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00379d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff80003b38000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2ad930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e2ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e2ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff800072f5000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2e3930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2e3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2e39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2e39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e2e3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e2e3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2e3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2e3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800072f65a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2e8930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2e8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2e89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2e89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e2e8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e2e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff800072f6000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2ed930 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2ed960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2ed9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2ed9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe003e2eda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e2eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff800072f7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe003e2f7900 mi_switch() at mi_switch+0x172/frame 0xfffffe003e2f7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe003e2f7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e2f79a0 _sleep() at _sleep+0x2da/frame 0xfffffe003e2f7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe003e2f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe003e2f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e2f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1707 out of 32622 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:0:pho> show allchains chain 1: thread 100203 (pid 38093, sleep) sleeping on 0xffffffff81e91be8 "nanslp" chain 2: thread 100254 (pid 16488, top) sleeping on 0xfffff801973be140 "select" chain 3: thread 100225 (pid 15390, bash) sleeping on 0xfffff802589fca60 "wait" chain 4: thread 100234 (pid 15389, sshd) sleeping on 0xfffff8032bf89e40 "select" chain 5: thread 100327 (pid 15386, sshd) sleeping on 0xfffff8070bf136c0 "select" chain 6: thread 100157 (pid 33776, ls) blocked on lockmgr ufsEXCL thread 100017 (pid 0, thread taskq) running on CPU 5 chain 7: thread 100227 (pid 33775, sh) sleeping on 0xfffff80004569530 "wait" chain 8: thread 100392 (pid 32750, lockf) blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7bb0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7bc0 trap() at trap+0x59/frame 0xfffffe00adbb7cd0 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7cd0 --- trap 0xc, rip = 0xffffffff80cd04af, rsp = 0xfffffe00adbb7da0, rbp = 0xfffffe00adbb7da0 --- strlen() at strlen+0x1f/frame 0xfffffe00adbb7da0 kvprintf() at kvprintf+0xf79/frame 0xfffffe00adbb7ec0 db_printf() at db_printf+0x5d/frame 0xfffffe00adbb7f40 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00adbb7f60 print_lockchain() at print_lockchain+0x89/frame 0xfffffe00adbb7f90 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command 'show allchains' returned error db:0:pho> chain 1: thread 100203 (pid 38093, sleep) sleeping on 0xffffffff81e91be8 "nanslp" chain 2: thread 100254 (pid 16488, top) sleeping on 0xfffff801973be140 "select" chain 3: thread 100225 (pid 15390, bash) sleeping on 0xfffff802589fca60 "wait" chain 4: thread 100234 (pid 15389, sshd) sleeping on 0xfffff8032bf89e40 "select" chain 5: thread 100327 (pid 15386, sshd) sleeping on 0xfffff8070bf136c0 "select" chain 6: thread 100157 (pid 33776, ls) blocked on lockmgr ufsEXCL thread 100017 (pid 0, thread taskq) running on CPU 5 chain 7: thread 100227 (pid 33775, sh) sleeping on 0xfffff80004569530 "wait" chain 8: thread 100392 (pid 32750, lockf) blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00adbb7bb0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00adbb7bc0 trap() at trap+0x59/frame 0xfffffe00adbb7cd0 calltrap() at calltrap+0x8/frame 0xfffffe00adbb7cd0 --- trap 0xc, rip = 0xffffffff80cd04af, rsp = 0xfffffe00adbb7da0, rbp = 0xfffffe00adbb7da0 --- strlen() at strlen+0x1f/frame 0xfffffe00adbb7da0 kvprintf() at kvprintf+0xf79/frame 0xfffffe00adbb7ec0 db_printf() at db_printf+0x5d/frame 0xfffffe00adbb7f40 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00adbb7f60 print_lockchain() at print_lockchain+0x89/frame 0xfffffe00adbb7f90 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00adbb7fc0 db_command() at db_command+0x279/frame 0xfffffe00adbb8090 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00adbb8130 db_command() at db_command+0x279/frame 0xfffffe00adbb8200 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00adbb8210 db_trap() at db_trap+0xef/frame 0xfffffe00adbb82a0 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe00adbb8320 trap() at trap+0x80f/frame 0xfffffe00adbb8430 calltrap() at calltrap+0x8/frame 0xfffffe00adbb8430 --- trap 0x3, rip = 0xffffffff80c2185b, rsp = 0xfffffe00adbb8500, rbp = 0xfffffe00adbb8510 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00adbb8510 hardclock() at hardclock+0x1ee/frame 0xfffffe00adbb8560 handleevents() at handleevents+0xc9/frame 0xfffffe00adbb85a0 timercb() at timercb+0x218/frame 0xfffffe00adbb85f0 lapic_handle_timer() at lapic_handle_timer+0xae/frame 0xfffffe00adbb8630 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00adbb8630 --- interrupt, rip = 0xffffffff80cb1ec0, rsp = 0xfffffe00adbb8700, rbp = 0xfffffe00adbb8730 --- __mnt_vnode_next_all() at __mnt_vnode_next_all+0x70/frame 0xfffffe00adbb8730 ffs_sync() at ffs_sync+0x216/frame 0xfffffe00adbb87e0 vfs_write_suspend() at vfs_write_suspend+0x26d/frame 0xfffffe00adbb8870 vfs_write_suspend_umnt() at vfs_write_suspend_umnt+0xc0/frame 0xfffffe00adbb88d0 ffs_unmount() at ffs_unmount+0x77/frame 0xfffffe00adbb8940 dounmount() at dounmount+0x4e0/frame 0xfffffe00adbb89a0 ffs_fsfail_unmount() at ffs_fsfail_unmount+0x59/frame 0xfffffe00adbb89e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00adbb8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00adbb8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00adbb8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adbb8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command '' returned error db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 5 Index: src/sys/fs/devfs/devfs_vnops.c =================================================================== --- src/sys/fs/devfs/devfs_vnops.c (revision 352067) +++ src/sys/fs/devfs/devfs_vnops.c (working copy) @@ -70,6 +70,7 @@ static struct vop_vector devfs_vnodeops; static struct vop_vector devfs_specops; +static struct vop_vector devfs_mntops; static struct fileops devfs_ops_f; #include @@ -96,6 +97,8 @@ static int devfs_dotimes; SYSCTL_INT(_vfs_devfs, OID_AUTO, dotimes, CTLFLAG_RW, &devfs_dotimes, 0, "Update timestamps on DEVFS with default precision"); +static const char devfs_vnode_tag[] = "devfs"; + /* * Update devfs node timestamp. Note that updates are unlocked and * stat(2) could see partially updated times. @@ -476,7 +479,7 @@ loop: } else { dev = NULL; } - error = getnewvnode("devfs", mp, &devfs_vnodeops, &vp); + error = getnewvnode(devfs_vnode_tag, mp, &devfs_vnodeops, &vp); if (error != 0) { devfs_allocv_drop_refs(1, dmp, de); printf("devfs_allocv: failed to allocate new vnode\n"); @@ -1902,6 +1905,77 @@ dev2udev(struct cdev *x) return (cdev2priv(x)->cdp_inode); } + +/* + * Allocate a private VCHR vnode for use by a mounted fs. + * The underlying device will be the same as for the given vnode. + * We keep a reference to the original vnode so we can call VOP_ACCESS(). + */ +struct vnode * +devfs_mntvp_alloc(struct vnode *ovp) +{ + struct mount *mp; + struct vnode *vp; + struct cdev *dev; + + ASSERT_VOP_ELOCKED(ovp, __func__); + + dev = ovp->v_rdev; + mp = ovp->v_mount; + vref(ovp); + + getnewvnode(devfs_vnode_tag, mp, &devfs_mntops, &vp); + vp->v_type = VCHR; + vp->v_data = ovp; + dev_lock(); + dev_refl(dev); + vp->v_rdev = dev; + dev->si_usecount += vp->v_usecount; + dev_unlock(); + + return (vp); +} + +void +devfs_mntvp_free(struct vnode *vp) +{ + + vgone(vp); + vrele(vp); +} + +static int +devfs_access_mntvp(struct vop_access_args *ap) +{ + struct vnode *vp = ap->a_vp; + struct vnode *ovp = vp->v_data; + int error; + + vn_lock(ovp, LK_EXCLUSIVE | LK_RETRY); + error = VOP_ACCESS(ovp, ap->a_accmode, ap->a_cred, ap->a_td); + VOP_UNLOCK(ovp, 0); + return (error); +} + +static int +devfs_reclaim_mntvp(struct vop_reclaim_args *ap) +{ + struct vnode *vp = ap->a_vp; + struct vnode *ovp = vp->v_data; + struct cdev *dev; + + dev_lock(); + dev = vp->v_rdev; + vp->v_rdev = NULL; + vp->v_data = NULL; + dev_unlock(); + + dev_rel(dev); + vnode_destroy_vobject(vp); + vrele(ovp); + return (0); +} + static struct fileops devfs_ops_f = { .fo_read = devfs_read_f, .fo_write = devfs_write_f, @@ -1981,6 +2055,17 @@ static struct vop_vector devfs_specops = { .vop_write = dead_write, }; + +/* Vops for VCHR vnodes being used by a mounted fs. */ +static struct vop_vector devfs_mntops = { + .vop_default = &default_vnodeops, + + .vop_access = devfs_access_mntvp, + .vop_fsync = vop_stdfsync, + .vop_strategy = VOP_PANIC, + .vop_reclaim = devfs_reclaim_mntvp, +}; + /* * Our calling convention to the device drivers used to be that we passed * vnode.h IO_* flags to read()/write(), but we're moving to fcntl.h O_ Index: src/sys/geom/geom_vfs.c =================================================================== --- src/sys/geom/geom_vfs.c (revision 352067) +++ src/sys/geom/geom_vfs.c (working copy) @@ -39,6 +39,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -55,6 +56,8 @@ struct g_vfs_softc { struct bufobj *sc_bo; int sc_active; int sc_orphaned; + int sc_enxio_enable; + int sc_enxio_active; }; static struct buf_ops __g_vfs_bufops = { @@ -77,6 +80,12 @@ static struct g_class g_vfs_class = { DECLARE_GEOM_CLASS(g_vfs_class, g_vfs); +SYSCTL_DECL(_kern_geom); +SYSCTL_NODE(_kern_geom, OID_AUTO, vfs, CTLFLAG_RW, 0, "GEOM_VFS stuff"); +static int g_vfs_enxio_enable; +SYSCTL_INT(_kern_geom_vfs, OID_AUTO, force_enxio, CTLFLAG_RWTUN, + &g_vfs_enxio_enable, 0, "Convert all I/O errors to ENXIO"); + static void g_vfs_destroy(void *arg, int flags __unused) { @@ -139,9 +148,16 @@ g_vfs_done(struct bio *bip) cp = bip->bio_from; sc = cp->geom->softc; - if (bip->bio_error) + if (bip->bio_error) { + mtx_lock(&sc->sc_mtx); + if (sc->sc_enxio_enable) + sc->sc_enxio_active = 1; + mtx_unlock(&sc->sc_mtx); g_print_bio("g_vfs_done():", bip, "error = %d", bip->bio_error); + } + if (sc->sc_enxio_active) + bip->bio_error = ENXIO; bp->b_error = bip->bio_error; bp->b_ioflags = bip->bio_flags; if (bip->bio_error) @@ -172,7 +188,7 @@ g_vfs_strategy(struct bufobj *bo, struct buf *bp) * If the provider has orphaned us, just return ENXIO. */ mtx_lock(&sc->sc_mtx); - if (sc->sc_orphaned) { + if (sc->sc_orphaned || sc->sc_enxio_active) { mtx_unlock(&sc->sc_mtx); bp->b_error = ENXIO; bp->b_ioflags |= BIO_ERROR; @@ -250,6 +266,7 @@ g_vfs_open(struct vnode *vp, struct g_consumer **c sc = g_malloc(sizeof(*sc), M_WAITOK | M_ZERO); mtx_init(&sc->sc_mtx, "g_vfs", NULL, MTX_DEF); sc->sc_bo = bo; + sc->sc_enxio_enable = g_vfs_enxio_enable; gp->softc = sc; cp = g_new_consumer(gp); g_attach(cp, pp); @@ -287,3 +304,35 @@ g_vfs_close(struct g_consumer *cp) g_wither_geom_close(gp, ENXIO); g_free(sc); } + +void +g_vfs_getconf(struct g_consumer *cp, struct g_vfs_conf *confp) +{ + struct g_geom *gp; + struct g_vfs_softc *sc; + + gp = cp->geom; + sc = gp->softc; + + mtx_lock(&sc->sc_mtx); + confp->enxio_active = sc->sc_enxio_active; + confp->enxio_enable = sc->sc_enxio_enable; + mtx_unlock(&sc->sc_mtx); +} + +void +g_vfs_setconf(struct g_consumer *cp, struct g_vfs_conf *confp) +{ + struct g_geom *gp; + struct g_vfs_softc *sc; + + gp = cp->geom; + sc = gp->softc; + + mtx_lock(&sc->sc_mtx); + if (confp->enxio_active != -1) + sc->sc_enxio_active = confp->enxio_active; + if (confp->enxio_enable != -1) + sc->sc_enxio_enable = confp->enxio_enable; + mtx_unlock(&sc->sc_mtx); +} Index: src/sys/geom/geom_vfs.h =================================================================== --- src/sys/geom/geom_vfs.h (revision 352067) +++ src/sys/geom/geom_vfs.h (working copy) @@ -34,6 +34,10 @@ struct vnode; struct bufobj; struct buf; +struct g_vfs_conf { + int enxio_active; + int enxio_enable; +}; extern struct buf_ops *g_vfs_bufops; @@ -40,5 +44,7 @@ extern struct buf_ops *g_vfs_bufops; void g_vfs_strategy(struct bufobj *bo, struct buf *bp); int g_vfs_open(struct vnode *vp, struct g_consumer **cpp, const char *fsname, int wr); void g_vfs_close(struct g_consumer *cp); +void g_vfs_getconf(struct g_consumer *cp, struct g_vfs_conf *confp); +void g_vfs_setconf(struct g_consumer *cp, struct g_vfs_conf *confp); #endif /* _GEOM_GEOM_VFS_H_ */ Index: src/sys/kern/vfs_cluster.c =================================================================== --- src/sys/kern/vfs_cluster.c (revision 352067) +++ src/sys/kern/vfs_cluster.c (working copy) @@ -718,6 +718,14 @@ cluster_write(struct vnode *vp, struct buf *bp, u_ struct cluster_save *buflist; buflist = cluster_collectbufs(vp, bp, gbflags); + if (buflist == NULL) { + /* + * Cluster build failed so just write + * it now. + */ + bawrite(bp); + return; + } endbp = &buflist->bs_children [buflist->bs_nchildren - 1]; if (VOP_REALLOCBLKS(vp, buflist)) { @@ -1056,7 +1064,7 @@ cluster_collectbufs(struct vnode *vp, struct buf * struct cluster_save *buflist; struct buf *bp; daddr_t lbn; - int i, len; + int error, i, j, len; len = vp->v_lastw - vp->v_cstart + 1; buflist = malloc(sizeof(struct buf *) * (len + 1) + sizeof(*buflist), @@ -1064,8 +1072,17 @@ cluster_collectbufs(struct vnode *vp, struct buf * buflist->bs_nchildren = 0; buflist->bs_children = (struct buf **) (buflist + 1); for (lbn = vp->v_cstart, i = 0; i < len; lbn++, i++) { - (void)bread_gb(vp, lbn, last_bp->b_bcount, NOCRED, + error = bread_gb(vp, lbn, last_bp->b_bcount, NOCRED, gbflags, &bp); + if (error != 0) { + /* + * If read fails, write children to expedite cleanup. + */ + for (j = 0; j < i; j++) + bawrite(buflist->bs_children[j]); + free(buflist, M_SEGMENT); + return (NULL); + } buflist->bs_children[i] = bp; if (bp->b_blkno == bp->b_lblkno) VOP_BMAP(vp, bp->b_lblkno, NULL, &bp->b_blkno, Index: src/sys/sys/conf.h =================================================================== --- src/sys/sys/conf.h (revision 352067) +++ src/sys/sys/conf.h (working copy) @@ -310,6 +310,9 @@ void devfs_clear_cdevpriv(void); ino_t devfs_alloc_cdp_inode(void); void devfs_free_cdp_inode(ino_t ino); +struct vnode *devfs_mntvp_alloc(struct vnode *vp); +void devfs_mntvp_free(struct vnode *vp); + #define UID_ROOT 0 #define UID_BIN 3 #define UID_UUCP 66 Index: src/sys/ufs/ffs/ffs_alloc.c =================================================================== --- src/sys/ufs/ffs/ffs_alloc.c (revision 352067) +++ src/sys/ufs/ffs/ffs_alloc.c (working copy) @@ -222,6 +222,10 @@ nospace: softdep_request_cleanup(fs, ITOV(ip), cred, FLUSH_BLOCKS_WAIT); goto retry; } + if (ffs_fsfail_cleanup_locked(ump, 0)) { + UFS_UNLOCK(ump); + return (ENXIO); + } if (reclaimed > 0 && ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); @@ -447,6 +451,12 @@ nospace: softdep_request_cleanup(fs, vp, cred, FLUSH_BLOCKS_WAIT); goto retry; } + if (bp) + brelse(bp); + if (ffs_fsfail_cleanup_locked(ump, 0)) { + UFS_UNLOCK(ump); + return (ENXIO); + } if (reclaimed > 0 && ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); @@ -456,8 +466,6 @@ nospace: } else { UFS_UNLOCK(ump); } - if (bp) - brelse(bp); return (ENOSPC); } @@ -1101,7 +1109,7 @@ ffs_valloc(pvp, mode, cred, vpp) struct ufsmount *ump; ino_t ino, ipref; u_int cg; - int error, error1, reclaimed; + int error, reclaimed; *vpp = NULL; pip = VTOI(pvp); @@ -1136,28 +1144,21 @@ retry: (allocfcn_t *)ffs_nodealloccg); if (ino == 0) goto noinodes; - /* * Get rid of the cached old vnode, force allocation of a new vnode - * for this inode. + * for this inode. If this fails, release the allocated ino and + * return the error. */ - error = ffs_vgetf(pvp->v_mount, ino, LK_EXCLUSIVE, vpp, FFSV_REPLACE); - if (error) { - error1 = ffs_vgetf(pvp->v_mount, ino, LK_EXCLUSIVE, vpp, - FFSV_FORCEINSMQ | FFSV_REPLACE); + if ((error = ffs_vgetf(pvp->v_mount, ino, LK_EXCLUSIVE, vpp, + FFSV_FORCEINSMQ | FFSV_REPLACE)) != 0) { ffs_vfree(pvp, ino, mode); - if (error1 == 0) { - ip = VTOI(*vpp); - if (ip->i_mode) - goto dup_alloc; - ip->i_flag |= IN_MODIFIED; - vput(*vpp); - } return (error); } + /* + * We got an inode, so check mode and panic if it is already allocated. + */ ip = VTOI(*vpp); if (ip->i_mode) { -dup_alloc: printf("mode = 0%o, inum = %ju, fs = %s\n", ip->i_mode, (uintmax_t)ip->i_number, fs->fs_fsmnt); panic("ffs_valloc: dup alloc"); @@ -1196,6 +1197,10 @@ noinodes: softdep_request_cleanup(fs, pvp, cred, FLUSH_INODES_WAIT); goto retry; } + if (ffs_fsfail_cleanup_locked(ump, 0)) { + UFS_UNLOCK(ump); + return (ENXIO); + } if (ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); ffs_fserr(fs, pip->i_number, "out of inodes"); @@ -2261,8 +2266,25 @@ ffs_blkfree_cg(ump, fs, devvp, bno, size, inum, de ffs_fserr(fs, inum, "bad block"); return; } - if ((error = ffs_getcg(fs, devvp, cg, &bp, &cgp)) != 0) + if ((error = ffs_getcg(fs, devvp, cg, &bp, &cgp)) != 0) { + if (!ffs_fsfail_cleanup(ump, error) || + !MOUNTEDSOFTDEP(UFSTOVFS(ump)) || devvp->v_type != VCHR) + return; + error = getblkx(devvp, devvp->v_type == VREG ? + fragstoblks(fs, cgtod(fs, cg)) : fsbtodb(fs, cgtod(fs, cg)), + (int) fs->fs_cgsize, 0, 0, 0, &bp); + if (error != 0) { + printf("%s: unexpected error %d from getblkx\n", + __func__, error); + return; + } + softdep_setup_blkfree(UFSTOVFS(ump), bp, bno, + numfrags(fs, size), dephd); + bp->b_flags |= B_RELBUF | B_NOCACHE; + bp->b_flags &= ~B_CACHE; + bawrite(bp); return; + } cgbno = dtogd(fs, bno); blksfree = cg_blksfree(cgp); UFS_LOCK(ump); @@ -2802,8 +2824,25 @@ ffs_freefile(ump, fs, devvp, ino, mode, wkhd) if (ino >= fs->fs_ipg * fs->fs_ncg) panic("ffs_freefile: range: dev = %s, ino = %ju, fs = %s", devtoname(dev), (uintmax_t)ino, fs->fs_fsmnt); - if ((error = ffs_getcg(fs, devvp, cg, &bp, &cgp)) != 0) + if ((error = ffs_getcg(fs, devvp, cg, &bp, &cgp)) != 0) { + if (!ffs_fsfail_cleanup(ump, error) || + !MOUNTEDSOFTDEP(UFSTOVFS(ump)) || devvp->v_type != VCHR) + return (error); + error = getblkx(devvp, devvp->v_type == VREG ? + fragstoblks(fs, cgtod(fs, cg)) : fsbtodb(fs, cgtod(fs, cg)), + (int) fs->fs_cgsize, 0, 0, 0, &bp); + if (error != 0) { + printf("%s: unexpected error %d from getblkx\n", + __func__, error); + return (error); + } + softdep_setup_inofree(UFSTOVFS(ump), bp, + ino + cg * fs->fs_ipg, wkhd); + bp->b_flags |= B_RELBUF | B_NOCACHE; + bp->b_flags &= ~B_CACHE; + bawrite(bp); return (error); + } inosused = cg_inosused(cgp); ino %= fs->fs_ipg; if (isclr(inosused, ino)) { Index: src/sys/ufs/ffs/ffs_balloc.c =================================================================== --- src/sys/ufs/ffs/ffs_balloc.c (revision 352067) +++ src/sys/ufs/ffs/ffs_balloc.c (working copy) @@ -324,7 +324,8 @@ retry: UFS_UNLOCK(ump); goto retry; } - if (ppsratecheck(&ump->um_last_fullmsg, + if (!ffs_fsfail_cleanup_locked(ump, error) && + ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); ffs_fserr(fs, ip->i_number, "filesystem full"); @@ -407,7 +408,8 @@ retry: UFS_UNLOCK(ump); goto retry; } - if (ppsratecheck(&ump->um_last_fullmsg, + if (!ffs_fsfail_cleanup_locked(ump, error) && + ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); ffs_fserr(fs, ip->i_number, "filesystem full"); @@ -919,7 +921,8 @@ retry: UFS_UNLOCK(ump); goto retry; } - if (ppsratecheck(&ump->um_last_fullmsg, + if (!ffs_fsfail_cleanup_locked(ump, error) && + ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); ffs_fserr(fs, ip->i_number, "filesystem full"); @@ -1003,7 +1006,8 @@ retry: UFS_UNLOCK(ump); goto retry; } - if (ppsratecheck(&ump->um_last_fullmsg, + if (!ffs_fsfail_cleanup_locked(ump, error) && + ppsratecheck(&ump->um_last_fullmsg, &ump->um_secs_fullmsg, 1)) { UFS_UNLOCK(ump); ffs_fserr(fs, ip->i_number, "filesystem full"); Index: src/sys/ufs/ffs/ffs_extern.h =================================================================== --- src/sys/ufs/ffs/ffs_extern.h (revision 352067) +++ src/sys/ufs/ffs/ffs_extern.h (working copy) @@ -116,6 +116,11 @@ int ffs_vfree(struct vnode *, ino_t, int); vfs_vget_t ffs_vget; int ffs_vgetf(struct mount *, ino_t, int, struct vnode **, int); void process_deferred_inactive(struct mount *mp); +int ffs_fsfail_cleanup(struct ufsmount *, int); +int ffs_fsfail_cleanup_locked(struct ufsmount *, int); +int ffs_breadz(struct ufsmount *, struct vnode *, daddr_t, int, daddr_t *, + int *, int, struct ucred *, int, void (*)(struct buf *), + struct buf **); /* * Flags to ffs_vgetf @@ -162,6 +167,7 @@ void softdep_uninitialize(void); int softdep_mount(struct vnode *, struct mount *, struct fs *, struct ucred *); void softdep_unmount(struct mount *); +void softdep_handle_error(struct buf *); int softdep_move_dependencies(struct buf *, struct buf *); int softdep_flushworklist(struct mount *, int *, struct thread *); int softdep_flushfiles(struct mount *, int, struct thread *); Index: src/sys/ufs/ffs/ffs_inode.c =================================================================== --- src/sys/ufs/ffs/ffs_inode.c (revision 352067) +++ src/sys/ufs/ffs/ffs_inode.c (working copy) @@ -112,9 +112,9 @@ ffs_update(vp, waitfor) if (IS_SNAPSHOT(ip)) flags = GB_LOCK_NOWAIT; loop: - error = bread_gb(ITODEVVP(ip), + error = ffs_breadz(VFSTOUFS(vp->v_mount), ITODEVVP(ip), fsbtodb(fs, ino_to_fsba(fs, ip->i_number)), - (int) fs->fs_bsize, NOCRED, flags, &bp); + (int) fs->fs_bsize, NULL, NULL, 0, NOCRED, flags, NULL, &bp); if (error != 0) { if (error != EBUSY) return (error); @@ -163,9 +163,11 @@ loop: */ random_harvest_queue(&(ip->i_din2), sizeof(ip->i_din2), RANDOM_FS_ATIME); } - if (waitfor) + if (waitfor) { error = bwrite(bp); - else if (vm_page_count_severe() || buf_dirty_count_severe()) { + if (ffs_fsfail_cleanup(VFSTOUFS(vp->v_mount), error)) + error = 0; + } else if (vm_page_count_severe() || buf_dirty_count_severe()) { bawrite(bp); error = 0; } else { @@ -442,7 +444,10 @@ ffs_truncate(vp, length, flags, cred) if (DOINGSOFTDEP(vp) && lbn < UFS_NDADDR && fragroundup(fs, blkoff(fs, length)) < fs->fs_bsize && (error = ffs_syncvnode(vp, MNT_WAIT, 0)) != 0) +{ +printf("CHUQ ffs_syncvnode -> %d\n", error); return (error); +} ip->i_size = length; DIP_SET(ip, i_size, length); size = blksize(fs, ip, lbn); Index: src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- src/sys/ufs/ffs/ffs_softdep.c (revision 352067) +++ src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -6695,8 +6695,9 @@ softdep_journal_freeblocks(ip, cred, length, flags */ ufs_itimes(vp); ip->i_flag &= ~(IN_LAZYACCESS | IN_LAZYMOD | IN_MODIFIED); - error = bread(ump->um_devvp, fsbtodb(fs, ino_to_fsba(fs, ip->i_number)), - (int)fs->fs_bsize, cred, &bp); + error = ffs_breadz(ump, ump->um_devvp, + fsbtodb(fs, ino_to_fsba(fs, ip->i_number)), + (int)fs->fs_bsize, NULL, NULL, 0, cred, 0, NULL, &bp); if (error) { softdep_error("softdep_journal_freeblocks", error); return; @@ -6797,13 +6798,13 @@ softdep_journal_freeblocks(ip, cred, length, flags */ size = sblksize(fs, length, lastlbn); error = bread(vp, lastlbn, size, cred, &bp); - if (error) { + if (error == 0) { + bzero((char *)bp->b_data + lastoff, size - lastoff); + bawrite(bp); + } else if (!ffs_fsfail_cleanup(ump, error)) { softdep_error("softdep_journal_freeblks", error); return; } - bzero((char *)bp->b_data + lastoff, size - lastoff); - bawrite(bp); - } ACQUIRE_LOCK(ump); inodedep_lookup(mp, ip->i_number, DEPALLOC, &inodedep); @@ -6914,8 +6915,8 @@ softdep_setup_freeblocks(ip, length, flags) if ((error = bread(ump->um_devvp, fsbtodb(fs, ino_to_fsba(fs, ip->i_number)), (int)fs->fs_bsize, NOCRED, &bp)) != 0) { - brelse(bp); - softdep_error("softdep_setup_freeblocks", error); + if (!ffs_fsfail_cleanup(ump, error)) + softdep_error("softdep_setup_freeblocks", error); return; } freeblks = newfreeblks(mp, ip); @@ -8128,7 +8129,7 @@ indir_trunc(freework, dbn, lbn) ufs_lbn_t lbnadd, nlbn; u_long key; int nblocks, ufs1fmt, freedblocks; - int goingaway, freedeps, needj, level, cnt, i; + int goingaway, freedeps, needj, level, cnt, i, error; freeblks = freework->fw_freeblks; mp = freeblks->fb_list.wk_mp; @@ -8166,10 +8167,11 @@ indir_trunc(freework, dbn, lbn) if (indirdep == NULL || (indirdep->ir_state & GOINGAWAY) == 0) panic("indir_trunc: Bad indirdep %p from buf %p", indirdep, bp); - } else if (bread(freeblks->fb_devvp, dbn, (int)fs->fs_bsize, - NOCRED, &bp) != 0) { - brelse(bp); - return; + } else { + error = ffs_breadz(ump, freeblks->fb_devvp, dbn, + (int)fs->fs_bsize, NULL, NULL, 0, NOCRED, 0, NULL, &bp); + if (error) + return; } ACQUIRE_LOCK(ump); /* Protects against a race with complete_trunc_indir(). */ @@ -9710,11 +9712,10 @@ clear_unlinked_inodedep(inodedep) bp = getblk(ump->um_devvp, btodb(fs->fs_sblockloc), (int)fs->fs_sbsize, 0, 0, 0); } else { - error = bread(ump->um_devvp, + error = ffs_breadz(ump, ump->um_devvp, fsbtodb(fs, ino_to_fsba(fs, pino)), - (int)fs->fs_bsize, NOCRED, &bp); - if (error) - brelse(bp); + (int)fs->fs_bsize, NULL, NULL, 0, NOCRED, 0, NULL, + &bp); } ACQUIRE_LOCK(ump); if (error) @@ -10513,7 +10514,8 @@ initiate_write_inodeblock_ufs2(inodedep, bp) if ((adp->ad_state & ATTACHED) == 0) panic("inodedep %p and adp %p not attached", inodedep, adp); prevlbn = adp->ad_offset; - if (adp->ad_offset < UFS_NDADDR && + if (!ffs_fsfail_cleanup(ump, 0) && + adp->ad_offset < UFS_NDADDR && dp->di_db[adp->ad_offset] != adp->ad_newblkno) panic("initiate_write_inodeblock_ufs2: " "direct pointer #%jd mismatch %jd != %jd", @@ -10520,7 +10522,8 @@ initiate_write_inodeblock_ufs2(inodedep, bp) (intmax_t)adp->ad_offset, (intmax_t)dp->di_db[adp->ad_offset], (intmax_t)adp->ad_newblkno); - if (adp->ad_offset >= UFS_NDADDR && + if (!ffs_fsfail_cleanup(ump, 0) && + adp->ad_offset >= UFS_NDADDR && dp->di_ib[adp->ad_offset - UFS_NDADDR] != adp->ad_newblkno) panic("initiate_write_inodeblock_ufs2: " "indirect pointer #%jd mismatch %jd != %jd", @@ -10750,12 +10753,14 @@ softdep_setup_inofree(mp, bp, ino, wkhd) ("softdep_setup_inofree called on non-softdep filesystem")); ump = VFSTOUFS(mp); ACQUIRE_LOCK(ump); - fs = ump->um_fs; - cgp = (struct cg *)bp->b_data; - inosused = cg_inosused(cgp); - if (isset(inosused, ino % fs->fs_ipg)) - panic("softdep_setup_inofree: inode %ju not freed.", - (uintmax_t)ino); + if (!ffs_fsfail_cleanup(ump, 0)) { + fs = ump->um_fs; + cgp = (struct cg *)bp->b_data; + inosused = cg_inosused(cgp); + if (isset(inosused, ino % fs->fs_ipg)) + panic("softdep_setup_inofree: inode %ju not freed.", + (uintmax_t)ino); + } if (inodedep_lookup(mp, ino, 0, &inodedep)) panic("softdep_setup_inofree: ino %ju has existing inodedep %p", (uintmax_t)ino, inodedep); @@ -11025,6 +11030,26 @@ initiate_write_bmsafemap(bmsafemap, bp) wk_list); } +void +softdep_handle_error(struct buf *bp) +{ + struct ufsmount *ump; + + ump = softdep_bp_to_mp(bp); + if (ump == NULL) + return; + + if (ffs_fsfail_cleanup(ump, bp->b_error)) { + /* + * No future writes will succeed, so the on-disk image is safe. + * Pretend that this write succeeded so that the softdep state + * will be cleaned up naturally. + */ + bp->b_ioflags &= ~BIO_ERROR; + bp->b_error = 0; + } +} + /* * This routine is called during the completion interrupt * service routine for a disk write (from the procedure called @@ -11051,6 +11076,8 @@ softdep_disk_write_complete(bp) "with outstanding dependencies for buffer %p", bp)); if (ump == NULL) return; + if ((bp->b_ioflags & BIO_ERROR) != 0) + softdep_handle_error(bp); /* * If an error occurred while doing the write, then the data * has not hit the disk and the dependencies cannot be processed. @@ -12573,7 +12600,7 @@ restart: else brelse(bp); vput(pvp); - if (error != 0) + if (!ffs_fsfail_cleanup(ump, error)) return (error); ACQUIRE_LOCK(ump); if (inodedep_lookup(mp, ip->i_number, 0, &inodedep) == 0) @@ -12851,6 +12878,7 @@ top: &pagedep->pd_diraddhd[i]))) { BUF_NOREC(bp); goto out_unlock; + } } BUF_NOREC(bp); @@ -13403,9 +13431,9 @@ softdep_request_cleanup(fs, vp, cred, resource) roundup((fs->fs_dsize * fs->fs_minfree / 100) - fs->fs_cstotal.cs_nffree, fs->fs_frag)); } else { - UFS_LOCK(ump); printf("softdep_request_cleanup: Unknown resource type %d\n", resource); + UFS_LOCK(ump); return (0); } starttime = time_second; Index: src/sys/ufs/ffs/ffs_subr.c =================================================================== --- src/sys/ufs/ffs/ffs_subr.c (revision 352067) +++ src/sys/ufs/ffs/ffs_subr.c (working copy) @@ -67,6 +67,8 @@ struct malloc_type; #include #include #include +#include +#include #include #include @@ -136,7 +138,8 @@ ffs_load_inode(struct buf *bp, struct inode *ip, s return (0); } dip2 = ((struct ufs2_dinode *)bp->b_data + ino_to_fsbo(fs, ino)); - if ((error = ffs_verify_dinode_ckhash(fs, dip2)) != 0) { + if ((error = ffs_verify_dinode_ckhash(fs, dip2)) != 0 && + !ffs_fsfail_cleanup(ITOUMP(ip), error)) { printf("%s: inode %jd: check-hash failed\n", fs->fs_fsmnt, (intmax_t)ino); return (error); @@ -202,6 +205,96 @@ ffs_check_blkno(struct mount *mp, ino_t inum, ufs2 UFS_UNLOCK(ump); return (EINTEGRITY); } + +/* + * Initiate a forcible unmount. + * Used to unmount filesystems whose underlying media has gone away. + */ +static void +ffs_fsfail_unmount(void *v, int pending) +{ + struct fsfail_task *etp; + struct mount *mp; + int error; + + etp = v; + + /* + * Find our mount and get a ref on it, then try to unmount. + */ + do { + mp = vfs_getvfs(&etp->fsid); + if (mp == NULL) + break; + error = dounmount(mp, MNT_FORCE, curthread); + } while (error != 0); + free(etp, M_UFSMNT); +} + +/* + * On first ENXIO error, start a task that forcibly unmounts the filesystem. + * + * Return true if a cleanup is in progress. + */ +int +ffs_fsfail_cleanup(struct ufsmount *ump, int error) +{ + int retval; + + UFS_LOCK(ump); + retval = ffs_fsfail_cleanup_locked(ump, error); + UFS_UNLOCK(ump); + return (retval); +} + +int +ffs_fsfail_cleanup_locked(struct ufsmount *ump, int error) +{ + struct fsfail_task *etp; + struct task *tp; + + mtx_assert(UFS_MTX(ump), MA_OWNED); + if (error == ENXIO && (ump->um_flags & UM_FSFAIL_CLEANUP) == 0) { + ump->um_flags |= UM_FSFAIL_CLEANUP; + /* + * Queue an async forced unmount. + */ + etp = ump->um_fsfail_task; + ump->um_fsfail_task = NULL; + if (etp != NULL) { + tp = &etp->task; + TASK_INIT(tp, 0, ffs_fsfail_unmount, etp); + taskqueue_enqueue(taskqueue_thread, tp); + } + } + return ((ump->um_flags & UM_FSFAIL_CLEANUP) != 0); +} + +/* + * Wrapper used during ENXIO cleanup to allocate empty buffers when + * the kernel is unable to read the real one. They are needed so that + * the soft updates code can use them to unwind its dependencies. + */ +int +ffs_breadz(struct ufsmount *ump, struct vnode *vp, daddr_t blkno, int size, + daddr_t *rablkno, int *rabsize, int cnt, struct ucred *cred, int flags, + void (*ckhashfunc)(struct buf *), struct buf **bpp) +{ + int error; + + error = breadn_flags(vp, blkno, size, rablkno, rabsize, cnt, cred, + flags, ckhashfunc, bpp); + if (error != 0 && ffs_fsfail_cleanup(ump, error)) { + error = getblkx(vp, blkno, size, 0, 0, flags, bpp); + if (error != 0) { + printf("%s: unexpected error %d from getblkx\n", + __func__, error); + return ENXIO; + } + bzero((*bpp)->b_data, size); + } + return error; +} #endif /* _KERNEL */ /* Index: src/sys/ufs/ffs/ffs_vfsops.c =================================================================== --- src/sys/ufs/ffs/ffs_vfsops.c (revision 352067) +++ src/sys/ufs/ffs/ffs_vfsops.c (working copy) @@ -58,6 +58,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -147,6 +148,12 @@ static const char *ffs_opts[] = { "acls", "async", "multilabel", "nfsv4acls", "fsckpid", "snapshot", "nosuid", "suiddir", "nosymfollow", "sync", "union", "userquota", "untrusted", NULL }; +static int ffs_enxio_enable_default; +SYSCTL_DECL(_vfs_ffs); +SYSCTL_INT(_vfs_ffs, OID_AUTO, enxio_enable_default, CTLFLAG_RW, + &ffs_enxio_enable_default, 0, + "enable mapping of disk I/O errors to ENXIO by default"); + static int ffs_mount(struct mount *mp) { @@ -781,8 +788,8 @@ loop: * Common code for mount and mountroot */ static int -ffs_mountfs(devvp, mp, td) - struct vnode *devvp; +ffs_mountfs(odevvp, mp, td) + struct vnode *odevvp; struct mount *mp; struct thread *td; { @@ -792,7 +799,10 @@ static int int error, i, len, ronly; struct ucred *cred; struct g_consumer *cp; + struct g_vfs_conf gvconf; struct mount *nmp; + struct vnode *devvp; + struct fsfail_task *etp; int candelete; off_t loc; @@ -801,11 +811,13 @@ static int cred = td ? td->td_ucred : NOCRED; ronly = (mp->mnt_flag & MNT_RDONLY) != 0; + devvp = devfs_mntvp_alloc(odevvp); + VOP_UNLOCK(odevvp, 0); KASSERT(devvp->v_type == VCHR, ("reclaimed devvp")); dev = devvp->v_rdev; if (atomic_cmpset_acq_ptr((uintptr_t *)&dev->si_mountpt, 0, (uintptr_t)mp) == 0) { - VOP_UNLOCK(devvp, 0); + devfs_mntvp_free(devvp); return (EBUSY); } g_topology_lock(); @@ -813,12 +825,14 @@ static int g_topology_unlock(); if (error != 0) { atomic_store_rel_ptr((uintptr_t *)&dev->si_mountpt, 0); - VOP_UNLOCK(devvp, 0); + devfs_mntvp_free(devvp); return (error); } + gvconf.enxio_active = 0; + gvconf.enxio_enable = ffs_enxio_enable_default; + g_vfs_setconf(cp, &gvconf); dev_ref(dev); devvp->v_bufobj.bo_ops = &ffs_ops; - VOP_UNLOCK(devvp, 0); if (dev->si_iosize_max != 0) mp->mnt_iosize_max = dev->si_iosize_max; if (mp->mnt_iosize_max > MAXPHYS) @@ -1072,6 +1086,9 @@ static int (void) ufs_extattr_autostart(mp, td); #endif /* !UFS_EXTATTR_AUTOSTART */ #endif /* !UFS_EXTATTR */ + etp = malloc(sizeof *ump->um_fsfail_task, M_UFSMNT, M_WAITOK | M_ZERO); + etp->fsid = mp->mnt_stat.f_fsid; + ump->um_fsfail_task = etp; return (0); out: if (fs != NULL) { @@ -1093,6 +1110,7 @@ out: mp->mnt_data = NULL; } atomic_store_rel_ptr((uintptr_t *)&dev->si_mountpt, 0); + devfs_mntvp_free(devvp); dev_rel(dev); return (error); } @@ -1117,7 +1135,6 @@ ffs_use_bread(void *devfd, off_t loc, void **bufp, return (0); } -#include static int bigcgs = 0; SYSCTL_INT(_debug, OID_AUTO, bigcgs, CTLFLAG_RW, &bigcgs, 0, ""); @@ -1222,7 +1239,7 @@ ffs_unmount(mp, mntflags) struct thread *td; struct ufsmount *ump = VFSTOUFS(mp); struct fs *fs; - int error, flags, susp; + int error, flags; #ifdef UFS_EXTATTR int e_restart; #endif @@ -1230,10 +1247,8 @@ ffs_unmount(mp, mntflags) flags = 0; td = curthread; fs = ump->um_fs; - susp = 0; if (mntflags & MNT_FORCE) { flags |= FORCECLOSE; - susp = fs->fs_ronly == 0; } #ifdef UFS_EXTATTR if ((error = ufs_extattr_stop(mp, td))) { @@ -1247,16 +1262,14 @@ ffs_unmount(mp, mntflags) e_restart = 1; } #endif - if (susp) { - error = vfs_write_suspend_umnt(mp); - if (error != 0) - goto fail1; - } + error = vfs_write_suspend_umnt(mp); + if (error != 0) + goto fail1; if (MOUNTEDSOFTDEP(mp)) error = softdep_flushfiles(mp, flags, td); else error = ffs_flushfiles(mp, flags, td); - if (error != 0 && error != ENXIO) + if (error != 0 && !ffs_fsfail_cleanup(ump, error)) goto fail; UFS_LOCK(ump); @@ -1273,13 +1286,14 @@ ffs_unmount(mp, mntflags) if (fs->fs_ronly == 0 || ump->um_fsckpid > 0) { fs->fs_clean = fs->fs_flags & (FS_UNCLEAN|FS_NEEDSFSCK) ? 0 : 1; error = ffs_sbupdate(ump, MNT_WAIT, 0); - if (error && error != ENXIO) { + if (ffs_fsfail_cleanup(ump, error)) + error = 0; + if (error != 0 && !ffs_fsfail_cleanup(ump, error)) { fs->fs_clean = 0; goto fail; } } - if (susp) - vfs_write_resume(mp, VR_START_WRITE); + vfs_write_resume(mp, VR_START_WRITE); if (ump->um_trim_tq != NULL) { while (ump->um_trim_inflight != 0) pause("ufsutr", hz); @@ -1298,7 +1312,7 @@ ffs_unmount(mp, mntflags) g_vfs_close(ump->um_cp); g_topology_unlock(); atomic_store_rel_ptr((uintptr_t *)&ump->um_dev->si_mountpt, 0); - vrele(ump->um_devvp); + devfs_mntvp_free(ump->um_devvp); dev_rel(ump->um_dev); mtx_destroy(UFS_MTX(ump)); if (mp->mnt_gjprovider != NULL) { @@ -1307,6 +1321,8 @@ ffs_unmount(mp, mntflags) } free(fs->fs_csp, M_UFSMNT); free(fs, M_UFSMNT); + if (ump->um_fsfail_task != NULL) + free(ump->um_fsfail_task, M_UFSMNT); free(ump, M_UFSMNT); mp->mnt_data = NULL; MNT_ILOCK(mp); @@ -1319,8 +1335,7 @@ ffs_unmount(mp, mntflags) return (error); fail: - if (susp) - vfs_write_resume(mp, VR_START_WRITE); + vfs_write_resume(mp, VR_START_WRITE); fail1: #ifdef UFS_EXTATTR if (e_restart) { @@ -1599,6 +1614,8 @@ loop: if (waitfor == MNT_WAIT || rebooting) { if ((error = softdep_flushworklist(ump->um_mountp, &count, td))) allerror = error; + if (ffs_fsfail_cleanup(ump, allerror)) + allerror = 0; /* Flushed work items may create new vnodes to clean */ if (allerror == 0 && count) goto loop; @@ -1619,6 +1636,8 @@ loop: error = ffs_sbupdate(ump, waitfor, 0); if (error != 0) allerror = error; + if (ffs_fsfail_cleanup(ump, allerror)) + allerror = 0; if (allerror == 0 && waitfor == MNT_WAIT) goto loop; } else if (suspend != 0) { @@ -1643,6 +1662,8 @@ loop: if (fs->fs_fmod != 0 && (error = ffs_sbupdate(ump, waitfor, suspended)) != 0) allerror = error; + if (ffs_fsfail_cleanup(ump, allerror)) + allerror = 0; return (allerror); } @@ -1758,9 +1779,10 @@ ffs_vgetf(mp, ino, flags, vpp, ffs_flags) } /* Read in the disk contents for the inode, copy into the inode. */ - error = bread(ump->um_devvp, fsbtodb(fs, ino_to_fsba(fs, ino)), - (int)fs->fs_bsize, NOCRED, &bp); - if (error) { + error = ffs_breadz(ump, ump->um_devvp, + fsbtodb(fs, ino_to_fsba(fs, ino)), (int)fs->fs_bsize, NULL, NULL, 0, + NOCRED, 0, NULL, &bp); + if (error != 0) { /* * The inode does not contain anything useful, so it would * be misleading to leave it on its hash chain. With mode @@ -2070,6 +2092,11 @@ ffs_backgroundwritedone(struct buf *bp) struct bufobj *bufobj; struct buf *origbp; +#ifdef SOFTUPDATES + if (!LIST_EMPTY(&bp->b_dep) && (bp->b_ioflags & BIO_ERROR) != 0) + softdep_handle_error(bp); +#endif + /* * Find the original buffer that we are writing. */ @@ -2080,7 +2107,7 @@ ffs_backgroundwritedone(struct buf *bp) /* * We should mark the cylinder group buffer origbp as - * dirty, to not loose the failed write. + * dirty, to not lose the failed write. */ if ((bp->b_ioflags & BIO_ERROR) != 0) origbp->b_vflags |= BV_BKGRDERR; Index: src/sys/ufs/ffs/ffs_vnops.c =================================================================== --- src/sys/ufs/ffs/ffs_vnops.c (revision 352067) +++ src/sys/ufs/ffs/ffs_vnops.c (working copy) @@ -220,6 +220,8 @@ retry: } BO_UNLOCK(bo); } + if (ffs_fsfail_cleanup(VFSTOUFS(vp->v_mount), 0)) + return (ENXIO); return (0); } @@ -228,6 +230,7 @@ ffs_syncvnode(struct vnode *vp, int waitfor, int f { struct inode *ip; struct bufobj *bo; + struct ufsmount *ump; struct buf *bp, *nbp; ufs_lbn_t lbn; int error, passes; @@ -236,6 +239,7 @@ ffs_syncvnode(struct vnode *vp, int waitfor, int f ip = VTOI(vp); ip->i_flag &= ~IN_NEEDSYNC; bo = &vp->v_bufobj; + ump = VFSTOUFS(vp->v_mount); /* * When doing MNT_WAIT we must first flush all dependencies @@ -242,8 +246,11 @@ ffs_syncvnode(struct vnode *vp, int waitfor, int f * on the inode. */ if (DOINGSOFTDEP(vp) && waitfor == MNT_WAIT && - (error = softdep_sync_metadata(vp)) != 0) + (error = softdep_sync_metadata(vp)) != 0) { + if (ffs_fsfail_cleanup(ump, error)) + error = 0; return (error); + } /* * Flush all dirty buffers associated with a vnode. @@ -313,7 +320,10 @@ loop: } if (wait) { bremfree(bp); - if ((error = bwrite(bp)) != 0) + error = bwrite(bp); + if (ffs_fsfail_cleanup(ump, error)) + error = 0; + if (error != 0) return (error); } else if ((bp->b_flags & B_CLUSTEROK)) { (void) vfs_bio_awrite(bp); Index: src/sys/ufs/ufs/ufs_vnops.c =================================================================== --- src/sys/ufs/ufs/ufs_vnops.c (revision 352067) +++ src/sys/ufs/ufs/ufs_vnops.c (working copy) @@ -1522,11 +1522,15 @@ unlockout: if (error == 0 && endoff != 0) { error = UFS_TRUNCATE(tdvp, endoff, IO_NORMAL | (DOINGASYNC(tdvp) ? 0 : IO_SYNC), tcnp->cn_cred); - if (error != 0) + if (error != 0) { vn_printf(tdvp, "ufs_rename: failed to truncate, error %d\n", error); #ifdef UFS_DIRHASH + ufsdirhash_free(tdp); +#endif + } +#ifdef UFS_DIRHASH else if (tdp->i_dirhash != NULL) ufsdirhash_dirtrunc(tdp, endoff); #endif @@ -2722,6 +2726,17 @@ ufs_ioctl(struct vop_ioctl_args *ap) } } +static int +ufs_putpages(struct vop_putpages_args *ap) +{ + int error; + + error = vop_stdputpages(ap); + if (ffs_fsfail_cleanup(VFSTOUFS(ap->a_vp->v_mount), error)) + error = ENXIO; + return (error); +} + /* Global vfs data structures for ufs. */ struct vop_vector ufs_vnodeops = { .vop_default = &default_vnodeops, @@ -2746,6 +2761,7 @@ struct vop_vector ufs_vnodeops = { .vop_pathconf = ufs_pathconf, .vop_poll = vop_stdpoll, .vop_print = ufs_print, + .vop_putpages = ufs_putpages, .vop_readdir = ufs_readdir, .vop_readlink = ufs_readlink, .vop_reclaim = ufs_reclaim, Index: src/sys/ufs/ufs/ufsmount.h =================================================================== --- src/sys/ufs/ufs/ufsmount.h (revision 352067) +++ src/sys/ufs/ufs/ufsmount.h (working copy) @@ -45,6 +45,8 @@ struct ufs_args { #ifdef _KERNEL +#include + #ifdef MALLOC_DECLARE MALLOC_DECLARE(M_UFSMNT); MALLOC_DECLARE(M_TRIM); @@ -65,6 +67,10 @@ struct inodedep; TAILQ_HEAD(inodedeplst, inodedep); LIST_HEAD(bmsafemaphd, bmsafemap); LIST_HEAD(trimlist_hashhead, ffs_blkfree_trim_params); +struct fsfail_task { + struct task task; + fsid_t fsid; +}; /* * This structure describes the UFS specific mount structure data. @@ -111,6 +117,7 @@ struct ufsmount { struct taskqueue *um_trim_tq; /* (c) trim request queue */ struct trimlist_hashhead *um_trimhash; /* (i) trimlist hash table */ u_long um_trimlisthashsize; /* (i) trim hash table size-1 */ + struct fsfail_task *um_fsfail_task; /* (i) task for fsfail cleanup*/ /* (c) - below function ptrs */ int (*um_balloc)(struct vnode *, off_t, int, struct ucred *, int, struct buf **); @@ -131,6 +138,8 @@ struct ufsmount { */ #define UM_CANDELETE 0x00000001 /* devvp supports TRIM */ #define UM_WRITESUSPENDED 0x00000002 /* suspension in progress */ +#define UM_FSFAIL_CLEANUP 0x00000004 /* need cleanup after + unrecoverable error */ /* * function prototypes -- Test scenario: wip/force.sh