KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r333863: Sat May 19 07:00:47 CEST 2018 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33175408640 (31638 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads arc4random: no preloaded entropy cache ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 2 10 7 6 11 8 4 3 5 9 Timecounter "TSC-low" frequency 1750037514 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff810c54f0, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues igb0: Using MSIX interrupts with 7 vectors igb0: allocated for 6 tx_queues igb0: allocated for 6 rx_queues igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: attach_pre capping queues at 8 igb1: using 1024 tx descriptors and 1024 rx descriptors igb1: msix_init qsets capped at 8 igb1: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: using 6 rx queues 6 tx queues igb1: Using MSIX interrupts with 7 vectors igb1: allocated for 6 tx_queues igb1: allocated for 6 rx_queues igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec arc4random: no preloaded entropy cache ugen1.1: at usbus1 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0: on usbus1 ugen2.1: at usbus2 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub2: on usbus2 Expensive timeout(9) function: 0xffffffff80483cb0(0xfffffe009c615000) 0.004523954 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: / was not properly dismounted Expensive timeout(9) function: 0xffffffff809f2f70(0xffffffff81af5280) 0.007401043 s random: unblocking device. arc4random: no preloaded entropy cache uhub0: 2 ports with 2 removable, self powered Interface IP-Address Broadcast uhub2: 2 ports with 2 removable, self powered Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 nd6 options=21 media: Ethernet autoselect status: no carrier igb1: flags=8802 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:db nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:db nd6 options=29 media: Ethernet autoselect status: no carrier ums0 on uhub5 ums0: on usbus0 Starting pflogd:ums0: 3 buttons and [Z] coordinates ID=0 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 19 May 07:11:23 ntpdate[529]: no servers can be used, exiting Starting rpcbind. No core dumps found. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 NFS access cache time=60 Starting casperd. Link state changed to up lock order reversal: 1st 0xfffffe0000ea8320 bufwait (bufwait) @ kern/vfs_bio.c:3916 2nd 0xfffff8003aa0c200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80bdf333 at witness_debugger+0x73 #1 0xffffffff80bdf1b4 at witness_checkorder+0xe34 #2 0xffffffff80b7f5a8 at _sx_xlock+0x68 #3 0xffffffff80e8d5ed at ufsdirhash_add+0x4d #4 0xffffffff80e9210f at ufs_direnter+0x49f #5 0xffffffff80e9a6e9 at ufs_mkdir+0x8b9 #6 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #7 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 Clearing /tmp (X related). if_delmulti_locked: detaching ifnet instance 0xfffff80003cc4000 Starting statd. lock order reversal: 1st 0xffffffff81f98bb8 unp_link_rwlock (unp_link_rwlock) @ kern/uipc_usrreq.c:921 2nd 0xfffff80056900500 unp_mtx (unp_mtx) @ kern/uipc_usrreq.c:929 stack backtrace: #0 0xffffffff80bdf333 at witness_debugger+0x73 #1 0xffffffff80bdf1b4 at witness_checkorder+0xe34 #2 0xffffffff80b55c6c at __mtx_lock_flags+0x9c #3 0xffffffff80c1cba1 at uipc_peeraddr+0x71 #4 0xffffffff80c1a51a at kern_getpeername+0xca #5 0xffffffff80c1a6ae at sys_getpeername+0x3e #6 0xffffffff81045f07 at amd64_syscall+0x2a7 #7 0xffffffff81020fcd at fast_syscall_common+0x101 Starting lockd. Updating motd:. Mounting late file systems:. Configuring syscons: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sat May 19 07:11 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root May 19 07:13:03 mercat1 login[776]: ROOT LOGIN (root) ON ttyu1 Last login: Sat May 19 06:27:35 on ttyu1 FreeBSD 12.0-CURRENT (PHO) #0 r333863: Sat May 19 07:00:47 CEST 2018 root@mercat1:~ # vi [?1h=~~~~~~~~~~~~~~~~~~~~~~/tmp/vi.TzjZuB1dHO: new file: line 1:q[?1l> [?1l>root@mercat1:~ # May 19 07:13:10 mercat1 su[788]: pho to root on /dev/pts/0 lock order reversal: 1st 0xfffff8003adf32e0 ufs (ufs) @ kern/vfs_mount.c:1343 2nd 0xfffff8003add3068 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1583 stack backtrace: #0 0xffffffff80bdf333 at witness_debugger+0x73 #1 0xffffffff80bdf1b4 at witness_checkorder+0xe34 #2 0xffffffff80b4b49e at lockmgr_lock_fast_path+0x18e #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80e8695c at ffs_sync+0x2cc #6 0xffffffff80c43215 at dounmount+0x555 #7 0xffffffff80c42c30 at sys_unmount+0x310 #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 20180519 07:13:45 all (1/562): advlock.sh 20180519 07:14:48 all (2/562): pcatch2.sh 20180519 07:14:49 all (3/562): mmap31.sh 20180519 07:16:57 all (4/562): marcus4.sh witness_lock_list_get: witness exhausted freework leak: 4494/4507. newblk leak: 64454/64463. 20180519 07:33:04 all (5/562): truncate5.sh 20180519 07:33:07 all (6/562): newfs2.sh 20180519 07:49:09 all (7/562): umountf5.sh May 19 07:49:20 mercat1 kernel: pid 22248 (creat), uid 0 inumber 385 on /mnt: out of inodes May 19 07:49:23 mercat1 syslogd: last message repeated 2 times May 19 07:49:29 mercat1 kernel: pid 22249 (mkdir), uid 0 inumber 384 on /mnt: out of inodes 20180519 07:50:07 all (8/562): nfs15lockd2.sh 20180519 07:50:18 all (9/562): graid1_3.sh 20180519 07:52:23 all (10/562): snap5-1.sh 20180519 08:03:21 all (11/562): vmstat.sh 20180519 08:04:32 all (12/562): sendfile10.sh 20180519 08:06:35 all (13/562): pthread.sh 20180519 08:06:38 all (14/562): sysctl3.sh freework leak: 561/5068. 20180519 08:17:17 all (15/562): mlockall.sh 20180519 08:17:30 all (16/562): truss2.sh 20180519 08:18:36 all (17/562): radix.sh 20180519 08:18:58 all (18/562): ptrace5.sh 20180519 08:23:59 all (19/562): mmap6.sh 20180519 08:29:02 all (20/562): setuid.sh 20180519 08:29:04 all (21/562): mmap9.sh 20180519 08:29:06 all (22/562): ptrace.sh 20180519 08:29:07 all (23/562): ffs_syncvnode.sh May 19 08:30:05 mercat1 kernel: pid 62938 (rw), uid 2007 inumber 148915 on /mnt: filesystem full May 19 08:30:05 mercat1 kernel: pid 62915 (mkdir), uid 2007 inumber 234841 on /mnt: filesystem full May 19 08:30:05 mercat1 kernel: pid 62932 (creat), uid 2007 inumber 65549 on /mnt: filesystem full May 19 08:31:57 mercat1 kernel: pid 78545 (rw), uid 2007 inumber 199774 on /mnt: filesystem full May 19 08:31:57 mercat1 kernel: pid 78544 (mkdir), uid 2007 inumber 203859 on /mnt: filesystem full May 19 08:31:57 mercat1 kernel: pid 78521 (creat), uid 2007 inumber 216359 on /mnt: filesystem full May 19 08:32:21 mercat1 kernel: pid 78538 (creat), uid 2007 inumber 216400 on /mnt: out of inodes May 19 08:32:38 mercat1 kernel: pid 78530 (creat), uid 2007 inumber 216371 on /mnt: out of inodes May 19 08:32:53 mercat1 kernel: pid 78535 (creat), uid 2007 inumber 216389 on /mnt: out of inodes May 19 08:33:03 mercat1 kernel: pid 78530 (creat), uid 2007 inumber 216371 on /mnt: out of inodes May 19 08:33:13 mercat1 kernel: pid 92733 (mkdir), uid 2007 inumber 140320 on /mnt: filesystem full May 19 08:33:13 mercat1 kernel: pid 92750 (creat), uid 2007 inumber 65549 on /mnt: filesystem full May 19 08:33:13 mercat1 kernel: pid 92727 (rw), uid 2007 inumber 97042 on /mnt: filesystem full May 19 08:33:20 mercat1 kernel: pid 92732 (rw), uid 2007 inumber 166565 on /mnt: filesystem full May 19 08:33:20 mercat1 kernel: pid 92736 (mkdir), uid 2007 inumber 220777 on /mnt: filesystem full May 19 08:33:20 mercat1 kernel: pid 92754 (creat), uid 2007 inumber 65553 on /mnt: filesystem full May 19 08:33:36 mercat1 kernel: pid 92752 (creat), uid 2007 inumber 65550 on /mnt: out of inodes May 19 08:34:00 mercat1 kernel: pid 92756 (creat), uid 2007 inumber 65554 on /mnt: out of inodes May 19 08:34:33 mercat1 kernel: pid 92748 (creat), uid 2007 inumber 65548 on /mnt: out of inodes May 19 08:34:45 mercat1 kernel: pid 92750 (creat), uid 2007 inumber 65549 on /mnt: out of inodes May 19 08:34:56 mercat1 kernel: pid 92752 (creat), uid 2007 inumber 65550 on /mnt: out of inodes May 19 08:35:22 mercat1 kernel: pid 8468 (rw), uid 2007 inumber 229925 on /mnt: filesystem full May 19 08:35:22 mercat1 kernel: pid 8465 (mkdir), uid 2007 inumber 133688 on /mnt: filesystem full May 19 08:37:37 mercat1 kernel: pid 24046 (rw), uid 2007 inumber 225726 on /mnt: filesystem full May 19 08:38:06 mercat1 kernel: pid 24040 (mkdir), uid 2007 inumber 92370 on /mnt: filesystem full May 19 08:38:06 mercat1 kernel: pid 24035 (creat), uid 2007 inumber 196644 on /mnt: filesystem full May 19 08:38:06 mercat1 kernel: pid 24042 (rw), uid 2007 inumber 24361 on /mnt: filesystem full May 19 08:39:14 mercat1 kernel: pid 39656 (mkdir), uid 2007 inumber 236678 on /mnt: filesystem full May 19 08:39:14 mercat1 kernel: pid 39633 (rw), uid 2007 inumber 236763 on /mnt: filesystem full May 19 08:42:55 mercat1 kernel: pid 55254 (mkdir), uid 2007 inumber 108800 on /mnt: filesystem full May 19 08:42:55 mercat1 kernel: pid 55229 (rw), uid 2007 inumber 50452 on /mnt: filesystem full May 19 08:42:55 mercat1 kernel: pid 55235 (creat), uid 2007 inumber 196656 on /mnt: filesystem full May 19 08:44:22 mercat1 kernel: pid 70876 (rw), uid 2007 inumber 112178 on /mnt: filesystem full May 19 08:44:55 mercat1 kernel: pid 70866 (rw), uid 2007 inumber 177828 on /mnt: filesystem full May 19 08:44:55 mercat1 kernel: pid 70871 (creat), uid 2007 inumber 71891 on /mnt: filesystem full May 19 08:46:12 mercat1 kernel: pid 85081 (rw), uid 2007 inumber 218766 on /mnt: filesystem full May 19 08:46:12 mercat1 kernel: pid 85054 (rw), uid 2007 inumber 199097 on /mnt: filesystem full May 19 08:46:12 mercat1 kernel: pid 85062 (mkdir), uid 2007 inumber 196718 on /mnt: filesystem full May 19 08:46:25 mercat1 kernel: pid 85061 (creat), uid 2007 inumber 143874 on /mnt: out of inodes May 19 08:46:48 mercat1 kernel: pid 85075 (creat), uid 2007 inumber 196635 on /mnt: out of inodes May 19 08:47:00 mercat1 kernel: pid 85072 (creat), uid 2007 inumber 196628 on /mnt: out of inodes May 19 08:47:35 mercat1 kernel: pid 822 (rw), uid 2007 inumber 229325 on /mnt: filesystem full May 19 08:47:35 mercat1 kernel: pid 820 (mkdir), uid 2007 inumber 233642 on /mnt: filesystem full May 19 08:47:35 mercat1 kernel: pid 808 (rw), uid 2007 inumber 233361 on /mnt: filesystem full May 19 08:47:48 mercat1 kernel: pid 793 (rw), uid 2007 inumber 177566 on /mnt: filesystem full May 19 08:47:48 mercat1 kernel: pid 800 (mkdir), uid 2007 inumber 224836 on /mnt: filesystem full May 19 08:48:35 mercat1 kernel: pid 819 (rw), uid 2007 inumber 188482 on /mnt: filesystem full May 19 08:48:56 mercat1 kernel: pid 821 (creat), uid 2007 inumber 115316 on /mnt: out of inodes May 19 08:53:17 mercat1 kernel: pid 30622 (mkdir), uid 2007 inumber 66929 on /mnt: filesystem full May 19 08:53:17 mercat1 kernel: pid 30598 (rw), uid 2007 inumber 104724 on /mnt: filesystem full May 19 08:53:17 mercat1 kernel: pid 30605 (creat), uid 2007 inumber 65545 on /mnt: filesystem full May 19 08:53:26 mercat1 kernel: pid 45796 (mkdir), uid 2007 inumber 153921 on /mnt: filesystem full May 19 08:53:26 mercat1 kernel: pid 45775 (rw), uid 2007 inumber 83925 on /mnt: filesystem full May 19 08:55:08 mercat1 kernel: pid 45782 (creat), uid 2007 inumber 65563 on /mnt: out of inodes May 19 08:55:44 mercat1 kernel: pid 60425 (rw), uid 2007 inumber 177637 on /mnt: filesystem full May 19 08:55:44 mercat1 kernel: pid 60417 (mkdir), uid 2007 inumber 214917 on /mnt: filesystem full May 19 08:55:44 mercat1 kernel: pid 60405 (creat), uid 2007 inumber 76965 on /mnt: filesystem full May 19 08:56:07 mercat1 kernel: pid 60416 (creat), uid 2007 inumber 65543 on /mnt: out of inodes May 19 08:56:26 mercat1 kernel: pid 60408 (creat), uid 2007 inumber 65552 on /mnt: out of inodes May 19 08:56:40 mercat1 kernel: pid 60411 (creat), uid 2007 inumber 65544 on /mnt: out of inodes May 19 08:56:54 mercat1 syslogd: last message repeated 1 times May 19 08:57:12 mercat1 kernel: pid 60405 (creat), uid 2007 inumber 76965 on /mnt: out of inodes May 19 08:57:25 mercat1 kernel: pid 76021 (rw), uid 2007 inumber 133785 on /mnt: filesystem full May 19 08:58:27 mercat1 kernel: pid 76019 (rw), uid 2007 inumber 221256 on /mnt: filesystem full May 19 08:58:42 mercat1 kernel: pid 76016 (creat), uid 2007 inumber 131084 on /mnt: out of inodes May 19 08:58:54 mercat1 kernel: pid 76018 (creat), uid 2007 inumber 131090 on /mnt: out of inodes May 19 08:59:12 mercat1 kernel: pid 76024 (creat), uid 2007 inumber 131087 on /mnt: out of inodes 20180519 08:59:21 all (24/562): ptrace6.sh 20180519 09:03:22 all (25/562): pts.sh pts leak: 112/113 20180519 09:18:11 all (26/562): mmap27.sh 20180519 09:20:14 all (27/562): pfl4.sh 20180519 09:31:30 all (28/562): execi386.sh 20180519 09:31:33 all (29/562): snap.sh 20180519 09:31:35 all (30/562): gnop3.sh 20180519 09:31:36 all (31/562): routetbl.sh 20180519 09:31:37 all (32/562): tcp3.sh 20180519 09:32:45 all (33/562): truncate2.sh 20180519 09:34:53 all (34/562): msdos9.sh 20180519 09:34:56 all (35/562): kevent2.sh 20180519 09:34:59 all (36/562): mountu.sh 20180519 09:35:10 all (37/562): nfs3.sh 20180519 09:35:11 all (38/562): symlink3.sh pts leak: 1/114 20180519 09:55:19 all (39/562): mlockall6.sh 20180519 10:05:24 all (40/562): mmap30.sh 20180519 10:05:25 all (41/562): ftruncate2.sh May 19 10:05:27 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 35 on /mnt: filesystem full May 19 10:05:27 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 6 on /mnt: filesystem full May 19 10:05:28 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 116 on /mnt: filesystem full May 19 10:05:28 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 62 on /mnt: filesystem full May 19 10:05:29 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 252 on /mnt: filesystem full May 19 10:05:29 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 120 on /mnt: filesystem full May 19 10:05:31 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 394 on /mnt: filesystem full May 19 10:05:31 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 502 on /mnt: filesystem full May 19 10:05:32 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 176 on /mnt: filesystem full May 19 10:05:32 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 379 on /mnt: filesystem full May 19 10:05:34 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 174 on /mnt: filesystem full May 19 10:05:34 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 277 on /mnt: filesystem full May 19 10:05:35 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 486 on /mnt: filesystem full May 19 10:05:35 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 131 on /mnt: filesystem full May 19 10:05:37 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 259 on /mnt: filesystem full May 19 10:05:37 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 50 on /mnt: filesystem full May 19 10:05:38 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 213 on /mnt: filesystem full May 19 10:05:38 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 329 on /mnt: filesystem full May 19 10:05:40 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 255 on /mnt: filesystem full May 19 10:05:40 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 411 on /mnt: filesystem full May 19 10:05:41 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 58 on /mnt: filesystem full May 19 10:05:41 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 219 on /mnt: filesystem full May 19 10:05:43 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 471 on /mnt: filesystem full May 19 10:05:43 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 348 on /mnt: filesystem full May 19 10:05:44 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 416 on /mnt: filesystem full May 19 10:05:44 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 71 on /mnt: filesystem full May 19 10:05:46 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 135 on /mnt: filesystem full May 19 10:05:46 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 28 on /mnt: filesystem full May 19 10:05:47 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 149 on /mnt: filesystem full May 19 10:05:47 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 237 on /mnt: filesystem full May 19 10:05:49 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 288 on /mnt: filesystem full May 19 10:05:49 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 495 on /mnt: filesystem full May 19 10:05:50 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 456 on /mnt: filesystem full May 19 10:05:50 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 196 on /mnt: filesystem full May 19 10:05:52 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 188 on /mnt: filesystem full May 19 10:05:52 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 275 on /mnt: filesystem full May 19 10:05:53 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 145 on /mnt: filesystem full May 19 10:05:53 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 148 on /mnt: filesystem full May 19 10:05:54 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 201 on /mnt: filesystem full May 19 10:05:55 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 433 on /mnt: filesystem full May 19 10:05:56 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 402 on /mnt: filesystem full May 19 10:05:56 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 61 on /mnt: filesystem full May 19 10:05:57 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 442 on /mnt: filesystem full May 19 10:05:57 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 421 on /mnt: filesystem full May 19 10:05:59 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 45 on /mnt: filesystem full May 19 10:05:59 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 373 on /mnt: filesystem full May 19 10:06:00 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 127 on /mnt: filesystem full May 19 10:06:00 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 288 on /mnt: filesystem full May 19 10:06:01 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 428 on /mnt: filesystem full May 19 10:06:01 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 282 on /mnt: filesystem full May 19 10:06:02 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 33 on /mnt: filesystem full May 19 10:06:02 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 62 on /mnt: filesystem full May 19 10:06:04 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 343 on /mnt: filesystem full May 19 10:06:04 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 273 on /mnt: filesystem full May 19 10:06:06 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 218 on /mnt: filesystem full May 19 10:06:06 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 252 on /mnt: filesystem full May 19 10:06:07 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 327 on /mnt: filesystem full May 19 10:06:07 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 85 on /mnt: filesystem full May 19 10:06:09 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 84 on /mnt: filesystem full May 19 10:06:09 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 375 on /mnt: filesystem full May 19 10:06:10 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 364 on /mnt: filesystem full May 19 10:06:10 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 343 on /mnt: filesystem full May 19 10:06:12 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 372 on /mnt: filesystem full May 19 10:06:12 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 336 on /mnt: filesystem full May 19 10:06:13 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 118 on /mnt: filesystem full May 19 10:06:13 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 72 on /mnt: filesystem full May 19 10:06:14 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 277 on /mnt: filesystem full May 19 10:06:14 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 413 on /mnt: filesystem full May 19 10:06:16 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 176 on /mnt: filesystem full May 19 10:06:16 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 138 on /mnt: filesystem full May 19 10:06:17 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 418 on /mnt: filesystem full May 19 10:06:17 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 473 on /mnt: filesystem full May 19 10:06:19 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 418 on /mnt: filesystem full May 19 10:06:19 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 393 on /mnt: filesystem full May 19 10:06:20 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 394 on /mnt: filesystem full May 19 10:06:20 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 318 on /mnt: filesystem full May 19 10:06:22 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 248 on /mnt: filesystem full May 19 10:06:22 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 108 on /mnt: filesystem full May 19 10:06:23 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 409 on /mnt: filesystem full May 19 10:06:23 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 284 on /mnt: filesystem full May 19 10:06:24 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 115 on /mnt: filesystem full May 19 10:06:24 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 288 on /mnt: filesystem full May 19 10:06:25 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 84 on /mnt: filesystem full May 19 10:06:25 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 378 on /mnt: filesystem full May 19 10:06:27 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 364 on /mnt: filesystem full May 19 10:06:27 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 409 on /mnt: filesystem full May 19 10:06:28 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 232 on /mnt: filesystem full May 19 10:06:29 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 233 on /mnt: filesystem full May 19 10:06:30 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 304 on /mnt: filesystem full May 19 10:06:30 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 479 on /mnt: filesystem full May 19 10:06:32 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 322 on /mnt: filesystem full May 19 10:06:32 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 189 on /mnt: filesystem full May 19 10:06:33 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 138 on /mnt: filesystem full May 19 10:06:33 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 215 on /mnt: filesystem full May 19 10:06:35 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 70 on /mnt: filesystem full May 19 10:06:35 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 102 on /mnt: filesystem full May 19 10:06:36 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 179 on /mnt: filesystem full May 19 10:06:36 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 361 on /mnt: filesystem full May 19 10:06:38 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 239 on /mnt: filesystem full May 19 10:06:38 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 19 on /mnt: filesystem full May 19 10:06:39 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 488 on /mnt: filesystem full May 19 10:06:39 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 351 on /mnt: filesystem full May 19 10:06:41 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 120 on /mnt: filesystem full May 19 10:06:41 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 339 on /mnt: filesystem full May 19 10:06:42 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 338 on /mnt: filesystem full May 19 10:06:42 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 161 on /mnt: filesystem full May 19 10:06:44 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 266 on /mnt: filesystem full May 19 10:06:44 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 294 on /mnt: filesystem full May 19 10:06:45 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 252 on /mnt: filesystem full May 19 10:06:45 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 417 on /mnt: filesystem full May 19 10:06:47 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 455 on /mnt: filesystem full May 19 10:06:47 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 54 on /mnt: filesystem full May 19 10:06:48 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 415 on /mnt: filesystem full May 19 10:06:48 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 134 on /mnt: filesystem full May 19 10:06:50 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 425 on /mnt: filesystem full May 19 10:06:50 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 453 on /mnt: filesystem full May 19 10:06:51 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 388 on /mnt: filesystem full May 19 10:06:51 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 151 on /mnt: filesystem full May 19 10:06:52 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 40 on /mnt: filesystem full May 19 10:06:52 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 465 on /mnt: filesystem full May 19 10:06:54 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 51 on /mnt: filesystem full May 19 10:06:54 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 27 on /mnt: filesystem full May 19 10:06:56 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 265 on /mnt: filesystem full May 19 10:06:56 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 439 on /mnt: filesystem full May 19 10:06:57 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 175 on /mnt: filesystem full May 19 10:06:57 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 280 on /mnt: filesystem full May 19 10:06:59 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 287 on /mnt: filesystem full May 19 10:06:59 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 431 on /mnt: filesystem full May 19 10:07:00 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 390 on /mnt: filesystem full May 19 10:07:00 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 75 on /mnt: filesystem full May 19 10:07:02 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 340 on /mnt: filesystem full May 19 10:07:02 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 398 on /mnt: filesystem full May 19 10:07:03 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 106 on /mnt: filesystem full May 19 10:07:03 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 212 on /mnt: filesystem full May 19 10:07:05 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 390 on /mnt: filesystem full May 19 10:07:05 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 117 on /mnt: filesystem full May 19 10:07:06 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 376 on /mnt: filesystem full May 19 10:07:06 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 215 on /mnt: filesystem full May 19 10:07:08 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 175 on /mnt: filesystem full May 19 10:07:08 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 470 on /mnt: filesystem full May 19 10:07:10 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 135 on /mnt: filesystem full May 19 10:07:10 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 297 on /mnt: filesystem full May 19 10:07:11 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 435 on /mnt: filesystem full May 19 10:07:11 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 321 on /mnt: filesystem full May 19 10:07:12 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 291 on /mnt: filesystem full May 19 10:07:13 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 6 on /mnt: filesystem full May 19 10:07:14 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 83 on /mnt: filesystem full May 19 10:07:14 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 201 on /mnt: filesystem full May 19 10:07:15 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 491 on /mnt: filesystem full May 19 10:07:15 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 132 on /mnt: filesystem full May 19 10:07:17 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 159 on /mnt: filesystem full May 19 10:07:17 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 140 on /mnt: filesystem full May 19 10:07:18 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 226 on /mnt: filesystem full May 19 10:07:18 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 180 on /mnt: filesystem full May 19 10:07:19 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 370 on /mnt: filesystem full May 19 10:07:19 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 263 on /mnt: filesystem full May 19 10:07:21 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 8 on /mnt: filesystem full May 19 10:07:21 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 43 on /mnt: filesystem full May 19 10:07:22 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 232 on /mnt: filesystem full May 19 10:07:22 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 202 on /mnt: filesystem full May 19 10:07:24 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 213 on /mnt: filesystem full May 19 10:07:24 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 191 on /mnt: filesystem full May 19 10:07:25 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 324 on /mnt: filesystem full May 19 10:07:25 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 400 on /mnt: filesystem full May 19 10:07:27 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 141 on /mnt: filesystem full May 19 10:07:27 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 199 on /mnt: filesystem full May 19 10:07:29 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 288 on /mnt: filesystem full May 19 10:07:29 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 303 on /mnt: filesystem full May 19 10:07:30 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 463 on /mnt: filesystem full May 19 10:07:30 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 153 on /mnt: filesystem full May 19 10:07:32 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 345 on /mnt: filesystem full May 19 10:07:32 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 307 on /mnt: filesystem full May 19 10:07:33 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 326 on /mnt: filesystem full May 19 10:07:33 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 13 on /mnt: filesystem full May 19 10:07:34 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 160 on /mnt: filesystem full May 19 10:07:34 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 302 on /mnt: filesystem full May 19 10:07:36 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 361 on /mnt: filesystem full May 19 10:07:36 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 5 on /mnt: filesystem full May 19 10:07:38 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 380 on /mnt: filesystem full May 19 10:07:38 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 264 on /mnt: filesystem full May 19 10:07:39 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 7 on /mnt: filesystem full May 19 10:07:39 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 421 on /mnt: filesystem full May 19 10:07:41 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 204 on /mnt: filesystem full May 19 10:07:41 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 370 on /mnt: filesystem full May 19 10:07:42 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 94 on /mnt: filesystem full May 19 10:07:42 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 60 on /mnt: filesystem full May 19 10:07:43 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 46 on /mnt: filesystem full May 19 10:07:43 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 388 on /mnt: filesystem full May 19 10:07:45 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 377 on /mnt: filesystem full May 19 10:07:45 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 437 on /mnt: filesystem full May 19 10:07:46 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 415 on /mnt: filesystem full May 19 10:07:46 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 113 on /mnt: filesystem full May 19 10:07:48 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 410 on /mnt: filesystem full May 19 10:07:48 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 151 on /mnt: filesystem full May 19 10:07:49 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 104 on /mnt: filesystem full May 19 10:07:49 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 83 on /mnt: filesystem full May 19 10:07:50 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 297 on /mnt: filesystem full May 19 10:07:50 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 223 on /mnt: filesystem full May 19 10:07:52 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 334 on /mnt: filesystem full May 19 10:07:52 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 129 on /mnt: filesystem full May 19 10:07:53 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 308 on /mnt: filesystem full May 19 10:07:53 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 267 on /mnt: filesystem full May 19 10:07:54 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 396 on /mnt: filesystem full May 19 10:07:54 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 70 on /mnt: filesystem full May 19 10:07:56 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 48 on /mnt: filesystem full May 19 10:07:56 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 350 on /mnt: filesystem full May 19 10:07:58 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 261 on /mnt: filesystem full May 19 10:07:58 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 185 on /mnt: filesystem full May 19 10:07:59 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 411 on /mnt: filesystem full May 19 10:07:59 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 232 on /mnt: filesystem full May 19 10:08:01 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 32 on /mnt: filesystem full May 19 10:08:01 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 373 on /mnt: filesystem full May 19 10:08:02 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 39 on /mnt: filesystem full May 19 10:08:02 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 414 on /mnt: filesystem full May 19 10:08:03 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 318 on /mnt: filesystem full May 19 10:08:03 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 120 on /mnt: filesystem full May 19 10:08:05 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 223 on /mnt: filesystem full May 19 10:08:05 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 77 on /mnt: filesystem full May 19 10:08:06 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 58 on /mnt: filesystem full May 19 10:08:06 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 110 on /mnt: filesystem full May 19 10:08:08 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 66 on /mnt: filesystem full May 19 10:08:08 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 449 on /mnt: filesystem full May 19 10:08:09 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 453 on /mnt: filesystem full May 19 10:08:10 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 347 on /mnt: filesystem full May 19 10:08:11 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 193 on /mnt: filesystem full May 19 10:08:11 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 373 on /mnt: filesystem full May 19 10:08:13 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 323 on /mnt: filesystem full May 19 10:08:13 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 80 on /mnt: filesystem full May 19 10:08:14 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 401 on /mnt: filesystem full May 19 10:08:14 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 211 on /mnt: filesystem full May 19 10:08:16 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 201 on /mnt: filesystem full May 19 10:08:16 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 404 on /mnt: filesystem full May 19 10:08:17 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 429 on /mnt: filesystem full May 19 10:08:17 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 375 on /mnt: filesystem full May 19 10:08:19 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 373 on /mnt: filesystem full May 19 10:08:19 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 497 on /mnt: filesystem full May 19 10:08:20 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 192 on /mnt: filesystem full May 19 10:08:20 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 502 on /mnt: filesystem full May 19 10:08:22 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 4 on /mnt: filesystem full May 19 10:08:22 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 463 on /mnt: filesystem full May 19 10:08:23 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 127 on /mnt: filesystem full May 19 10:08:23 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 144 on /mnt: filesystem full May 19 10:08:25 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 76 on /mnt: filesystem full May 19 10:08:25 mercat1 kernel: pid 59694 (ftruncate2), uid 65534 inumber 448 on /mnt: filesystem full 20180519 10:08:30 all (42/562): linger4.sh May 19 10:08:33 mercat1 kernel: pid 84109 (linger4), uid 2007 inumber 37655 on /mnt: out of inodes 20180519 10:08:35 all (43/562): sndstat.sh 20180519 10:08:36 all (44/562): tmpfs3.sh 20180519 10:18:54 all (45/562): tmpfs.sh 20180519 10:29:22 all (46/562): suj2.sh 20180519 10:29:23 all (47/562): tmpfs2.sh 20180519 10:33:14 all (48/562): udp.sh 20180519 10:33:17 all (49/562): 1st.sh 20180519 10:33:18 all (50/562): fdatasync.sh 20180519 10:36:22 all (51/562): tmpfs16.sh 20180519 10:39:23 all (52/562): pthread4.sh 20180519 10:42:21 all (53/562): rename12.sh 20180519 10:45:42 all (54/562): contigmalloc2.sh 20180519 10:45:46 all (55/562): schedfuzz.sh 20180519 10:45:47 all (56/562): link.sh 20180519 10:50:30 all (57/562): crossmp8.sh 20180519 10:51:32 all (58/562): tmpfs7.sh 20180519 10:51:36 all (59/562): nullfs17.sh 20180519 10:56:37 all (60/562): rename4.sh 20180519 10:56:38 all (61/562): pmc2.sh 20180519 11:06:40 all (62/562): kevent6.sh 20180519 11:07:00 all (63/562): snap11.sh panic: handle_written_inodeblock: not started cpuid = 2 time = 1526720890 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1a3/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- KDB: enter: panic [ thread pid 42728 tid 100598 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 42728 tid 100598 td 0xfffff8021ff01580 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0xc377c0 curthread = 0xfffff8020f106580: pid 42693 tid 102179 "mkdir" curpcb = 0xfffffe00a45f3b80 fpcurthread = none idlethread = 0xfffff80003653000: tid 100003 "idle: cpu0" curpmap = 0xfffff802433d5130 tssp = 0xffffffff8205c620 commontssp = 0xffffffff8205c620 rsp0 = 0xfffffe00a45f3b80 gs32p = 0xffffffff82063258 ldt = 0xffffffff82063298 tss = 0xffffffff82063288 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00856187c0 curthread = 0xfffff8021feb4580: pid 42720 tid 100689 "rw" curpcb = 0xfffffe00a28bdb80 fpcurthread = none idlethread = 0xfffff80003652580: tid 100004 "idle: cpu1" curpmap = 0xfffff80228964130 tssp = 0xffffffff8205c688 commontssp = 0xffffffff8205c688 rsp0 = 0xfffffe00a28bdb80 gs32p = 0xffffffff820632c0 ldt = 0xffffffff82063300 tss = 0xffffffff820632f0 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00856247c0 curthread = 0xfffff8021ff01580: pid 42728 tid 100598 "rw" curpcb = 0xfffffe00a26f4b80 fpcurthread = none idlethread = 0xfffff80003652000: tid 100005 "idle: cpu2" curpmap = 0xfffff80241b8c130 tssp = 0xffffffff8205c6f0 commontssp = 0xffffffff8205c6f0 rsp0 = 0xfffffe00a26f4b80 gs32p = 0xffffffff82063328 ldt = 0xffffffff82063368 tss = 0xffffffff82063358 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00856307c0 curthread = 0xfffff8003ab51580: pid 42698 tid 100171 "mkdir" curpcb = 0xfffffe009f2a4b80 fpcurthread = none idlethread = 0xfffff80003651580: tid 100006 "idle: cpu3" curpmap = 0xfffff802408cd130 tssp = 0xffffffff8205c758 commontssp = 0xffffffff8205c758 rsp0 = 0xfffffe009f2a4b80 gs32p = 0xffffffff82063390 ldt = 0xffffffff820633d0 tss = 0xffffffff820633c0 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008563c7c0 curthread = 0xfffff805db0ff000: pid 42722 tid 102361 "rw" curpcb = 0xfffffe00a4985b80 fpcurthread = none idlethread = 0xfffff80003651000: tid 100007 "idle: cpu4" curpmap = 0xfffff80788e29130 tssp = 0xffffffff8205c7c0 commontssp = 0xffffffff8205c7c0 rsp0 = 0xfffffe00a4985b80 gs32p = 0xffffffff820633f8 ldt = 0xffffffff82063438 tss = 0xffffffff82063428 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00856487c0 curthread = 0xfffff8021f747000: pid 42739 tid 100617 "rw" curpcb = 0xfffffe00a2753b80 fpcurthread = none idlethread = 0xfffff8000364b580: tid 100008 "idle: cpu5" curpmap = 0xfffff802bad1c130 tssp = 0xffffffff8205c828 commontssp = 0xffffffff8205c828 rsp0 = 0xfffffe00a2753b80 gs32p = 0xffffffff82063460 ldt = 0xffffffff820634a0 tss = 0xffffffff82063490 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00856547c0 curthread = 0xfffff80176d02580: pid 42741 tid 100729 "rw" curpcb = 0xfffffe00a2985b80 fpcurthread = none idlethread = 0xfffff8000364b000: tid 100009 "idle: cpu6" curpmap = 0xfffff802ff7b7130 tssp = 0xffffffff8205c890 commontssp = 0xffffffff8205c890 rsp0 = 0xfffffe00a2985b80 gs32p = 0xffffffff820634c8 ldt = 0xffffffff82063508 tss = 0xffffffff820634f8 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00856607c0 curthread = 0xfffff80056dcd580: pid 42734 tid 100276 "creat" curpcb = 0xfffffe00a14a9b80 fpcurthread = none idlethread = 0xfffff80003665580: tid 100010 "idle: cpu7" curpmap = 0xfffff805fdadd130 tssp = 0xffffffff8205c8f8 commontssp = 0xffffffff8205c8f8 rsp0 = 0xfffffe00a14a9b80 gs32p = 0xffffffff82063530 ldt = 0xffffffff82063570 tss = 0xffffffff82063560 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007f11e7c0 curthread = 0xfffff80823952580: pid 42699 tid 101601 "mkdir" curpcb = 0xfffffe00a3a9fb80 fpcurthread = none idlethread = 0xfffff80003665000: tid 100011 "idle: cpu8" curpmap = 0xfffff802473b7130 tssp = 0xffffffff8205c960 commontssp = 0xffffffff8205c960 rsp0 = 0xfffffe00a3a9fb80 gs32p = 0xffffffff82063598 ldt = 0xffffffff820635d8 tss = 0xffffffff820635c8 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007f12a7c0 curthread = 0xfffff800567d3580: pid 42740 tid 100214 "rw" curpcb = 0xfffffe009f371b80 fpcurthread = none idlethread = 0xfffff80003664580: tid 100012 "idle: cpu9" curpmap = 0xfffff802ba620130 tssp = 0xffffffff8205c9c8 commontssp = 0xffffffff8205c9c8 rsp0 = 0xfffffe009f371b80 gs32p = 0xffffffff82063600 ldt = 0xffffffff82063640 tss = 0xffffffff82063630 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007f1367c0 curthread = 0xfffff8024b9bf580: pid 42733 tid 102571 "rw" curpcb = 0xfffffe00a4da3b80 fpcurthread = none idlethread = 0xfffff80003664000: tid 100013 "idle: cpu10" curpmap = 0xfffff80380643130 tssp = 0xffffffff8205ca30 commontssp = 0xffffffff8205ca30 rsp0 = 0xfffffe00a4da3b80 gs32p = 0xffffffff82063668 ldt = 0xffffffff820636a8 tss = 0xffffffff82063698 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007f1427c0 curthread = 0xfffff801ac10a000: pid 42705 tid 100832 "mkdir" curpcb = 0xfffffe00a2b8ab80 fpcurthread = none idlethread = 0xfffff80003663580: tid 100014 "idle: cpu11" curpmap = 0xfffff80484f0d130 tssp = 0xffffffff8205ca98 commontssp = 0xffffffff8205ca98 rsp0 = 0xfffffe00a2b8ab80 gs32p = 0xffffffff820636d0 ldt = 0xffffffff82063710 tss = 0xffffffff82063700 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff804bde17000: tag ufs, type VREG usecount 16, writecount 0, refcount 21 flags (VV_TEXT|VI_ACTIVE) v_object 0xfffff80568f10100 ref 12 pages 27 cleanbuf 4 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80eaaef1 at vm_fault_hold+0x1681 #7 0xffffffff80ea9820 at vm_fault+0x60 #8 0xffffffff81045711 at trap_pfault+0x171 #9 0xffffffff81044de9 at trap+0x3a9 #10 0xffffffff810206ec at calltrap+0x8 ino 49278433, on dev gpt/work vnode 0xfffff8073e2734f0: tag ufs, type VDIR usecount 17, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801a17a2800 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8039ded0000 (pid 42692, mkdir, tid 102990) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65536, on dev md10a vnode 0xfffff805c2444768: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8025b877a00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff802e15e9580 (pid 42718, creat, tid 101609) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65552, on dev md10a vnode 0xfffff800735c7768: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80240bc2c00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80484724000 (pid 42724, creat, tid 100590) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65555, on dev md10a vnode 0xfffff80847a34000: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80806e69100 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8025b07c000 (pid 42721, creat, tid 102537) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65556, on dev md10a vnode 0xfffff804bdcba278: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80568f10d00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff807d6e6e000 (pid 42727, creat, tid 102529) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65557, on dev md10a vnode 0xfffff804bdeec278: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff808065e6300 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80056dcd580 (pid 42734, creat, tid 100276) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65560, on dev md10a vnode 0xfffff8021c22b278: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022e116a00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80241e15580 (pid 42732, creat, tid 101564) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65561, on dev md10a vnode 0xfffff804bdfd3278: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8023e6dd700 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8039dfb7000 (pid 42730, creat, tid 100599) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c5c204 at vn_open_cred+0xd4 #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65562, on dev md10a vnode 0xfffff80355d374f0: tag ufs, type VREG usecount 0, writecount 0, refcount 2 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff802ba1d1d00 ref 0 pages 1266 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff805db0ff000 (pid 42722, rw, tid 102361) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80c3ce31 at vfs_hash_get+0xd1 #7 0xffffffff80e83baf at ffs_vgetf+0x3f #8 0xffffffff80e91409 at ufs_lookup_ino+0x959 #9 0xffffffff811cafa7 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80c35636 at vfs_cache_lookup+0xd6 #11 0xffffffff811cadb7 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff80c3ede2 at lookup+0x692 #13 0xffffffff80c3e30d at namei+0x4fd #14 0xffffffff80c56040 at kern_unlinkat+0x80 #15 0xffffffff81045f07 at amd64_syscall+0x2a7 #16 0xffffffff81020fcd at fast_syscall_common+0x101 ino 78377, on dev md10a vnode 0xfffff8018c7dcc58: tag ufs, type VREG usecount 1, writecount 1, refcount 1888 flags (VI_ACTIVE) v_object 0xfffff802292c7700 ref 0 pages 15088 cleanbuf 1884 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff80265073580 (pid 42742, rw, tid 101726) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 72271, on dev md10a vnode 0xfffff801af986c58: tag ufs, type VREG usecount 1, writecount 1, refcount 2143 flags (VI_ACTIVE) v_object 0xfffff8020c81ec00 ref 0 pages 17128 cleanbuf 2139 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff80176d02580 (pid 42741, rw, tid 100729) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 75226, on dev md10a vnode 0xfffff805b7bfc000: tag ufs, type VREG usecount 1, writecount 1, refcount 2195 flags (VI_ACTIVE) v_object 0xfffff8023477d100 ref 0 pages 17544 cleanbuf 2191 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff801ac10a580 (pid 42735, rw, tid 100848) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 76671, on dev md10a vnode 0xfffff80547f969e0: tag ufs, type VREG usecount 1, writecount 1, refcount 1795 flags (VI_ACTIVE) v_object 0xfffff80244bad600 ref 0 pages 14344 cleanbuf 1791 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8003afc3000 (pid 42731, rw, tid 100219) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 72955, on dev md10a vnode 0xfffff804295664f0: tag ufs, type VREG usecount 1, writecount 1, refcount 1601 flags (VI_ACTIVE) v_object 0xfffff8023fc36e00 ref 0 pages 12792 cleanbuf 1597 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8028f4c1580 (pid 42725, rw, tid 101440) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 72142, on dev md10a vnode 0xfffff802f5f80278: tag ufs, type VREG usecount 1, writecount 1, refcount 913 flags (VI_ACTIVE) v_object 0xfffff8003adb3a00 ref 0 pages 7288 cleanbuf 909 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8003ab41580 (pid 42738, rw, tid 100175) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 69415, on dev md10a vnode 0xfffff8040a701c58: tag ufs, type VREG usecount 1, writecount 1, refcount 1865 flags (VI_ACTIVE) v_object 0xfffff8023e8f6000 ref 0 pages 14904 cleanbuf 1861 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff800567d3580 (pid 42740, rw, tid 100214) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 75304, on dev md10a vnode 0xfffff8051d9c24f0: tag ufs, type VREG usecount 1, writecount 1, refcount 1520 flags (VI_ACTIVE) v_object 0xfffff801a144cb00 ref 0 pages 12144 cleanbuf 1516 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8020f106000 (pid 42717, rw, tid 102156) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 65584, on dev md10a vnode 0xfffff8011c390768: tag ufs, type VREG usecount 1, writecount 1, refcount 694 flags (VI_ACTIVE) v_object 0xfffff80806d62000 ref 0 pages 5536 cleanbuf 690 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8021f747000 (pid 42739, rw, tid 100617) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 72352, on dev md10a vnode 0xfffff802d231b278: tag ufs, type VREG usecount 1, writecount 1, refcount 496 flags (VI_ACTIVE) v_object 0xfffff80233f96400 ref 0 pages 3952 cleanbuf 492 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8021ff01580 (pid 42728, rw, tid 100598) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 80326, on dev md10a vnode 0xfffff802d233e9e0: tag ufs, type VREG usecount 1, writecount 1, refcount 408 flags (VI_ACTIVE) v_object 0xfffff8020c27c700 ref 0 pages 3248 cleanbuf 404 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8025c6bd000 (pid 42743, rw, tid 102371) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 80378, on dev md10a vnode 0xfffff804e94e6000: tag ufs, type VREG usecount 1, writecount 1, refcount 243 flags (VI_ACTIVE) v_object 0xfffff8023e38e000 ref 0 pages 1928 cleanbuf 239 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8023c030580 (pid 42737, rw, tid 102151) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c5f6b4 at vn_write+0x194 #6 0xffffffff80c5f153 at vn_io_fault_doio+0x43 #7 0xffffffff80c5d1a1 at vn_io_fault1+0x171 #8 0xffffffff80c5b505 at vn_io_fault+0x195 #9 0xffffffff80be4327 at dofilewrite+0x97 #10 0xffffffff80be3f4a at kern_writev+0x4a #11 0xffffffff80be3ef6 at sys_write+0x86 #12 0xffffffff81045f07 at amd64_syscall+0x2a7 #13 0xffffffff81020fcd at fast_syscall_common+0x101 ino 76171, on dev md10a vnode 0xfffff801ae2614f0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8080694b800 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80823952580 (pid 42699, mkdir, tid 101601) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c562ce at kern_rmdirat+0x7e #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141306, on dev md10a vnode 0xfffff801ae3c89e0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8023e978200 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80236bbf000 (pid 42695, mkdir, tid 101626) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c562ce at kern_rmdirat+0x7e #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141324, on dev md10a vnode 0xfffff801ae3cf9e0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022de80c00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8048471c580 (pid 42691, mkdir, tid 100580) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c562ce at kern_rmdirat+0x7e #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141328, on dev md10a vnode 0xfffff801ae38c4f0: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8023e978900 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80823952580 (pid 42699, mkdir, tid 101601) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80c3ce31 at vfs_hash_get+0xd1 #7 0xffffffff80e83baf at ffs_vgetf+0x3f #8 0xffffffff80e91409 at ufs_lookup_ino+0x959 #9 0xffffffff811cafa7 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80c35636 at vfs_cache_lookup+0xd6 #11 0xffffffff811cadb7 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff80c3ede2 at lookup+0x692 #13 0xffffffff80c3e30d at namei+0x4fd #14 0xffffffff80c562ce at kern_rmdirat+0x7e #15 0xffffffff81045f07 at amd64_syscall+0x2a7 #16 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141329, on dev md10a vnode 0xfffff801ae3d7278: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8023e978c00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80236bbf000 (pid 42695, mkdir, tid 101626) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80c3ce31 at vfs_hash_get+0xd1 #7 0xffffffff80e83baf at ffs_vgetf+0x3f #8 0xffffffff80e91409 at ufs_lookup_ino+0x959 #9 0xffffffff811cafa7 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80c35636 at vfs_cache_lookup+0xd6 #11 0xffffffff811cadb7 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff80c3ede2 at lookup+0x692 #13 0xffffffff80c3e30d at namei+0x4fd #14 0xffffffff80c562ce at kern_rmdirat+0x7e #15 0xffffffff81045f07 at amd64_syscall+0x2a7 #16 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141330, on dev md10a vnode 0xfffff804bee164f0: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80484224d00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8048471c580 (pid 42691, mkdir, tid 100580) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80c3ce31 at vfs_hash_get+0xd1 #7 0xffffffff80e83baf at ffs_vgetf+0x3f #8 0xffffffff80e91409 at ufs_lookup_ino+0x959 #9 0xffffffff811cafa7 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80c35636 at vfs_cache_lookup+0xd6 #11 0xffffffff811cadb7 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff80c3ede2 at lookup+0x692 #13 0xffffffff80c3e30d at namei+0x4fd #14 0xffffffff80c562ce at kern_rmdirat+0x7e #15 0xffffffff81045f07 at amd64_syscall+0x2a7 #16 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141365, on dev md10a vnode 0xfffff804bee739e0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8023ac6a200 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8003ab51580 (pid 42698, mkdir, tid 100171) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c562ce at kern_rmdirat+0x7e #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141422, on dev md10a vnode 0xfffff804beea3000: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80240124800 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8023f6c8000 (pid 42701, mkdir, tid 101704) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141434, on dev md10a vnode 0xfffff804beea3278: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80240124100 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8003ab51580 (pid 42698, mkdir, tid 100171) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80c3ce31 at vfs_hash_get+0xd1 #7 0xffffffff80e83baf at ffs_vgetf+0x3f #8 0xffffffff80e91409 at ufs_lookup_ino+0x959 #9 0xffffffff811cafa7 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80c35636 at vfs_cache_lookup+0xd6 #11 0xffffffff811cadb7 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff80c3ede2 at lookup+0x692 #13 0xffffffff80c3e30d at namei+0x4fd #14 0xffffffff80c562ce at kern_rmdirat+0x7e #15 0xffffffff81045f07 at amd64_syscall+0x2a7 #16 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141435, on dev md10a vnode 0xfffff804beea34f0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022c16fd00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8025e051580 (pid 42690, mkdir, tid 102366) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141436, on dev md10a vnode 0xfffff804beea3768: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80240124000 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff805fded9580 (pid 42696, mkdir, tid 100991) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141437, on dev md10a vnode 0xfffff804beea9c58: tag ufs, type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8024a498c00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8028f4c2580 (pid 42688, mkdir, tid 101438) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4b856 at vputx+0x1a6 #6 0xffffffff80c5490b at kern_chdir+0x13b #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141440, on dev md10a vnode 0xfffff804beeb1768: tag ufs, type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff802e1733e00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80484426580 (pid 42703, mkdir, tid 101951) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4b856 at vputx+0x1a6 #6 0xffffffff80c5490b at kern_chdir+0x13b #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141442, on dev md10a vnode 0xfffff804beeb1c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8023f6c8000 (pid 42701, mkdir, tid 101704) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141443, on dev md10a vnode 0xfffff804beebc768: tag ufs, type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8024a498300 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8030162e000 (pid 42694, mkdir, tid 102200) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4b856 at vputx+0x1a6 #6 0xffffffff80c5490b at kern_chdir+0x13b #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141447, on dev md10a vnode 0xfffff804beec1768: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8024a498800 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8003ab42000 (pid 42700, mkdir, tid 100173) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141450, on dev md10a vnode 0xfffff804beec1c58: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8024a498400 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801ac10a000 (pid 42705, mkdir, tid 100832) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141452, on dev md10a vnode 0xfffff804bee7a000: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022c16fa00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80241e15000 (pid 42697, mkdir, tid 101571) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141453, on dev md10a vnode 0xfffff804beecdc58: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022c16f600 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8023183a000 (pid 42689, mkdir, tid 101611) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141456, on dev md10a vnode 0xfffff804beeaf278: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8024a515700 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801a167c580 (pid 42704, mkdir, tid 100277) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c562ce at kern_rmdirat+0x7e #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141457, on dev md10a vnode 0xfffff804beed1768: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff80241e15580 (pid 42732, creat, tid 101564) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e9afe2 at ufs_makeinode+0xb2 #5 0xffffffff80e971e4 at ufs_create+0x34 #6 0xffffffff811cb197 at VOP_CREATE_APV+0xf7 #7 0xffffffff80c5c3cc at vn_open_cred+0x29c #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 80772, on dev md10a vnode 0xfffff804beed5000: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff805fded9580 (pid 42696, mkdir, tid 100991) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141460, on dev md10a vnode 0xfffff804beed5278: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022c16f100 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801a167c580 (pid 42704, mkdir, tid 100277) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c4aef8 at vget+0x98 #6 0xffffffff80c3ce31 at vfs_hash_get+0xd1 #7 0xffffffff80e83baf at ffs_vgetf+0x3f #8 0xffffffff80e91409 at ufs_lookup_ino+0x959 #9 0xffffffff811cafa7 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80c35636 at vfs_cache_lookup+0xd6 #11 0xffffffff811cadb7 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff80c3ede2 at lookup+0x692 #13 0xffffffff80c3e30d at namei+0x4fd #14 0xffffffff80c562ce at kern_rmdirat+0x7e #15 0xffffffff81045f07 at amd64_syscall+0x2a7 #16 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141461, on dev md10a vnode 0xfffff804beedb278: tag ufs, type VNON usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8023183a000 (pid 42689, mkdir, tid 101611) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141464, on dev md10a vnode 0xfffff804beedb4f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8039ded0000 (pid 42692, mkdir, tid 102990) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141465, on dev md10a vnode 0xfffff804beedb768: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8022c16f900 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8003ae0d580 (pid 42702, mkdir, tid 100167) #0 0xffffffff80b4b8ab at lockmgr_slock_hard+0x32b #1 0xffffffff80b4c3a1 at __lockmgr_args+0x571 #2 0xffffffff80e883af at ffs_lock+0xaf #3 0xffffffff811ce3c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c5cb06 at _vn_lock+0x66 #5 0xffffffff80c3e864 at lookup+0x114 #6 0xffffffff80c3e30d at namei+0x4fd #7 0xffffffff80c59ada at kern_mkdirat+0xaa #8 0xffffffff81045f07 at amd64_syscall+0x2a7 #9 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141466, on dev md10a vnode 0xfffff804beedbc58: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff807d6e6e000 (pid 42727, creat, tid 102529) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e9afe2 at ufs_makeinode+0xb2 #5 0xffffffff80e971e4 at ufs_create+0x34 #6 0xffffffff811cb197 at VOP_CREATE_APV+0xf7 #7 0xffffffff80c5c3cc at vn_open_cred+0x29c #8 0xffffffff80c54cbc at kern_openat+0x20c #9 0xffffffff81045f07 at amd64_syscall+0x2a7 #10 0xffffffff81020fcd at fast_syscall_common+0x101 ino 80783, on dev md10a vnode 0xfffff804bee19000: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8003ae0d580 (pid 42702, mkdir, tid 100167) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141468, on dev md10a vnode 0xfffff804bee19278: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8003ab42000 (pid 42700, mkdir, tid 100173) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141469, on dev md10a vnode 0xfffff804bee194f0: tag ufs, type VNON usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff801ac10a000 (pid 42705, mkdir, tid 100832) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141470, on dev md10a vnode 0xfffff804bee199e0: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff80241e15000 (pid 42697, mkdir, tid 101571) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141471, on dev md10a vnode 0xfffff804bee19c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8025e051580 (pid 42690, mkdir, tid 102366) #0 0xffffffff80b4bcba at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b4c375 at __lockmgr_args+0x545 #2 0xffffffff80e83ca9 at ffs_vgetf+0x139 #3 0xffffffff80e57407 at ffs_valloc+0x567 #4 0xffffffff80e99f00 at ufs_mkdir+0xd0 #5 0xffffffff811cd6ad at VOP_MKDIR_APV+0xfd #6 0xffffffff80c59c06 at kern_mkdirat+0x1d6 #7 0xffffffff81045f07 at amd64_syscall+0x2a7 #8 0xffffffff81020fcd at fast_syscall_common+0x101 ino 141472, on dev md10a db:1:pho1> show allchains chain 1: thread 100271 (pid 46726, egrep) sleeping on 0xfffff808620378b0 "vmpfw" chain 2: thread 100328 (pid 46724, grep) sleeping on 0xfffffe00028bfe18 "biord" chain 3: thread 100164 (pid 46723, egrep) sleeping on 0xfffff808620378b0 "vmpfw" chain 4: thread 100155 (pid 46720, md11) sleeping on 0xfffff8066ab12000 "mdwait" chain 5: thread 100592 (pid 46713, sh) sleeping on 0xfffff8020c6bb000 "wait" chain 6: thread 100279 (pid 42729, swap) sleeping on 0xfffff80240e99a8c "swread" chain 7: thread 100159 (pid 42726, swap) sleeping on 0xfffff8078877548c "swread" chain 8: thread 101020 (pid 42723, swap) sleeping on 0xfffff8022ed66a8c "swread" chain 9: thread 100215 (pid 42715, swap) sleeping on 0xfffff80056465000 "wait" chain 10: thread 101345 (pid 42714, creat) blocked on lockmgr 8VEXCL thread 0 (pid -512, ) is inactive chain 11: thread 102343 (pid 42713, rw) sleeping on 0xfffff8022fbb5000 "wait" chain 12: thread 100173 (pid 42700, mkdir) blocked on lockmgr bufwaitEXCL thread 100832 (pid 42705, mkdir) running on CPU 11 chain 13: thread 101571 (pid 42697, mkdir) blocked on lockmgr bufwaitEXCL thread 100832 (pid 42705, mkdir) running on CPU 11 chain 14: thread 102366 (pid 42690, mkdir) blocked on lockmgr bufwaitEXCL thread 100832 (pid 42705, mkdir) running on CPU 11 chain 15: thread 100993 (pid 42686, mkdir) sleeping on 0xfffff805fded5000 "wait" chain 16: thread 100148 (pid 42685, rw) sleeping on 0xffffffff81df7453 "nanslp" chain 17: thread 102083 (pid 42684, mkdir) sleeping on 0xffffffff81df7458 "nanslp" chain 18: thread 103198 (pid 42682, creat) sleeping on 0xffffffff81df745b "nanslp" chain 19: thread 100578 (pid 42681, swap) sleeping on 0xffffffff81df7450 "nanslp" chain 20: thread 100190 (pid 42679, run) sleeping on 0xfffff80056cfaa70 "wait" chain 21: thread 100596 (pid 42678, run) blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 22: thread 100176 (pid 42672, run) sleeping on 0xffffffff81df7456 "nanslp" chain 23: thread 100643 (pid 42636, sh) blocked on lockmgr p6EXCL thread 0 (pid -512, ) is inactive chain 24: thread 102532 (pid 42632, md10) sleeping on 0xfffff801dd13e000 "mdwait" chain 25: thread 102340 (pid 42622, sh) sleeping on 0xfffff80236cf9a70 "wait" chain 26: thread 101016 (pid 42621, tee) sleeping on 0xfffff8022c3b78e8 "piperd" chain 27: thread 100989 (pid 42620, sh) blocked on lockmgr pj8eEXCL thread 0 (pid -512, ) is inactive chain 28: thread 101102 (pid 27860, bash) sleeping on 0xfffff80003c97440 "select" chain 29: thread 102355 (pid 27859, sshd) sleeping on 0xfffff807cbef1a40 "select" chain 30: thread 100696 (pid 27856, sshd) sleeping on 0xfffff807cbef1ec0 "select" chain 31: thread 100690 (pid 95179, watchdogd) sleeping on 0xffffffff81df7450 "nanslp" chain 32: thread 100221 (pid 2205, sh) sleeping on 0xfffff80056cfa000 "wait" chain 33: thread 100213 (pid 807, sh) sleeping on 0xfffff8003af888e8 "piperd" chain 34: thread 100212 (pid 805, awk) sleeping on 0xfffff8003ae285f0 "piperd" chain 35: thread 100195 (pid 804, sh) sleeping on 0xfffff8003ac79a70 "wait" chain 36: thread 100211 (pid 801, sh) sleeping on 0xfffff80056dc8000 "wait" chain 37: thread 100141 (pid 790, bash) sleeping on 0xfffff801a10d86c0 "select" chain 38: thread 100208 (pid 788, csh) sleeping on 0xfffff8003afb8b18 "pause" chain 39: thread 100207 (pid 787, su) sleeping on 0xfffff80056dc8538 "wait" chain 40: thread 100188 (pid 786, bash) blocked on lockmgr 8uEXCL thread 0 (pid -512, ) ??? (0x6) chain 41: thread 100172 (pid 782, sshd) sleeping on 0xfffff8003a8cc240 "select" chain 42: thread 100192 (pid 779, csh) sleeping on 0xfffff800071d6cb0 "ttyin" chain 43: thread 100206 (pid 776, login) blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 44: thread 100168 (pid 775, getty) sleeping on 0xfffff800071d78b0 "ttyin" chain 45: thread 100205 (pid 774, getty) sleeping on 0xfffff8003aa7dcb0 "ttyin" chain 46: thread 100204 (pid 773, getty) sleeping on 0xfffff8003aa7e0b0 "ttyin" chain 47: thread 100203 (pid 772, getty) sleeping on 0xfffff8003aa7e4b0 "ttyin" chain 48: thread 100202 (pid 771, getty) sleeping on 0xfffff8003aa7e8b0 "ttyin" chain 49: thread 100201 (pid 770, getty) sleeping on 0xfffff8003aa7ecb0 "ttyin" chain 50: thread 100200 (pid 769, getty) sleeping on 0xfffff8003aa800b0 "ttyin" chain 51: thread 100165 (pid 768, getty) sleeping on 0xfffff8003aa804b0 "ttyin" chain 52: thread 100166 (pid 767, getty) sleeping on 0xfffff8003aa808b0 "ttyin" chain 53: thread 100181 (pid 733, cron) sleeping on 0xffffffff81df7459 "nanslp" chain 54: thread 100143 (pid 729, sshd) sleeping on 0xfffff80003c97940 "select" chain 55: thread 100156 (pid 662, NLM: master) sleeping on 0xfffff8003a961a60 "rpcsvc" chain 56: thread 100182 (pid 659, rpc.statd) sleeping on 0xfffff8003a9082c0 "select" chain 57: thread 100187 (pid 646, dhclient) sleeping on 0xfffff80003c979c0 "select" chain 58: thread 100145 (pid 592, dhclient) sleeping on 0xfffff800070dc240 "select" chain 59: thread 100149 (pid 589, dhclient) sleeping on 0xfffff800566c65c0 "select" chain 60: thread 100180 (pid 577, casperd) sleeping on 0xfffff8003a8cc340 "select" chain 61: thread 100179 (pid 576, casperd) sleeping on 0xfffff800070d6240 "select" chain 62: thread 100150 (pid 532, rpcbind) sleeping on 0xfffff80056546540 "select" chain 63: thread 100174 (pid 527, syslogd) sleeping on 0xfffff800566c6640 "select" chain 64: thread 100154 (pid 452, devd) sleeping on 0xfffff8003a908440 "select" chain 65: thread 100135 (pid 33, syncer) sleeping on 0xffffffff81f99880 "syncer" chain 66: thread 100132 (pid 32, vnlru) sleeping on 0xfffff8003a893000 "vlruwt" chain 67: thread 100131 (pid 31, bufdaemon) sleeping on 0xffffffff81f98d20 "qsleep" chain 68: thread 100133 (pid 31, bufspacedaemon-0) sleeping on 0xffffffff81a0a480 "-" chain 69: thread 100134 (pid 31, bufspacedaemon-1) sleeping on 0xffffffff81a12740 "-" chain 70: thread 100136 (pid 31, bufspacedaemon-2) sleeping on 0xffffffff81a1aa00 "-" chain 71: thread 100137 (pid 31, bufspacedaemon-3) sleeping on 0xffffffff81a22cc0 "-" chain 72: thread 100138 (pid 31, bufspacedaemon-4) sleeping on 0xffffffff81a2af80 "-" chain 73: thread 100139 (pid 31, bufspacedaemon-5) sleeping on 0xffffffff81a33240 "-" chain 74: thread 100140 (pid 31, bufspacedaemon-6) sleeping on 0xffffffff81a3b500 "-" chain 75: thread 100151 (pid 31, / worker) sleeping on 0xfffff8003a8c22e8 "sdflush" chain 76: thread 100210 (pid 31, /tmp worker) sleeping on 0xfffff801a1394ae8 "sdflush" chain 77: thread 103327 (pid 31, /mnt worker) sleeping on 0xfffff807b123cae8 "sdflush" chain 78: thread 100128 (pid 30, vmdaemon) sleeping on 0xffffffff81fa5740 "psleep" chain 79: thread 100127 (pid 29, dom0) sleeping on 0xffffffff81df61e3 "pwait" chain 80: thread 100129 (pid 29, laundry: dom0) sleeping on 0xffffffff81fa166c "wswbuf0" chain 81: thread 100130 (pid 29, uma) sleeping on 0xffffffff80ea6610 "umarcl" chain 82: thread 100126 (pid 28, enc_daemon1) sleeping on 0xfffff8003a7a5000 "idle" chain 83: thread 100125 (pid 27, enc_daemon0) sleeping on 0xfffff8003a7a5538 "idle" chain 84: thread 100119 (pid 26, rand_harvestq) sleeping on 0xffffffff81cc8390 "-" chain 85: thread 100118 (pid 25, sctp_iterator) sleeping on 0xffffffff82014640 "waiting_for_work" chain 86: thread 100117 (pid 24, soaiod4) sleeping on 0xffffffff81f9871c "-" chain 87: thread 100116 (pid 23, soaiod3) sleeping on 0xffffffff81f9871c "-" chain 88: thread 100115 (pid 22, soaiod2) sleeping on 0xffffffff81f9871c "-" chain 89: thread 100114 (pid 21, soaiod1) sleeping on 0xffffffff81f9871c "-" chain 90: thread 100095 (pid 20, usbus0) sleeping on 0xfffffe009c7dd460 "-" chain 91: thread 100096 (pid 20, usbus0) sleeping on 0xfffffe009c7dd4b8 "-" chain 92: thread 100097 (pid 20, usbus0) sleeping on 0xfffffe009c7dd510 "-" chain 93: thread 100098 (pid 20, usbus0) sleeping on 0xfffffe009c7dd568 "-" chain 94: thread 100099 (pid 20, usbus0) sleeping on 0xfffffe009c7dd5c0 "-" chain 95: thread 100101 (pid 20, usbus1) sleeping on 0xfffffe009a5ead10 "-" chain 96: thread 100102 (pid 20, usbus1) sleeping on 0xfffffe009a5ead68 "-" chain 97: thread 100103 (pid 20, usbus1) sleeping on 0xfffffe009a5eadc0 "-" chain 98: thread 100104 (pid 20, usbus1) sleeping on 0xfffffe009a5eae18 "-" chain 99: thread 100105 (pid 20, usbus1) sleeping on 0xfffffe009a5eae70 "-" chain 100: thread 100106 (pid 20, usbus2) sleeping on 0xfffffe009ca50d10 "-" chain 101: thread 100107 (pid 20, usbus2) sleeping on 0xfffffe009ca50d68 "-" chain 102: thread 100108 (pid 20, usbus2) sleeping on 0xfffffe009ca50dc0 "-" chain 103: thread 100109 (pid 20, usbus2) sleeping on 0xfffffe009ca50e18 "-" chain 104: thread 100110 (pid 20, usbus2) sleeping on 0xfffffe009ca50e70 "-" chain 105: thread 100090 (pid 19, doneq0) sleeping on 0xffffffff81ba35c0 "-" chain 106: thread 100091 (pid 19, doneq1) sleeping on 0xffffffff81ba3640 "-" chain 107: thread 100092 (pid 19, doneq2) sleeping on 0xffffffff81ba36c0 "-" chain 108: thread 100124 (pid 19, scanner) sleeping on 0xffffffff81ba3488 "-" chain 109: thread 100089 (pid 18, crypto returns 11) sleeping on 0xfffff80003681450 "crypto_ret_wait" chain 110: thread 100088 (pid 17, crypto returns 10) sleeping on 0xfffff800036813f0 "crypto_ret_wait" chain 111: thread 100087 (pid 16, crypto returns 9) sleeping on 0xfffff80003681390 "crypto_ret_wait" chain 112: thread 100086 (pid 15, crypto returns 8) sleeping on 0xfffff80003681330 "crypto_ret_wait" chain 113: thread 100085 (pid 14, crypto returns 7) sleeping on 0xfffff800036812d0 "crypto_ret_wait" chain 114: thread 100084 (pid 9, crypto returns 6) sleeping on 0xfffff80003681270 "crypto_ret_wait" chain 115: thread 100083 (pid 8, crypto returns 5) sleeping on 0xfffff80003681210 "crypto_ret_wait" chain 116: thread 100082 (pid 7, crypto returns 4) sleeping on 0xfffff800036811b0 "crypto_ret_wait" chain 117: thread 100081 (pid 6, crypto returns 3) sleeping on 0xfffff80003681150 "crypto_ret_wait" chain 118: thread 100080 (pid 5, crypto returns 2) sleeping on 0xfffff800036810f0 "crypto_ret_wait" chain 119: thread 100079 (pid 4, crypto returns 1) sleeping on 0xfffff80003681090 "crypto_ret_wait" chain 120: thread 100078 (pid 3, crypto returns 0) sleeping on 0xfffff80003681030 "crypto_ret_wait" chain 121: thread 100077 (pid 2, crypto) sleeping on 0xffffffff81f9fd28 "crypto_wait" chain 122: thread 100061 (pid 13, g_event) sleeping on 0xffffffff81ff0e80 "-" chain 123: thread 100062 (pid 13, g_up) sleeping on 0xffffffff81ff0e90 "-" chain 124: thread 100063 (pid 13, g_down) sleeping on 0xffffffff81ff0e78 "-" chain 125: thread 100002 (pid 1, init) sleeping on 0xfffff8000364a538 "wait" chain 126: thread 100001 (pid 10, audit) sleeping on 0xffffffff82015350 "audit_worker_cv" chain 127: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81ff0ec0 "swapin" chain 128: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff800030bab00 "-" chain 129: thread 100017 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800030baa00 "-" chain 130: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff800030ba700 "-" chain 131: thread 100021 (pid 0, if_config_tqg_0) sleeping on 0xfffff800030ba600 "-" chain 132: thread 100022 (pid 0, config_0) sleeping on 0xfffff800030ba500 "-" chain 133: thread 100023 (pid 0, if_io_tqg_0) sleeping on 0xfffff800030ba400 "-" chain 134: thread 100024 (pid 0, if_io_tqg_1) sleeping on 0xfffff800030ba300 "-" chain 135: thread 100025 (pid 0, if_io_tqg_2) sleeping on 0xfffff800030ba200 "-" chain 136: thread 100026 (pid 0, if_io_tqg_3) sleeping on 0xfffff800030ba100 "-" chain 137: thread 100027 (pid 0, if_io_tqg_4) sleeping on 0xfffff800030ba000 "-" chain 138: thread 100028 (pid 0, if_io_tqg_5) sleeping on 0xfffff800030b9e00 "-" chain 139: thread 100029 (pid 0, if_io_tqg_6) sleeping on 0xfffff800030b9d00 "-" chain 140: thread 100030 (pid 0, if_io_tqg_7) sleeping on 0xfffff800030b9c00 "-" chain 141: thread 100031 (pid 0, if_io_tqg_8) sleeping on 0xfffff800030b9b00 "-" chain 142: thread 100032 (pid 0, if_io_tqg_9) sleeping on 0xfffff800030b9a00 "-" chain 143: thread 100033 (pid 0, if_io_tqg_10) sleeping on 0xfffff800030b9900 "-" chain 144: thread 100034 (pid 0, if_io_tqg_11) sleeping on 0xfffff800030b9800 "-" chain 145: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff800030b9700 "-" chain 146: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff800030b9600 "-" chain 147: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff800030b9500 "-" chain 148: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff800030b9400 "-" chain 149: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff800030b9300 "-" chain 150: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff800030b9200 "-" chain 151: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff800030b9100 "-" chain 152: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff800030b9000 "-" chain 153: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff800030b8e00 "-" chain 154: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff800030b8d00 "-" chain 155: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff800030b8c00 "-" chain 156: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff800030b8b00 "-" chain 157: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff800030b8a00 "-" chain 158: thread 100065 (pid 0, crypto_0) sleeping on 0xfffff800030b8900 "-" chain 159: thread 100066 (pid 0, crypto_1) sleeping on 0xfffff800030b8900 "-" chain 160: thread 100067 (pid 0, crypto_2) sleeping on 0xfffff800030b8900 "-" chain 161: thread 100068 (pid 0, crypto_3) sleeping on 0xfffff800030b8900 "-" chain 162: thread 100069 (pid 0, crypto_4) sleeping on 0xfffff800030b8900 "-" chain 163: thread 100070 (pid 0, crypto_5) sleeping on 0xfffff800030b8900 "-" chain 164: thread 100071 (pid 0, crypto_6) sleeping on 0xfffff800030b8900 "-" chain 165: thread 100072 (pid 0, crypto_7) sleeping on 0xfffff800030b8900 "-" chain 166: thread 100073 (pid 0, crypto_8) sleeping on 0xfffff800030b8900 "-" chain 167: thread 100074 (pid 0, crypto_9) sleeping on 0xfffff800030b8900 "-" chain 168: thread 100075 (pid 0, crypto_10) sleeping on 0xfffff800030b8900 "-" chain 169: thread 100076 (pid 0, crypto_11) sleeping on 0xfffff800030b8900 "-" chain 170: thread 100113 (pid 0, mca taskq) sleeping on 0xfffff8000719da00 "-" chain 171: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff8003a8da300 "-" chain 172: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff8003a8da300 "-" chain 173: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff8003a8da300 "-" chain 174: thread 100123 (pid 0, CAM taskq) sleeping on 0xfffff800030b8800 "-" db:1:pho1> show mount 0xfffff8003ab35000 /dev/gpt/work on / (ufs) 0xfffff8003ab36000 devfs on /dev (devfs) 0xfffff801a1374000 /dev/gpt/tmp on /tmp (ufs) 0xfffff8024b0ed000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 28761 Buf domain 0 freebufs 11036 lofreebufs 219 hifreebufs 329 bufspace 132755456 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 20 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 3922 (127455232) dirtyq count 20 (221184) wakeup 0 lim 25 CPU 18, 22, 22, 4, 16, 19, 5, 0, 8, 6, 17, 18, Locked buffers: 0 space 0 Total buffers: 11057 space 132755456 Buf domain 1 freebufs 12445 lofreebufs 219 hifreebufs 329 bufspace 87207936 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 26 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2490 (81207296) dirtyq count 26 (421888) wakeup 0 lim 25 CPU 17, 10, 22, 9, 10, 20, 5, 23, 23, 4, 6, 21, Locked buffers: 3 space 40960 Total buffers: 13726 space 87207936 Buf domain 2 freebufs 13182 lofreebufs 219 hifreebufs 329 bufspace 62091264 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 21 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1793 (57430016) dirtyq count 21 (200704) wakeup 0 lim 25 CPU 10, 10, 12, 4, 23, 13, 16, 4, 15, 7, 3, 19, Locked buffers: 2 space 36864 Total buffers: 8040 space 62091264 Buf domain 3 freebufs 14187 lofreebufs 219 hifreebufs 329 bufspace 30040064 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 27 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 829 (26951680) dirtyq count 27 (167936) wakeup 0 lim 25 CPU 3, 0, 8, 12, 18, 0, 8, 8, 9, 6, 2, 15, Locked buffers: 2 space 36864 Total buffers: 9234 space 30040064 Buf domain 4 freebufs 9501 lofreebufs 219 hifreebufs 329 bufspace 183197696 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 28 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5430 (177156096) dirtyq count 28 (339968) wakeup 0 lim 25 CPU 2, 17, 2, 20, 24, 4, 13, 22, 17, 20, 23, 9, Locked buffers: 4 space 57344 Total buffers: 19003 space 183197696 Buf domain 5 freebufs 13046 lofreebufs 219 hifreebufs 329 bufspace 67035136 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 20 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1956 (63131648) dirtyq count 20 (266240) wakeup 0 lim 25 CPU 1, 14, 13, 8, 12, 7, 11, 14, 7, 6, 7, 11, Locked buffers: 1 space 16384 Total buffers: 16514 space 67035136 Buf domain 6 freebufs 9816 lofreebufs 219 hifreebufs 329 bufspace 172601344 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 372 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4751 (154730496) dirtyq count 373 (11546624) wakeup 0 lim 25 CPU 23, 8, 17, 5, 15, 18, 3, 21, 7, 11, 17, 23, Locked buffers: 31 space 1007616 Total buffers: 28357 space 172601344 db:1:pho1> show page vm_cnt.v_free_count: 88565 vm_cnt.v_inactive_count: 3581 vm_cnt.v_active_count: 3686783 vm_cnt.v_laundry_count: 3979410 vm_cnt.v_wire_count: 369885 vm_cnt.v_free_reserved: 10650 vm_cnt.v_free_min: 51292 vm_cnt.v_free_target: 173218 vm_cnt.v_inactive_target: 259827 db:1:pho1> show pageq pq_free 88565 dom 0 page_cnt 8128712 free 88565 pq_act 3686783 pq_inact 3581 pq_laund 3979410 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000005 | 000000 08 (001024K) | 000001 | 000001 07 (000512K) | 000001 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000000 | 000001 03 (000032K) | 000019 | 000000 02 (000016K) | 000875 | 000000 01 (000008K) | 002572 | 000000 00 (000004K) | 005745 | 000001 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> acttrace Tracing command rw pid 42741 tid 100729 td 0xfffff80176d02580 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e9e10 trap() at trap+0x49/frame 0xfffffe00071e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e9f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a2985160, rbp = 0xfffffe00a2985170 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a2985170 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a2985200 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a2985240 softdep_request_cleanup() at softdep_request_cleanup+0x11f/frame 0xfffffe00a29852d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a2985460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a2985500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a2985610 vn_write() at vn_write+0x26b/frame 0xfffffe00a2985690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a29856f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a2985830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a29858a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a29858f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a2985930 sys_write() at sys_write+0x86/frame 0xfffffe00a2985980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2985ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2985ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42740 tid 100214 td 0xfffff800567d3580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cbfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cbfe10 trap() at trap+0x49/frame 0xfffffe0000cbff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cbff20 --- trap 0x13, rip = 0xffffffff80bbee40, rsp = 0xfffffe009f3710b0, rbp = 0xfffffe009f3710c0 --- lock_delay() at lock_delay+0x40/frame 0xfffffe009f3710c0 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe009f371150 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe009f371190 handle_workitem_freefile() at handle_workitem_freefile+0x19a/frame 0xfffffe009f3711d0 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe009f371240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe009f3712d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe009f371460 ffs_write() at ffs_write+0x20f/frame 0xfffffe009f371500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe009f371610 vn_write() at vn_write+0x26b/frame 0xfffffe009f371690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe009f3716f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe009f371830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe009f3718a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe009f3718f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe009f371930 sys_write() at sys_write+0x86/frame 0xfffffe009f371980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f371ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f371ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42739 tid 100617 td 0xfffff8021f747000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071dde10 trap() at trap+0x49/frame 0xfffffe00071ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071ddf20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a27530b0, rbp = 0xfffffe00a27530c0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a27530c0 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a2753150 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a2753190 handle_workitem_freefile() at handle_workitem_freefile+0x3d/frame 0xfffffe00a27531d0 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe00a2753240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe00a27532d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a2753460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a2753500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a2753610 vn_write() at vn_write+0x26b/frame 0xfffffe00a2753690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a27536f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a2753830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a27538a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a27538f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a2753930 sys_write() at sys_write+0x86/frame 0xfffffe00a2753980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2753ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2753ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42734 tid 100276 td 0xfffff80056dcd580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071f5e10 trap() at trap+0x49/frame 0xfffffe00071f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f5f20 --- trap 0x13, rip = 0xffffffff80bbee40, rsp = 0xfffffe00a14a9200, rbp = 0xfffffe00a14a9210 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00a14a9210 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a14a92a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a14a92e0 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe00a14a9310 softdep_setup_inomapdep() at softdep_setup_inomapdep+0x13a/frame 0xfffffe00a14a9370 ffs_nodealloccg() at ffs_nodealloccg+0x5a0/frame 0xfffffe00a14a9410 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a14a9460 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00a14a94f0 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00a14a9680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a14a96a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a14a96d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a14a9810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a14a9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a14a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a14a9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42733 tid 102571 td 0xfffff8024b9bf580 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000ccbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000ccbe10 trap() at trap+0x49/frame 0xfffffe0000ccbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000ccbf20 --- trap 0x13, rip = 0xffffffff80bbee40, rsp = 0xfffffe00a4da3520, rbp = 0xfffffe00a4da3530 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00a4da3530 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00a4da35b0 __mtx_lock_flags() at __mtx_lock_flags+0xf9/frame 0xfffffe00a4da3600 zone_release() at zone_release+0x49/frame 0xfffffe00a4da3660 uma_zfree_arg() at uma_zfree_arg+0x620/frame 0xfffffe00a4da36c0 free() at free+0xa5/frame 0xfffffe00a4da3700 vn_io_fault1() at vn_io_fault1+0x3b1/frame 0xfffffe00a4da3840 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a4da38b0 dofileread() at dofileread+0x95/frame 0xfffffe00a4da38f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a4da3930 sys_read() at sys_read+0x86/frame 0xfffffe00a4da3980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4da3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4da3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800829baa, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42728 tid 100598 td 0xfffff8021ff01580 (CPU 2) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42722 tid 102361 td 0xfffff805db0ff000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d1df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d1e10 trap() at trap+0x49/frame 0xfffffe00071d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d1f20 --- trap 0x13, rip = 0xffffffff80eccde7, rsp = 0xfffffe00a4985200, rbp = 0xfffffe00a4985230 --- vm_phys_free_pages() at vm_phys_free_pages+0x107/frame 0xfffffe00a4985230 vm_page_release() at vm_page_release+0x4b/frame 0xfffffe00a4985270 uma_zfree_arg() at uma_zfree_arg+0x620/frame 0xfffffe00a49852d0 vm_object_page_remove() at vm_object_page_remove+0x24a/frame 0xfffffe00a4985320 vnode_pager_setsize() at vnode_pager_setsize+0xb1/frame 0xfffffe00a4985370 trunc_pages() at trunc_pages+0xc2/frame 0xfffffe00a49853b0 softdep_setup_freeblocks() at softdep_setup_freeblocks+0x8cb/frame 0xfffffe00a4985420 ffs_truncate() at ffs_truncate+0x6bf/frame 0xfffffe00a4985620 ufs_inactive() at ufs_inactive+0x1cd/frame 0xfffffe00a4985660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a4985690 vinactive() at vinactive+0xe6/frame 0xfffffe00a49856e0 vputx() at vputx+0x320/frame 0xfffffe00a4985740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00a4985980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4985ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4985ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8008217fa, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42720 tid 100689 td 0xfffff8021feb4580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00007ffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00007ffe10 trap() at trap+0x49/frame 0xfffffe00007fff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00007fff20 --- trap 0x13, rip = 0xffffffff80b55c80, rsp = 0xfffffe00a28bd4e0, rbp = 0xfffffe00a28bd520 --- __mtx_lock_flags() at __mtx_lock_flags+0xb0/frame 0xfffffe00a28bd520 zone_fetch_slab() at zone_fetch_slab+0x49/frame 0xfffffe00a28bd560 zone_import() at zone_import+0x53/frame 0xfffffe00a28bd5d0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00a28bd610 uma_zalloc_arg() at uma_zalloc_arg+0x676/frame 0xfffffe00a28bd680 malloc() at malloc+0x114/frame 0xfffffe00a28bd6d0 cloneuio() at cloneuio+0x2c/frame 0xfffffe00a28bd700 vn_io_fault1() at vn_io_fault1+0x141/frame 0xfffffe00a28bd840 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a28bd8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a28bd8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a28bd930 sys_read() at sys_read+0x86/frame 0xfffffe00a28bd980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a28bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a28bdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800829baa, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command mkdir pid 42705 tid 100832 td 0xfffff801ac10a000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cd7df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cd7e10 trap() at trap+0x49/frame 0xfffffe0000cd7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cd7f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a2b8a360, rbp = 0xfffffe00a2b8a370 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a2b8a370 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a2b8a400 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a2b8a440 softdep_load_inodeblock() at softdep_load_inodeblock+0x54/frame 0xfffffe00a2b8a470 ffs_vgetf() at ffs_vgetf+0x365/frame 0xfffffe00a2b8a4f0 ffs_valloc() at ffs_valloc+0x567/frame 0xfffffe00a2b8a580 ufs_mkdir() at ufs_mkdir+0xd0/frame 0xfffffe00a2b8a730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a2b8a760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a2b8a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2b8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2b8aab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffd958, rbp = 0x7fffffffdd80 --- Tracing command mkdir pid 42699 tid 101601 td 0xfffff80823952580 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cb3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cb3e10 trap() at trap+0x49/frame 0xfffffe0000cb3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cb3f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a3a9f1c0, rbp = 0xfffffe00a3a9f1d0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a3a9f1d0 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a3a9f260 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a3a9f2a0 softdep_setup_blkfree() at softdep_setup_blkfree+0x58/frame 0xfffffe00a3a9f2e0 ffs_blkfree_cg() at ffs_blkfree_cg+0x457/frame 0xfffffe00a3a9f380 ffs_blkfree() at ffs_blkfree+0x9b/frame 0xfffffe00a3a9f3e0 freework_freeblock() at freework_freeblock+0x5b1/frame 0xfffffe00a3a9f440 handle_workitem_freeblocks() at handle_workitem_freeblocks+0x139/frame 0xfffffe00a3a9f490 softdep_setup_freeblocks() at softdep_setup_freeblocks+0x8b9/frame 0xfffffe00a3a9f500 ffs_truncate() at ffs_truncate+0x6bf/frame 0xfffffe00a3a9f700 ufs_inactive() at ufs_inactive+0x1cd/frame 0xfffffe00a3a9f740 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a3a9f770 vinactive() at vinactive+0xe6/frame 0xfffffe00a3a9f7c0 vputx() at vputx+0x320/frame 0xfffffe00a3a9f820 kern_rmdirat() at kern_rmdirat+0x1c9/frame 0xfffffe00a3a9f980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3a9fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3a9fab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffd4f8, rbp = 0x7fffffffd930 --- Tracing command mkdir pid 42698 tid 100171 td 0xfffff8003ab51580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c5e10 trap() at trap+0x49/frame 0xfffffe00071c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c5f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe009f2a4550, rbp = 0xfffffe009f2a4560 --- lock_delay() at lock_delay+0x42/frame 0xfffffe009f2a4560 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe009f2a45f0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe009f2a4630 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe009f2a4660 newdirrem() at newdirrem+0xe0/frame 0xfffffe009f2a4700 softdep_setup_remove() at softdep_setup_remove+0x4e/frame 0xfffffe009f2a4740 ufs_dirremove() at ufs_dirremove+0x1bb/frame 0xfffffe009f2a47a0 ufs_rmdir() at ufs_rmdir+0x114/frame 0xfffffe009f2a47f0 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x11d/frame 0xfffffe009f2a4820 kern_rmdirat() at kern_rmdirat+0x1a4/frame 0xfffffe009f2a4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2a4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2a4ab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffbb78, rbp = 0x7fffffffbfb0 --- Tracing command mkdir pid 42693 tid 102179 td 0xfffff8020f106580 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fa9a70 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff81fa9a90 trap() at trap+0x49/frame 0xffffffff81fa9ba0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fa9ba0 --- trap 0x13, rip = 0x8007220ba, rsp = 0x7fffffffcc78, rbp = 0x7fffffffd0b0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 46726 46713 801 0 D+ vmpfw 0xfffff808620378b0 egrep 46724 42622 2205 0 D+ biord 0xfffffe00028bfe18 grep 46723 42622 2205 0 D+ vmpfw 0xfffff808620378b0 egrep 46720 0 0 0 DL mdwait 0xfffff8066ab12000 [md11] 46713 804 801 0 S+ wait 0xfffff8020c6bb000 sh 42743 42713 2205 0 R+ rw 42742 42713 2205 0 R+ rw 42741 42713 2205 0 R+ CPU 6 rw 42740 42713 2205 0 RL+ CPU 9 rw 42739 42713 2205 0 RL+ CPU 5 rw 42738 42713 2205 0 R+ rw 42737 42713 2205 0 R+ rw 42736 42713 2205 0 R+ rw 42735 42713 2205 0 RL+ rw 42734 42714 2205 0 R+ CPU 7 creat 42733 42713 2205 0 R+ CPU 10 rw 42732 42714 2205 0 R+ creat 42731 42713 2205 0 RL+ rw 42730 42714 2205 0 R+ creat 42729 42715 2205 0 D+ swread 0xfffff80240e99a8c swap 42728 42713 2205 0 R+ CPU 2 rw 42727 42714 2205 0 R+ creat 42726 42715 2205 0 D+ swread 0xfffff8078877548c swap 42725 42713 2205 0 R+ rw 42724 42714 2205 0 R+ creat 42723 42715 2205 0 D+ swread 0xfffff8022ed66a8c swap 42722 42713 2205 0 R+ CPU 4 rw 42721 42714 2205 0 R+ creat 42720 42713 2205 0 R+ CPU 1 rw 42719 42715 2205 0 R+ swap 42718 42714 2205 0 R+ creat 42717 42713 2205 0 RL+ rw 42715 42681 2205 0 SW+ wait 0xfffff80056465000 swap 42714 42682 2205 0 SW+ wait 0xfffff80265c12a70 creat 42713 42685 2205 0 SW+ wait 0xfffff8022fbb5000 rw 42705 42686 2205 0 R+ CPU 11 mkdir 42704 42686 2205 0 R+ mkdir 42703 42686 2205 0 R+ mkdir 42702 42686 2205 0 R+ mkdir 42701 42686 2205 0 R+ mkdir 42700 42686 2205 0 D+ getblk 0xfffffe0005c87530 mkdir 42699 42686 2205 0 R+ CPU 8 mkdir 42698 42686 2205 0 R+ CPU 3 mkdir 42697 42686 2205 0 D+ getblk 0xfffffe0005c87530 mkdir 42696 42686 2205 0 R+ mkdir 42695 42686 2205 0 R+ mkdir 42694 42686 2205 0 R+ mkdir 42693 42686 2205 0 R+ CPU 0 mkdir 42692 42686 2205 0 R+ mkdir 42691 42686 2205 0 R+ mkdir 42690 42686 2205 0 D+ getblk 0xfffffe0005c87530 mkdir 42689 42686 2205 0 R+ mkdir 42688 42686 2205 0 R+ mkdir 42686 42684 2205 0 SW+ wait 0xfffff805fded5000 mkdir 42685 42679 2205 0 S+ nanslp 0xffffffff81df7453 rw 42684 42679 2205 0 S+ nanslp 0xffffffff81df7458 mkdir 42682 42679 2205 0 S+ nanslp 0xffffffff81df745b creat 42681 42679 2205 0 S+ nanslp 0xffffffff81df7450 swap 42679 42678 2205 0 SW+ wait 0xfffff80056cfaa70 run 42678 42672 2205 0 SW+ wait 0xfffff802ba0ae538 run 42672 42636 2205 0 S+ nanslp 0xffffffff81df7456 run 42636 42622 2205 0 SW+ wait 0xfffff8048465d000 sh 42632 0 0 0 DL mdwait 0xfffff801dd13e000 [md10] 42622 42620 2205 0 SW+ wait 0xfffff80236cf9a70 sh 42621 2205 2205 0 S+ piperd 0xfffff8022c3b78e8 tee 42620 2205 2205 0 SW+ wait 0xfffff805fded6538 sh 27860 27859 27860 2006 Ss+ select 0xfffff80003c97440 bash 27859 27856 27856 2006 S select 0xfffff807cbef1a40 sshd 27856 729 27856 0 Ss select 0xfffff807cbef1ec0 sshd 95179 1 95179 0 Ss nanslp 0xffffffff81df7450 watchdogd 2205 790 2205 0 SW+ wait 0xfffff80056cfa000 sh 807 801 801 0 S+ piperd 0xfffff8003af888e8 sh 805 801 801 0 S+ piperd 0xfffff8003ae285f0 awk 804 801 801 0 S+ wait 0xfffff8003ac79a70 sh 801 790 801 0 SW+ wait 0xfffff80056dc8000 sh 790 788 790 0 S+ select 0xfffff801a10d86c0 bash 788 787 788 0 SW+ pause 0xfffff8003afb8b18 csh 787 786 787 2006 SW+ wait 0xfffff80056dc8538 su 786 785 786 2006 SWs+ wait 0xfffff8003afb9000 bash 785 782 782 2006 R sshd 782 729 782 0 Ss select 0xfffff8003a8cc240 sshd 779 776 779 0 S+ ttyin 0xfffff800071d6cb0 csh 776 1 776 0 SWs+ wait 0xfffff80056dc8a70 login 775 1 775 0 Ss+ ttyin 0xfffff800071d78b0 getty 774 1 774 0 Ss+ ttyin 0xfffff8003aa7dcb0 getty 773 1 773 0 Ss+ ttyin 0xfffff8003aa7e0b0 getty 772 1 772 0 Ss+ ttyin 0xfffff8003aa7e4b0 getty 771 1 771 0 Ss+ ttyin 0xfffff8003aa7e8b0 getty 770 1 770 0 Ss+ ttyin 0xfffff8003aa7ecb0 getty 769 1 769 0 Ss+ ttyin 0xfffff8003aa800b0 getty 768 1 768 0 Ss+ ttyin 0xfffff8003aa804b0 getty 767 1 767 0 Ss+ ttyin 0xfffff8003aa808b0 getty 733 1 733 0 SWs nanslp 0xffffffff81df7459 cron 729 1 729 0 Ss select 0xfffff80003c97940 sshd 662 1 662 0 Ss rpcsvc 0xfffff8003a961a60 NLM: master 659 1 659 0 Ss select 0xfffff8003a9082c0 rpc.statd 646 1 646 65 Ss select 0xfffff80003c979c0 dhclient 592 1 592 0 Ss select 0xfffff800070dc240 dhclient 589 1 589 0 Ss select 0xfffff800566c65c0 dhclient 577 1 577 0 Ss select 0xfffff8003a8cc340 casperd 576 1 576 0 Ss select 0xfffff800070d6240 casperd 532 1 532 0 Ss select 0xfffff80056546540 rpcbind 527 1 527 0 Ss select 0xfffff800566c6640 syslogd 452 1 452 0 Ss select 0xfffff8003a908440 devd 33 0 0 0 DL syncer 0xffffffff81f99880 [syncer] 32 0 0 0 DL vlruwt 0xfffff8003a893000 [vnlru] 31 0 0 0 DL (threaded) [bufdaemon] 100131 D qsleep 0xffffffff81f98d20 [bufdaemon] 100133 D - 0xffffffff81a0a480 [bufspacedaemon-0] 100134 D - 0xffffffff81a12740 [bufspacedaemon-1] 100136 D - 0xffffffff81a1aa00 [bufspacedaemon-2] 100137 D - 0xffffffff81a22cc0 [bufspacedaemon-3] 100138 D - 0xffffffff81a2af80 [bufspacedaemon-4] 100139 D - 0xffffffff81a33240 [bufspacedaemon-5] 100140 D - 0xffffffff81a3b500 [bufspacedaemon-6] 100151 D sdflush 0xfffff8003a8c22e8 [/ worker] 100210 D sdflush 0xfffff801a1394ae8 [/tmp worker] 103327 D sdflush 0xfffff807b123cae8 [/mnt worker] 30 0 0 0 DL psleep 0xffffffff81fa5740 [vmdaemon] 29 0 0 0 DL (threaded) [pagedaemon] 100127 D pwait 0xffffffff81df61e3 [dom0] 100129 D wswbuf0 0xffffffff81fa166c [laundry: dom0] 100130 D umarcl 0xffffffff80ea6610 [uma] 28 0 0 0 DL idle 0xfffff8003a7a5000 [enc_daemon1] 27 0 0 0 DL idle 0xfffff8003a7a5538 [enc_daemon0] 26 0 0 0 DL - 0xffffffff81cc8390 [rand_harvestq] 25 0 0 0 DL waiting 0xffffffff82014640 [sctp_iterator] 24 0 0 0 DL - 0xffffffff81f9871c [soaiod4] 23 0 0 0 DL - 0xffffffff81f9871c [soaiod3] 22 0 0 0 DL - 0xffffffff81f9871c [soaiod2] 21 0 0 0 DL - 0xffffffff81f9871c [soaiod1] 20 0 0 0 DL (threaded) [usb] 100095 D - 0xfffffe009c7dd460 [usbus0] 100096 D - 0xfffffe009c7dd4b8 [usbus0] 100097 D - 0xfffffe009c7dd510 [usbus0] 100098 D - 0xfffffe009c7dd568 [usbus0] 100099 D - 0xfffffe009c7dd5c0 [usbus0] 100101 D - 0xfffffe009a5ead10 [usbus1] 100102 D - 0xfffffe009a5ead68 [usbus1] 100103 D - 0xfffffe009a5eadc0 [usbus1] 100104 D - 0xfffffe009a5eae18 [usbus1] 100105 D - 0xfffffe009a5eae70 [usbus1] 100106 D - 0xfffffe009ca50d10 [usbus2] 100107 D - 0xfffffe009ca50d68 [usbus2] 100108 D - 0xfffffe009ca50dc0 [usbus2] 100109 D - 0xfffffe009ca50e18 [usbus2] 100110 D - 0xfffffe009ca50e70 [usbus2] 19 0 0 0 DL (threaded) [cam] 100090 D - 0xffffffff81ba35c0 [doneq0] 100091 D - 0xffffffff81ba3640 [doneq1] 100092 D - 0xffffffff81ba36c0 [doneq2] 100124 D - 0xffffffff81ba3488 [scanner] 18 0 0 0 DL crypto_ 0xfffff80003681450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff800036813f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff80003681390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff80003681330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff800036812d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003681270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003681210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800036811b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003681150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800036810f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003681090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003681030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81f9fd28 [crypto] 13 0 0 0 DL (threaded) [geom] 100061 D - 0xffffffff81ff0e80 [g_event] 100062 D - 0xffffffff81ff0e90 [g_up] 100063 D - 0xffffffff81ff0e78 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi5: fast taskq] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100093 I [irq264: ahci0] 100094 I [irq19: xhci0] 100100 I [irq18: ehci0 ehci1] 100111 I [irq279: ahci1] 100112 I [swi0: uart uart] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff8000364a538 [init] 10 0 0 0 DL audit_w 0xffffffff82015350 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81ff0ec0 [swapper] 100016 D - 0xfffff800030bab00 [aiod_kick taskq] 100017 D - 0xfffff800030baa00 [kqueue_ctx taskq] 100020 D - 0xfffff800030ba700 [thread taskq] 100021 D - 0xfffff800030ba600 [if_config_tqg_0] 100022 D - 0xfffff800030ba500 [config_0] 100023 D - 0xfffff800030ba400 [if_io_tqg_0] 100024 D - 0xfffff800030ba300 [if_io_tqg_1] 100025 D - 0xfffff800030ba200 [if_io_tqg_2] 100026 D - 0xfffff800030ba100 [if_io_tqg_3] 100027 D - 0xfffff800030ba000 [if_io_tqg_4] 100028 D - 0xfffff800030b9e00 [if_io_tqg_5] 100029 D - 0xfffff800030b9d00 [if_io_tqg_6] 100030 D - 0xfffff800030b9c00 [if_io_tqg_7] 100031 D - 0xfffff800030b9b00 [if_io_tqg_8] 100032 D - 0xfffff800030b9a00 [if_io_tqg_9] 100033 D - 0xfffff800030b9900 [if_io_tqg_10] 100034 D - 0xfffff800030b9800 [if_io_tqg_11] 100035 D - 0xfffff800030b9700 [softirq_0] 100036 D - 0xfffff800030b9600 [softirq_1] 100037 D - 0xfffff800030b9500 [softirq_2] 100038 D - 0xfffff800030b9400 [softirq_3] 100039 D - 0xfffff800030b9300 [softirq_4] 100040 D - 0xfffff800030b9200 [softirq_5] 100041 D - 0xfffff800030b9100 [softirq_6] 100042 D - 0xfffff800030b9000 [softirq_7] 100043 D - 0xfffff800030b8e00 [softirq_8] 100044 D - 0xfffff800030b8d00 [softirq_9] 100045 D - 0xfffff800030b8c00 [softirq_10] 100046 D - 0xfffff800030b8b00 [softirq_11] 100064 D - 0xfffff800030b8a00 [firmware taskq] 100065 D - 0xfffff800030b8900 [crypto_0] 100066 D - 0xfffff800030b8900 [crypto_1] 100067 D - 0xfffff800030b8900 [crypto_2] 100068 D - 0xfffff800030b8900 [crypto_3] 100069 D - 0xfffff800030b8900 [crypto_4] 100070 D - 0xfffff800030b8900 [crypto_5] 100071 D - 0xfffff800030b8900 [crypto_6] 100072 D - 0xfffff800030b8900 [crypto_7] 100073 D - 0xfffff800030b8900 [crypto_8] 100074 D - 0xfffff800030b8900 [crypto_9] 100075 D - 0xfffff800030b8900 [crypto_10] 100076 D - 0xfffff800030b8900 [crypto_11] 100113 D - 0xfffff8000719da00 [mca taskq] 100120 D - 0xfffff8003a8da300 [acpi_task_0] 100121 D - 0xfffff8003a8da300 [acpi_task_1] 100122 D - 0xfffff8003a8da300 [acpi_task_2] 100123 D - 0xfffff800030b8800 [CAM taskq] db:0:pho> allt Tracing command egrep pid 46726 tid 100271 td 0xfffff801a159b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a1490640 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a1490670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a14906b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a14906e0 _sleep() at _sleep+0x3a9/frame 0xfffffe00a1490780 vm_page_busy_sleep() at vm_page_busy_sleep+0xc5/frame 0xfffffe00a14907b0 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0xb0/frame 0xfffffe00a14907e0 vm_fault_hold() at vm_fault_hold+0x2df/frame 0xfffffe00a1490910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a1490950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe00a14909a0 trap() at trap+0x3a9/frame 0xfffffe00a1490ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a1490ab0 --- trap 0xc, rip = 0x217e08, rsp = 0x7fffffffdaa8, rbp = 0x7fffffffdf20 --- Tracing command grep pid 46724 tid 100328 td 0xfffff8003af40000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a15a8410 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a15a8440 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a15a8480 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a15a84b0 _sleep() at _sleep+0x3a9/frame 0xfffffe00a15a8550 bufwait() at bufwait+0x84/frame 0xfffffe00a15a8590 breadn_flags() at breadn_flags+0x1df/frame 0xfffffe00a15a8600 vfs_bio_getpages() at vfs_bio_getpages+0x2d2/frame 0xfffffe00a15a86e0 ffs_getpages() at ffs_getpages+0x78/frame 0xfffffe00a15a8700 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0xfd/frame 0xfffffe00a15a8730 vnode_pager_getpages() at vnode_pager_getpages+0x6d/frame 0xfffffe00a15a87a0 vm_pager_get_pages() at vm_pager_get_pages+0x4d/frame 0xfffffe00a15a87e0 vm_fault_hold() at vm_fault_hold+0x17a5/frame 0xfffffe00a15a8910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a15a8950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe00a15a89a0 trap() at trap+0x3a9/frame 0xfffffe00a15a8ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a15a8ab0 --- trap 0xc, rip = 0x217e08, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc10 --- Tracing command egrep pid 46723 tid 100164 td 0xfffff8003a7ab580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f281640 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f281670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2816b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009f2816e0 _sleep() at _sleep+0x3a9/frame 0xfffffe009f281780 vm_page_busy_sleep() at vm_page_busy_sleep+0xc5/frame 0xfffffe009f2817b0 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0xb0/frame 0xfffffe009f2817e0 vm_fault_hold() at vm_fault_hold+0x2df/frame 0xfffffe009f281910 vm_fault() at vm_fault+0x60/frame 0xfffffe009f281950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe009f2819a0 trap() at trap+0x3a9/frame 0xfffffe009f281ab0 calltrap() at calltrap+0x8/frame 0xfffffe009f281ab0 --- trap 0xc, rip = 0x217e08, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc10 --- Tracing command md11 pid 46720 tid 100155 td 0xfffff8003afc5000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2548d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f254900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f254940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009f254970 _sleep() at _sleep+0x3a9/frame 0xfffffe009f254a10 md_kthread() at md_kthread+0x1e5/frame 0xfffffe009f254a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009f254ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009f254ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 46713 tid 100592 td 0xfffff80484753580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a26d6560 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a26d6590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a26d65d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a26d6630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a26d6660 _sleep() at _sleep+0x39c/frame 0xfffffe00a26d6700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a26d6790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a26d6980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26d6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26d6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003feb9a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4c0 --- Tracing command rw pid 42743 tid 102371 td 0xfffff8025c6bd000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a49b6da0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a49b6dd0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a49b6e10 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a49b6e40 sleeplk() at sleeplk+0x149/frame 0xfffffe00a49b6ea0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a49b6f20 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a49b6fc0 getblkx() at getblkx+0x12d/frame 0xfffffe00a49b70a0 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a49b7110 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a49b7180 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00a49b7200 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a49b7250 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00a49b72c0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00a49b7460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a49b7500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a49b7610 vn_write() at vn_write+0x26b/frame 0xfffffe00a49b7690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a49b76f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a49b7830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a49b78a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a49b78f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a49b7930 sys_write() at sys_write+0x86/frame 0xfffffe00a49b7980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a49b7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a49b7ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42742 tid 101726 td 0xfffff80265073580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3d12010 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3d12040 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3d12080 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3d120b0 _sleep() at _sleep+0x3a9/frame 0xfffffe00a3d12150 bufwait() at bufwait+0xc4/frame 0xfffffe00a3d12190 bufwrite() at bufwrite+0x248/frame 0xfffffe00a3d121e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a3d12240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a3d122d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a3d12460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a3d12500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a3d12610 vn_write() at vn_write+0x26b/frame 0xfffffe00a3d12690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a3d126f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a3d12830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a3d128a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a3d128f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a3d12930 sys_write() at sys_write+0x86/frame 0xfffffe00a3d12980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3d12ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3d12ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42741 tid 100729 td 0xfffff80176d02580 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e9e10 trap() at trap+0x49/frame 0xfffffe00071e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e9f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a2985160, rbp = 0xfffffe00a2985170 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a2985170 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a2985200 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a2985240 softdep_request_cleanup() at softdep_request_cleanup+0x11f/frame 0xfffffe00a29852d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a2985460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a2985500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a2985610 vn_write() at vn_write+0x26b/frame 0xfffffe00a2985690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a29856f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a2985830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a29858a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a29858f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a2985930 sys_write() at sys_write+0x86/frame 0xfffffe00a2985980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2985ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2985ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42740 tid 100214 td 0xfffff800567d3580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cbfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cbfe10 trap() at trap+0x49/frame 0xfffffe0000cbff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cbff20 --- trap 0x13, rip = 0xffffffff80bbee40, rsp = 0xfffffe009f3710b0, rbp = 0xfffffe009f3710c0 --- lock_delay() at lock_delay+0x40/frame 0xfffffe009f3710c0 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe009f371150 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe009f371190 handle_workitem_freefile() at handle_workitem_freefile+0x19a/frame 0xfffffe009f3711d0 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe009f371240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe009f3712d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe009f371460 ffs_write() at ffs_write+0x20f/frame 0xfffffe009f371500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe009f371610 vn_write() at vn_write+0x26b/frame 0xfffffe009f371690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe009f3716f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe009f371830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe009f3718a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe009f3718f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe009f371930 sys_write() at sys_write+0x86/frame 0xfffffe009f371980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f371ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f371ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42739 tid 100617 td 0xfffff8021f747000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071dde10 trap() at trap+0x49/frame 0xfffffe00071ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071ddf20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a27530b0, rbp = 0xfffffe00a27530c0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a27530c0 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a2753150 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a2753190 handle_workitem_freefile() at handle_workitem_freefile+0x3d/frame 0xfffffe00a27531d0 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe00a2753240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe00a27532d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a2753460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a2753500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a2753610 vn_write() at vn_write+0x26b/frame 0xfffffe00a2753690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a27536f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a2753830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a27538a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a27538f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a2753930 sys_write() at sys_write+0x86/frame 0xfffffe00a2753980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2753ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2753ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42738 tid 100175 td 0xfffff8003ab41580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2b7da0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2b7dd0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2b7e10 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009f2b7e40 sleeplk() at sleeplk+0x149/frame 0xfffffe009f2b7ea0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe009f2b7f20 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe009f2b7fc0 getblkx() at getblkx+0x12d/frame 0xfffffe009f2b80a0 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe009f2b8110 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe009f2b8180 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe009f2b8200 ffs_hashalloc() at ffs_hashalloc+0xc4/frame 0xfffffe009f2b8250 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe009f2b82c0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe009f2b8460 ffs_write() at ffs_write+0x20f/frame 0xfffffe009f2b8500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe009f2b8610 vn_write() at vn_write+0x26b/frame 0xfffffe009f2b8690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe009f2b86f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe009f2b8830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe009f2b88a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe009f2b88f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe009f2b8930 sys_write() at sys_write+0x86/frame 0xfffffe009f2b8980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2b8ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42737 tid 102151 td 0xfffff8023c030580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a4567010 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a4567040 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a4567080 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a45670b0 _sleep() at _sleep+0x3a9/frame 0xfffffe00a4567150 bufwait() at bufwait+0xc4/frame 0xfffffe00a4567190 bufwrite() at bufwrite+0x248/frame 0xfffffe00a45671e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a4567240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a45672d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a4567460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a4567500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a4567610 vn_write() at vn_write+0x26b/frame 0xfffffe00a4567690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a45676f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a4567830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a45678a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a45678f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a4567930 sys_write() at sys_write+0x86/frame 0xfffffe00a4567980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4567ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4567ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42736 tid 102155 td 0xfffff802284b6580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a457ba40 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a457ba70 ast() at ast+0x28b/frame 0xfffffe00a457bab0 fast_syscall_common() at fast_syscall_common+0x187/frame 0xfffffe00a457bab0 --- syscall (4096), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42735 tid 100848 td 0xfffff801ac10a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a2bd9d30 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a2bd9d60 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a2bd9da0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a2bd9dd0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a2bd9e30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a2bd9eb0 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a2bd9f50 getblkx() at getblkx+0x12d/frame 0xfffffe00a2bda030 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a2bda0a0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a2bda110 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00a2bda190 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00a2bda1d0 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe00a2bda240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe00a2bda2d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a2bda460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a2bda500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a2bda610 vn_write() at vn_write+0x26b/frame 0xfffffe00a2bda690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a2bda6f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a2bda830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a2bda8a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a2bda8f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a2bda930 sys_write() at sys_write+0x86/frame 0xfffffe00a2bda980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2bdaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2bdaab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42734 tid 100276 td 0xfffff80056dcd580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071f5e10 trap() at trap+0x49/frame 0xfffffe00071f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f5f20 --- trap 0x13, rip = 0xffffffff80bbee40, rsp = 0xfffffe00a14a9200, rbp = 0xfffffe00a14a9210 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00a14a9210 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a14a92a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a14a92e0 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe00a14a9310 softdep_setup_inomapdep() at softdep_setup_inomapdep+0x13a/frame 0xfffffe00a14a9370 ffs_nodealloccg() at ffs_nodealloccg+0x5a0/frame 0xfffffe00a14a9410 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a14a9460 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00a14a94f0 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00a14a9680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a14a96a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a14a96d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a14a9810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a14a9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a14a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a14a9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42733 tid 102571 td 0xfffff8024b9bf580 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000ccbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000ccbe10 trap() at trap+0x49/frame 0xfffffe0000ccbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000ccbf20 --- trap 0x13, rip = 0xffffffff80bbee40, rsp = 0xfffffe00a4da3520, rbp = 0xfffffe00a4da3530 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00a4da3530 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe00a4da35b0 __mtx_lock_flags() at __mtx_lock_flags+0xf9/frame 0xfffffe00a4da3600 zone_release() at zone_release+0x49/frame 0xfffffe00a4da3660 uma_zfree_arg() at uma_zfree_arg+0x620/frame 0xfffffe00a4da36c0 free() at free+0xa5/frame 0xfffffe00a4da3700 vn_io_fault1() at vn_io_fault1+0x3b1/frame 0xfffffe00a4da3840 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a4da38b0 dofileread() at dofileread+0x95/frame 0xfffffe00a4da38f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a4da3930 sys_read() at sys_read+0x86/frame 0xfffffe00a4da3980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4da3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4da3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800829baa, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42732 tid 101564 td 0xfffff80241e15580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a39e3d80 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a39e3db0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a39e3df0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a39e3e20 sleeplk() at sleeplk+0x149/frame 0xfffffe00a39e3e80 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a39e3f00 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a39e3fa0 getblkx() at getblkx+0x12d/frame 0xfffffe00a39e4080 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a39e40f0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a39e4160 ffs_realloccg() at ffs_realloccg+0x38c/frame 0xfffffe00a39e4270 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00a39e4420 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00a39e44f0 ufs_makeinode() at ufs_makeinode+0x61c/frame 0xfffffe00a39e4680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a39e46a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a39e46d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a39e4810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a39e4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a39e4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a39e4ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42731 tid 100219 td 0xfffff8003afc3000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f389cb0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f389ce0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f389d20 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009f389d50 sleeplk() at sleeplk+0x149/frame 0xfffffe009f389db0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe009f389e30 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe009f389ed0 getblkx() at getblkx+0x12d/frame 0xfffffe009f389fb0 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe009f38a020 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe009f38a090 ffs_blkfree_cg() at ffs_blkfree_cg+0xff/frame 0xfffffe009f38a130 ffs_blkfree() at ffs_blkfree+0x9b/frame 0xfffffe009f38a190 handle_workitem_freefrag() at handle_workitem_freefrag+0xb3/frame 0xfffffe009f38a1d0 process_worklist_item() at process_worklist_item+0x245/frame 0xfffffe009f38a240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe009f38a2d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe009f38a460 ffs_write() at ffs_write+0x20f/frame 0xfffffe009f38a500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe009f38a610 vn_write() at vn_write+0x26b/frame 0xfffffe009f38a690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe009f38a6f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe009f38a830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe009f38a8a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe009f38a8f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe009f38a930 sys_write() at sys_write+0x86/frame 0xfffffe009f38a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f38aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f38aab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42730 tid 100599 td 0xfffff8039dfb7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a26f8f90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a26f8fc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a26f9000 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a26f9030 sleeplk() at sleeplk+0x149/frame 0xfffffe00a26f9090 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a26f9110 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a26f91b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a26f9290 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a26f9300 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a26f9370 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00a26f9410 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a26f9460 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00a26f94f0 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00a26f9680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a26f96a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a26f96d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a26f9810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a26f9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command swap pid 42729 tid 100279 td 0xfffff8003af48000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a14b85c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a14b85f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a14b8630 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a14b8670 _sleep() at _sleep+0x34d/frame 0xfffffe00a14b8710 swap_pager_getpages() at swap_pager_getpages+0x6df/frame 0xfffffe00a14b87a0 vm_pager_get_pages() at vm_pager_get_pages+0x4d/frame 0xfffffe00a14b87e0 vm_fault_hold() at vm_fault_hold+0x17a5/frame 0xfffffe00a14b8910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a14b8950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe00a14b89a0 trap() at trap+0x3a9/frame 0xfffffe00a14b8ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a14b8ab0 --- trap 0xc, rip = 0x401e39, rsp = 0x7fffffffe5c0, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42728 tid 100598 td 0xfffff8021ff01580 (CPU 2) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42727 tid 102529 td 0xfffff807d6e6e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a4cd0d80 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a4cd0db0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a4cd0df0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a4cd0e20 sleeplk() at sleeplk+0x149/frame 0xfffffe00a4cd0e80 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a4cd0f00 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a4cd0fa0 getblkx() at getblkx+0x12d/frame 0xfffffe00a4cd1080 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a4cd10f0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a4cd1160 ffs_realloccg() at ffs_realloccg+0x38c/frame 0xfffffe00a4cd1270 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00a4cd1420 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00a4cd14f0 ufs_makeinode() at ufs_makeinode+0x61c/frame 0xfffffe00a4cd1680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a4cd16a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a4cd16d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a4cd1810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a4cd1980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4cd1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4cd1ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command swap pid 42726 tid 100159 td 0xfffff8003ae40000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2685c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2685f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f268630 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009f268670 _sleep() at _sleep+0x34d/frame 0xfffffe009f268710 swap_pager_getpages() at swap_pager_getpages+0x6df/frame 0xfffffe009f2687a0 vm_pager_get_pages() at vm_pager_get_pages+0x4d/frame 0xfffffe009f2687e0 vm_fault_hold() at vm_fault_hold+0x17a5/frame 0xfffffe009f268910 vm_fault() at vm_fault+0x60/frame 0xfffffe009f268950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe009f2689a0 trap() at trap+0x3a9/frame 0xfffffe009f268ab0 calltrap() at calltrap+0x8/frame 0xfffffe009f268ab0 --- trap 0xc, rip = 0x401e39, rsp = 0x7fffffffe5c0, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42725 tid 101440 td 0xfffff8028f4c1580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3775da0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3775dd0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3775e10 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3775e40 sleeplk() at sleeplk+0x149/frame 0xfffffe00a3775ea0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a3775f20 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a3775fc0 getblkx() at getblkx+0x12d/frame 0xfffffe00a37760a0 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a3776110 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a3776180 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00a3776200 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a3776250 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00a37762c0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00a3776460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a3776500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a3776610 vn_write() at vn_write+0x26b/frame 0xfffffe00a3776690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a37766f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a3776830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a37768a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a37768f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a3776930 sys_write() at sys_write+0x86/frame 0xfffffe00a3776980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3776ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3776ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42724 tid 100590 td 0xfffff80484724000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a26cbf90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a26cbfc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a26cc000 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a26cc030 sleeplk() at sleeplk+0x149/frame 0xfffffe00a26cc090 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a26cc110 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a26cc1b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a26cc290 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a26cc300 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a26cc370 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00a26cc410 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a26cc460 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00a26cc4f0 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00a26cc680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a26cc6a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a26cc6d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a26cc810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a26cc980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26ccab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command swap pid 42723 tid 101020 td 0xfffff80806532000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a2f3a5c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a2f3a5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a2f3a630 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a2f3a670 _sleep() at _sleep+0x34d/frame 0xfffffe00a2f3a710 swap_pager_getpages() at swap_pager_getpages+0x6df/frame 0xfffffe00a2f3a7a0 vm_pager_get_pages() at vm_pager_get_pages+0x4d/frame 0xfffffe00a2f3a7e0 vm_fault_hold() at vm_fault_hold+0x17a5/frame 0xfffffe00a2f3a910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a2f3a950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe00a2f3a9a0 trap() at trap+0x3a9/frame 0xfffffe00a2f3aab0 calltrap() at calltrap+0x8/frame 0xfffffe00a2f3aab0 --- trap 0xc, rip = 0x401e39, rsp = 0x7fffffffe5c0, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42722 tid 102361 td 0xfffff805db0ff000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d1df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d1e10 trap() at trap+0x49/frame 0xfffffe00071d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d1f20 --- trap 0x13, rip = 0xffffffff80eccde7, rsp = 0xfffffe00a4985200, rbp = 0xfffffe00a4985230 --- vm_phys_free_pages() at vm_phys_free_pages+0x107/frame 0xfffffe00a4985230 vm_page_release() at vm_page_release+0x4b/frame 0xfffffe00a4985270 uma_zfree_arg() at uma_zfree_arg+0x620/frame 0xfffffe00a49852d0 vm_object_page_remove() at vm_object_page_remove+0x24a/frame 0xfffffe00a4985320 vnode_pager_setsize() at vnode_pager_setsize+0xb1/frame 0xfffffe00a4985370 trunc_pages() at trunc_pages+0xc2/frame 0xfffffe00a49853b0 softdep_setup_freeblocks() at softdep_setup_freeblocks+0x8cb/frame 0xfffffe00a4985420 ffs_truncate() at ffs_truncate+0x6bf/frame 0xfffffe00a4985620 ufs_inactive() at ufs_inactive+0x1cd/frame 0xfffffe00a4985660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a4985690 vinactive() at vinactive+0xe6/frame 0xfffffe00a49856e0 vputx() at vputx+0x320/frame 0xfffffe00a4985740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00a4985980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4985ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4985ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8008217fa, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42721 tid 102537 td 0xfffff8025b07c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a4cf8f90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a4cf8fc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a4cf9000 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a4cf9030 sleeplk() at sleeplk+0x149/frame 0xfffffe00a4cf9090 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a4cf9110 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a4cf91b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a4cf9290 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a4cf9300 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a4cf9370 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00a4cf9410 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a4cf9460 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00a4cf94f0 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00a4cf9680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a4cf96a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a4cf96d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a4cf9810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a4cf9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4cf9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4cf9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42720 tid 100689 td 0xfffff8021feb4580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00007ffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00007ffe10 trap() at trap+0x49/frame 0xfffffe00007fff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00007fff20 --- trap 0x13, rip = 0xffffffff80b55c80, rsp = 0xfffffe00a28bd4e0, rbp = 0xfffffe00a28bd520 --- __mtx_lock_flags() at __mtx_lock_flags+0xb0/frame 0xfffffe00a28bd520 zone_fetch_slab() at zone_fetch_slab+0x49/frame 0xfffffe00a28bd560 zone_import() at zone_import+0x53/frame 0xfffffe00a28bd5d0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00a28bd610 uma_zalloc_arg() at uma_zalloc_arg+0x676/frame 0xfffffe00a28bd680 malloc() at malloc+0x114/frame 0xfffffe00a28bd6d0 cloneuio() at cloneuio+0x2c/frame 0xfffffe00a28bd700 vn_io_fault1() at vn_io_fault1+0x141/frame 0xfffffe00a28bd840 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a28bd8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a28bd8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a28bd930 sys_read() at sys_read+0x86/frame 0xfffffe00a28bd980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a28bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a28bdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800829baa, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command swap pid 42719 tid 102153 td 0xfffff8023c915580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a4571a18 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a4571a48 critical_exit() at critical_exit+0x8c/frame 0xfffffe00a4571a68 ipi_bitmap_handler() at ipi_bitmap_handler+0x7b/frame 0xfffffe00a4571aa8 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xa2/frame 0xfffffe00a4571aa8 --- interrupt, rip = 0x401e39, rsp = 0x7fffffffe5c0, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42718 tid 101609 td 0xfffff802e15e9580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3ac6f90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3ac6fc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3ac7000 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3ac7030 sleeplk() at sleeplk+0x149/frame 0xfffffe00a3ac7090 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a3ac7110 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a3ac71b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a3ac7290 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a3ac7300 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a3ac7370 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00a3ac7410 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00a3ac7460 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00a3ac74f0 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00a3ac7680 ufs_create() at ufs_create+0x34/frame 0xfffffe00a3ac76a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00a3ac76d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00a3ac7810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00a3ac7980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3ac7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3ac7ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5cfa, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42717 tid 102156 td 0xfffff8020f106000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a457fd30 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a457fd60 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a457fda0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a457fdd0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a457fe30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a457feb0 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a457ff50 getblkx() at getblkx+0x12d/frame 0xfffffe00a4580030 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a45800a0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00a4580110 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00a4580190 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00a45801d0 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe00a4580240 softdep_request_cleanup() at softdep_request_cleanup+0x295/frame 0xfffffe00a45802d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a4580460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a4580500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a4580610 vn_write() at vn_write+0x26b/frame 0xfffffe00a4580690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a45806f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a4580830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a45808a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a45808f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a4580930 sys_write() at sys_write+0x86/frame 0xfffffe00a4580980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4580ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4580ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command swap pid 42715 tid 100215 td 0xfffff800567d3000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command creat pid 42714 tid 101345 td 0xfffff80265c17000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42713 tid 102343 td 0xfffff802314bb000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command mkdir pid 42705 tid 100832 td 0xfffff801ac10a000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cd7df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cd7e10 trap() at trap+0x49/frame 0xfffffe0000cd7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cd7f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a2b8a360, rbp = 0xfffffe00a2b8a370 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a2b8a370 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a2b8a400 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a2b8a440 softdep_load_inodeblock() at softdep_load_inodeblock+0x54/frame 0xfffffe00a2b8a470 ffs_vgetf() at ffs_vgetf+0x365/frame 0xfffffe00a2b8a4f0 ffs_valloc() at ffs_valloc+0x567/frame 0xfffffe00a2b8a580 ufs_mkdir() at ufs_mkdir+0xd0/frame 0xfffffe00a2b8a730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a2b8a760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a2b8a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2b8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2b8aab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffd958, rbp = 0x7fffffffdd80 --- Tracing command mkdir pid 42704 tid 100277 td 0xfffff801a167c580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a14ae2a0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a14ae2d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a14ae310 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a14ae340 sleeplk() at sleeplk+0x149/frame 0xfffffe00a14ae3a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a14ae420 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a14ae4c0 getblkx() at getblkx+0x12d/frame 0xfffffe00a14ae5a0 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a14ae610 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a14ae690 handle_workitem_remove() at handle_workitem_remove+0x3ff/frame 0xfffffe00a14ae700 softdep_setup_remove() at softdep_setup_remove+0x20a/frame 0xfffffe00a14ae740 ufs_dirremove() at ufs_dirremove+0x1bb/frame 0xfffffe00a14ae7a0 ufs_rmdir() at ufs_rmdir+0x114/frame 0xfffffe00a14ae7f0 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x11d/frame 0xfffffe00a14ae820 kern_rmdirat() at kern_rmdirat+0x1a4/frame 0xfffffe00a14ae980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a14aeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a14aeab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffb738, rbp = 0x7fffffffbb70 --- Tracing command mkdir pid 42703 tid 101951 td 0xfffff80484426580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a417b340 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a417b370 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a417b3b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a417b3e0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a417b440 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a417b4c0 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a417b560 getblkx() at getblkx+0x12d/frame 0xfffffe00a417b640 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a417b6b0 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a417b730 ufs_inactive() at ufs_inactive+0x278/frame 0xfffffe00a417b770 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a417b7a0 vinactive() at vinactive+0xe6/frame 0xfffffe00a417b7f0 vputx() at vputx+0x320/frame 0xfffffe00a417b850 kern_chdir() at kern_chdir+0x13b/frame 0xfffffe00a417b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a417bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a417bab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8006ec96a, rsp = 0x7fffffffc038, rbp = 0x7fffffffc460 --- Tracing command mkdir pid 42702 tid 100167 td 0xfffff8003ae0d580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f290190 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2901c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f290200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009f290230 sleeplk() at sleeplk+0x149/frame 0xfffffe009f290290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe009f290310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe009f2903b0 getblkx() at getblkx+0x12d/frame 0xfffffe009f290490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe009f290500 ffs_update() at ffs_update+0x11f/frame 0xfffffe009f290580 ufs_mkdir() at ufs_mkdir+0x344/frame 0xfffffe009f290730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe009f290760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe009f290980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f290ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f290ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffb7d8, rbp = 0x7fffffffbc00 --- Tracing command mkdir pid 42701 tid 101704 td 0xfffff8023f6c8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3ca4190 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3ca41c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3ca4200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3ca4230 sleeplk() at sleeplk+0x149/frame 0xfffffe00a3ca4290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a3ca4310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a3ca43b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a3ca4490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a3ca4500 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a3ca4580 ufs_mkdir() at ufs_mkdir+0x7f3/frame 0xfffffe00a3ca4730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a3ca4760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a3ca4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3ca4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3ca4ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffd958, rbp = 0x7fffffffdd80 --- Tracing command mkdir pid 42700 tid 100173 td 0xfffff8003ab42000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2ae190 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2ae1c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2ae200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009f2ae230 sleeplk() at sleeplk+0x149/frame 0xfffffe009f2ae290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe009f2ae310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe009f2ae3b0 getblkx() at getblkx+0x12d/frame 0xfffffe009f2ae490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe009f2ae500 ffs_update() at ffs_update+0x11f/frame 0xfffffe009f2ae580 ufs_mkdir() at ufs_mkdir+0x344/frame 0xfffffe009f2ae730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe009f2ae760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe009f2ae980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2aeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2aeab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffb3a8, rbp = 0x7fffffffb7d0 --- Tracing command mkdir pid 42699 tid 101601 td 0xfffff80823952580 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cb3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cb3e10 trap() at trap+0x49/frame 0xfffffe0000cb3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cb3f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe00a3a9f1c0, rbp = 0xfffffe00a3a9f1d0 --- lock_delay() at lock_delay+0x42/frame 0xfffffe00a3a9f1d0 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe00a3a9f260 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a3a9f2a0 softdep_setup_blkfree() at softdep_setup_blkfree+0x58/frame 0xfffffe00a3a9f2e0 ffs_blkfree_cg() at ffs_blkfree_cg+0x457/frame 0xfffffe00a3a9f380 ffs_blkfree() at ffs_blkfree+0x9b/frame 0xfffffe00a3a9f3e0 freework_freeblock() at freework_freeblock+0x5b1/frame 0xfffffe00a3a9f440 handle_workitem_freeblocks() at handle_workitem_freeblocks+0x139/frame 0xfffffe00a3a9f490 softdep_setup_freeblocks() at softdep_setup_freeblocks+0x8b9/frame 0xfffffe00a3a9f500 ffs_truncate() at ffs_truncate+0x6bf/frame 0xfffffe00a3a9f700 ufs_inactive() at ufs_inactive+0x1cd/frame 0xfffffe00a3a9f740 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a3a9f770 vinactive() at vinactive+0xe6/frame 0xfffffe00a3a9f7c0 vputx() at vputx+0x320/frame 0xfffffe00a3a9f820 kern_rmdirat() at kern_rmdirat+0x1c9/frame 0xfffffe00a3a9f980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3a9fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3a9fab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffd4f8, rbp = 0x7fffffffd930 --- Tracing command mkdir pid 42698 tid 100171 td 0xfffff8003ab51580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c5df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c5e10 trap() at trap+0x49/frame 0xfffffe00071c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c5f20 --- trap 0x13, rip = 0xffffffff80bbee42, rsp = 0xfffffe009f2a4550, rbp = 0xfffffe009f2a4560 --- lock_delay() at lock_delay+0x42/frame 0xfffffe009f2a4560 __rw_wlock_hard() at __rw_wlock_hard+0x149/frame 0xfffffe009f2a45f0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe009f2a4630 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe009f2a4660 newdirrem() at newdirrem+0xe0/frame 0xfffffe009f2a4700 softdep_setup_remove() at softdep_setup_remove+0x4e/frame 0xfffffe009f2a4740 ufs_dirremove() at ufs_dirremove+0x1bb/frame 0xfffffe009f2a47a0 ufs_rmdir() at ufs_rmdir+0x114/frame 0xfffffe009f2a47f0 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x11d/frame 0xfffffe009f2a4820 kern_rmdirat() at kern_rmdirat+0x1a4/frame 0xfffffe009f2a4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2a4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2a4ab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffbb78, rbp = 0x7fffffffbfb0 --- Tracing command mkdir pid 42697 tid 101571 td 0xfffff80241e15000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3a09190 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3a091c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3a09200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3a09230 sleeplk() at sleeplk+0x149/frame 0xfffffe00a3a09290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a3a09310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a3a093b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a3a09490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a3a09500 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a3a09580 ufs_mkdir() at ufs_mkdir+0x344/frame 0xfffffe00a3a09730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a3a09760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a3a09980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3a09ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3a09ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffbc08, rbp = 0x7fffffffc030 --- Tracing command mkdir pid 42696 tid 100991 td 0xfffff805fded9580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a2ea9190 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a2ea91c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a2ea9200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a2ea9230 sleeplk() at sleeplk+0x149/frame 0xfffffe00a2ea9290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a2ea9310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a2ea93b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a2ea9490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a2ea9500 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a2ea9580 ufs_mkdir() at ufs_mkdir+0x7f3/frame 0xfffffe00a2ea9730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a2ea9760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a2ea9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2ea9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2ea9ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffccc8, rbp = 0x7fffffffd0f0 --- Tracing command mkdir pid 42695 tid 101626 td 0xfffff80236bbf000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3b1c110 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3b1c140 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3b1c180 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3b1c1b0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a3b1c210 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a3b1c290 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a3b1c330 getblkx() at getblkx+0x12d/frame 0xfffffe00a3b1c410 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a3b1c480 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a3b1c500 ffs_truncate() at ffs_truncate+0x53a/frame 0xfffffe00a3b1c700 ufs_inactive() at ufs_inactive+0x1cd/frame 0xfffffe00a3b1c740 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a3b1c770 vinactive() at vinactive+0xe6/frame 0xfffffe00a3b1c7c0 vputx() at vputx+0x320/frame 0xfffffe00a3b1c820 kern_rmdirat() at kern_rmdirat+0x1c9/frame 0xfffffe00a3b1c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3b1cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3b1cab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffd4f8, rbp = 0x7fffffffd930 --- Tracing command mkdir pid 42694 tid 102200 td 0xfffff8030162e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a465e340 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a465e370 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a465e3b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a465e3e0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a465e440 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a465e4c0 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a465e560 getblkx() at getblkx+0x12d/frame 0xfffffe00a465e640 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a465e6b0 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a465e730 ufs_inactive() at ufs_inactive+0x278/frame 0xfffffe00a465e770 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a465e7a0 vinactive() at vinactive+0xe6/frame 0xfffffe00a465e7f0 vputx() at vputx+0x320/frame 0xfffffe00a465e850 kern_chdir() at kern_chdir+0x13b/frame 0xfffffe00a465e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a465eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a465eab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8006ec96a, rsp = 0x7fffffffb3a8, rbp = 0x7fffffffb7d0 --- Tracing command mkdir pid 42693 tid 102179 td 0xfffff8020f106580 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fa9a70 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff81fa9a90 trap() at trap+0x49/frame 0xffffffff81fa9ba0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fa9ba0 --- trap 0x13, rip = 0x8007220ba, rsp = 0x7fffffffcc78, rbp = 0x7fffffffd0b0 --- Tracing command mkdir pid 42692 tid 102990 td 0xfffff8039ded0000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a55da190 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a55da1c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a55da200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a55da230 sleeplk() at sleeplk+0x149/frame 0xfffffe00a55da290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a55da310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a55da3b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a55da490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a55da500 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a55da580 ufs_mkdir() at ufs_mkdir+0x7f3/frame 0xfffffe00a55da730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a55da760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a55da980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a55daab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a55daab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffdd88, rbp = 0x7fffffffe1b0 --- Tracing command mkdir pid 42691 tid 100580 td 0xfffff8048471c580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a269a110 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a269a140 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a269a180 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a269a1b0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a269a210 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a269a290 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a269a330 getblkx() at getblkx+0x12d/frame 0xfffffe00a269a410 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a269a480 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a269a500 ffs_truncate() at ffs_truncate+0x53a/frame 0xfffffe00a269a700 ufs_inactive() at ufs_inactive+0x1cd/frame 0xfffffe00a269a740 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a269a770 vinactive() at vinactive+0xe6/frame 0xfffffe00a269a7c0 vputx() at vputx+0x320/frame 0xfffffe00a269a820 kern_rmdirat() at kern_rmdirat+0x1c9/frame 0xfffffe00a269a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a269aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a269aab0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8007220ba, rsp = 0x7fffffffcc78, rbp = 0x7fffffffd0b0 --- Tracing command mkdir pid 42690 tid 102366 td 0xfffff8025e051580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a499e190 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a499e1c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a499e200 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a499e230 sleeplk() at sleeplk+0x149/frame 0xfffffe00a499e290 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a499e310 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a499e3b0 getblkx() at getblkx+0x12d/frame 0xfffffe00a499e490 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a499e500 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a499e580 ufs_mkdir() at ufs_mkdir+0x7f3/frame 0xfffffe00a499e730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a499e760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a499e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a499eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a499eab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffd0f8, rbp = 0x7fffffffd520 --- Tracing command mkdir pid 42689 tid 101611 td 0xfffff8023183a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a3ad10e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a3ad1110 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3ad1150 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a3ad1180 sleeplk() at sleeplk+0x149/frame 0xfffffe00a3ad11e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a3ad1260 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a3ad1300 getblkx() at getblkx+0x12d/frame 0xfffffe00a3ad13e0 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a3ad1450 ffs_vgetf() at ffs_vgetf+0x2dc/frame 0xfffffe00a3ad14f0 ffs_valloc() at ffs_valloc+0x567/frame 0xfffffe00a3ad1580 ufs_mkdir() at ufs_mkdir+0xd0/frame 0xfffffe00a3ad1730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00a3ad1760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00a3ad1980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a3ad1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a3ad1ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082545a, rsp = 0x7fffffffb3a8, rbp = 0x7fffffffb7d0 --- Tracing command mkdir pid 42688 tid 101438 td 0xfffff8028f4c2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a376c340 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a376c370 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a376c3b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a376c3e0 sleeplk() at sleeplk+0x149/frame 0xfffffe00a376c440 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00a376c4c0 __lockmgr_args() at __lockmgr_args+0x545/frame 0xfffffe00a376c560 getblkx() at getblkx+0x12d/frame 0xfffffe00a376c640 breadn_flags() at breadn_flags+0x3d/frame 0xfffffe00a376c6b0 ffs_update() at ffs_update+0x11f/frame 0xfffffe00a376c730 ufs_inactive() at ufs_inactive+0x278/frame 0xfffffe00a376c770 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00a376c7a0 vinactive() at vinactive+0xe6/frame 0xfffffe00a376c7f0 vputx() at vputx+0x320/frame 0xfffffe00a376c850 kern_chdir() at kern_chdir+0x13b/frame 0xfffffe00a376c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a376cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a376cab0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8006ec96a, rsp = 0x7fffffffb3a8, rbp = 0x7fffffffb7d0 --- Tracing command mkdir pid 42686 tid 100993 td 0xfffff805fded8580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command rw pid 42685 tid 100148 td 0xfffff8003ae40580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f231700 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f231730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f231770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2317d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f231810 _sleep() at _sleep+0x33b/frame 0xfffffe009f2318b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe009f231940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe009f231980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f231ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f231ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007b5d1a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe640 --- Tracing command mkdir pid 42684 tid 102083 td 0xfffff8020cd75000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a4413700 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a4413730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a4413770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a44137d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a4413810 _sleep() at _sleep+0x33b/frame 0xfffffe00a44138b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a4413940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a4413980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4413ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4413ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007b5d1a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe640 --- Tracing command creat pid 42682 tid 103198 td 0xfffff8048441e580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a59ee700 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a59ee730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a59ee770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a59ee7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a59ee810 _sleep() at _sleep+0x33b/frame 0xfffffe00a59ee8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a59ee940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a59ee980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a59eeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a59eeab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007b5d1a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe640 --- Tracing command swap pid 42681 tid 100578 td 0xfffff8021fa83580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a2690700 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a2690730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a2690770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a26907d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a2690810 _sleep() at _sleep+0x33b/frame 0xfffffe00a26908b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a2690940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a2690980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2690ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2690ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007b5d1a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe640 --- Tracing command run pid 42679 tid 100190 td 0xfffff80056cf8580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command run pid 42678 tid 100596 td 0xfffff802100aa580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command run pid 42672 tid 100176 td 0xfffff80056036580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2bd700 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2bd730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2bd770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2bd7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f2bd810 _sleep() at _sleep+0x33b/frame 0xfffffe009f2bd8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe009f2bd940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe009f2bd980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2bdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2bdab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8007b4d1a, rsp = 0x7fffffffe578, rbp = 0x7fffffffe5c0 --- Tracing command sh pid 42636 tid 100643 td 0xfffff804844a9580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command md10 pid 42632 tid 102532 td 0xfffff808061fc580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a4ce08d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a4ce0900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a4ce0940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a4ce0970 _sleep() at _sleep+0x3a9/frame 0xfffffe00a4ce0a10 md_kthread() at md_kthread+0x1e5/frame 0xfffffe00a4ce0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a4ce0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a4ce0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 42622 tid 102340 td 0xfffff80231a02000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command tee pid 42621 tid 101016 td 0xfffff80806534000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a2f266b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a2f266e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a2f26720 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a2f26780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a2f267b0 _sleep() at _sleep+0x39c/frame 0xfffffe00a2f26850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a2f268b0 dofileread() at dofileread+0x95/frame 0xfffffe00a2f268f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a2f26930 sys_read() at sys_read+0x86/frame 0xfffffe00a2f26980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a2f26ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a2f26ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800411baa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sh pid 42620 tid 100989 td 0xfffff805fdeda580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command bash pid 27860 tid 101102 td 0xfffff80823952000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a30d6580 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a30d65b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a30d65f0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a30d6650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a30d6680 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a30d66e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a30d6720 kern_select() at kern_select+0x850/frame 0xfffffe00a30d6900 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00a30d6980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a30d6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a30d6ab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800afacba, rsp = 0x7fffffffd778, rbp = 0x7fffffffd840 --- Tracing command sshd pid 27859 tid 102355 td 0xfffff805db0ff580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a49675c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a49675f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a4967630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a4967690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a49676c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a4967720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a4967760 kern_select() at kern_select+0x850/frame 0xfffffe00a4967940 sys_select() at sys_select+0x56/frame 0xfffffe00a4967980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a4967ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a4967ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800874b8a, rsp = 0x7fffffffa5b8, rbp = 0x7fffffffa5f0 --- Tracing command sshd pid 27856 tid 100696 td 0xfffff8078883c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a28e0640 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a28e0670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a28e06b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a28e0710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a28e0740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a28e07a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a28e07e0 kern_poll() at kern_poll+0x3ea/frame 0xfffffe00a28e0960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a28e0980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a28e0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a28e0ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008134ea, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command watchdogd pid 95179 tid 100690 td 0xfffff8021feb4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a28c2700 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a28c2730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a28c2770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a28c27d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a28c2810 _sleep() at _sleep+0x33b/frame 0xfffffe00a28c28b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a28c2940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a28c2980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a28c2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a28c2ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003b5d1a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb00 --- Tracing command sh pid 2205 tid 100221 td 0xfffff8003ae7d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command sh pid 807 tid 100213 td 0xfffff8003ac7b580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f36c6b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f36c6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f36c720 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f36c780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f36c7b0 _sleep() at _sleep+0x39c/frame 0xfffffe009f36c850 pipe_read() at pipe_read+0x345/frame 0xfffffe009f36c8b0 dofileread() at dofileread+0x95/frame 0xfffffe009f36c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f36c930 sys_read() at sys_read+0x86/frame 0xfffffe009f36c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f36cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f36cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800472baa, rsp = 0x7fffffffe558, rbp = 0x7fffffffe660 --- Tracing command awk pid 805 tid 100212 td 0xfffff8003ac83000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f3676b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f3676e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f367720 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f367780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f3677b0 _sleep() at _sleep+0x39c/frame 0xfffffe009f367850 pipe_read() at pipe_read+0x345/frame 0xfffffe009f3678b0 dofileread() at dofileread+0x95/frame 0xfffffe009f3678f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f367930 sys_read() at sys_read+0x86/frame 0xfffffe009f367980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f367ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f367ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800472baa, rsp = 0x7fffffffe648, rbp = 0x7fffffffe660 --- Tracing command sh pid 804 tid 100195 td 0xfffff8003ac83580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f31c560 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f31c590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f31c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f31c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f31c660 _sleep() at _sleep+0x39c/frame 0xfffffe009f31c700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe009f31c790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009f31c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f31cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f31cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003feb9a, rsp = 0x7fffffffe648, rbp = 0x7fffffffe700 --- Tracing command sh pid 801 tid 100211 td 0xfffff80056dcc000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command bash pid 790 tid 100141 td 0xfffff8000709d580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f20e580 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f20e5b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f20e5f0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f20e650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f20e680 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f20e6e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f20e720 kern_select() at kern_select+0x850/frame 0xfffffe009f20e900 sys_pselect() at sys_pselect+0x127/frame 0xfffffe009f20e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f20eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f20eab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800afacba, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 788 tid 100208 td 0xfffff8003afc3580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command su pid 787 tid 100207 td 0xfffff80056dcc580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command bash pid 786 tid 100188 td 0xfffff8003afc4000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command sshd pid 785 tid 100170 td 0xfffff80056037000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f29f5c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f29f5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f29f630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f29f690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f29f6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f29f720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f29f760 kern_select() at kern_select+0x850/frame 0xfffffe009f29f940 sys_select() at sys_select+0x56/frame 0xfffffe009f29f980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f29fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f29fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800874b8a, rsp = 0x7fffffffa5b8, rbp = 0x7fffffffa5f0 --- Tracing command sshd pid 782 tid 100172 td 0xfffff8003ab51000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2a9640 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2a9670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2a96b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2a9710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f2a9740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f2a97a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f2a97e0 kern_poll() at kern_poll+0x3ea/frame 0xfffffe009f2a9960 sys_poll() at sys_poll+0x50/frame 0xfffffe009f2a9980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2a9ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008134ea, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command csh pid 779 tid 100192 td 0xfffff80056cf8000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f30d620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f30d650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f30d690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f30d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f30d720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f30d780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f30d7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f30d820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f30d850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f30d8b0 dofileread() at dofileread+0x95/frame 0xfffffe009f30d8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f30d930 sys_read() at sys_read+0x86/frame 0xfffffe009f30d980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f30dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f30dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004f5baa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 776 tid 100206 td 0xfffff80056dcd000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command getty pid 775 tid 100168 td 0xfffff8003af4e580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f295620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f295650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f295690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2956f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f295720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f295780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f2957b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f295820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f295850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f2958b0 dofileread() at dofileread+0x95/frame 0xfffffe009f2958f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f295930 sys_read() at sys_read+0x86/frame 0xfffffe009f295980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f295ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f295ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 774 tid 100205 td 0xfffff8003ac0f000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f34e620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f34e650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f34e690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f34e6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f34e720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f34e780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f34e7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f34e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f34e850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f34e8b0 dofileread() at dofileread+0x95/frame 0xfffffe009f34e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f34e930 sys_read() at sys_read+0x86/frame 0xfffffe009f34e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f34eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f34eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 773 tid 100204 td 0xfffff8003ac0f580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f349620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f349650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f349690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f3496f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f349720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f349780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f3497b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f349820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f349850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f3498b0 dofileread() at dofileread+0x95/frame 0xfffffe009f3498f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f349930 sys_read() at sys_read+0x86/frame 0xfffffe009f349980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f349ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f349ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 772 tid 100203 td 0xfffff8003ac17000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f344620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f344650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f344690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f3446f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f344720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f344780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f3447b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f344820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f344850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f3448b0 dofileread() at dofileread+0x95/frame 0xfffffe009f3448f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f344930 sys_read() at sys_read+0x86/frame 0xfffffe009f344980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f344ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f344ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 771 tid 100202 td 0xfffff8003ac17580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f33f620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f33f650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f33f690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f33f6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f33f720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f33f780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f33f7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f33f820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f33f850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f33f8b0 dofileread() at dofileread+0x95/frame 0xfffffe009f33f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f33f930 sys_read() at sys_read+0x86/frame 0xfffffe009f33f980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f33fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f33fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 770 tid 100201 td 0xfffff8003ac18000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f33a620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f33a650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f33a690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f33a6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f33a720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f33a780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f33a7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f33a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f33a850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f33a8b0 dofileread() at dofileread+0x95/frame 0xfffffe009f33a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f33a930 sys_read() at sys_read+0x86/frame 0xfffffe009f33a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f33aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f33aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 769 tid 100200 td 0xfffff8003ac18580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f335620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f335650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f335690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f3356f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f335720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f335780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f3357b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f335820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f335850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f3358b0 dofileread() at dofileread+0x95/frame 0xfffffe009f3358f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f335930 sys_read() at sys_read+0x86/frame 0xfffffe009f335980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f335ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f335ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 768 tid 100165 td 0xfffff8003ac19580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f286620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f286650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f286690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2866f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f286720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f286780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f2867b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f286820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f286850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f2868b0 dofileread() at dofileread+0x95/frame 0xfffffe009f2868f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f286930 sys_read() at sys_read+0x86/frame 0xfffffe009f286980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f286ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f286ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 767 tid 100166 td 0xfffff8003ac19000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f28b620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f28b650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f28b690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f28b6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f28b720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f28b780 tty_wait() at tty_wait+0x42/frame 0xfffffe009f28b7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009f28b820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009f28b850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009f28b8b0 dofileread() at dofileread+0x95/frame 0xfffffe009f28b8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009f28b930 sys_read() at sys_read+0x86/frame 0xfffffe009f28b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f28bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f28bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042cbaa, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command cron pid 733 tid 100181 td 0xfffff8003a7ab000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a26f37d0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a26f37e0 trap() at trap+0x5c/frame 0xfffffe00a26f38f0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f38f0 --- trap 0xc, rip = 0xffffffff8101f276, rsp = 0xfffffe00a26f39c0, rbp = 0xfffffe00a26f39d0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00a26f39d0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe00a26f3a70 db_command() at db_command+0x279/frame 0xfffffe00a26f3b40 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a26f3be0 db_command() at db_command+0x279/frame 0xfffffe00a26f3cb0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a26f3cc0 db_trap() at db_trap+0xef/frame 0xfffffe00a26f3d50 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe00a26f3dc0 trap() at trap+0x723/frame 0xfffffe00a26f3ed0 calltrap() at calltrap+0x8/frame 0xfffffe00a26f3ed0 --- trap 0x3, rip = 0xffffffff80bbd7cb, rsp = 0xfffffe00a26f3fa0, rbp = 0xfffffe00a26f3fb0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a26f3fb0 vpanic() at vpanic+0x1c0/frame 0xfffffe00a26f4010 panic() at panic+0x43/frame 0xfffffe00a26f4070 handle_written_inodeblock() at handle_written_inodeblock+0x614/frame 0xfffffe00a26f40c0 softdep_disk_write_complete() at softdep_disk_write_complete+0xbc/frame 0xfffffe00a26f4120 bufdone() at bufdone+0x392/frame 0xfffffe00a26f4190 bufwrite() at bufwrite+0x23a/frame 0xfffffe00a26f41e0 ffs_update() at ffs_update+0x2aa/frame 0xfffffe00a26f4240 softdep_request_cleanup() at softdep_request_cleanup+0xbb/frame 0xfffffe00a26f42d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcb1/frame 0xfffffe00a26f4460 ffs_write() at ffs_write+0x20f/frame 0xfffffe00a26f4500 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00a26f4610 vn_write() at vn_write+0x26b/frame 0xfffffe00a26f4690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a26f46f0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00a26f4830 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00a26f48a0 dofilewrite() at dofilewrite+0x97/frame 0xfffffe00a26f48f0 kern_writev() at kern_writev+0x4a/frame 0xfffffe00a26f4930 sys_write() at sys_write+0x86/frame 0xfffffe00a26f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a26f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a26f4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829b6a, rsp = 0x7fffffffd528, rbp = 0x7fffffffe5e0 --- Tracing command sshd pid 729 tid 100143 td 0xfffff8003ac85580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2185c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2185f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f218630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f218690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f2186c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f218720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f218760 kern_select() at kern_select+0x850/frame 0xfffffe009f218940 sys_select() at sys_select+0x56/frame 0xfffffe009f218980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f218ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f218ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800874b8a, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6d0 --- Tracing command rpc.lockd pid 662 tid 100156 td 0xfffff8003afc4580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2594d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f259500 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f259540 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2595a0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f2595e0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009f259650 svc_run_internal() at svc_run_internal+0x38e/frame 0xfffffe009f259790 svc_run() at svc_run+0x1fe/frame 0xfffffe009f2597f0 sys_nlm_syscall() at sys_nlm_syscall+0x776/frame 0xfffffe009f259980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f259ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f259ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002ee56a, rsp = 0x7fffffffec28, rbp = 0x7fffffffece0 --- Tracing command rpc.statd pid 659 tid 100182 td 0xfffff8003ae7f580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2db5a0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2db5d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2db610 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2db670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f2db6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009f2db720 seltdwait() at seltdwait+0x6b/frame 0xfffffe009f2db760 kern_select() at kern_select+0x850/frame 0xfffffe009f2db940 sys_select() at sys_select+0x56/frame 0xfffffe009f2db980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2dbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2dbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800421b8a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffec00 --- Tracing command dhclient pid 646 tid 100187 td 0xfffff8003ae0d000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2f4620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2f4650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2f4690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2f46f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f2f4730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009f2f47a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe009f2f47e0 kern_poll() at kern_poll+0x3ea/frame 0xfffffe009f2f4960 sys_poll() at sys_poll+0x50/frame 0xfffffe009f2f4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2f4ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003e74ea, rsp = 0x7fffffffec48, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 592 tid 100145 td 0xfffff8003ae0e000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f222640 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f222670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2226b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f222710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f222740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f2227a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f2227e0 kern_poll() at kern_poll+0x3ea/frame 0xfffffe009f222960 sys_poll() at sys_poll+0x50/frame 0xfffffe009f222980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f222ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f222ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003e74ea, rsp = 0x7fffffffec58, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 589 tid 100149 td 0xfffff8003a7bc000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2365c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2365f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f236630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f236690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f2366c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f236720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f236760 kern_select() at kern_select+0x850/frame 0xfffffe009f236940 sys_select() at sys_select+0x56/frame 0xfffffe009f236980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f236ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f236ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800448b8a, rsp = 0x7fffffffea08, rbp = 0x7fffffffeac0 --- Tracing command casperd pid 577 tid 100180 td 0xfffff800567d4000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2d15c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2d15f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2d1630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2d1690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f2d16c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f2d1720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f2d1760 kern_select() at kern_select+0x850/frame 0xfffffe009f2d1940 sys_select() at sys_select+0x56/frame 0xfffffe009f2d1980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2d1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2d1ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800851b8a, rsp = 0x7fffffffe7f8, rbp = 0x7fffffffece0 --- Tracing command casperd pid 576 tid 100179 td 0xfffff8003ab41000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2cc5c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2cc5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2cc630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2cc690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f2cc6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f2cc720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f2cc760 kern_select() at kern_select+0x850/frame 0xfffffe009f2cc940 sys_select() at sys_select+0x56/frame 0xfffffe009f2cc980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2ccab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800851b8a, rsp = 0x7fffffffe658, rbp = 0x7fffffffe720 --- Tracing command rpcbind pid 532 tid 100150 td 0xfffff8003ab52580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f23b620 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f23b650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f23b690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f23b6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f23b730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009f23b7a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe009f23b7e0 kern_poll() at kern_poll+0x3ea/frame 0xfffffe009f23b960 sys_poll() at sys_poll+0x50/frame 0xfffffe009f23b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f23bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f23bab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c54ea, rsp = 0x7fffffffca58, rbp = 0x7fffffffec70 --- Tracing command syslogd pid 527 tid 100174 td 0xfffff80003946000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2b35c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2b35f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f2b3630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f2b3690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009f2b36c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009f2b3720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009f2b3760 kern_select() at kern_select+0x850/frame 0xfffffe009f2b3940 sys_select() at sys_select+0x56/frame 0xfffffe009f2b3980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f2b3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f2b3ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800432b8a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffece0 --- Tracing command devd pid 452 tid 100154 td 0xfffff8003ab52000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f24f5a0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f24f5d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f24f610 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009f24f670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009f24f6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009f24f720 seltdwait() at seltdwait+0x6b/frame 0xfffffe009f24f760 kern_select() at kern_select+0x850/frame 0xfffffe009f24f940 sys_select() at sys_select+0x56/frame 0xfffffe009f24f980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe009f24fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009f24fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f5caa, rsp = 0x7fffffffcb58, rbp = 0x7fffffffed00 --- Tracing command syncer pid 33 tid 100135 td 0xfffff8003ab44000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f08c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005f08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f0930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005f0970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1f1/frame 0xfffffe00005f09e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00005f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 32 tid 100132 td 0xfffff8003ab44580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e1880 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005e18b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e18f0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005e1930 _sleep() at _sleep+0x34d/frame 0xfffffe00005e19d0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00005e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100131 td 0xfffff8003ab45000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005dc8d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005dc900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005dc940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005dc980 _sleep() at _sleep+0x34d/frame 0xfffffe00005dca20 buf_daemon() at buf_daemon+0xd8/frame 0xfffffe00005dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100133 td 0xfffff8000709a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e68c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005e68f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e6930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005e6970 _sleep() at _sleep+0x34d/frame 0xfffffe00005e6a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100134 td 0xfffff80007099580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005eb8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005eb8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005eb930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005eb970 _sleep() at _sleep+0x34d/frame 0xfffffe00005eba10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100136 td 0xfffff80007099000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f58c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005f58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f5930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005f5970 _sleep() at _sleep+0x34d/frame 0xfffffe00005f5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100137 td 0xfffff8003ab54580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005fa8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005fa8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fa930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005fa970 _sleep() at _sleep+0x34d/frame 0xfffffe00005faa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100138 td 0xfffff8003ab54000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ff8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005ff8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ff930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005ff970 _sleep() at _sleep+0x34d/frame 0xfffffe00005ffa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00005ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100139 td 0xfffff8003ab53580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2048c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f204930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009f204970 _sleep() at _sleep+0x34d/frame 0xfffffe009f204a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009f204a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009f204ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009f204ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100140 td 0xfffff8003ab53000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2098c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f2098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f209930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009f209970 _sleep() at _sleep+0x34d/frame 0xfffffe009f209a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009f209a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009f209ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009f209ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100151 td 0xfffff8003ab43000 sched_switch() at sched_switch+0x942/frame 0xfffffe009f2408f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f240920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f240960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009f2409a0 _sleep() at _sleep+0x34d/frame 0xfffffe009f240a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe009f240a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009f240ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009f240ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100210 td 0xfffff8003ab45580 sched_switch() at sched_switch+0x942/frame 0xfffffe009f25e8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe009f25e920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009f25e960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009f25e9a0 _sleep() at _sleep+0x34d/frame 0xfffffe009f25ea40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe009f25ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe009f25eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009f25eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 103327 td 0xfffff80228a76580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a469a8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00a469a920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a469a960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a469a9a0 _sleep() at _sleep+0x34d/frame 0xfffffe00a469aa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a469aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a469aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a469aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 30 tid 100128 td 0xfffff8003a7bf580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005cd8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005cd8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cd920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cd950 _sleep() at _sleep+0x3a9/frame 0xfffffe00005cd9f0 vm_daemon() at vm_daemon+0x85/frame 0xfffffe00005cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100127 td 0xfffff8003a899000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c84d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005c8500 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c8540 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005c8580 _sleep() at _sleep+0x34d/frame 0xfffffe00005c8620 pause_sbt() at pause_sbt+0x144/frame 0xfffffe00005c8670 vm_pageout_worker() at vm_pageout_worker+0x1da/frame 0xfffffe00005c8a50 vm_pageout() at vm_pageout+0x133/frame 0xfffffe00005c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100129 td 0xfffff8000709b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d2290 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005d22c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d2300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d2330 _sleep() at _sleep+0x3a9/frame 0xfffffe00005d23d0 getpbuf() at getpbuf+0x98/frame 0xfffffe00005d2400 swap_pager_putpages() at swap_pager_putpages+0x17c/frame 0xfffffe00005d2470 vm_pageout_flush() at vm_pageout_flush+0x144/frame 0xfffffe00005d2570 vm_pageout_cluster() at vm_pageout_cluster+0x43e/frame 0xfffffe00005d27f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x5c3/frame 0xfffffe00005d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100130 td 0xfffff8000709a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d78f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005d7920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d7960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005d79a0 _sleep() at _sleep+0x34d/frame 0xfffffe00005d7a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00005d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 28 tid 100126 td 0xfffff8003a7bc580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c38b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005c38e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c3920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c3950 _sleep() at _sleep+0x3a9/frame 0xfffffe00005c39f0 enc_daemon() at enc_daemon+0x1ca/frame 0xfffffe00005c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 27 tid 100125 td 0xfffff8003a7bd000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005be8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005be8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005be920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005be950 _sleep() at _sleep+0x3a9/frame 0xfffffe00005be9f0 enc_daemon() at enc_daemon+0x1ca/frame 0xfffffe00005bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 26 tid 100119 td 0xfffff8003a8a7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a08c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005a08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a0930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005a0970 _sleep() at _sleep+0x34d/frame 0xfffffe00005a0a10 random_kthread() at random_kthread+0x57/frame 0xfffffe00005a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 25 tid 100118 td 0xfffff8003a8a7580 sched_switch() at sched_switch+0x942/frame 0xfffffe000059b910 mi_switch() at mi_switch+0x18c/frame 0xfffffe000059b940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059b980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059b9b0 _sleep() at _sleep+0x3a9/frame 0xfffffe000059ba50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe000059ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 24 tid 100117 td 0xfffff8003a7bd580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005958e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000595910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000595950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000595990 _sleep() at _sleep+0x34d/frame 0xfffffe0000595a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe0000595a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000595ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000595ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 23 tid 100116 td 0xfffff8003a7be000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005908e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000590910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000590950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000590990 _sleep() at _sleep+0x34d/frame 0xfffffe0000590a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe0000590a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000590ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000590ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 22 tid 100115 td 0xfffff8003a7be580 sched_switch() at sched_switch+0x942/frame 0xfffffe000058b8e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000058b910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058b950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe000058b990 _sleep() at _sleep+0x34d/frame 0xfffffe000058ba30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe000058ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 21 tid 100114 td 0xfffff8003a7bf000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005868e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000586910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000586950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000586990 _sleep() at _sleep+0x34d/frame 0xfffffe0000586a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe0000586a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000586ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000586ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100095 td 0xfffff80003d0e580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000527920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000527950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000527990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005279c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000527a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000527a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000527ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000527ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100096 td 0xfffff80003d0e000 sched_switch() at sched_switch+0x942/frame 0xfffffe000052c920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000052c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000052c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052c9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000052ca30 usb_process() at usb_process+0x12b/frame 0xfffffe000052ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100097 td 0xfffff80003d0d580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000531920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000531950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000531990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005319c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000531a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000531a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000531ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000531ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100098 td 0xfffff80003d0d000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000536920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000536950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000536990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005369c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000536a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000536a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000536ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000536ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100099 td 0xfffff80003d01580 sched_switch() at sched_switch+0x942/frame 0xfffffe000053b920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000053b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000053b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000053b9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000053ba30 usb_process() at usb_process+0x12b/frame 0xfffffe000053ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000053bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000053bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100101 td 0xfffff80003948580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000545920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000545950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000545990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005459c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000545a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000545a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000545ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000545ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100102 td 0xfffff8000709d000 sched_switch() at sched_switch+0x942/frame 0xfffffe000054a920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000054a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054a9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000054aa30 usb_process() at usb_process+0x12b/frame 0xfffffe000054aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100103 td 0xfffff8000709c580 sched_switch() at sched_switch+0x942/frame 0xfffffe000054f920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000054f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054f9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000054fa30 usb_process() at usb_process+0x12b/frame 0xfffffe000054fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100104 td 0xfffff8000709c000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000554920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000554950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000554990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005549c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000554a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000554a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000554ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000554ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100105 td 0xfffff8000709b580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000559920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000559950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000559990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005599c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000559a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000559a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000559ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000559ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100106 td 0xfffff8000718a580 sched_switch() at sched_switch+0x942/frame 0xfffffe000055e920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000055e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000055e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000055e9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000055ea30 usb_process() at usb_process+0x12b/frame 0xfffffe000055ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000055eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000055eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100107 td 0xfffff8000718a000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000563920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000563950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000563990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005639c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000563a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000563a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000563ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000563ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100108 td 0xfffff80007189580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000568920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000568950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000568990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005689c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000568a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000568a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000568ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000568ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100109 td 0xfffff80007189000 sched_switch() at sched_switch+0x942/frame 0xfffffe000056d920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000056d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000056d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000056d9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe000056da30 usb_process() at usb_process+0x12b/frame 0xfffffe000056da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000056dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000056dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100110 td 0xfffff80007188580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000572920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000572950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000572990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005729c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0000572a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000572a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000572ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000572ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100090 td 0xfffff800037ab580 sched_switch() at sched_switch+0x942/frame 0xfffffe000050e8e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000050e910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000050e950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000050e980 _sleep() at _sleep+0x3a9/frame 0xfffffe000050ea20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe000050ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000050eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000050eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100091 td 0xfffff80003948000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005138e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000513910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000513950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000513980 _sleep() at _sleep+0x3a9/frame 0xfffffe0000513a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0000513a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000513ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000513ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100092 td 0xfffff80003947580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005188e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000518910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000518950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000518980 _sleep() at _sleep+0x3a9/frame 0xfffffe0000518a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0000518a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000518ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000518ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100124 td 0xfffff8003a899580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b98d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005b9900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b9940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b9970 _sleep() at _sleep+0x3a9/frame 0xfffffe00005b9a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe00005b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100089 td 0xfffff800037b8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005098c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000509930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000509960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000509a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000509a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000509ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000509ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100088 td 0xfffff800037b8580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005048c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000504930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000504960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000504a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000504a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000504ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000504ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100087 td 0xfffff800037b9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004ff8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004ff8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ff930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ff960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004ffa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100086 td 0xfffff800037b9580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004fa8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004fa8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004fa930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004fa960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004faa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100085 td 0xfffff800037ba000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004f58c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004f58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004f5930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f5960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004f5a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100084 td 0xfffff800037ba580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004f08c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004f08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004f0930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f0960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004f0a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100083 td 0xfffff800037bb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004eb8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004eb8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004eb930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004eb960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004eba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100082 td 0xfffff800037bb580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004e68c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004e68f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e6930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e6960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004e6a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100081 td 0xfffff800037a7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004e18c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004e18f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e1930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e1960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004e1a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100080 td 0xfffff800037a7580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004dc8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004dc8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004dc930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004dc960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004dca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100079 td 0xfffff800037a8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004d78c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004d78f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d7960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004d7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100078 td 0xfffff800037a8580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004d28c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004d28f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d2960 _sleep() at _sleep+0x3a9/frame 0xfffffe00004d2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100077 td 0xfffff800037a9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004cd8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004cd920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cd990 _sleep() at _sleep+0x3a9/frame 0xfffffe00004cda30 crypto_proc() at crypto_proc+0x2d4/frame 0xfffffe00004cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff80003728000 sched_switch() at sched_switch+0x942/frame 0xfffffe000047d8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000047d920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047d990 _sleep() at _sleep+0x3a9/frame 0xfffffe000047da30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000047da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003727580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004828f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000482920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000482960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000482990 _sleep() at _sleep+0x3a9/frame 0xfffffe0000482a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000482a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000482a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000482ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000482ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003727000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004878e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000487910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000487950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000487980 _sleep() at _sleep+0x3a9/frame 0xfffffe0000487a20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000487a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000487a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000487ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000487ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff80003663000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xfffff80003654580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789a59f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789a5a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00789a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff8000368b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789aa9f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789aaa20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00789aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff80003723000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004379f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000437a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000437a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000437ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000437ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003722580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003722000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003721580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003721000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003720580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003720000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff800036d6580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff8000372e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff8000372a580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff8000372a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003729580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003729000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004739f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000473a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000473a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000473ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000473ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff80003728580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffff80003d0f580 sched_switch() at sched_switch+0x942/frame 0xfffffe000051d9f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000051da20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe000051da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000051dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000051dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80003d0f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005229f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000522a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000522a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000522ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000522ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffff80003d01000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005409f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000540a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000540a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000540ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000540ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100111 td 0xfffff80007188000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100112 td 0xfffff8000717c580 sched_switch() at sched_switch+0x942/frame 0xfffffe000057c9f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000057ca20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe000057ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003653000 sched_switch() at sched_switch+0x942/frame 0xfffffe007895a970 mi_switch() at mi_switch+0x18c/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003652580 sched_switch() at sched_switch+0x942/frame 0xfffffe007895f970 mi_switch() at mi_switch+0x18c/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003652000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078964970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003651580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078969970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003651000 sched_switch() at sched_switch+0x942/frame 0xfffffe007896e970 mi_switch() at mi_switch+0x18c/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000364b580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078973970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000364b000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078978970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x569/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003665580 sched_switch() at sched_switch+0x942/frame 0xfffffe007897d970 mi_switch() at mi_switch+0x18c/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003665000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078982970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003664580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078987970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003664000 sched_switch() at sched_switch+0x942/frame 0xfffffe007898c970 mi_switch() at mi_switch+0x18c/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003663580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078991970 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0xb8/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff80003653580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078955560 mi_switch() at mi_switch+0x18c/frame 0xfffffe0078955590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789555d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe0078955630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078955660 _sleep() at _sleep+0x39c/frame 0xfffffe0078955700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe0078955790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078955980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0078955ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078955ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2a714a, rsp = 0x7fffffffe788, rbp = 0x7fffffffe7f0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003654000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078950900 mi_switch() at mi_switch+0x18c/frame 0xfffffe0078950930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078950970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789509a0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0078950a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078950a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078950ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078950ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81ff1420 sched_switch() at sched_switch+0x942/frame 0xffffffff827cd9d0 mi_switch() at mi_switch+0x18c/frame 0xffffffff827cda00 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff827cda40 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xffffffff827cda80 _sleep() at _sleep+0x34d/frame 0xffffffff827cdb20 swapper() at swapper+0x247/frame 0xffffffff827cdb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff80003662580 sched_switch() at sched_switch+0x942/frame 0xfffffe007899b900 mi_switch() at mi_switch+0x18c/frame 0xfffffe007899b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007899b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007899b9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe007899ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe007899ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007899bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007899bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003662000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789a0900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789a09a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00789a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff8000368a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789af900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789af9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00789afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000368a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789b4920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789b4950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789b4990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789b49c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789b4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003689580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789b9920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789b9950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789b9990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789b99c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789b9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003689000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789be920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789be950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789be990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789be9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789bea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003688580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789c3920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789c3950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789c3990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789c39c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789c3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003688000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789c8920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789c8950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789c8990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789c89c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789c8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003687580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789cd920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789cd950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789cd990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789cd9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789cda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003687000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789d2920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789d2950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789d2990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789d29c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789d2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003695580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789d7920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789d7950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789d7990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789d79c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789d7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003695000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789dc920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789dc950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789dc990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789dc9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789dca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003694580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e1920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789e1950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e1990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e19c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789e1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003694000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e6920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789e6950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e6990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e69c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789e6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003693580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789eb920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789eb950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789eb990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789eb9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789eba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003693000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f0920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789f0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789f0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003692580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f5920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789f5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789f5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003692000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789fa920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789fa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789fa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789fa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789faa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000368b580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789ff920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789ff950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789ff990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789ff9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789ffa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800036d6000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000405920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000405950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000405990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004059c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000405a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000405a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000405ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000405ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800036d4580 sched_switch() at sched_switch+0x942/frame 0xfffffe000040a920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000040a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000040aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800036d4000 sched_switch() at sched_switch+0x942/frame 0xfffffe000040f920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000040f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000040fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800036d0580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000414920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000414950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000414990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004149c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000414a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000414a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000414ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000414ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800036d0000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000419920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000419950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000419990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004199c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000419a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000419a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000419ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000419ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800036c9580 sched_switch() at sched_switch+0x942/frame 0xfffffe000041e920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000041e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000041e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000041e9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000041ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000041ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000041eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000041eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800036c9000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000423920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000423950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000423990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004239c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000423a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000423a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000423ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000423ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800036c1580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000428920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000428950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000428990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004289c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000428a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000428a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000428ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000428ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800036c1000 sched_switch() at sched_switch+0x942/frame 0xfffffe000042d920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000042d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000042d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042d9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000042da40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003723580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000432920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000432950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000432990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004329c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000432a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000432a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000432ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000432ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff8000376d580 sched_switch() at sched_switch+0x942/frame 0xfffffe000048c900 mi_switch() at mi_switch+0x18c/frame 0xfffffe000048c930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048c9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000048ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000048ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff8000376d000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000491900 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000491930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000491970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004919a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000491a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000491a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000491ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000491ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000376c580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000496900 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000496930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000496970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004969a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000496a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000496a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000496ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000496ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff8000376c000 sched_switch() at sched_switch+0x942/frame 0xfffffe000049b900 mi_switch() at mi_switch+0x18c/frame 0xfffffe000049b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049b9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000049ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000049ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000376b580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004a0900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a09a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000376b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004a5900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004a5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a59a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000376a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004aa900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004aa930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004aa9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000376a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004af900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004af9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000372e580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b4900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004b4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b49a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004b4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff800037ab000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b9900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004b9930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b99a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004b9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800037aa580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004be900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004be930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004be970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004be9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004bea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff800037aa000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004c3900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004c3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c39a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004c3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800037a9580 sched_switch() at sched_switch+0x942/frame 0xfffffe00004c8900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004c8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c89a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00004c8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffff8000717c000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000581920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000581950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000581990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005819c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000581a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0000581a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000581ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000581ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff8003a8a6580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a5920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005a5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00005a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8003a8a6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005aa920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005aa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005aa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005aa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00005aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8003a8a5580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005af920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005af950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005af990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005af9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00005afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8003a8a5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b4900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005b4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b49a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00005b4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1646 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:231 #1 0xffffffff8043a0eb in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:574 #2 0xffffffff80439eb9 in db_command (cmd_table=) at ../../../ddb/db_command.c:481 #3 0xffffffff8043ec58 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff80439eb9 in db_command (cmd_table=) at ../../../ddb/db_command.c:481 #5 0xffffffff80439c34 in db_command_loop () at ../../../ddb/db_command.c:534 #6 0xffffffff8043ce6f in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80bbe0f3 in kdb_trap (type=0x3, code=0xffff0ff0, tf=) at ../../../kern/subr_kdb.c:697 #8 0xffffffff81045163 in trap (frame=0xfffffe00a26f3ee0) at ../../../amd64/amd64/trap.c:601 #9 0xffffffff810206ec in calltrap () at ../../../amd64/amd64/exception.S:230 #10 0xffffffff80bbd7cb in kdb_enter (why=0xffffffff812d6b3b "panic", msg=) at cpufunc.h:65 #11 0xffffffff80b77280 in vpanic (fmt=, ap=0xfffffe00a26f4050) at ../../../kern/kern_shutdown.c:852 #12 0xffffffff80b77313 in panic (fmt=) at ../../../kern/kern_shutdown.c:790 #13 0xffffffff80e80d14 in handle_written_inodeblock (inodedep=0xfffff801ae24a000, bp=0xfffffe0005698c58, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:11402 #14 0xffffffff80e6846c in softdep_disk_write_complete (bp=0xfffffe0005698c58) at ../../../ufs/ffs/ffs_softdep.c:11009 #15 0xffffffff80c2c252 in bufdone (bp=0xfffffe0005698c58) at buf.h:433 #16 0xffffffff80c2643a in bufwrite (bp=0xfffffe0005698c58) at buf.h:419 #17 0xffffffff80e5e21a in ffs_update (vp=0xfffff802d231b278, waitfor=0x1) at buf.h:407 #18 0xffffffff80e7a19b in softdep_request_cleanup (fs=0xfffffe00a132e000, vp=0xfffff802d231b278, cred=0xfffff8005696e900, resource=) at ../../../ufs/ffs/ffs_softdep.c:13309 #19 0xffffffff80e5ce61 in ffs_balloc_ufs2 (vp=0xfffff802d231b278, startoffset=, size=, cred=0xfffff8005696e900, flags=, bpp=0xfffffe00a26f44c0) at ../../../ufs/ffs/ffs_balloc.c:987 #20 0xffffffff80e87dff in ffs_write (ap=0xfffffe00a26f4628) at ../../../ufs/ffs/ffs_vnops.c:776 #21 0xffffffff811cc61a in VOP_WRITE_APV (vop=, a=0xfffffe00a26f4628) at vnode_if.c:1000 #22 0xffffffff80c5f78b in vn_write (fp=0xfffff80788afc500, uio=0xfffffe00a26f4940, active_cred=0xf68000, flags=, td=) at vnode_if.h:413 #23 0xffffffff80c5f153 in vn_io_fault_doio (args=0xfffffe00a26f4840, uio=0xfffffe00a26f4940, td=0xfffff8021ff01580) at ../../../kern/vfs_vnops.c:965 #24 0xffffffff80c5d1a1 in vn_io_fault1 () at ../../../kern/vfs_vnops.c:1083 #25 0xffffffff80c5b505 in vn_io_fault (fp=, uio=0xfffff802d231b498, active_cred=0xfffff8003ae94870, flags=, td=) at ../../../kern/vfs_vnops.c:1187 #26 0xffffffff80be4327 in dofilewrite (td=0xfffff8021ff01580, fd=0x4, fp=0xfffff80788afc500, auio=0xfffffe00a26f4940, offset=, flags=0x0) at file.h:309 #27 0xffffffff80be3f4a in kern_writev (td=0xfffff8021ff01580, fd=0x4, auio=0xfffffe00a26f4940) at ../../../kern/sys_generic.c:491 #28 0xffffffff80be3ef6 in sys_write (td=, uap=) at ../../../kern/sys_generic.c:406 #29 0xffffffff81045f07 in amd64_syscall (td=0xfffff8021ff01580, traced=0x0) at subr_syscall.c:135 #30 0xffffffff81020fcd in fast_syscall_common () at ../../../amd64/amd64/exception.S:493 #31 0x0000000800829b6a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 14 #14 0xffffffff80e6846c in softdep_disk_write_complete (bp=0xfffffe0005698c58) at ../../../ufs/ffs/ffs_softdep.c:11009 11009 handle_written_inodeblock(WK_INODEDEP(wk), (kgdb) l 11004 case D_PAGEDEP: 11005 handle_written_filepage(WK_PAGEDEP(wk), bp, 0); 11006 continue; 11007 11008 case D_INODEDEP: 11009 handle_written_inodeblock(WK_INODEDEP(wk), 11010 bp, 0); 11011 continue; 11012 11013 case D_BMSAFEMAP: (kgdb) info loc ump = (struct ufsmount *) 0xfffff80358d0fc00 wk = (struct worklist *) 0xfffff801ae24a000 sbp = owk = reattach = (kgdb) p *bp $1 = {b_bufobj = 0xfffff804bd478dc0, b_bcount = 0x8000, b_caller1 = 0x0, b_data = 0xfffffe0019834000 "\201\001", b_error = 0x1c, b_iocmd = 0x2, b_ioflags = 0x1, b_iooffset = 0x203c0000, b_resid = 0x0, b_iodone = 0, b_ckhashcalc = 0, b_ckhash = 0x0, b_blkno = 0x101e00, b_offset = 0x203c0000, b_bobufs = {tqe_next = 0xfffffe000385bb30, tqe_prev = 0xfffffe0000fe7b30}, b_vflags = 0x0, b_qindex = 0x2, b_domain = 0x6, b_subqueue = 0xffff, b_flags = 0xa0021020, b_xflags = 0x2, b_lock = {lock_object = {lo_name = 0xffffffff81310281 "bufwait", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71080}, lk_lock = 0xfffff8021ff01580, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x12, pcs = 0xfffffe0005698d10}}, b_bufsize = 0x8000, b_runningbufspace = 0x0, b_kvasize = 0x8000, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_kvabase = 0xfffffe0019834000 "\201\001", b_lblkno = 0x101e00, b_vp = 0xfffff804bd478c58, b_rcred = 0x0, b_wcred = 0x0, {b_freelist = {tqe_next = 0xfffffe0001087310, tqe_prev = 0xfffffe0004171060}, {b_pgiodone = 0xfffffe0001087310, b_pgbefore = 0x4171060, b_pgafter = 0xfffffe00}}, b_cluster = { cluster_head = {tqh_first = 0xfffffe000360a8f8, tqh_last = 0xfffffe00011a05d8}, cluster_entry = {tqe_next = 0xfffffe000360a8f8, tqe_prev = 0xfffffe00011a05d8}}, b_pages = 0xfffffe0005698e00, b_npages = 0x8, b_dep = { lh_first = 0xfffff801ae24a000}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_io_tracking = 0xfffffe0005698f28, b_io_tcnt = 0x10ee} (kgdb) p *ump $2 = {um_mountp = 0xfffff8024b0ed000, um_dev = 0xfffff8003aabd400, um_cp = 0xfffff8021c54e400, um_bo = 0xfffff804bd478dc0, um_devvp = 0xfffff804bd478c58, um_fstype = 0x2, um_fs = 0xfffffe00a132e000, um_extattr = {uepm_lock = { lock_object = {lo_name = 0xffffffff811e55ee "ufs_extattr_sx", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0x0}, sx_lock = 0x1}, uepm_list = {lh_first = 0x0}, uepm_ucred = 0x0, uepm_flags = 0x1}, um_nindir = 0x1000, um_bptrtodb = 0x3, um_seqinc = 0x8, um_lock = {lock_object = {lo_name = 0xffffffff811fa25e "FFS", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, um_fsckpid = 0x0, um_softdep = 0xfffff807b123ca00, um_quotas = 0xfffff80358d0fcb8, um_cred = 0xfffff80358d0fcc8, um_btime = 0xfffff80358d0fcd8, um_itime = 0xfffff80358d0fce8, um_qflags = 0xfffff80358d0fcf8 "", um_savedmaxfilesize = 0x0, um_candelete = 0x0, um_writesuspended = 0x0, um_trim_inflight = 0x0, um_trim_tq = 0x0, um_balloc = 0xffffffff80e5c1b0 , um_blkatoff = 0xffffffff80e82300 , um_truncate = 0xffffffff80e5e2d0 , um_update = 0xffffffff80e5df70 , um_valloc = 0xffffffff80e56ea0 , um_vfree = 0xffffffff80e57cc0 , um_ifree = 0xffffffff80e86fc0 , um_rdonly = 0xffffffff80e5ff90 , um_snapgone = 0xffffffff80e63b90 } (kgdb) p *wk $3 = {wk_list = {le_next = 0xfffff801ae24aa00, le_prev = 0xfffffe0005698f08}, wk_mp = 0xfffff8024b0ed000, wk_type = 0x2, wk_state = 0x8009} (kgdb) (kgdb) p *ump->um_softdep $4 = {sd_fslock = {lock_object = {lo_name = 0xffffffff8128a2c6 "Per-Filesystem Softdep Lock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0x0}, rw_lock = 0xfffff8021ff01580}, sd_workitem_pending = {lh_first = 0xfffffe009f38a1f0}, sd_worklist_tail = 0xfffff806a0d887c0, sd_journal_pending = {lh_first = 0x0}, sd_journal_tail = 0x0, sd_jblocks = 0x0, sd_unlinked = {tqh_first = 0x0, tqh_last = 0xfffff807b123ca48}, sd_dirtycg = {lh_first = 0xfffff80003c8e500}, sd_mkdirlisthd = {lh_first = 0xfffff806f111db00}, sd_pdhash = 0xfffffe00a1661000, sd_pdhashsize = 0xffff, sd_pdnextclean = 0x0, sd_idhash = 0xfffffe00a9c00000, sd_idhashsize = 0x7ffff, sd_idnextclean = 0x0, sd_newblkhash = 0xfffffe009d400000, sd_newblkhashsize = 0xfffff, sd_bmhash = 0xfffffe00a134e000, sd_bmhashsize = 0x3ff, sd_indirhash = 0xfffff80789164420, sd_indirhashsize = 0x0, sd_on_journal = 0x0, sd_on_worklist = 0x11c, sd_deps = 0x21bec, sd_accdeps = 0x60753c, sd_req = 0x0, sd_flags = 0x0, sd_cleanups = 0x0, sd_flushtd = 0xfffff80228a76580, sd_next = {tqe_next = 0x0, tqe_prev = 0xfffff801a1394af0}, sd_ump = 0xfffff80358d0fc00, sd_curdeps = 0xfffff807b123cb08} (kgdb) -- Test scenario: misc/snap11.sh