GENERIC HEAD from Mar 21 2008 + geom5.diff, vmcore.3

GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.0-CURRENT #0: Sun Mar 23 04:20:48 EDT 2008
    test@beaver1.sentex.ca:/usr/pho/sys/amd64/compile/PHO
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Core(TM)2 Duo CPU     E4500  @ 2.20GHz (2208.95-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6fd  Stepping = 13
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xe39d<SSE3,DTES64,MON,DS_CPL,EST,TM2,SSSE3,CX16,xTPR,PDCM>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 2
usable memory = 3206328320 (3057 MB)
avail memory  = 3104133120 (2960 MB)
ACPI APIC Table: <IntelR AWRDACPI>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ioapic0: Changing APIC ID to 4
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <IntelR AWRDACPI> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, bfdf0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xff00-0xff07 mem 0xfde80000-0xfdefffff,0xc0000000-0xcfffffff,0xfdf00000-0xfdf3ffff irq 16 at device 2.0 on pci0
agp0: <Intel 82945G (945G GMCH) SVGA controller> on vgapci0
agp0: detected 764k stolen memory
agp0: aperture size is 256M
uhci0: <UHCI (generic) USB controller> port 0xfe00-0xfe1f irq 23 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <UHCI (generic) USB controller> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
pcib1: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib1
re0: <RealTek 8169SC/8110SC Single-chip Gigabit Ethernet> port 0xde00-0xdeff mem 0xfdcff000-0xfdcff0ff irq 20 at device 5.0 on pci1
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211B media interface> PHY 1 on miibus0
rgephy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
re0: Ethernet address: 00:e0:4d:0e:03:7b
re0: [FILTER]
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf800-0xf80f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <Intel ICH7 SATA300 controller> port 0xf700-0xf707,0xf600-0xf603,0xf500-0xf507,0xf400-0xf403,0xf300-0xf30f mem 0xfdffd000-0xfdffd3ff irq 19 at device 31.2 on pci0
atapci1: [ITHREAD]
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
cpu0: <ACPI CPU> on acpi0
acpi_perf0: <ACPI CPU Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1: <ACPI CPU> on acpi0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr b280b2806000b28
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
acpi_button0: <Power Button> on acpi0
acpi_button1: <Sleep Button> on acpi0
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
sio0: [FILTER]
acpi_tz0: <Thermal Zone> on acpi0
orm0: <ISA Option ROM> at iomem 0xcc000-0xccfff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ad0: 38166MB <Seagate ST340014A 8.54> at ata0-master UDMA100
SMP: AP CPU #1 Launched!
WARNING: WITNESS option enabled, expect reduced performance.
lock order reversal:
 1st 0xffffff0001421d40 devfs (devfs) @ kern/vfs_subr.c:2064
 2nd 0xffffff00014c3020 devfsmount (devfsmount) @ fs/devfs/devfs_vnops.c:201
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
witness_checkorder() at witness_checkorder+0x605
_sx_xlock() at _sx_xlock+0x52
devfs_allocv() at devfs_allocv+0x136
devfs_root() at devfs_root+0x52
set_rootvnode() at set_rootvnode+0x2c
vfs_mountroot() at vfs_mountroot+0x310
start_init() at start_init+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac457d30, rbp = 0 ---
Trying to mount root from ufs:/dev/ad0s1a
lock order reversal:
 1st 0xffffff0001421ab8 ufs (ufs) @ kern/vfs_subr.c:2064
 2nd 0xffffff00014ca000 vfslock (vfslock) @ kern/vfs_subr.c:364
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
witness_checkorder() at witness_checkorder+0x605
_lockmgr_args() at _lockmgr_args+0x88a
vfs_busy() at vfs_busy+0xea
lookup() at lookup+0x903
namei() at namei+0x2cb
kern_unlink() at kern_unlink+0x8e
vfs_mountroot_try() at vfs_mountroot_try+0x41f
vfs_mountroot() at vfs_mountroot+0x3fd
start_init() at start_init+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac457d30, rbp = 0 ---
lock order reversal:
 1st 0xffffff00010ef070 user map (user map) @ vm/vm_map.c:3111
 2nd 0xffffff0001421830 ufs (ufs) @ kern/vfs_subr.c:2064
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
witness_checkorder() at witness_checkorder+0x605
_lockmgr_args() at _lockmgr_args+0x88a
ffs_lock() at ffs_lock+0x87
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b
_vn_lock() at _vn_lock+0x94
vget() at vget+0x125
vnode_pager_lock() at vnode_pager_lock+0x14a
vm_fault() at vm_fault+0x1e5
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x400146, rsp = 0x7fffffffee80, rbp = 0x7fffffffeeb8 ---
Loading configuration files.
kernel dumps on /dev/ad0s1b
Entropy harvesting: interrupts ethernet point_to_point kickstart.
swapon: adding /dev/ad0s1b as swap device
Starting file system checks:
/dev/ad0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1a: clean, 31818 free (274 frags, 3943 blocks, 0.1% fragmentation)
/dev/ad0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1e: clean, 252447 free (31 frags, 31552 blocks, 0.0% fragmentation)
/dev/ad0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1f: clean, 12616274 free (71314 frags, 1568120 blocks, 0.5% fragmentation)
/dev/ad0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1d: clean, 1598610 free (226 frags, 199798 blocks, 0.0% fragmentation)
Setting hostuuid: 00e04d0e-037b-ffff-ffff-ffffffffffff.
Setting hostid: 0xc1d5bca1.
Mounting local file systems:.
Setting hostname: beaver1.sentex.ca.
net.inet6.ip6.auto_linklocal: 1 -> 0
re0: link state changed to DOWN
re0: no link .....re0: link state changed to UP
 got link
re0: link state changed to DOWN
DHCPREQUEST on re0 to 255.255.255.255 port 67
reDHCPREQUEST on r0e0 to 255.255.25: 5.255 port 67li
nk state changed to UP
DHCPDISCOVER on re0 to 255.255.255.255 port 67 interval 7
DHCPOFFER from 192.168.5.1
DHCPREQUEST on re0 to 255.255.255.255 port 67r
e0DHCPACK from 192: .168.5.1
link state changed to DOWN
bound to 192.168.5.112 -- renewal in 300 seconds.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
        inet6 ::1 prefixlen 128
        inet 127.0.0.1 netmask 0xff000000
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=399b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4>
        ether 00:e0:4d:0e:03:7b
        inet 192.168.5.112 netmask 0xffffff00 broadcast 192.168.5.255
        media: Ethernet autoselect (none)
        status: no carrier
Additional routing options: IP gateway=YES.
Starting devd.
hw.acpi.cpu.cx_lowest: C1
sysctl: hw.acpi.cpu.cx_lowest: Invalid argument
Additional IP options:.
Mounting NFS file systems:.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
32-bit compatibility ldconfig path:
Creating and/or trimming log files:.
Starting syslogd.
Checking for core dump on /dev/alock order reversal:
d0s1b...
 1st 0xffffff000155ed40 ufs (ufs) @ kern/vfs_subr.c:2064
savecore: no dum 2nd 0xffffffff9a01a0f0 bufwait (bufwait) @ sys/buf.h:279
ps found
Initia 3rd 0xffffff0001599d40 ufs (ufs) @ kern/vfs_subr.c:2064
l amd64 initialiKDB: stack backtrace:
zation:.
Additidonal ABI supportb:.
_trace_self_wrapper() at db_trace_self_wrapper+0x2a
witness_checkorder() at witness_checkorder+0x605
_lockmgr_args() at _lockmgr_args+0x86a
ffs_lock() at ffs_lock+0x87
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b
_vn_lock() at _vn_lock+0x94
vget() at vget+0x125
vfs_hash_get() at vfs_hash_get+0xd5
ffs_vget() at ffs_vget+0x44
softdep_sync_metadata() at softdep_sync_metadata+0x466
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_truncate() at ffs_truncate+0x184
ufs_direnter() at ufs_direnter+0x46a
ufs_mkdir() at ufs_mkdir+0x690
VOP_MKDIR_APV() at VOP_MKDIR_APV+0xb9
kern_mkdir() at kern_mkdir+0x299
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (136, FreeBSD ELF64, mkdir), rip = 0x80070340c, rsp = 0x7fffffffed18, rbp = 0x7fffffffef76 ---
Clearing /tmp (X related).
Recovering vi editor sessions:.
Starting local daemons:.
Updating motd.
Mounting late file systems:.
Configuring syscons: blanktime.
Starting sshd.
Starting cron.
Local package initialization:.

Sun Mar 23 13:44:11 EDT 2008

FreeBSD/amd64 (beaver1.sentex.ca) (ttyd0)

login: Mar 23 14:57:57 beaver1 su: test to root on /dev/ttyp0
test
Password:
Last login: Sun Mar 23 14:57:54 from 192.168.5.1
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.

FreeBSD 8.0-CURRENT (PHO) #0: Sun Mar 23 04:20:48 EDT 2008

Welcome to FreeBSD!

Before seeking technical support, please use the following resources:

o  Security advisories and updated errata information for all releases are
   at http://www.FreeBSD.org/releases/ - always consult the ERRATA section
   for your release first as it's updated frequently.

o  The Handbook and FAQ documents are at http://www.FreeBSD.org/ and,
   along with the mailing lists, can be searched by going to
   http://www.FreeBSD.org/search/.  If the doc distribution has
   been installed, they're also available formatted in /usr/share/doc.

If you still have a question or problem, please take the output of
`uname -a', along with any relevant error messages, and email it
as a question to the questions@FreeBSD.org mailing list.  If you are
unfamiliar with FreeBSD's directory layout, please refer to the hier(7)
manual page.  If you are not familiar with manual pages, type `man man'.

You may also use sysinstall(8) to re-enter the installation and
configuration utility.  Edit /etc/motd to change this login announcement.

%pho/keepalive.sh
Sun Mar 23 19:58:30 CET 2008  7:58PM  up  1:15, 2 users, load averages: 0.00, 0.00, 0.00
lock order reversal:
 1st 0xffffff00207b1ba0 vnode interlock (vnode interlock) @ kern/kern_lockf.c:192
 2nd 0xffffff00264a7548 process lock (process lock) @ kern/kern_lockf.c:286
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
witness_checkorder() at witness_checkorder+0x605
_mtx_lock_flags() at _mtx_lock_flags+0x75
lf_advlock() at lf_advlock+0x2b9
VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xb5
kern_fcntl() at kern_fcntl+0xcd7
fcntl() at fcntl+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (92, FreeBSD ELF64, fcntl), rip = 0x80070310c, rsp = 0x7fffffffe688, rbp = 0x7fffffffe6d0 ---
Limiting icmp unreach response from 142570 to 200 packets/sec
Limiting icmp unreach response from 135857 to 200 packets/sec
Limiting icmp unreach response from 135016 to 200 packets/sec
:
Limiting icmp unreach response from 102541 to 200 packets/sec
Limiting icmp unreach response from 17477 to 200 packets/sec
Limiting icmp unreach response from 12964 to 200 packets/sec
Limiting icmp unreach response from 3443 to 200 packets/sec
Connection closed by foreign host.
$ telnet pm25 2017
Trying 192.168.5.25...
Connected to pm25.
Escape character is '^]'.

Connection closed by foreign host.
$ telnet pm25 2017
Trying 192.168.5.25...
Connected to pm25.
Escape character is '^]'.

db> bt
Tracing pid 11 tid 100004 td 0xffffff00010ea340
kdb_enter() at kdb_enter+0x3d
lapic_handle_timer() at lapic_handle_timer+0xc7
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff80724996, rsp = 0xffffffffac461b60, rbp = 0xffffffffac461b70 ---
acpi_cpu_c1() at acpi_cpu_c1+0x6
acpi_cpu_idle() at acpi_cpu_idle+0x1a4
sched_idletd() at sched_idletd+0x65
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac461d30, rbp = 0 ---
db> c
interrupt                   total
irq4: sio0                        236143
irq14: ata0                     16917436
irq20: re0                        222310
cpu0: timer                    484657806
cpu1: timer                    484555445
Total                   986589227
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
hardclock() at hardclock+0x19e
lapic_handle_timer() at lapic_handle_timer+0xc7
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff8068f158, rsp = 0xffffffffac4998a0, rbp = 0xffffffffac4998b0 ---
trash_dtor() at trash_dtor+0x18
mb_dtor_pack() at mb_dtor_pack+0x8f
uma_zfree_arg() at uma_zfree_arg+0x41
m_freem() at m_freem+0x37
udp_input() at udp_input+0x73
ip_input() at ip_input+0xc0
ether_demux() at ether_demux+0x1ed
ether_input() at ether_input+0x1d5
re_rxeof() at re_rxeof+0x389
re_int_task() at re_int_task+0x1f8
taskqueue_run() at taskqueue_run+0x94
ithread_loop() at ithread_loop+0xe0
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac499d30, rbp = 0 ---
KDB: enter: watchdog timeout
[thread pid 12 tid 100015 ]
Stopped at      kdb_enter+0x3d: movq    $0,0x5e98a8(%rip)
db> set $lines 0
db> show allpcpu
Current CPU: 0

cpuid        = 0
curthread    = 0xffffff0001220680: pid 12 "swi5: +"
curpcb       = 0xffffffffac499d40
fpcurthread  = none
idlethread   = 0xffffff00010ea340: pid 11 "idle: cpu0"
spin locks held:

cpuid        = 1
curthread    = 0xffffff00010ea680: pid 11 "idle: cpu1"
curpcb       = 0xffffffffac45cd40
fpcurthread  = none
idlethread   = 0xffffff00010ea680: pid 11 "idle: cpu1"
spin locks held:

db> show alllocks
Process 12835 (rw) thread 0xffffff0026ed8680 (100360)
exclusive lockmgr ufs r = 0 (0xffffff002065c5a8) locked @ kern/vfs_vnops.c:591
Process 12834 (rw) thread 0xffffff00269f8680 (100185)
exclusive lockmgr ufs r = 0 (0xffffff009a5d55a8) locked @ kern/vfs_vnops.c:591
Process 12833 (rw) thread 0xffffff004abc79c0 (100263)
exclusive lockmgr ufs r = 0 (0xffffff0021188098) locked @ kern/vfs_vnops.c:591
Process 12832 (rw) thread 0xffffff00266d69c0 (100137)
exclusive lockmgr ufs r = 0 (0xffffff00019f2098) locked @ kern/vfs_vnops.c:591
Process 12830 (rw) thread 0xffffff003b56f340 (100241)
exclusive lockmgr ufs r = 0 (0xffffff00b4f2e320) locked @ kern/vfs_vnops.c:591
Process 12828 (rw) thread 0xffffff006d0f5340 (100267)
exclusive lockmgr ufs r = 0 (0xffffff0001ae1098) locked @ kern/vfs_vnops.c:591
Process 12827 (rw) thread 0xffffff003b59f000 (101177)
exclusive lockmgr ufs r = 0 (0xffffff00039c75a8) locked @ kern/vfs_vnops.c:591
Process 12825 (rw) thread 0xffffff003b467680 (101410)
exclusive lockmgr ufs r = 0 (0xffffff002141c5a8) locked @ kern/vfs_vnops.c:591
Process 12824 (rw) thread 0xffffff0026834680 (100155)
exclusive lockmgr ufs r = 0 (0xffffff0086dfaab8) locked @ kern/vfs_vnops.c:591
Process 12791 (creat) thread 0xffffff0026833680 (100159)
exclusive lockmgr bufwait r = 0 (0xffffffff9a8ae9f0) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00a8079830) locked @ kern/vfs_lookup.c:412
Process 12790 (creat) thread 0xffffff00aca22680 (100242)
exclusive lockmgr bufwait r = 0 (0xffffffff9a0a7ca8) locked @ sys/buf.h:300
exclusive lockmgr ufs r = 0 (0xffffff0021e45830) locked @ ufs/ffs/ffs_vfsops.c:1385
exclusive lockmgr ufs r = 0 (0xffffff00b9c1f5a8) locked @ kern/vfs_lookup.c:412
Process 12789 (creat) thread 0xffffff00015b79c0 (100060)
exclusive lockmgr ufs r = 0 (0xffffff00217755a8) locked @ kern/vfs_lookup.c:412
Process 12788 (creat) thread 0xffffff00acde0340 (100248)
exclusive lockmgr bufwait r = 0 (0xffffffff9a97b008) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a5e7720) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00b4f2fab8) locked @ kern/vfs_lookup.c:412
Process 12787 (creat) thread 0xffffff00aca59340 (100231)
exclusive lockmgr bufwait r = 0 (0xffffffff9a3bc810) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a9cfb18) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff002045ed40) locked @ kern/vfs_lookup.c:412
Process 12786 (creat) thread 0xffffff00ac9fd000 (100255)
exclusive lockmgr bufwait r = 0 (0xffffffff9a686318) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a507ba8) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff001bf82320) locked @ kern/vfs_lookup.c:412
Process 12785 (creat) thread 0xffffff0026aec9c0 (100201)
exclusive lockmgr bufwait r = 0 (0xffffffff9a09aa48) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a7fc268) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00a80c2098) locked @ kern/vfs_lookup.c:412
Process 12784 (creat) thread 0xffffff00266d6000 (100166)
exclusive lockmgr bufwait r = 0 (0xffffffff9a93f728) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a3dc9a0) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00aa46d098) locked @ kern/vfs_lookup.c:412
Process 12783 (creat) thread 0xffffff008cc2d340 (100523)
exclusive lockmgr bufwait r = 0 (0xffffffff9a34b008) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a34c298) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff0021499320) locked @ kern/vfs_lookup.c:412
Process 12782 (creat) thread 0xffffff0026f22000 (100538)
exclusive lockmgr bufwait r = 0 (0xffffffff9a0414f8) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff005cb47098) locked @ kern/vfs_lookup.c:412
Process 12781 (creat) thread 0xffffff0001465340 (100045)
exclusive lockmgr bufwait r = 0 (0xffffffff9a7a1a88) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff0020bbc098) locked @ kern/vfs_lookup.c:412
Process 12780 (creat) thread 0xffffff00269859c0 (100189)
exclusive lockmgr bufwait r = 0 (0xffffffff9a344d08) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff0001535d40) locked @ kern/vfs_lookup.c:412
Process 12779 (creat) thread 0xffffff0026638680 (100147)
exclusive lockmgr bufwait r = 0 (0xffffffff9a666188) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a2ebad0) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00019f2320) locked @ kern/vfs_lookup.c:412
Process 12778 (creat) thread 0xffffff004ae67340 (100258)
exclusive lockmgr bufwait r = 0 (0xffffffff9a4ee978) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff006f7bd830) locked @ kern/vfs_lookup.c:412
Process 12777 (creat) thread 0xffffff0026988000 (100181)
exclusive lockmgr bufwait r = 0 (0xffffffff9a088778) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff007c55a320) locked @ kern/vfs_lookup.c:412
Process 12776 (creat) thread 0xffffff0024a32000 (101148)
exclusive lockmgr bufwait r = 0 (0xffffffff9a881f48) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9aa1f5b8) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00201b8320) locked @ kern/vfs_lookup.c:412
Process 12775 (creat) thread 0xffffff003b59f9c0 (101425)
exclusive lockmgr bufwait r = 0 (0xffffffff9a4dfb40) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff00b5d92ab8) locked @ kern/vfs_lookup.c:412
Process 12774 (creat) thread 0xffffff00017f89c0 (100081)
exclusive lockmgr bufwait r = 0 (0xffffffff9a843800) locked @ sys/buf.h:300
exclusive lockmgr bufwait r = 0 (0xffffffff9a0e38a0) locked @ sys/buf.h:279
exclusive lockmgr ufs r = 0 (0xffffff0020172098) locked @ kern/vfs_lookup.c:412
Process 12773 (creat) thread 0xffffff00014f2680 (100050)
exclusive lockmgr ufs r = 0 (0xffffff0001e61ab8) locked @ ufs/ffs/ffs_vfsops.c:1385
exclusive lockmgr ufs r = 0 (0xffffff0001ae95a8) locked @ kern/vfs_lookup.c:412
Process 12772 (mkdir) thread 0xffffff004a8c1340 (100261)
exclusive lockmgr bufwait r = 0 (0xffffffff9a229598) locked @ sys/buf.h:300
exclusive lockmgr ufs r = 0 (0xffffff002085a098) locked @ kern/vfs_subr.c:2159
Process 911 (sshd) thread 0xffffff00017c7680 (100095)
exclusive sx so_rcv_sx r = 0 (0xffffff0001604648) locked @ kern/uipc_sockbuf.c:148
Process 26 (softdepflush) thread 0xffffff0001466000 (100040)
shared lockmgr vfslock r = 0 (0xffffff00014d23c0) locked @ kern/vfs_subr.c:364
Process 24 (syncer) thread 0xffffff0001466680 (100038)
exclusive lockmgr devfs r = 0 (0xffffff000158a5a8) locked @ kern/vfs_subr.c:1667
db> show lockedvnods
Locked vnodes

0xffffff000158a510: tag devfs, type VCHR
    usecount 1, writecount 0, refcount 6084 mountedhere 0xffffff0001497a00
    flags ()
    v_object 0xffffff000151baf8 ref 0 pages 24313
     lock type devfs: EXCL (count 1) by thread 0xffffff0001466680 (pid 24)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80507fcf at vop_stdlock+0x3f
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff80517b28 at sched_sync+0x4e8
#5 0xffffffff80479b3a at fork_exit+0x12a
#6 0xffffffff8072c61e at fork_trampoline+0xe

        dev ad0s1f

0xffffff0001ae9510: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 13 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00014f2680 (pid 12773)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1884289, on dev ad0s1f

0xffffff00b5d92a20: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff003b59f9c0 (pid 12775)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1884951, on dev ad0s1f

0xffffff007c55a288: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0026988000 (pid 12777)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1884958, on dev ad0s1f

0xffffff00a8079798: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0026833680 (pid 12791)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1886066, on dev ad0s1f

0xffffff00b9c1f510: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 13 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00aca22680 (pid 12790)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1886074, on dev ad0s1f

0xffffff0020bbc000: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 15 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0001465340 (pid 12781)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1886104, on dev ad0s1f

0xffffff0086dfaa20: tag ufs, type VREG
    usecount 1, writecount 1, refcount 1004 mountedhere 0
    flags ()
    v_object 0xffffff00a7575ca8 ref 0 pages 4008
     lock type ufs: EXCL (count 1) by thread 0xffffff0026834680 (pid 12824)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2121759, on dev ad0s1f

0xffffff00b4f2fa20: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 14 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00acde0340 (pid 12788)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931264, on dev ad0s1f

0xffffff0001535ca8: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00269859c0 (pid 12780)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931276, on dev ad0s1f

0xffffff00019f2288: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 15 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0026638680 (pid 12779)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931586, on dev ad0s1f

0xffffff009a5d5510: tag ufs, type VREG
    usecount 1, writecount 1, refcount 523 mountedhere 0
    flags ()
    v_object 0xffffff009afa45e8 ref 0 pages 2084
     lock type ufs: EXCL (count 1) by thread 0xffffff00269f8680 (pid 12834)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931723, on dev ad0s1f

0xffffff006f7bd798: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff004ae67340 (pid 12778)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931739, on dev ad0s1f

0xffffff001bf82288: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00ac9fd000 (pid 12786)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931768, on dev ad0s1f

0xffffff00a80c2000: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 15 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0026aec9c0 (pid 12785)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1931848, on dev ad0s1f

0xffffff002045eca8: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00aca59340 (pid 12787)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1954816, on dev ad0s1f

0xffffff0020172000: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00017f89c0 (pid 12774)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1954825, on dev ad0s1f

0xffffff005cb47000: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0026f22000 (pid 12782)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1954954, on dev ad0s1f

0xffffff00aa46d000: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00266d6000 (pid 12784)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1954962, on dev ad0s1f

0xffffff00b4f2e288: tag ufs, type VREG
    usecount 1, writecount 1, refcount 368 mountedhere 0
    flags ()
    v_object 0xffffff009afeb438 ref 0 pages 1464
     lock type ufs: EXCL (count 1) by thread 0xffffff003b56f340 (pid 12830)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 1956000, on dev ad0s1f

0xffffff0021188000: tag ufs, type VREG
    usecount 1, writecount 1, refcount 295 mountedhere 0
    flags ()
    v_object 0xffffff00b8d136c0 ref 0 pages 1172
     lock type ufs: EXCL (count 1) by thread 0xffffff004abc79c0 (pid 12833)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2002264, on dev ad0s1f

0xffffff0021775510: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00015b79c0 (pid 12789)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2002265, on dev ad0s1f

0xffffff002141c510: tag ufs, type VREG
    usecount 1, writecount 1, refcount 319 mountedhere 0
    flags ()
    v_object 0xffffff009a940288 ref 0 pages 1268
     lock type ufs: EXCL (count 1) by thread 0xffffff003b467680 (pid 12825)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2003052, on dev ad0s1f

0xffffff00201b8288: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff0024a32000 (pid 12776)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2003053, on dev ad0s1f

0xffffff0021499288: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 16 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff008cc2d340 (pid 12783)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff8050b7a9 at lookup+0xe9
#5 0xffffffff8050c84b at namei+0x2cb
#6 0xffffffff80521380 at vn_open_cred+0xb0
#7 0xffffffff80520575 at kern_open+0x125
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2003055, on dev ad0s1f

0xffffff00039c7510: tag ufs, type VREG
    usecount 1, writecount 1, refcount 267 mountedhere 0
    flags ()
    v_object 0xffffff00acd89798 ref 0 pages 1060
     lock type ufs: EXCL (count 1) by thread 0xffffff003b59f000 (pid 12827)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2003065, on dev ad0s1f

0xffffff0001ae1000: tag ufs, type VREG
    usecount 1, writecount 1, refcount 215 mountedhere 0
    flags ()
    v_object 0xffffff009a01f1b0 ref 0 pages 852
     lock type ufs: EXCL (count 1) by thread 0xffffff006d0f5340 (pid 12828)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2006582, on dev ad0s1f

0xffffff002065c510: tag ufs, type VREG
    usecount 1, writecount 1, refcount 326 mountedhere 0
    flags ()
    v_object 0xffffff009afbb948 ref 0 pages 1299
     lock type ufs: EXCL (count 1) by thread 0xffffff0026ed8680 (pid 12835)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2006586, on dev ad0s1f

0xffffff00019f2000: tag ufs, type VREG
    usecount 1, writecount 1, refcount 228 mountedhere 0
    flags ()
    v_object 0xffffff003b4e81b0 ref 0 pages 904
     lock type ufs: EXCL (count 1) by thread 0xffffff00266d69c0 (pid 12832)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff805225f9 at vn_write+0x159
#5 0xffffffff804d22e5 at dofilewrite+0x85
#6 0xffffffff804d25b0 at kern_writev+0x60
#7 0xffffffff804d2634 at write+0x54
#8 0xffffffff8074856f at syscall+0x1bf
#9 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2006593, on dev ad0s1f

0xffffff002085a000: tag ufs, type VDIR
    usecount 0, writecount 0, refcount 2 mountedhere 0
    flags (VI_DOINGINACT)
     lock type ufs: EXCL (count 1) by thread 0xffffff004a8c1340 (pid 12772)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80678527 at ffs_lock+0x87
#2 0xffffffff8078b5db at VOP_LOCK1_APV+0x9b
#3 0xffffffff80521bf4 at _vn_lock+0x94
#4 0xffffffff80516a53 at vrele+0x133
#5 0xffffffff8051dcb0 at kern_chdir+0x170
#6 0xffffffff8074856f at syscall+0x1bf
#7 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2072595, on dev ad0s1f

0xffffff0001e61a20: tag ufs, type VNON
    usecount 1, writecount 0, refcount 1 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00014f2680 (pid 12773)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80674555 at ffs_vget+0x195
#2 0xffffffff8065a42b at ffs_valloc+0x17b
#3 0xffffffff80684007 at ufs_makeinode+0x87
#4 0xffffffff8078c343 at VOP_CREATE_APV+0xb3
#5 0xffffffff80521745 at vn_open_cred+0x475
#6 0xffffffff80520575 at kern_open+0x125
#7 0xffffffff8074856f at syscall+0x1bf
#8 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2053285, on dev ad0s1f

0xffffff0021e45798: tag ufs, type VREG
    usecount 1, writecount 0, refcount 1 mountedhere 0
    flags ()
     lock type ufs: EXCL (count 1) by thread 0xffffff00aca22680 (pid 12790)#0 0xffffffff80485c6e at _lockmgr_args+0x9ce
#1 0xffffffff80674555 at ffs_vget+0x195
#2 0xffffffff8065a42b at ffs_valloc+0x17b
#3 0xffffffff80684007 at ufs_makeinode+0x87
#4 0xffffffff8078c343 at VOP_CREATE_APV+0xb3
#5 0xffffffff80521745 at vn_open_cred+0x475
#6 0xffffffff80520575 at kern_open+0x125
#7 0xffffffff8074856f at syscall+0x1bf
#8 0xffffffff8072c45b at Xfast_syscall+0xab

        ino 2053286, on dev ad0s1f
db> ps
  pid  ppid  pgrp   uid   state   wmesg         wchan        cmd
12864   927   927     0  SL      pfault   0xffffffff80b3a73c watchdogd
12848 12836 98001  1002  SL+     (threaded)                  thr1
101166                   D       pfault   0xffffffff80b3a73c thr1
100190                   D       pfault   0xffffffff80b3a73c thr1
12847 12836 98001  1002  SL+     (threaded)                  thr1
100135                   D       pfault   0xffffffff80b3a73c thr1
12846 12836 98001  1002  SL+     (threaded)                  thr1
100142                   D       pfault   0xffffffff80b3a73c thr1
12845 12836 98001  1002  SL+     (threaded)                  thr1
100115                   D       pfault   0xffffffff80b3a73c thr1
12844 12836 98001  1002  SL+     (threaded)                  thr1
100179                   D       pfault   0xffffffff80b3a73c thr1
12843 12836 98001  1002  SL+     (threaded)                  thr1
101181                   D       pfault   0xffffffff80b3a73c thr1
12842 12836 98001  1002  SL+     (threaded)                  thr1
101151                   D       pfault   0xffffffff80b3a73c thr1
100152                   D       pfault   0xffffffff80b3a73c thr1
12841 12836 98001  1002  SL+     (threaded)                  thr1
100211                   D       pfault   0xffffffff80b3a73c thr1
12840 12836 98001  1002  SL+     (threaded)                  thr1
100289                   D       pfault   0xffffffff80b3a73c thr1
100108                   D       pfault   0xffffffff80b3a73c thr1
12839 12836 98001  1002  SL+     (threaded)                  thr1
100176                   D       pfault   0xffffffff80b3a73c thr1
12838 12836 98001  1002  SL+     (threaded)                  thr1
100134                   D       pfault   0xffffffff80b3a73c thr1
12837 12836 98001  1002  SL+     (threaded)                  thr1
100321                   S       umtxn    0xffffff0026ef9e00 thr1
100286                   S       umtxn    0xffffff0045897980 thr1
100283                   S       umtxn    0xffffff00458b0e00 thr1
100320                   S       umtxn    0xffffff00acffa880 thr1
100319                   S       umtxn    0xffffff00231f4200 thr1
100318                   S       umtxn    0xffffff0072b6fa00 thr1
100317                   S       umtxn    0xffffff00726af700 thr1
100316                   S       umtxn    0xffffff00b7d16780 thr1
100315                   S       umtxn    0xffffff0015781c00 thr1
100314                   S       umtxn    0xffffff00aebcf480 thr1
100313                   S       umtxn    0xffffff0009ae4200 thr1
100312                   S       umtxn    0xffffff00ac374000 thr1
100311                   S       umtxn    0xffffff00aebcf300 thr1
100310                   S       umtxn    0xffffff0093967800 thr1
100309                   S       umtxn    0xffffff0035177a80 thr1
100308                   S       umtxn    0xffffff0009ae4b80 thr1
100307                   S       umtxn    0xffffff008c5fee00 thr1
100306                   S       umtxn    0xffffff0070db1380 thr1
100305                   S       umtxn    0xffffff008db6b880 thr1
100304                   S       umtxn    0xffffff0055b45800 thr1
100303                   S       umtxn    0xffffff0015781c80 thr1
100302                   S       umtxn    0xffffff0072a35300 thr1
100301                   S       umtxn    0xffffff00015be980 thr1
100300                   S       umtxn    0xffffff00587e2b00 thr1
100299                   S       umtxn    0xffffff00726af380 thr1
100297                   S       umtxn    0xffffff003b5a3100 thr1
100296                   S       umtxn    0xffffff009ad22980 thr1
100295                   S       umtxn    0xffffff005f6d5780 thr1
100293                   S       umtxn    0xffffff000186e880 thr1
100292                   S       umtxn    0xffffff0070d9b100 thr1
100291                   S       umtxn    0xffffff00ac2b3580 thr1
100287                   S       umtxn    0xffffff0026f0f500 thr1
100285                   S       umtxn    0xffffff00ac290e00 thr1
100284                   S       umtxn    0xffffff00312c5b00 thr1
100118                   S       umtxn    0xffffff002b2b2d00 thr1
100298                   S       umtxn    0xffffff00597d8a00 thr1
100294                   S       umtxn    0xffffff009aeb5100 thr1
100290                   S       umtxn    0xffffff00aebcf280 thr1
101421                   D       pfault   0xffffffff80b3a73c thr1
12836 12765 98001  1002  S+      wait     0xffffff008c5bf000 thr1
12835 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12834 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12833 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12832 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12830 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12828 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12827 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12825 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12824 12823 98001  1002  S+      wdrain   0xffffffff80b2a3d0 rw
12823 12758 98001  1002  S+      wait     0xffffff0026925000 rw
12822 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12821 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12820 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12819 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12818 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12817 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12816 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12815 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12814 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12813 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12812 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12811 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12810 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12809 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12808 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12807 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12806 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12805 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12804 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12803 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12802 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12801 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12800 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12799 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12798 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12797 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12796 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12795 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12794 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12793 12792 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12792 12761 98001  1002  S+      wait     0xffffff009a1d8880 swap
12791 12770 98001  1002  S+      getblk   0xffffffff9a0052d0 creat
12790 12770 98001  1002  S+      biowr    0xffffffff9a0a7c10 creat
12789 12770 98001  1002  S+      wdrain   0xffffffff80b2a3d0 creat
12788 12770 98001  1002  S+      biowr    0xffffffff9a97af70 creat
12787 12770 98001  1002  S+      biowr    0xffffffff9a3bc778 creat
12786 12770 98001  1002  S+      biowr    0xffffffff9a686280 creat
12785 12770 98001  1002  S+      biowr    0xffffffff9a09a9b0 creat
12784 12770 98001  1002  S+      biowr    0xffffffff9a93f690 creat
12783 12770 98001  1002  S+      biowr    0xffffffff9a34af70 creat
12782 12770 98001  1002  S+      wdrain   0xffffffff80b2a3d0 creat
12781 12770 98001  1002  S+      getblk   0xffffffff9a75dfb8 creat
12780 12770 98001  1002  S+      wdrain   0xffffffff80b2a3d0 creat
12779 12770 98001  1002  S+      biowr    0xffffffff9a6660f0 creat
12778 12770 98001  1002  S+      wdrain   0xffffffff80b2a3d0 creat
12777 12770 98001  1002  S+      getblk   0xffffffff9a18afd0 creat
12776 12770 98001  1002  S+      biowr    0xffffffff9a881eb0 creat
12775 12770 98001  1002  S+      getblk   0xffffffff9a1fa5d0 creat
12774 12770 98001  1002  S+      biowr    0xffffffff9a843768 creat
12773 12770 98001  1002  S+      getblk   0xffffffff9a0a7ca8 creat
12772 12771 98001  1002  S+      biowr    0xffffffff9a229500 mkdir
12771 12754 98001  1002  S+      wait     0xffffff00268cd000 mkdir
12770 12752 98001  1002  S+      wait     0xffffff00a3434000 creat
12765 12750 98001  1002  SL+     pfault   0xffffffff80b3a73c initial thread
12761 12750 98001  1002  SL+     pfault   0xffffffff80b3a73c swap
12759 12750 98001  1002  SL+     pfault   0xffffffff80b3a73c shm
12758 12750 98001  1002  SL+     pfault   0xffffffff80b3a73c rw
12754 12750 98001  1002  SL+     pfault   0xffffffff80b3a73c mkdir
12752 12750 98001  1002  SL+     pfault   0xffffffff80b3a73c creat
12750 12749 98001  1002  S+      wait     0xffffff008c5c1440 run
12749 12748 98001  1002  S+      wait     0xffffff0026a72880 run
12748 12736 98001  1002  SL+     pfault   0xffffffff80b3a73c run
12736 98001 98001  1002  S+      wait     0xffffff009a1d9880 sh
12367   937   937  1002  SL+     pfault   0xffffffff80b3a73c sleep
98001   915 98001  1002  S+      wait     0xffffff0026926880 sh
  937   934   937  1002  S+      wait     0xffffff000159a880 sh
  934   652   934  1002  S+      pause    0xffffff0001595930 csh
  927     1   927     0  Ss      wait     0xffffff0001848880 watchdogd
  915   914   915  1002  Ss+     pause    0xffffff00018430b0 csh
  914   911   911  1002  ?                                   sshd
  911   587   911     0  Ss      sbwait   0xffffff00016046a4 sshd
  652     1   652     0  Ss+     wait     0xffffff0001595440 login
  651     1   651     0  Ss+     ttyin    0xffffff0001415410 getty
  650     1   650     0  Ss+     ttyin    0xffffff0001415810 getty
  649     1   649     0  Ss+     ttyin    0xffffff0001415c10 getty
  648     1   648     0  Ss+     ttyin    0xffffff0001416010 getty
  647     1   647     0  Ss+     ttyin    0xffffff0001416410 getty
  646     1   646     0  Ss+     ttyin    0xffffff0001409c10 getty
  645     1   645     0  Ss+     ttyin    0xffffff0001407c10 getty
  644     1   644     0  Ss+     ttyin    0xffffff0001407810 getty
  604     1   604     0  SLs     pfault   0xffffffff80b3a73c cron
  597     1   597    25  SLs     pfault   0xffffffff80b3a73c sendmail
  593     1   593     0  SLs     pfault   0xffffffff80b3a73c sendmail
  587     1   587     0  ?s                                  sshd
  457     1   457     0  ?s                                  syslogd
  402     1   402     0  Ss      select   0xffffff00014c3a50 devd
  284     1   284    65  ?s                                  dhclient
  257     1    27     0  S+      select   0xffffff00014c3750 dhclient
  112     1   112     0  Ss      pause    0xffffff000159a4f0 adjkerntz
   26     0     0     0  SL      getblk   0xffffffff9a957cf8 [softdepflush]
   25     0     0     0  SL      vlruwt   0xffffff000147a000 [vnlru]
   24     0     0     0  SL      vmwait   0xffffffff80b3a73c [syncer]
   23     0     0     0  SL      wdrain   0xffffffff80b2a3d0 [bufdaemon]
   22     0     0     0  SL      pgzero   0xffffffff80b3b7cc [pagezero]
   21     0     0     0  SL      psleep   0xffffffff80b3ab48 [vmdaemon]
   20     0     0     0  SL      wswbuf0  0xffffffff80b39fa4 [pagedaemon]
   19     0     0     0  SL      waiting_ 0xffffffff80b2da68 [sctp_iterator]
   18     0     0     0  SL      tzpoll   0xffffffff80a676d0 [acpi_thermal]
   17     0     0     0  SL      usbtsk   0xffffffff80a93f28 [usbtask-dr]
   16     0     0     0  SL      usbtsk   0xffffffff80a93f00 [usbtask-hc]
   15     0     0     0  SL      usbevt   0xffffffff80e54420 [usb0]
   14     0     0     0  SL      -        0xffffff00011fd880 [acpi_task_2]
    9     0     0     0  SL      -        0xffffff00011fd880 [acpi_task_1]
    8     0     0     0  SL      -        0xffffff00011fd880 [acpi_task_0]
    7     0     0     0  SL      -        0xffffff00011fdb00 [thread taskq]
    6     0     0     0  SL      -        0xffffff00011fdc80 [kqueue taskq]
    5     0     0     0  SL      ccb_scan 0xffffffff80a63120 [xpt_thrd]
   13     0     0     0  SL      -        0xffffffff80a986c8 [yarrow]
    4     0     0     0  SL      g_down   0xffffffff80a986c8 [g_down]
    3     0     0     0  SL      -        0xffffffff80a95010 [g_up]
    2     0     0     0  SL      -        0xffffffff80a95000 [g_event]
   12     0     0     0  RL      (threaded)                  intr
100032                   I                                   [irq1: atkbd0]
100030                   I                                   [swi0: sio]
100029                   I                                   [irq19: atapci1]
100028                   I                                   [irq15: ata1]
100027                   I                                   [irq14: ata0]
100023                   I                                   [irq23: uhci0]
100022                   I                                   [irq9: acpi0]
100018                   I                                   [swi6: task queue]
100017                   I                                   [swi6: Giant taskq]
100015                   Run     CPU 0                       [swi5: +]
100013                   I                                   [swi2: cambio]
100007                   I                                   [swi3: vm]
100006                   I                                   [swi4: clock sio]
100005                   I                                   [swi1: net]
   11     0     0     0  RL      (threaded)                  idle
100004                   CanRun                              [idle: cpu0]
100003                   Run     CPU 1                       [idle: cpu1]
    1     0     1     0  SLs     wait     0xffffff00010e7880 [init]
   10     0     0     0  SL      audit_wo 0xffffffff80b391a0 [audit]
    0     0     0     0  SLs     vmwait   0xffffffff80b3a73c [swapper]
12826 12759 98001  1002  Z+                                  shm
12757 12750 98001  1002  Z+                                  pty
12753 12750 98001  1002  Z+                                  lockf
12768 12750 98001  1002  Z+                                  link
12769 12750 98001  1002  Z+                                  lockf2
12766 12750 98001  1002  Z+                                  initial thread
12767 12750 98001  1002  Z+                                  udp
12764 12750 98001  1002  Z+                                  tcp
12763 12750 98001  1002  Z+                                  sysctl
12762 12750 98001  1002  Z+                                  symlink
12756 12750 98001  1002  Z+                                  mmap
12755 12750 98001  1002  Z+                                  mkfifo
12760 12750 98001  1002  Z+                                  socket
db> allt

Tracing command watchdogd pid 12864 tid 100157 td 0xffffff0026834000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800509594, rsp = 0x7fffffffe910, rbp = 0xde0 ---

Tracing command thr1 pid 12848 tid 101166 td 0xffffff004a79d000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401064, rsp = 0x7fffffbfefa8, rbp = 0x7fffffbfefc0 ---

Tracing command thr1 pid 12848 tid 100190 td 0xffffff0026985680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401004, rsp = 0x7fffffffded8, rbp = 0x7fffffffe6f0 ---

Tracing command thr1 pid 12847 tid 100135 td 0xffffff00266d9340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063de36, rsp = 0x7fffffffdda0, rbp = 0x1000 ---

Tracing command thr1 pid 12846 tid 100142 td 0xffffff002663a9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063de36, rsp = 0x7fffffffdda0, rbp = 0x1000 ---

Tracing command thr1 pid 12845 tid 100115 td 0xffffff00264e5680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063e06c, rsp = 0x7fffffffdd68, rbp = 0x800a01120 ---

Tracing command thr1 pid 12844 tid 100179 td 0xffffff0026988340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063cb0a, rsp = 0x7fffffffdde0, rbp = 0x7fffffffe6f0 ---

Tracing command thr1 pid 12843 tid 101181 td 0xffffff000162f9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063cb0a, rsp = 0x7fffffffdde0, rbp = 0x7fffffffe6f0 ---

Tracing command thr1 pid 12842 tid 101151 td 0xffffff005585f340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063aa9c, rsp = 0x7fffffbfefc8, rbp = 0 ---

Tracing command thr1 pid 12842 tid 100152 td 0xffffff0026835340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401236, rsp = 0x7fffffffdee0, rbp = 0x7fffffffe6f0 ---

Tracing command thr1 pid 12841 tid 100211 td 0xffffff0014c93680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063de36, rsp = 0x7fffffffdda0, rbp = 0x1000 ---

Tracing command thr1 pid 12840 tid 100289 td 0xffffff00683eb9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x8006439cd, rsp = 0x7ffff2794f30, rbp = 0x800a17c10 ---

Tracing command thr1 pid 12840 tid 100108 td 0xffffff00264e7340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800507255, rsp = 0x7fffffffdd10, rbp = 0x170 ---

Tracing command thr1 pid 12839 tid 100176 td 0xffffff002663c9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050b835, rsp = 0x7fffffffdcc0, rbp = 0x70 ---

Tracing command thr1 pid 12838 tid 100134 td 0xffffff00266d9680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050b890, rsp = 0x7fffffffdcc0, rbp = 0x3 ---

Tracing command thr1 pid 12837 tid 100321 td 0xffffff0026f1a680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffa3d2f18, rbp = 0x800a051d0 ---

Tracing command thr1 pid 12837 tid 100286 td 0xffffff00a74359c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffa5d3f18, rbp = 0x800a05060 ---

Tracing command thr1 pid 12837 tid 100283 td 0xffffff00a8cd79c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffa7d4f18, rbp = 0x800a04ef0 ---

Tracing command thr1 pid 12837 tid 100320 td 0xffffff00470a49c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffa9d5f18, rbp = 0x800a04d80 ---

Tracing command thr1 pid 12837 tid 100319 td 0xffffff003b5f49c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffabd6f18, rbp = 0x800a04c10 ---

Tracing command thr1 pid 12837 tid 100318 td 0xffffff000c809000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffadd7f18, rbp = 0x800a04aa0 ---

Tracing command thr1 pid 12837 tid 100317 td 0xffffff0093057680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffafd8f18, rbp = 0x800a04930 ---

Tracing command thr1 pid 12837 tid 100316 td 0xffffff00a7428340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffb1d9f18, rbp = 0x800a047c0 ---

Tracing command thr1 pid 12837 tid 100315 td 0xffffff00a7494680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffb3daf18, rbp = 0x800a04650 ---

Tracing command thr1 pid 12837 tid 100314 td 0xffffff00a26289c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffb5dbf18, rbp = 0x800a044e0 ---

Tracing command thr1 pid 12837 tid 100313 td 0xffffff00683e5000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffb7dcf18, rbp = 0x800a04370 ---

Tracing command thr1 pid 12837 tid 100312 td 0xffffff00683e1340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffb9ddf18, rbp = 0x800a04200 ---

Tracing command thr1 pid 12837 tid 100311 td 0xffffff00a2627340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffbbdef18, rbp = 0x800a04090 ---

Tracing command thr1 pid 12837 tid 100310 td 0xffffff0093051340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffbddff18, rbp = 0x800a03f20 ---

Tracing command thr1 pid 12837 tid 100309 td 0xffffff009305e9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffbfe0f18, rbp = 0x800a03db0 ---

Tracing command thr1 pid 12837 tid 100308 td 0xffffff00683e59c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffc1e1f18, rbp = 0x800a03c40 ---

Tracing command thr1 pid 12837 tid 100307 td 0xffffff005585f680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffc3e2f18, rbp = 0x800a03ad0 ---

Tracing command thr1 pid 12837 tid 100306 td 0xffffff003b5f1680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffc5e3f18, rbp = 0x800a03960 ---

Tracing command thr1 pid 12837 tid 100305 td 0xffffff0052dd5340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffc7e4f18, rbp = 0x800a037f0 ---

Tracing command thr1 pid 12837 tid 100304 td 0xffffff008e74f000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffc9e5f18, rbp = 0x800a03680 ---

Tracing command thr1 pid 12837 tid 100303 td 0xffffff00a7496340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffcbe6f18, rbp = 0x800a03510 ---

Tracing command thr1 pid 12837 tid 100302 td 0xffffff00a749c000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffcde7f18, rbp = 0x800a033a0 ---

Tracing command thr1 pid 12837 tid 100301 td 0xffffff007b784340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffcfe8f18, rbp = 0x800a03230 ---

Tracing command thr1 pid 12837 tid 100300 td 0xffffff00718a29c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffd1e9f18, rbp = 0x800a030c0 ---

Tracing command thr1 pid 12837 tid 100299 td 0xffffff000c80c9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffd3eaf18, rbp = 0x800a02f50 ---

Tracing command thr1 pid 12837 tid 100297 td 0xffffff000c805340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffd5ebf18, rbp = 0x800a02de0 ---

Tracing command thr1 pid 12837 tid 100296 td 0xffffff0012856680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffd7ecf18, rbp = 0x800a02c70 ---

Tracing command thr1 pid 12837 tid 100295 td 0xffffff00a8c969c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffd9edf18, rbp = 0x800a02b00 ---

Tracing command thr1 pid 12837 tid 100293 td 0xffffff003b5f3000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffdbeef18, rbp = 0x800a02990 ---

Tracing command thr1 pid 12837 tid 100292 td 0xffffff002c5fa9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffddeff18, rbp = 0x800a02820 ---

Tracing command thr1 pid 12837 tid 100291 td 0xffffff007b7519c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffdff0f18, rbp = 0x800a026b0 ---

Tracing command thr1 pid 12837 tid 100287 td 0xffffff009304c680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffe1f1f18, rbp = 0x800a02540 ---

Tracing command thr1 pid 12837 tid 100285 td 0xffffff0062fdb000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffe3f2f18, rbp = 0x800a023d0 ---

Tracing command thr1 pid 12837 tid 100284 td 0xffffff0052dea9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffe5f3f18, rbp = 0x800a02260 ---

Tracing command thr1 pid 12837 tid 100118 td 0xffffff0078d2c9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffe7f4f18, rbp = 0x800a020f0 ---

Tracing command thr1 pid 12837 tid 100298 td 0xffffff000c804680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7ffffedf7f18, rbp = 0x800a01ca0 ---

Tracing command thr1 pid 12837 tid 100294 td 0xffffff0003dfd680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7fffff1f9f18, rbp = 0x800a019c0 ---

Tracing command thr1 pid 12837 tid 100290 td 0xffffff00a2626680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
_do_lock_umutex() at _do_lock_umutex+0xca9
do_lock_umutex() at do_lock_umutex+0x17c
__umtx_op_lock_umutex() at __umtx_op_lock_umutex+0x53
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80079addc, rsp = 0x7fffff5fbf18, rbp = 0x800a016e0 ---

Tracing command thr1 pid 12837 tid 101421 td 0xffffff00250eb000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80063de36, rsp = 0x7fffffffdda0, rbp = 0x1000 ---

Tracing command thr1 pid 12836 tid 101146 td 0xffffff0001658000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x8007b151c, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe750 ---

Tracing command rw pid 12835 tid 100360 td 0xffffff0026ed8680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
cluster_wbuild() at cluster_wbuild+0x531
cluster_write() at cluster_write+0x5fa
ffs_write() at ffs_write+0x62b
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12834 tid 100185 td 0xffffff00269f8680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
ffs_write() at ffs_write+0x4f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12833 tid 100263 td 0xffffff004abc79c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
ffs_write() at ffs_write+0x4f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12832 tid 100137 td 0xffffff00266d69c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
cluster_wbuild() at cluster_wbuild+0x531
cluster_write() at cluster_write+0x5fa
ffs_write() at ffs_write+0x62b
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12830 tid 100241 td 0xffffff003b56f340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
cluster_wbuild() at cluster_wbuild+0x531
cluster_write() at cluster_write+0x5fa
ffs_write() at ffs_write+0x62b
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12828 tid 100267 td 0xffffff006d0f5340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
cluster_wbuild() at cluster_wbuild+0x531
cluster_write() at cluster_write+0x5fa
ffs_write() at ffs_write+0x62b
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12827 tid 101177 td 0xffffff003b59f000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
cluster_wbuild() at cluster_wbuild+0x531
cluster_write() at cluster_write+0x5fa
ffs_write() at ffs_write+0x62b
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12825 tid 101410 td 0xffffff003b467680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
cluster_wbuild() at cluster_wbuild+0x531
cluster_write() at cluster_write+0x5fa
ffs_write() at ffs_write+0x62b
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12824 tid 100155 td 0xffffff0026834680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
ffs_write() at ffs_write+0x4f8
VOP_WRITE_APV() at VOP_WRITE_APV+0x131
vn_write() at vn_write+0x23f
dofilewrite() at dofilewrite+0x85
kern_writev() at kern_writev+0x60
write() at write+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (4, FreeBSD ELF64, write), rip = 0x800713dcc, rsp = 0x7fffffffd658, rbp = 0x7fffffffe6f0 ---

Tracing command rw pid 12823 tid 100184 td 0xffffff00269f89c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069d51c, rsp = 0x7fffffffe728, rbp = 0x7fffffffe750 ---

Tracing command swap pid 12822 tid 100106 td 0xffffff00264e79c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12821 tid 100074 td 0xffffff00015149c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12820 tid 100130 td 0xffffff000182d9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12819 tid 100251 td 0xffffff000f084000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12818 tid 101076 td 0xffffff0026f07000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12817 tid 101003 td 0xffffff0052bb59c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12816 tid 100213 td 0xffffff00ac264000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12815 tid 100144 td 0xffffff002663a340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12814 tid 100271 td 0xffffff0048afc9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12813 tid 100161 td 0xffffff0026833000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12812 tid 100123 td 0xffffff002663b680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12811 tid 100129 td 0xffffff00018f0000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12810 tid 100170 td 0xffffff00266da9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12809 tid 100198 td 0xffffff0026af1680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12808 tid 100101 td 0xffffff00015b5680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12807 tid 100264 td 0xffffff00125a8680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12806 tid 100119 td 0xffffff0001987680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12805 tid 100059 td 0xffffff00015b8000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12804 tid 100092 td 0xffffff0001987340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12803 tid 100053 td 0xffffff00014679c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12802 tid 100197 td 0xffffff0026af19c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12801 tid 100160 td 0xffffff0026833340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12800 tid 100194 td 0xffffff0026835680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12799 tid 100141 td 0xffffff002663b000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12798 tid 100146 td 0xffffff00266389c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12797 tid 100192 td 0xffffff0026985000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12796 tid 100273 td 0xffffff004ab84000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12795 tid 100206 td 0xffffff0026aeb680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12794 tid 100067 td 0xffffff0001565680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x401898, rsp = 0x7fffffffe6d0, rbp = 0x7fffffffe6f0 ---

Tracing command swap pid 12793 tid 100208 td 0xffffff0026aeb000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe620, rbp = 0x450 ---

Tracing command swap pid 12792 tid 101075 td 0xffffff0026d8a000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069d51c, rsp = 0x7fffffffe728, rbp = 0x7fffffffe750 ---

Tracing command creat pid 12791 tid 100159 td 0xffffff0026833680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
acquire() at acquire+0xb7
_lockmgr_args() at _lockmgr_args+0x62c
getblk() at getblk+0x116
breadn() at breadn+0x3f
bread() at bread+0x1e
softdep_sync_metadata() at softdep_sync_metadata+0xa36
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12790 tid 100242 td 0xffffff00aca22680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
ffs_update() at ffs_update+0x1d2
ufs_makeinode() at ufs_makeinode+0x217
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12789 tid 100060 td 0xffffff00015b79c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
ffs_syncvnode() at ffs_syncvnode+0x291
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12788 tid 100248 td 0xffffff00acde0340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12787 tid 100231 td 0xffffff00aca59340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12786 tid 100255 td 0xffffff00ac9fd000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12785 tid 100201 td 0xffffff0026aec9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12784 tid 100166 td 0xffffff00266d6000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12783 tid 100523 td 0xffffff008cc2d340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12782 tid 100538 td 0xffffff0026f22000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
softdep_sync_metadata() at softdep_sync_metadata+0x302
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12781 tid 100045 td 0xffffff0001465340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
acquire() at acquire+0xb7
_lockmgr_args() at _lockmgr_args+0x62c
getblk() at getblk+0x116
breadn() at breadn+0x3f
bread() at bread+0x1e
softdep_sync_metadata() at softdep_sync_metadata+0xa36
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12780 tid 100189 td 0xffffff00269859c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
softdep_sync_metadata() at softdep_sync_metadata+0x302
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12779 tid 100147 td 0xffffff0026638680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12778 tid 100258 td 0xffffff004ae67340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
bufwrite() at bufwrite+0x185
softdep_sync_metadata() at softdep_sync_metadata+0x302
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12777 tid 100181 td 0xffffff0026988000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
acquire() at acquire+0xb7
_lockmgr_args() at _lockmgr_args+0x62c
getblk() at getblk+0x116
breadn() at breadn+0x3f
bread() at bread+0x1e
softdep_sync_metadata() at softdep_sync_metadata+0xa36
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12776 tid 101148 td 0xffffff0024a32000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12775 tid 101425 td 0xffffff003b59f9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
acquire() at acquire+0xb7
_lockmgr_args() at _lockmgr_args+0x62c
getblk() at getblk+0x116
breadn() at breadn+0x3f
bread() at bread+0x1e
softdep_sync_metadata() at softdep_sync_metadata+0xa36
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12774 tid 100081 td 0xffffff00017f89c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
softdep_sync_metadata() at softdep_sync_metadata+0xa6d
ffs_syncvnode() at ffs_syncvnode+0x221
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
ufs_direnter() at ufs_direnter+0x91e
ufs_makeinode() at ufs_makeinode+0x37c
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command creat pid 12773 tid 100050 td 0xffffff00014f2680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
acquire() at acquire+0xb7
_lockmgr_args() at _lockmgr_args+0x62c
getblk() at getblk+0x116
breadn() at breadn+0x3f
bread() at bread+0x1e
ffs_vget() at ffs_vget+0x2b8
ffs_valloc() at ffs_valloc+0x17b
ufs_makeinode() at ufs_makeinode+0x87
VOP_CREATE_APV() at VOP_CREATE_APV+0xb3
vn_open_cred() at vn_open_cred+0x475
kern_open() at kern_open+0x125
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (5, FreeBSD ELF64, open), rip = 0x80070644c, rsp = 0x7fffffffe658, rbp = 0x7fffffffe6f0 ---

Tracing command mkdir pid 12772 tid 100261 td 0xffffff004a8c1340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
bwait() at bwait+0x64
bufwait() at bufwait+0x23
bufwrite() at bufwrite+0x1b8
ffs_update() at ffs_update+0x1d2
ufs_inactive() at ufs_inactive+0x17d
VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xb5
vinactive() at vinactive+0x90
vrele() at vrele+0x1de
kern_chdir() at kern_chdir+0x170
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (12, FreeBSD ELF64, chdir), rip = 0x800688adc, rsp = 0x7ffffffe9808, rbp = 0x7ffffffe9c30 ---

Tracing command mkdir pid 12771 tid 100174 td 0xffffff0026989000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069d51c, rsp = 0x7fffffffe728, rbp = 0x7fffffffe750 ---

Tracing command creat pid 12770 tid 100236 td 0xffffff00ac29e9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069d51c, rsp = 0x7fffffffe728, rbp = 0x7fffffffe750 ---

Tracing command thr1 pid 12765 tid 100058 td 0xffffff00015b8340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x8005086d3, rsp = 0x7fffffffe6b0, rbp = 0x60 ---

Tracing command swap pid 12761 tid 100151 td 0xffffff00264e8680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe6b0, rbp = 0x90 ---

Tracing command shm pid 12759 tid 100210 td 0xffffff0026c05680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x8005096d3, rsp = 0x7fffffffe6b0, rbp = 0x90 ---

Tracing command rw pid 12758 tid 100088 td 0xffffff0001833000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe6b0, rbp = 0x90 ---

Tracing command mkdir pid 12754 tid 100085 td 0xffffff00018339c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe6b0, rbp = 0x90 ---

Tracing command creat pid 12752 tid 100162 td 0xffffff00268319c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050a6d3, rsp = 0x7fffffffe6b0, rbp = 0x90 ---

Tracing command run pid 12750 tid 100222 td 0xffffff00599a1680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069c51c, rsp = 0x7fffffffe028, rbp = 0x7fffffffe4c0 ---

Tracing command run pid 12749 tid 100196 td 0xffffff0026af2000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069c51c, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe520 ---

Tracing command run pid 12748 tid 101231 td 0xffffff008cc23000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x8005096d3, rsp = 0x7fffffffe480, rbp = 0x60 ---

Tracing command sh pid 12736 tid 100895 td 0xffffff008c50b000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092b51c, rsp = 0x7fffffffe478, rbp = 0x17ed1 ---

Tracing command sleep pid 12367 tid 100546 td 0xffffff003b5be340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x8006f4bde, rsp = 0x7fffffffec08, rbp = 0x7fffffffec90 ---

Tracing command sh pid 98001 tid 100173 td 0xffffff00266d5000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092b51c, rsp = 0x7fffffffe4e8, rbp = 0x17ed1 ---

Tracing command sh pid 937 tid 100055 td 0xffffff0001467680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092b51c, rsp = 0x7fffffffe7b8, rbp = 0x3a9 ---

Tracing command csh pid 934 tid 100061 td 0xffffff00015b7680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_sigsuspend() at kern_sigsuspend+0xca
sigsuspend() at sigsuspend+0x34
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (341, FreeBSD ELF64, sigsuspend), rip = 0x80094395c, rsp = 0x7fffffffe6c8, rbp = 0x800c6e130 ---

Tracing command watchdogd pid 927 tid 100091 td 0xffffff00015ac340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x8008c251c, rsp = 0x7fffffffe9c8, rbp = 0x800b01050 ---

Tracing command csh pid 915 tid 100083 td 0xffffff00017f8340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_sigsuspend() at kern_sigsuspend+0xca
sigsuspend() at sigsuspend+0x34
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (341, FreeBSD ELF64, sigsuspend), rip = 0x80094395c, rsp = 0x7fffffffe648, rbp = 0x800c70130 ---

Tracing command sshd pid 914 tid 100098 td 0xffffff00018349c0

Tracing command sshd pid 911 tid 100095 td 0xffffff00017c7680

Tracing command login pid 652 tid 100062 td 0xffffff00015b7340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x8009ca51c, rsp = 0x7fffffffed08, rbp = 0x800b6e860 ---

Tracing command getty pid 651 tid 100078 td 0xffffff000182d680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 650 tid 100080 td 0xffffff000182d000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 649 tid 100079 td 0xffffff000182d340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 648 tid 100054 td 0xffffff00013c29c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 647 tid 100082 td 0xffffff00017f8680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 646 tid 100043 td 0xffffff00014f5680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 645 tid 100084 td 0xffffff00017f8000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command getty pid 644 tid 100057 td 0xffffff00015b8680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
ttysleep() at ttysleep+0x25
ttread() at ttread+0x303
giant_read() at giant_read+0x68
devfs_read_f() at devfs_read_f+0x75
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x54
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (3, FreeBSD ELF64, read), rip = 0x800822dec, rsp = 0x7fffffffed98, rbp = 0 ---

Tracing command cron pid 604 tid 100048 td 0xffffff00014f29c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x8008bfaf8, rsp = 0x7fffffffebf0, rbp = 0x50a138 ---

Tracing command sendmail pid 597 tid 100047 td 0xffffff00014f5000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x30c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff807475bb, rsp = 0xffffffffaea6d6f0, rbp = 0xffffffffaea6db40 ---
copyout() at copyout+0x3b
postsig() at postsig+0x29d
ast() at ast+0x387
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (4, FreeBSD ELF64, write), rip = 0x800d1095c, rsp = 0x7fffffffda48, rbp = 0x1 ---

Tracing command sendmail pid 593 tid 100072 td 0xffffff00015bc340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_fault() at vm_fault+0x1484
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4e4
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800d9b354, rsp = 0x7fffffffb7a0, rbp = 0x5a5ef4 ---

Tracing command sshd pid 587 tid 100068 td 0xffffff0001565340

Tracing command syslogd pid 457 tid 100065 td 0xffffff00015ac000

Tracing command devd pid 402 tid 100049 td 0xffffff0001465000

Tracing command dhclient pid 284 tid 100064 td 0xffffff0001467340

Tracing command dhclient pid 257 tid 100066 td 0xffffff00015659c0

Tracing command adjkerntz pid 112 tid 100056 td 0xffffff00015b89c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_sigsuspend() at kern_sigsuspend+0xca
sigsuspend() at sigsuspend+0x34
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (341, FreeBSD ELF64, sigsuspend), rip = 0x80068495c, rsp = 0x7fffffffed08, rbp = 0x1 ---

Tracing command softdepflush pid 26 tid 100040 td 0xffffff0001466000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
acquire() at acquire+0xb7
_lockmgr_args() at _lockmgr_args+0x62c
getblk() at getblk+0x116
breadn() at breadn+0x3f
bread() at bread+0x1e
ffs_freefile() at ffs_freefile+0xc2
handle_workitem_freefile() at handle_workitem_freefile+0xc8
process_worklist_item() at process_worklist_item+0x24f
softdep_process_worklist() at softdep_process_worklist+0xa0
softdep_flush() at softdep_flush+0xd2
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac747d30, rbp = 0 ---

Tracing command vnlru pid 25 tid 100039 td 0xffffff0001466340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
vnlru_proc() at vnlru_proc+0x678
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac742d30, rbp = 0 ---

Tracing command syncer pid 24 tid 100038 td 0xffffff0001466680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
uma_small_alloc() at uma_small_alloc+0x4c
slab_zalloc() at slab_zalloc+0x76
uma_zone_slab() at uma_zone_slab+0xbf
uma_zalloc_arg() at uma_zalloc_arg+0x41a
malloc() at malloc+0x8a
softdep_disk_io_initiation() at softdep_disk_io_initiation+0x54b
ffs_geom_strategy() at ffs_geom_strategy+0x1a0
bufwrite() at bufwrite+0x154
vfs_bio_awrite() at vfs_bio_awrite+0x78
vop_stdfsync() at vop_stdfsync+0x1d9
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
sched_sync() at sched_sync+0x511
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac73dd30, rbp = 0 ---

Tracing command bufdaemon pid 23 tid 100037 td 0xffffff00014669c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
waitrunningbufspace() at waitrunningbufspace+0x59
flushbufqueues() at flushbufqueues+0x40b
buf_daemon() at buf_daemon+0xc3
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac738d30, rbp = 0 ---

Tracing command pagezero pid 22 tid 100036 td 0xffffff0001467000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
vm_pagezero() at vm_pagezero+0x73
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac733d30, rbp = 0 ---

Tracing command vmdaemon pid 21 tid 100035 td 0xffffff0001227680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
vm_daemon() at vm_daemon+0x4d
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac72ed30, rbp = 0 ---

Tracing command pagedaemon pid 20 tid 100034 td 0xffffff00012279c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
getpbuf() at getpbuf+0x4e
swap_pager_putpages() at swap_pager_putpages+0x1ad
vm_pageout_flush() at vm_pageout_flush+0x14b
vm_pageout_clean() at vm_pageout_clean+0xec
vm_pageout() at vm_pageout+0x13f2
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac729d30, rbp = 0 ---

Tracing command sctp_iterator pid 19 tid 100033 td 0xffffff00013c0000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
sctp_iterator_thread() at sctp_iterator_thread+0x47
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac724d30, rbp = 0 ---

Tracing command acpi_thermal pid 18 tid 100031 td 0xffffff00013c0680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
acpi_tz_thread() at acpi_tz_thread+0x1dc
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac6f7d30, rbp = 0 ---

Tracing command usbtask-dr pid 17 tid 100026 td 0xffffff0001221680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
usb_task_thread() at usb_task_thread+0x94
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac591d30, rbp = 0 ---

Tracing command usbtask-hc pid 16 tid 100025 td 0xffffff00012219c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
usb_task_thread() at usb_task_thread+0x94
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac58cd30, rbp = 0 ---

Tracing command usb0 pid 15 tid 100024 td 0xffffff0001226000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
usb_event_thread() at usb_event_thread+0xaa
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac587d30, rbp = 0 ---

Tracing command acpi_task_2 pid 14 tid 100021 td 0xffffff00012269c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4b7d30, rbp = 0 ---

Tracing command acpi_task_1 pid 9 tid 100020 td 0xffffff0001227000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4b2d30, rbp = 0 ---

Tracing command acpi_task_0 pid 8 tid 100019 td 0xffffff0001227340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4add30, rbp = 0 ---

Tracing command thread taskq pid 7 tid 100016 td 0xffffff0001220340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac49ed30, rbp = 0 ---

Tracing command kqueue taskq pid 6 tid 100014 td 0xffffff00012209c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac494d30, rbp = 0 ---

Tracing command xpt_thrd pid 5 tid 100012 td 0xffffff0001221340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
xpt_scanner_thread() at xpt_scanner_thread+0x3a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac48ad30, rbp = 0 ---

Tracing command yarrow pid 13 tid 100011 td 0xffffff00010eb340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
random_kthread() at random_kthread+0x194
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac485d30, rbp = 0 ---

Tracing command g_down pid 4 tid 100010 td 0xffffff00010eb680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
g_io_schedule_down() at g_io_schedule_down+0x15e
g_down_procbody() at g_down_procbody+0x6f
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac480d30, rbp = 0 ---

Tracing command g_up pid 3 tid 100009 td 0xffffff00010eb9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
g_io_schedule_up() at g_io_schedule_up+0x154
g_up_procbody() at g_up_procbody+0x6f
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac47bd30, rbp = 0 ---

Tracing command g_event pid 2 tid 100008 td 0xffffff00010f6000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x303
g_event_procbody() at g_event_procbody+0xa1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac476d30, rbp = 0 ---

Tracing command intr pid 12 tid 100032 td 0xffffff00013c0340
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100030 td 0xffffff00013c09c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
ithread_loop() at ithread_loop+0x3c1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac6f2d30, rbp = 0 ---

Tracing command intr pid 12 tid 100029 td 0xffffff00013c2000
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100028 td 0xffffff00013c2340
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100027 td 0xffffff00013c2680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
ithread_loop() at ithread_loop+0x3c1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac6aad30, rbp = 0 ---

Tracing command intr pid 12 tid 100023 td 0xffffff0001226340
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100022 td 0xffffff0001226680
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100018 td 0xffffff00010f69c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
ithread_loop() at ithread_loop+0x3c1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4a8d30, rbp = 0 ---

Tracing command intr pid 12 tid 100017 td 0xffffff0001220000
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100015 td 0xffffff0001220680
kdb_enter() at kdb_enter+0x3d
lapic_handle_timer() at lapic_handle_timer+0xc7
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff8068f158, rsp = 0xffffffffac4998a0, rbp = 0xffffffffac4998b0 ---
trash_dtor() at trash_dtor+0x18
mb_dtor_pack() at mb_dtor_pack+0x8f
uma_zfree_arg() at uma_zfree_arg+0x41
m_freem() at m_freem+0x37
udp_input() at udp_input+0x73
ip_input() at ip_input+0xc0
ether_demux() at ether_demux+0x1ed
ether_input() at ether_input+0x1d5
re_rxeof() at re_rxeof+0x389
re_int_task() at re_int_task+0x1f8
taskqueue_run() at taskqueue_run+0x94
ithread_loop() at ithread_loop+0xe0
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac499d30, rbp = 0 ---

Tracing command intr pid 12 tid 100013 td 0xffffff0001221000
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100007 td 0xffffff00010f6340
fork_trampoline() at fork_trampoline

Tracing command intr pid 12 tid 100006 td 0xffffff00010f6680
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
ithread_loop() at ithread_loop+0x3c1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac46cd30, rbp = 0 ---

Tracing command intr pid 12 tid 100005 td 0xffffff00010ea000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
ithread_loop() at ithread_loop+0x3c1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac467d30, rbp = 0 ---

Tracing command idle pid 11 tid 100004 td 0xffffff00010ea340
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
critical_exit() at critical_exit+0x91
intr_execute_handlers() at intr_execute_handlers+0xe9
Xapic_isr1() at Xapic_isr1+0x7f
--- interrupt, rip = 0xffffffff80724996, rsp = 0xffffffffac461b60, rbp = 0xffffffffac461b70 ---
acpi_cpu_c1() at acpi_cpu_c1+0x6
acpi_cpu_idle() at acpi_cpu_idle+0x1a4
sched_idletd() at sched_idletd+0x65
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac461d30, rbp = 0 ---

Tracing command idle pid 11 tid 100003 td 0xffffff00010ea680
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff80724996, rsp = 0xffffffffab99fff0, rbp = 0xffffffffac45cb70 ---
acpi_cpu_c1() at acpi_cpu_c1+0x6
acpi_cpu_idle() at acpi_cpu_idle+0x1a4
sched_idletd() at sched_idletd+0x65
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac45cd30, rbp = 0 ---

Tracing command init pid 1 tid 100002 td 0xffffff00010ea9c0
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_catch_signals() at sleepq_catch_signals+0x256
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2cc
kern_wait() at kern_wait+0x3cc
wait4() at wait4+0x35
syscall() at syscall+0x1bf
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x40bf4c, rsp = 0x7fffffffe8e8, rbp = 0x7fffffffed70 ---

Tracing command audit pid 10 tid 100001 td 0xffffff00010eb000
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x160
audit_worker() at audit_worker+0x77
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac452d30, rbp = 0 ---

Tracing command kernel pid 0 tid 100000 td 0xffffffff80a95560
sched_switch() at sched_switch+0x15d
mi_switch() at mi_switch+0x217
sleepq_switch() at sleepq_switch+0x118
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x319
scheduler() at scheduler+0x268
mi_startup() at mi_startup+0x59
btext() at btext+0x2c
db> call doadump
Physical memory: 3057 MB
Dumping 435 MB: 420 404 388 372 356 340 324 308 292 276 260 244 228 212 196 180 164 148 132 116 100 84 68 52 36 20 4
Dump complete
= 0xf
db> c
interrupt                   total
irq4: sio0                        237317
irq14: ata0                     16917437
irq20: re0                        222310
cpu0: timer                    484657808
cpu1: timer                    484556718
Total                   986591677
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
hardclock() at hardclock+0x19e
lapic_handle_timer() at lapic_handle_timer+0xc7
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff804d007d, rsp = 0xffffffffac499a20, rbp = 0xffffffffac499aa0 ---
witness_checkorder() at witness_checkorder+0x3d
_mtx_lock_flags() at _mtx_lock_flags+0x75
re_rxeof() at re_rxeof+0x3a0
re_int_task() at re_int_task+0x1f8
taskqueue_run() at taskqueue_run+0x94
ithread_loop() at ithread_loop+0xe0
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac499d30, rbp = 0 ---
KDB: enter: watchdog timeout
[thread pid 12 tid 100015 ]
Stopped at      kdb_enter+0x3d: movq    $0,0x5e98a8(%rip)
db> c
interrupt                   total
irq4: sio0                        238308
irq14: ata0                     16917437
irq20: re0                        222310
cpu0: timer                    484657810
cpu1: timer                    484557787
Total                   986593740
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
hardclock() at hardclock+0x19e
lapic_handle_timer() at lapic_handle_timer+0xc7
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff8068f2b0, rsp = 0xffffffffac4999a0, rbp = 0xffffffffac4999b0 ---
trash_ctor() at trash_ctor+0x20
mb_ctor_pack() at mb_ctor_pack+0x2c
uma_zalloc_arg() at uma_zalloc_arg+0x2db
re_newbuf() at re_newbuf+0x44
re_rxeof() at re_rxeof+0x1d7
re_int_task() at re_int_task+0x1f8
taskqueue_run() at taskqueue_run+0x94
ithread_loop() at ithread_loop+0xe0
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac499d30, rbp = 0 ---
KDB: enter: watchdog timeout
[thread pid 12 tid 100015 ]
Stopped at      kdb_enter+0x3d: movq    $0,0x5e98a8(%rip)
db> c
interrupt                   total
irq4: sio0                        239353
irq14: ata0                     16917437
irq20: re0                        222310
cpu0: timer                    484657812
cpu1: timer                    484558916
Total                   986595915
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
hardclock() at hardclock+0x19e
lapic_handle_timer() at lapic_handle_timer+0xc7
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff803968ad, rsp = 0xffffffffac499b40, rbp = 0xffffffffac499b80 ---
re_int_task() at re_int_task+0x5d
taskqueue_run() at taskqueue_run+0x94
ithread_loop() at ithread_loop+0xe0
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac499d30, rbp = 0 ---
KDB: enter: watchdog timeout
[thread pid 12 tid 100015 ]
Stopped at      kdb_enter+0x3d: movq    $0,0x5e98a8(%rip)
db> reset

(kgdb) p bio_reserve_use
$1 = 0
(kgdb)

--
Test scenario: run.sh -a
watchdogd -t 36000 -e 'ls -l /tmp /dev /usr > /dev/null; true' -s 60