Genereic HEAD from Sep 19 12:00 UTC + fdclone.5.patch, vmcore.4

KDB: debugger backends: ddb
KDB: current backend: ddb
786432K of memory above 4GB ignored
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-CURRENT #0: Fri Sep 21 14:13:05 UTC 2007
    test@hydra2.netperf.freebsd.org:/m2/src/sys/i386/compile/ULE
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU           E5320  @ 1.86GHz (1866.74-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f7  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
  AMD Features=0x20100000<NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 4
real memory  = 3489005568 (3327 MB)
avail memory = 3409276928 (3251 MB)
MPTable: <INTEL    Bridge CRB  >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0: Assuming intbase of 0
:
Trying to mount root from nfs:
NFS ROOT: 192.168.5.1:/zoo/hydra2
em0: link state changed to UP
Interface em0 IP-Address 192.168.5.111 Broadcast 192.168.5.255
Loading configuration files.
No suitable dump device was found.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
mount_nfs: can't update /var/db/mounttab for 192.168.5.1:/zoo/hydra2
Setting hostuuid: 7634a964-b127-0430-c299-0030488f5548.
Setting hostid: 0x20c74c48.
Mounting local file systems:.
Setting hostname: hydra2.netperf.freebsd.org.
net.inet6.ip6.auto_linklocal: 1 -> 0
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
        inet6 ::1 prefixlen 128
        inet 127.0.0.1 netmask 0xff000000
Additional routing options:.
Starting devd.
em1: link state changed to UP
Additional IP options:.
Mounting NFS file systems:.
Creating and/or trimming log files:.
Starting syslogd.
/etc/rc: WARNING: Dump device does not exist.  Savecore not run.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout
Initial i386 initialization:.
Additional ABI support:.
Starting rpcbind.
NFS access cache time=60
Clearing /tmp (X related).
Starting statd.
Starting lockd.
Starting local daemons:.
Updating motd.
Mounting late file systems:.
Configuring syscons: blanktime.
Starting sshd.
Starting cron.
Local package initialization:.
Starting background file system checks in 60 seconds.

Fri Sep 21 16:36:49 UTC 2007

FreeBSD/i386 (hydra2.netperf.freebsd.org) (ttyd0)

login: root
Sep 21 17:32:01 hydra2 login: ROOT LOGIN (root) ON ttyd0
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.

FreeBSD 7.0-CURRENT (ULE) #0: Fri Sep 21 14:13:05 UTC 2007

Welcome to FreeBSD!

Before seeking technical support, please use the following resources:

o  Security advisories and updated errata information for all releases are
   at http://www.FreeBSD.org/releases/ - always consult the ERRATA section
   for your release first as it's updated frequently.

o  The Handbook and FAQ documents are at http://www.FreeBSD.org/ and,
   along with the mailing lists, can be searched by going to
   http://www.FreeBSD.org/search/.  If the doc distribution has
   been installed, they're also available formatted in /usr/share/doc.

If you still have a question or problem, please take the output of
`uname -a', along with any relevant error messages, and email it
as a question to the questions@FreeBSD.org mailing list.  If you are
unfamiliar with FreeBSD's directory layout, please refer to the hier(7)
manual page.  If you are not familiar with manual pages, type `man man'.

You may also use sysinstall(8) to re-enter the installation and
configuration utility.  Edit /etc/motd to change this login announcement.

hydra2# cd ~test/pho
hydra2# ./keepalive.sh
Fri Sep 21 19:32:11 CEST 2007  7:32PM  up 56 mins, 1 user, load averages: 0.00, 0.00, 0.00
Sep 21 17:34:09 hydra2 su: test to root on /dev/ttyp0
Sep 21 17:37:39 hydra2 su: test to root on /dev/ttyp0
Fri Sep 21 19:42:13 CEST 2007  7:42PM  up  1:06, 2 users, load averages: 7.06, 4.77, 2.15
VNASSERT failed
0xc74056cc: tag devfs, type VCHR
    usecount 1, writecount 1, refcount 1 mountedhere 0xc73d4000
    flags ()
 VI_LOCKed     lock type devfs: EXCL (count 1) by thread 0xc6f26aa0 (pid 2804)#0 0xc073db10 at _lockmgr+0x560
#1 0xc07bcc40 at vop_stdlock+0x40
#2 0xc0a1b4a5 at VOP_LOCK1_APV+0xa5
#3 0xc07d6d38 at _vn_lock+0xf8
#4 0xc07cb950 at vget+0x110
#5 0xc06e4bc5 at devfs_allocv+0x125
#6 0xc06e5973 at devfs_lookup+0x793
#7 0xc0a1c645 at VOP_LOOKUP_APV+0xe5
#8 0xc07c019e at lookup+0x59e
#9 0xc07c0cce at namei+0x34e
#10 0xc07cde2f at kern_lstat+0x4f
#11 0xc07cdf1f at lstat+0x2f
#12 0xc0a045f3 at syscall+0x2b3
#13 0xc09ea8c0 at Xint0x80_syscall+0x20

KDB: stack backtrace:
db_trace_self_wrapper(c0a9f59e,e94e4984,c07c7a63,c74057a0,e94e49a8,...) at db_trace_self_wrapper+0x26
kdb_backtrace(c74057a0,e94e49a8,c077932e,c0a9c5d8,c0b45ac0,...) at kdb_backtrace+0x29
vfs_badlock(e94e49a8,c0a184dd,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x23
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c6f26aa0,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e49c4,1,1,c73d4000,...) at VOP_PRINT_APV+0x7d
vn_printf(c74056cc,c0aa6dc9,c0aa7d3c,86f,60,...) at vn_printf+0x4af
vput(c74056cc,ffffffdf,c70ba000,0,c6f26aa0,...) at vput+0xc5
kern_lstat(c6f26aa0,2821b918,0,e94e4c18,e94e4c24,...) at kern_lstat+0xb5
lstat(c6f26aa0,e94e4cfc,8,c0aa213c,c0b49db0,...) at lstat+0x2f
syscall(e94e4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (190, FreeBSD ELF32, lstat), eip = 0x2819a3bf, esp = 0xbfbfe4ec, ebp = 0xbfbfe578 ---
VOP_PRINT: 0xc74056cc interlock is locked but should not be
KDB: enter: lock violation
[thread pid 2804 tid 100172 ]
Stopped at      kdb_enter+0x32: leave
db> set $lines 0
db> show allpcpu
Current CPU: 1

cpuid        = 0
curthread    = 0xc677eaa0: pid 18 "idle: cpu0"
curpcb       = 0xe53d8d90
fpcurthread  = none
idlethread   = 0xc677eaa0: pid 18 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
spin locks held:

cpuid        = 1
curthread    = 0xc6f26aa0: pid 2804 "ls"
curpcb       = 0xe94e4d90
fpcurthread  = none
idlethread   = 0xc677e880: pid 17 "idle: cpu1"
APIC ID      = 1
currentldt   = 0x50
spin locks held:

cpuid        = 2
curthread    = 0xc6780440: pid 2 "g_event"
curpcb       = 0xe53e4d90
fpcurthread  = none
idlethread   = 0xc677e660: pid 16 "idle: cpu2"
APIC ID      = 2
currentldt   = 0x50
spin locks held:

cpuid        = 3
curthread    = 0xc677e000: pid 15 "idle: cpu3"
curpcb       = 0xe53c9d90
fpcurthread  = none
idlethread   = 0xc677e000: pid 15 "idle: cpu3"
APIC ID      = 3
currentldt   = 0x50
spin locks held:

cpuid        = 4
curthread    = 0xc677ccc0: pid 14 "idle: cpu4"
curpcb       = 0xe53c6d90
fpcurthread  = none
idlethread   = 0xc677ccc0: pid 14 "idle: cpu4"
APIC ID      = 4
currentldt   = 0x50
spin locks held:

cpuid        = 5
curthread    = 0xc677caa0: pid 13 "idle: cpu5"
curpcb       = 0xe53c3d90
fpcurthread  = none
idlethread   = 0xc677caa0: pid 13 "idle: cpu5"
APIC ID      = 5
currentldt   = 0x50
spin locks held:

cpuid        = 6
curthread    = 0xc677c880: pid 12 "idle: cpu6"
curpcb       = 0xe53c0d90
fpcurthread  = none
idlethread   = 0xc677c880: pid 12 "idle: cpu6"
APIC ID      = 6
currentldt   = 0x50
spin locks held:

cpuid        = 7
curthread    = 0xc677c660: pid 11 "idle: cpu7"
curpcb       = 0xe53bdd90
fpcurthread  = none
idlethread   = 0xc677c660: pid 11 "idle: cpu7"
APIC ID      = 7
currentldt   = 0x50
spin locks held:

db> show alllocks
Process 2804 (ls) thread 0xc6f26aa0 (100172)
exclusive sleep mutex vnode interlock r = 0 (0xc74057a0) locked @ kern/vfs_subr.c:2159
Process 2797 (fclone) thread 0xc6e54660 (100104)
exclusive sleep mutex devfs interlock r = 0 (0xc0bafb14) locked @ fs/devfs/devfs_vnops.c:256
exclusive sx devfsmount r = 0 (0xc6b5ca14) locked @ fs/devfs/devfs_vnops.c:740
Process 757 (sshd) thread 0xc6e54000 (100107)
exclusive sx so_rcv_sx r = 0 (0xc6e2ee78) locked @ kern/uipc_sockbuf.c:145
db> show lockedvnods
Locked vnodes

0xc6b5f2b8: tag devfs, type VDIR
    usecount 5, writecount 0, refcount 21 mountedhere 0
    flags (VV_ROOT)
     lock type devfs: EXCL (count 1) by thread 0xc6e54660 (pid 2797) with 16 pending#0 0xc073db10 at _lockmgr+0x560
#1 0xc07bcc40 at vop_stdlock+0x40
#2 0xc0a1b4a5 at VOP_LOCK1_APV+0xa5
#3 0xc07d6d38 at _vn_lock+0xf8
#4 0xc07cb950 at vget+0x110
#5 0xc06e4bc5 at devfs_allocv+0x125
#6 0xc06e34a1 at devfs_root+0x51
#7 0xc07c04f7 at lookup+0x8f7
#8 0xc07c0cce at namei+0x34e
#9 0xc07d67f9 at vn_open_cred+0x2c9
#10 0xc07d6a93 at vn_open+0x33
#11 0xc07d56b7 at kern_open+0xe7
#12 0xc07d5bc0 at open+0x30
#13 0xc0a045f3 at syscall+0x2b3
#14 0xc09ea8c0 at Xint0x80_syscall+0x20


0xc74056cc: tag devfs, type VCHR
    usecount 1, writecount 1, refcount 1 mountedhere 0xc73d4000
    flags ()
 VI_LOCKed     lock type devfs: EXCL (count 1) by thread 0xc6f26aa0 (pid 2804)#0 0xc073db10 at _lockmgr+0x560
#1 0xc07bcc40 at vop_stdlock+0x40
#2 0xc0a1b4a5 at VOP_LOCK1_APV+0xa5
#3 0xc07d6d38 at _vn_lock+0xf8
#4 0xc07cb950 at vget+0x110
#5 0xc06e4bc5 at devfs_allocv+0x125
#6 0xc06e5973 at devfs_lookup+0x793
#7 0xc0a1c645 at VOP_LOOKUP_APV+0xe5
#8 0xc07c019e at lookup+0x59e
#9 0xc07c0cce at namei+0x34e
#10 0xc07cde2f at kern_lstat+0x4f
#11 0xc07cdf1f at lstat+0x2f
#12 0xc0a045f3 at syscall+0x2b3
#13 0xc09ea8c0 at Xint0x80_syscall+0x20

KDB: stack backtrace:
db_trace_self_wrapper(c0a9f59e,e94e45c8,c07c7a63,e94e4740,e94e45ec,...) at db_trace_self_wrapper+0x26
kdb_backtrace(e94e4740,e94e45ec,c077932e,c0a9c5d8,c0b45ac0,...) at kdb_backtrace+0x29
vfs_badlock(e94e45ec,c0a184dd,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x23
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c74056cc,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e4608,1,1,c73d4000,...) at VOP_PRINT_APV+0x7d
vn_printf(c74056cc,c0a670fc,c0a8e6d5,c0b800c0,c74056cc,...) at vn_printf+0x4af
lockedvnodes(c07761d2,0,ffffffff,e94e4770,c048f200,...) at lockedvnodes+0x71
db_command_loop(c07761d2,0,c0c88494,7,0,...) at db_command_loop+0x2f5
db_trap(3,0,fd,3,c6f26aa0,...) at db_trap+0xc5
kdb_trap(3,0,e94e4918,fffffff2,c714caa0,...) at kdb_trap+0x96
trap(e94e4918) at trap+0x56b
calltrap() at calltrap+0x6
--- trap 0x3, eip = 0xc07761d2, esp = 0xe94e4958, ebp = 0xe94e4960 ---
kdb_enter(c0aa7f1a,c0acd6a5,c74056cc,c0aa7f34,c0b45ac0,...) at kdb_enter+0x32
vfs_badlock(e94e49a8,c0a184dd,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x59
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c6f26aa0,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e49c4,1,1,c73d4000,...) at VOP_PRINT_APV+0x7d
vn_printf(c74056cc,c0aa6dc9,c0aa7d3c,86f,60,...) at vn_printf+0x4af
vput(c74056cc,ffffffdf,c70ba000,0,c6f26aa0,...) at vput+0xc5
kern_lstat(c6f26aa0,2821b918,0,e94e4c18,e94e4c24,...) at kern_lstat+0xb5
lstat(c6f26aa0,e94e4cfc,8,c0aa213c,c0b49db0,...) at lstat+0x2f
syscall(e94e4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (190, FreeBSD ELF32, lstat), eip = 0x2819a3bf, esp = 0xbfbfe4ec, ebp = 0xbfbfe578 ---
VOP_PRINT: 0xc74056cc interlock is locked but should not be
        dev fmaster
KDB: stack backtrace:
db_trace_self_wrapper(c0a9f59e,e94e45c8,c07c7a63,0,c0acd6a5,...) at db_trace_self_wrapper+0x26
kdb_backtrace(0,c0acd6a5,c74056cc,c0b45ac0,0,...) at kdb_backtrace+0x29
vfs_badlock(e94e45ec,c0a1854c,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x23
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c74056cc,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e4608,1,1,c73d4000,...) at VOP_PRINT_APV+0xec
vn_printf(c74056cc,c0a670fc,c0a8e6d5,c0b800c0,c74056cc,...) at vn_printf+0x4af
lockedvnodes(c07761d2,0,ffffffff,e94e4770,c048f200,...) at lockedvnodes+0x71
db_command_loop(c07761d2,0,c0c88494,7,0,...) at db_command_loop+0x2f5
db_trap(3,0,fd,3,c6f26aa0,...) at db_trap+0xc5
kdb_trap(3,0,e94e4918,fffffff2,c714caa0,...) at kdb_trap+0x96
trap(e94e4918) at trap+0x56b
calltrap() at calltrap+0x6
--- trap 0x3, eip = 0xc07761d2, esp = 0xe94e4958, ebp = 0xe94e4960 ---
kdb_enter(c0aa7f1a,c0acd6a5,c74056cc,c0aa7f34,c0b45ac0,...) at kdb_enter+0x32
vfs_badlock(e94e49a8,c0a184dd,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x59
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c6f26aa0,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e49c4,1,1,c73d4000,...) at VOP_PRINT_APV+0x7d
vn_printf(c74056cc,c0aa6dc9,c0aa7d3c,86f,60,...) at vn_printf+0x4af
vput(c74056cc,ffffffdf,c70ba000,0,c6f26aa0,...) at vput+0xc5
kern_lstat(c6f26aa0,2821b918,0,e94e4c18,e94e4c24,...) at kern_lstat+0xb5
lstat(c6f26aa0,e94e4cfc,8,c0aa213c,c0b49db0,...) at lstat+0x2f
syscall(e94e4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (190, FreeBSD ELF32, lstat), eip = 0x2819a3bf, esp = 0xbfbfe4ec, ebp = 0xbfbfe578 ---
VOP_PRINT: 0xc74056cc interlock is locked but should not be

0xc742a414: tag devfs, type VCHR
    usecount 1, writecount 0, refcount 1 mountedhere 0xc7424900
    flags ()
     lock type devfs: EXCL (count 1) by thread 0xc6cbf880 (pid 2783)#0 0xc073db10 at _lockmgr+0x560
#1 0xc07bcc40 at vop_stdlock+0x40
#2 0xc0a1b4a5 at VOP_LOCK1_APV+0xa5
#3 0xc07d6d38 at _vn_lock+0xf8
#4 0xc06e5df4 at devfs_close+0x424
#5 0xc0a194d5 at VOP_CLOSE_APV+0xc5
#6 0xc07d75e6 at vn_close+0xe6
#7 0xc07d7704 at vn_closefile+0xf4
#8 0xc06e3819 at devfs_close_f+0x19
#9 0xc072312e at fdrop+0x11e
#10 0xc0724674 at closef+0x254
#11 0xc0724a1d at kern_close+0x11d
#12 0xc0724aba at close+0x1a
#13 0xc0a045f3 at syscall+0x2b3
#14 0xc09ea8c0 at Xint0x80_syscall+0x20

        dev clones/_fdclone
db> show lockedvnods^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^Hps
  pid  ppid  pgrp   uid   state   wmesg     wchan    cmd
 2804  2803   809     0  R       CPU 1               ls
 2803   809   809     0  S       wait     0xc74867f8 sh
 2801  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2800  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2799  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2798  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2797  2780  2780  1001  L+     *vnode in 0xc68de5f0 fclone
 2796  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2795  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2794  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2793  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2792  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2791  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2790  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2788  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2787  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2786  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2785  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2783  2780  2780  1001  S+      devfsmou 0xc6b5ca14 fclone
 2782  2780  2780  1001  S+      devfs    0xc6b5f310 fclone
 2780   783  2780  1001  S+      wait     0xc714c000 sh
 2442   753   753     0  S+      nanslp   0xc0bb2264 sleep
  809     1   809     0  Ss      wait     0xc714c7f8 watchdogd
  783   762   783  1001  S+      wait     0xc6d93aa0 sh
  762   761   762  1001  Ss+     pause    0xc6b00b00 tcsh
  761   757   757  1001  S       select   0xc0c0381c sshd
  757   612   757     0  Ss      sbwait   0xc6e2eea8 sshd
  753   749   753     0  S+      wait     0xc6b002a8 sh
  749   674   749     0  S+      pause    0xc6d8fb00 csh
  674     1   674     0  Ss+     wait     0xc6e56550 login
  673     1   673     0  Ss+     ttyin    0xc68fbc10 getty
  672     1   672     0  Ss+     ttyin    0xc690e010 getty
  671     1   671     0  Ss+     ttyin    0xc690e410 getty
  670     1   670     0  Ss+     ttyin    0xc690e810 getty
  669     1   669     0  Ss+     ttyin    0xc690ec10 getty
  668     1   668     0  Ss+     ttyin    0xc690f010 getty
  667     1   667     0  Ss+     ttyin    0xc690f410 getty
  666     1   666     0  Ss+     ttyin    0xc690f810 getty
  628     1   628     0  Ss      nanslp   0xc0bb2264 cron
  622     1   622    25  Ss      pause    0xc6e56060 sendmail
  618     1   618     0  Ss      select   0xc0c0381c sendmail
  612     1   612     0  Ss      select   0xc0c0381c sshd
  558   553   553     0  S       nfslockd 0xc0c09e08 rpc.lockd
  553     1   553     0  Ss      select   0xc0c0381c rpc.lockd
  548     1   548     0  Ss      select   0xc0c0381c rpc.statd
  518     0     0     0  SL      mdwait   0xc6de8000 [md1]
  498     1   498     0  Ss      select   0xc0c0381c rpcbind
  476     1   476     0  Ss      select   0xc0c0381c syslogd
  430     1   430     0  Ss      select   0xc0c0381c devd
  114     0     0     0  SL      mdwait   0xc6da6800 [md0]
   47     0     0     0  SL      sdflush  0xc0c0f5a4 [softdepflush]
   46     0     0     0  SL      syncer   0xc0bb208c [syncer]
   45     0     0     0  SL      vlruwt   0xc68acaa0 [vnlru]
   44     0     0     0  SL      psleep   0xc0c03cc4 [bufdaemon]
   43     0     0     0  SL      pgzero   0xc0c10058 [pagezero]
   42     0     0     0  SL      psleep   0xc0c0fd74 [vmdaemon]
   41     0     0     0  SL      psleep   0xc0c0fd3c [pagedaemon]
   40     0     0     0  SL      waiting_ 0xc0c05a2c [sctp_iterator]
   39     0     0     0  WL                          [swi0: sio]
   38     0     0     0  WL                          [irq1: atkbd0]
   37     0     0     0  WL                          [irq15: ata1]
   36     0     0     0  WL                          [irq14: ata0]
   35     0     0     0  SL      usbevt   0xc687a210 [usb3]
   34     0     0     0  SL      usbevt   0xc68cc210 [usb2]
   33     0     0     0  WL                          [irq18: uhci2]
   32     0     0     0  SL      usbevt   0xc68bc210 [usb1]
   31     0     0     0  WL                          [irq19: uhci1+]
   30     0     0     0  SL      usbtsk   0xc0baf994 [usbtask-dr]
   29     0     0     0  SL      usbtsk   0xc0baf980 [usbtask-hc]
   28     0     0     0  SL      usbevt   0xc689b210 [usb0]
   27     0     0     0  WL                          [irq17: uhci0 ehci0]
    9     0     0     0  SL      -        0xc6884980 [em1 taskq]
    8     0     0     0  SL      -        0xc6884500 [em0 taskq]
   26     0     0     0  WL                          [swi6: Giant taskq]
    7     0     0     0  SL      -        0xc6884100 [thread taskq]
   25     0     0     0  WL                          [swi5: +]
   24     0     0     0  WL                          [swi2: cambio]
    6     0     0     0  SL      ccb_scan 0xc0b80b94 [xpt_thrd]
    5     0     0     0  SL      -        0xc67ca800 [kqueue taskq]
   23     0     0     0  WL                          [swi6: task queue]
   22     0     0     0  SL      -        0xc0bb2094 [yarrow]
    4     0     0     0  SL      -        0xc0bb010c [g_down]
    3     0     0     0  SL      -        0xc0bb0108 [g_up]
    2     0     0     0  RL      CPU 2               [g_event]
   21     0     0     0  WL                          [swi1: net]
   20     0     0     0  WL                          [swi3: vm]
   19     0     0     0  WL                          [swi4: clock sio]
   18     0     0     0  RL      CPU 0               [idle: cpu0]
   17     0     0     0  RL                          [idle: cpu1]
   16     0     0     0  RL                          [idle: cpu2]
   15     0     0     0  RL      CPU 3               [idle: cpu3]
   14     0     0     0  RL      CPU 4               [idle: cpu4]
   13     0     0     0  RL      CPU 5               [idle: cpu5]
   12     0     0     0  RL      CPU 6               [idle: cpu6]
   11     0     0     0  RL      CPU 7               [idle: cpu7]
    1     0     1     0  SLs     wait     0xc677bd48 [init]
   10     0     0     0  SL      audit_wo 0xc0c0f014 [audit]
    0     0     0     0  WLs                         [swapper]
db> allt

Tracing command ls pid 2804 tid 100172 td 0xc6f26aa0
kdb_enter(c0aa7f1a,c0acd6a5,c74056cc,c0aa7f34,c0b45ac0,...) at kdb_enter+0x32
vfs_badlock(e94e49a8,c0a184dd,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x59
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c6f26aa0,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e49c4,1,1,c73d4000,...) at VOP_PRINT_APV+0x7d
vn_printf(c74056cc,c0aa6dc9,c0aa7d3c,86f,60,...) at vn_printf+0x4af
vput(c74056cc,ffffffdf,c70ba000,0,c6f26aa0,...) at vput+0xc5
kern_lstat(c6f26aa0,2821b918,0,e94e4c18,e94e4c24,...) at kern_lstat+0xb5
lstat(c6f26aa0,e94e4cfc,8,c0aa213c,c0b49db0,...) at lstat+0x2f
syscall(e94e4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (190, FreeBSD ELF32, lstat), eip = 0x2819a3bf, esp = 0xbfbfe4ec, ebp = 0xbfbfe578 ---

Tracing command sh pid 2803 tid 100237 td 0xc7152660
sched_switch(c7152660,0,1,180,3dcac469,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c7152660,0,c0aa0187,19b,c74867f8,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba440,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c74867f8,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c74867f8,c7486888,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c7152660,ffffffff,e9532c2c,2,0,...) at kern_wait+0xa66
wait4(c7152660,e9532cfc,10,e9532d38,c0b48c88,...) at wait4+0x3b
syscall(e9532d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfe9ac, ebp = 0xbfbfe9c8 ---

Tracing command fclone pid 2801 tid 100184 td 0xc7151880
sched_switch(c7151880,0,1,180,5d8c5c90,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c7151880,...) at mi_switch+0x217
sleepq_switch(c7151880,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9520864,e952085c,c0a9a0ce,d7,0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c7151880,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e95208cc,246,c0bbd0d4,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e95208cc,e95208d8,c07852ab,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c7151880,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c7151880,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e952097c,c7151880,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e95209e4,c7151880,19b,...) at devfs_root+0x51
lookup(e9520b80,c0aa744f,c6,bf,c75b542c,...) at lookup+0x8f7
namei(e9520b80,c7151880,e9520a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9520b80,e9520c78,0,c7026800,c6ff7168,...) at vn_open_cred+0x2c9
vn_open(e9520b80,e9520c78,0,c6ff7168,c1474b88,...) at vn_open+0x33
kern_open(c7151880,80485a3,0,3,0,...) at kern_open+0xe7
open(c7151880,e9520cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9520d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2800 tid 100293 td 0xc75e2440
sched_switch(c75e2440,0,1,180,5d8c105b,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c75e2440,...) at mi_switch+0x217
sleepq_switch(c75e2440,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,0,c0a9d0dd,da,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9758864,e975885c,c0a9a0ce,d7,c6e54660,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c75e2440,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e97588cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e97588cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c75e2440,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c75e2440,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e975897c,c75e2440,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e97589e4,c75e2440,19b,...) at devfs_root+0x51
lookup(e9758b80,c0aa744f,c6,bf,c742362c,...) at lookup+0x8f7
namei(e9758b80,c75e2440,e9758a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9758b80,e9758c78,0,c7026800,c6cf99d8,...) at vn_open_cred+0x2c9
vn_open(e9758b80,e9758c78,0,c6cf99d8,c1474b88,...) at vn_open+0x33
kern_open(c75e2440,80485a3,0,3,0,...) at kern_open+0xe7
open(c75e2440,e9758cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9758d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2799 tid 100147 td 0xc6ee1440
sched_switch(c6ee1440,0,1,180,5d8caa2a,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6ee1440,...) at mi_switch+0x217
sleepq_switch(c6ee1440,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e948b864,e948b85c,c0a9a0ce,d7,0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c6ee1440,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e948b8cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e948b8cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c6ee1440,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c6ee1440,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e948b97c,c6ee1440,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e948b9e4,c6ee1440,19b,...) at devfs_root+0x51
lookup(e948bb80,c0aa744f,c6,bf,c7423a2c,...) at lookup+0x8f7
namei(e948bb80,c6ee1440,e948ba78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e948bb80,e948bc78,0,c7026800,c6cda318,...) at vn_open_cred+0x2c9
vn_open(e948bb80,e948bc78,0,c6cda318,c1474b88,...) at vn_open+0x33
kern_open(c6ee1440,80485a3,0,3,0,...) at kern_open+0xe7
open(c6ee1440,e948bcfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e948bd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2798 tid 100263 td 0xc74aa660
sched_switch(c74aa660,0,1,180,5d8b7447,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c74aa660,...) at mi_switch+0x217
sleepq_switch(c74aa660,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9665864,e966585c,c0a9a0ce,d7,3,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c74aa660,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e96658cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e96658cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c74aa660,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c74aa660,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e966597c,c74aa660,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e96659e4,c74aa660,19b,...) at devfs_root+0x51
lookup(e9665b80,c0aa744f,c6,bf,c73d302c,...) at lookup+0x8f7
namei(e9665b80,c74aa660,e9665a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9665b80,e9665c78,0,c7026800,c7483510,...) at vn_open_cred+0x2c9
vn_open(e9665b80,e9665c78,0,c7483510,c1474b88,...) at vn_open+0x33
kern_open(c74aa660,80485a3,0,3,0,...) at kern_open+0xe7
open(c74aa660,e9665cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9665d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2797 tid 100104 td 0xc6e54660
sched_switch(c6e54660,0,1,17b,5f538a1e,...) at sched_switch+0x491
mi_switch(1,0,c0aa08dd,2e2,c68de5f0,...) at mi_switch+0x217
turnstile_wait(c68de5f0,c6f26aa0,0,17a,c74057a0,...) at turnstile_wait+0x4cb
_mtx_lock_sleep(c74057a0,c6e54660,0,c0a93517,103,...) at _mtx_lock_sleep+0x15a
_mtx_lock_flags(c74057a0,0,c0a93517,103,c6b5ca14,...) at _mtx_lock_flags+0xef
devfs_allocv(c6e85580,c6b59000,e93ddb94,c6e54660,c0a9b50e,...) at devfs_allocv+0xcf
devfs_lookup(e93dd9d4,c0aa84b5,c6b5f2b8,2,c6b5f2b8,...) at devfs_lookup+0x793
VOP_LOOKUP_APV(c0b459e0,e93dd9d4,c6e54660,c0aa744f,2a9,...) at VOP_LOOKUP_APV+0xe5
lookup(e93ddb80,c0aa744f,c6,bf,c702462c,...) at lookup+0x59e
namei(e93ddb80,c6e54660,e93dda78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e93ddb80,e93ddc78,0,c7026800,c6cc6630,...) at vn_open_cred+0x2c9
vn_open(e93ddb80,e93ddc78,0,c6cc6630,c1474b88,...) at vn_open+0x33
kern_open(c6e54660,80485a3,0,3,0,...) at kern_open+0xe7
open(c6e54660,e93ddcfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e93ddd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2796 tid 100058 td 0xc68ddaa0
sched_switch(c68ddaa0,0,1,180,5d8c8000,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c68ddaa0,...) at mi_switch+0x217
sleepq_switch(c68ddaa0,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,0,c0a9d0dd,da,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e6ed1864,e6ed185c,c0a9a0ce,d7,0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c68ddaa0,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e6ed18cc,246,c0bbd0d4,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e6ed18cc,e6ed18d8,c07852ab,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c68ddaa0,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c68ddaa0,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e6ed197c,c68ddaa0,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e6ed19e4,c68ddaa0,19b,...) at devfs_root+0x51
lookup(e6ed1b80,c0aa744f,c6,bf,c73c8e2c,...) at lookup+0x8f7
namei(e6ed1b80,c68ddaa0,e6ed1a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e6ed1b80,e6ed1c78,0,c7026800,c6cf91f8,...) at vn_open_cred+0x2c9
vn_open(e6ed1b80,e6ed1c78,0,c6cf91f8,c1474b88,...) at vn_open+0x33
kern_open(c68ddaa0,80485a3,0,3,0,...) at kern_open+0xe7
open(c68ddaa0,e6ed1cfc,c,e6ed1ccc,c0b48c58,...) at open+0x30
syscall(e6ed1d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2795 tid 100191 td 0xc73c4cc0
sched_switch(c73c4cc0,0,1,180,5d8bd0c1,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c73c4cc0,...) at mi_switch+0x217
sleepq_switch(c73c4cc0,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9550864,e955085c,c0a9a0ce,d7,c6cbf880,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c73c4cc0,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e95508cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e95508cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c73c4cc0,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c73c4cc0,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e955097c,c73c4cc0,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e95509e4,c73c4cc0,19b,...) at devfs_root+0x51
lookup(e9550b80,c0aa744f,c6,bf,c741ac2c,...) at lookup+0x8f7
namei(e9550b80,c73c4cc0,e9550a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9550b80,e9550c78,0,c7026800,c6edf900,...) at vn_open_cred+0x2c9
vn_open(e9550b80,e9550c78,0,c6edf900,c1474b88,...) at vn_open+0x33
kern_open(c73c4cc0,80485a3,0,3,0,...) at kern_open+0xe7
open(c73c4cc0,e9550cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9550d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2794 tid 100102 td 0xc6ce2220
sched_switch(c6ce2220,0,1,180,5d8c4981,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6ce2220,...) at mi_switch+0x217
sleepq_switch(c6ce2220,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9361864,e936185c,c0a9a0ce,d7,c6ce2220,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c6ce2220,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e93618cc,246,c0bbd0d4,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e93618cc,e93618d8,c07852ab,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c6ce2220,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c6ce2220,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e936197c,c6ce2220,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e93619e4,c6ce2220,19b,...) at devfs_root+0x51
lookup(e9361b80,c0aa744f,c6,bf,c75e502c,...) at lookup+0x8f7
namei(e9361b80,c6ce2220,e9361a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9361b80,e9361c78,0,c7026800,c7021510,...) at vn_open_cred+0x2c9
vn_open(e9361b80,e9361c78,0,c7021510,c1474b88,...) at vn_open+0x33
kern_open(c6ce2220,80485a3,0,3,0,...) at kern_open+0xe7
open(c6ce2220,e9361cfc,c,e9361ccc,c0b48c58,...) at open+0x30
syscall(e9361d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2793 tid 100136 td 0xc6ee8cc0
sched_switch(c6ee8cc0,0,1,180,5d8b8f9f,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6ee8cc0,...) at mi_switch+0x217
sleepq_switch(c6ee8cc0,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e94ac864,e94ac85c,c0a9a0ce,d7,2,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c6ee8cc0,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e94ac8cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e94ac8cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c6ee8cc0,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c6ee8cc0,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e94ac97c,c6ee8cc0,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e94ac9e4,c6ee8cc0,19b,...) at devfs_root+0x51
lookup(e94acb80,c0aa744f,c6,bf,c75b6d2c,...) at lookup+0x8f7
namei(e94acb80,c6ee8cc0,e94aca78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e94acb80,e94acc78,0,c7026800,c7021cf0,...) at vn_open_cred+0x2c9
vn_open(e94acb80,e94acc78,0,c7021cf0,c1474b88,...) at vn_open+0x33
kern_open(c6ee8cc0,80485a3,0,3,0,...) at kern_open+0xe7
open(c6ee8cc0,e94accfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e94acd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2792 tid 100140 td 0xc6ee8440
sched_switch(c6ee8440,0,1,180,5f53c5dd,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6ee8440,...) at mi_switch+0x217
sleepq_switch(c6ee8440,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e94a0864,e94a085c,c0a9a0ce,d7,1,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c6ee8440,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e94a08cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e94a08cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c6ee8440,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c6ee8440,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e94a097c,c6ee8440,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e94a09e4,c6ee8440,19b,...) at devfs_root+0x51
lookup(e94a0b80,c0aa744f,c6,bf,c73c7d2c,...) at lookup+0x8f7
namei(e94a0b80,c6ee8440,e94a0a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e94a0b80,e94a0c78,0,c7026800,c7483d38,...) at vn_open_cred+0x2c9
vn_open(e94a0b80,e94a0c78,0,c7483d38,c1474b88,...) at vn_open+0x33
kern_open(c6ee8440,80485a3,0,3,0,...) at kern_open+0xe7
open(c6ee8440,e94a0cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e94a0d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2791 tid 100188 td 0xc73c5440
sched_switch(c73c5440,0,1,180,5d8b165a,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c73c5440,...) at mi_switch+0x217
sleepq_switch(c73c5440,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9559864,e955985c,c0a9a0ce,d7,3,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c73c5440,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e95598cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e95598cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c73c5440,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c73c5440,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e955997c,c73c5440,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e95599e4,c73c5440,19b,...) at devfs_root+0x51
lookup(e9559b80,c0aa744f,c6,bf,c75e7c2c,...) at lookup+0x8f7
namei(e9559b80,c73c5440,e9559a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9559b80,e9559c78,0,c7026800,c7483048,...) at vn_open_cred+0x2c9
vn_open(e9559b80,e9559c78,0,c7483048,c1474b88,...) at vn_open+0x33
kern_open(c73c5440,80485a3,0,3,0,...) at kern_open+0xe7
open(c73c5440,e9559cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9559d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2790 tid 100247 td 0xc748acc0
sched_switch(c748acc0,0,1,180,5d8bb4f9,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c748acc0,...) at mi_switch+0x217
sleepq_switch(c748acc0,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e962f864,e962f85c,c0a9a0ce,d7,1,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c748acc0,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e962f8cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e962f8cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c748acc0,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c748acc0,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e962f97c,c748acc0,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e962f9e4,c748acc0,19b,...) at devfs_root+0x51
lookup(e962fb80,c0aa744f,c6,bf,c747902c,...) at lookup+0x8f7
namei(e962fb80,c748acc0,e962fa78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e962fb80,e962fc78,0,c7026800,c6cc6ea0,...) at vn_open_cred+0x2c9
vn_open(e962fb80,e962fc78,0,c6cc6ea0,c1474b88,...) at vn_open+0x33
kern_open(c748acc0,80485a3,0,3,0,...) at kern_open+0xe7
open(c748acc0,e962fcfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e962fd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2788 tid 100255 td 0xc748a000
sched_switch(c748a000,0,1,180,5d8b4cd9,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c748a000,...) at mi_switch+0x217
sleepq_switch(c748a000,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e961d864,e961d85c,c0a9a0ce,d7,c73c5440,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c748a000,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e961d8cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e961d8cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c748a000,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c748a000,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e961d97c,c748a000,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e961d9e4,c748a000,19b,...) at devfs_root+0x51
lookup(e961db80,c0aa744f,c6,bf,c7020e2c,...) at lookup+0x8f7
namei(e961db80,c748a000,e961da78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e961db80,e961dc78,0,c7026800,c6e4c558,...) at vn_open_cred+0x2c9
vn_open(e961db80,e961dc78,0,c6e4c558,c1474b88,...) at vn_open+0x33
kern_open(c748a000,80485a3,0,3,0,...) at kern_open+0xe7
open(c748a000,e961dcfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e961dd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2787 tid 100101 td 0xc6ce2440
sched_switch(c6ce2440,0,1,180,5d8c2a47,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6ce2440,...) at mi_switch+0x217
sleepq_switch(c6ce2440,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9364864,e936485c,c0a9a0ce,d7,0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c6ce2440,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e93648cc,246,c0bbd0d4,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e93648cc,e93648d8,c07852ab,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c6ce2440,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c6ce2440,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e936497c,c6ce2440,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e93649e4,c6ce2440,19b,...) at devfs_root+0x51
lookup(e9364b80,c0aa744f,c6,bf,c752062c,...) at lookup+0x8f7
namei(e9364b80,c6ce2440,e9364a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9364b80,e9364c78,0,c7026800,c6cc7bd0,...) at vn_open_cred+0x2c9
vn_open(e9364b80,e9364c78,0,c6cc7bd0,c1474b88,...) at vn_open+0x33
kern_open(c6ce2440,80485a3,0,3,0,...) at kern_open+0xe7
open(c6ce2440,e9364cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9364d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2786 tid 100240 td 0xc748bcc0
sched_switch(c748bcc0,0,1,180,5d8bede0,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c748bcc0,...) at mi_switch+0x217
sleepq_switch(c748bcc0,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9644864,e964485c,c0a9a0ce,d7,0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c748bcc0,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e96448cc,246,c0bbd0d4,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e96448cc,e96448d8,c07852ab,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c748bcc0,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c748bcc0,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e964497c,c748bcc0,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e96449e4,c748bcc0,19b,...) at devfs_root+0x51
lookup(e9644b80,c0aa744f,c6,bf,c75e5b2c,...) at lookup+0x8f7
namei(e9644b80,c748bcc0,e9644a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9644b80,e9644c78,0,c7026800,c6ff7360,...) at vn_open_cred+0x2c9
vn_open(e9644b80,e9644c78,0,c6ff7360,c1474b88,...) at vn_open+0x33
kern_open(c748bcc0,80485a3,0,3,0,...) at kern_open+0xe7
open(c748bcc0,e9644cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9644d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2785 tid 100131 td 0xc6e65000
sched_switch(c6e65000,0,1,180,5d8c954d,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6e65000,...) at mi_switch+0x217
sleepq_switch(c6e65000,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e9428864,e942885c,c0a9a0ce,d7,c6f26aa0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c6e65000,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e94288cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e94288cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c6e65000,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c6e65000,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e942897c,c6e65000,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e94289e4,c6e65000,19b,...) at devfs_root+0x51
lookup(e9428b80,c0aa744f,c6,bf,c73c7b2c,...) at lookup+0x8f7
namei(e9428b80,c6e65000,e9428a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e9428b80,e9428c78,0,c7026800,c6fda288,...) at vn_open_cred+0x2c9
vn_open(e9428b80,e9428c78,0,c6fda288,c1474b88,...) at vn_open+0x33
kern_open(c6e65000,80485a3,0,3,0,...) at kern_open+0xe7
open(c6e65000,e9428cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e9428d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2783 tid 100069 td 0xc6cbf880
sched_switch(c6cbf880,0,1,180,5d8c9706,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6cbf880,...) at mi_switch+0x217
sleepq_switch(c6cbf880,0,c0aa0187,21d,c6b5ca14,...) at sleepq_switch+0xf0
sleepq_wait(c6b5ca14,0,c0a934fd,3,0,...) at sleepq_wait+0x60
_sx_xlock_hard(c6b5ca14,c6cbf880,0,c0a93517,19d,...) at _sx_xlock_hard+0x286
_sx_xlock(c6b5ca14,0,c0a93517,19d,189,...) at _sx_xlock+0xb8
devfs_close(e9305b40,c0acda26,3,3,c742a414,...) at devfs_close+0x48e
VOP_CLOSE_APV(c0b45ac0,e9305b40,c6cbf880,c0aa8c31,120,...) at VOP_CLOSE_APV+0xc5
vn_close(c742a414,3,c7026800,c6cbf880,c0a9879b,...) at vn_close+0xe6
vn_closefile(c7021360,c6cbf880,e9305bec,c072312e,c7021360,...) at vn_closefile+0xf4
devfs_close_f(c7021360,c6cbf880,c0a98792,87b,6da,...) at devfs_close_f+0x19
fdrop(c7021360,c6cbf880,c0786128,c0c03528,0,c6cbf918,c0b5044c,c0a9879b,c747702c,41c,c0a98792,e9305c44,c0755030,c747702c,8,c0a98792,41c) at fdrop+0x11e
closef(c7021360,c6cbf880,41c,401,c7021360,...) at closef+0x254
kern_close(c6cbf880,3,e9305d2c,c0a045f3,c6cbf880,...) at kern_close+0x11d
close(c6cbf880,e9305cfc,4,c0a56423,c0b48c70,...) at close+0x1a
syscall(e9305d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (6, FreeBSD ELF32, close), eip = 0x28155043, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command fclone pid 2782 tid 100220 td 0xc743c880
sched_switch(c743c880,0,1,180,6b85fea8,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c743c880,...) at mi_switch+0x217
sleepq_switch(c743c880,0,c0aa0187,21d,50,...) at sleepq_switch+0xf0
sleepq_wait(c6b5f310,c0bb1350,c0a93369,0,0,...) at sleepq_wait+0x60
_sleep(c6b5f310,c0bb1350,50,c0a93369,0,...) at _sleep+0x369
acquire(e95c8864,e95c885c,c0a9a0ce,d7,0,...) at acquire+0x73
_lockmgr(c6b5f310,2002,c6b5f38c,c743c880,c0aa7d3c,...) at _lockmgr+0x4bc
vop_stdlock(e95c88cc,c0741bbd,c0bbbbdc,2002,c6b5f2b8,...) at vop_stdlock+0x40
VOP_LOCK1_APV(c0b459e0,e95c88cc,c0bbbbdc,0,c6b5f38c,...) at VOP_LOCK1_APV+0xa5
_vn_lock(c6b5f2b8,2002,c743c880,c0aa7d3c,7f3,...) at _vn_lock+0xf8
vget(c6b5f2b8,2002,c743c880,104,c6b5ca14,...) at vget+0x110
devfs_allocv(c6b5e480,c6b59000,e95c897c,c743c880,810,...) at devfs_allocv+0x125
devfs_root(c6b59000,2,e95c89e4,c743c880,19b,...) at devfs_root+0x51
lookup(e95c8b80,c0aa744f,c6,bf,c702552c,...) at lookup+0x8f7
namei(e95c8b80,c743c880,e95c8a78,246,c0bbd0d4,...) at namei+0x34e
vn_open_cred(e95c8b80,e95c8c78,0,c7026800,c6fdabd0,...) at vn_open_cred+0x2c9
vn_open(e95c8b80,e95c8c78,0,c6fdabd0,c1474b88,...) at vn_open+0x33
kern_open(c743c880,80485a3,0,3,0,...) at kern_open+0xe7
open(c743c880,e95c8cfc,c,c0ab7222,c0b48c58,...) at open+0x30
syscall(e95c8d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2814643f, esp = 0xbfbfebec, ebp = 0xbfbfec68 ---

Tracing command sh pid 2780 tid 100168 td 0xc6f27440
sched_switch(c6f27440,0,1,180,58ec3d3c,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f27440,0,c0aa0187,19b,c714c000,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba2c0,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c714c000,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c714c000,c714c090,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c6f27440,ffffffff,e94f0c2c,2,0,...) at kern_wait+0xa66
wait4(c6f27440,e94f0cfc,10,c0aa20b1,c0b48c88,...) at wait4+0x3b
syscall(e94f0d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfe99c, ebp = 0xbfbfe9b8 ---

Tracing command sleep pid 2442 tid 100138 td 0xc6ee8880
sched_switch(c6ee8880,0,1,180,ba6a53a4,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee8880,0,c0aa0187,19b,c0bb2264,...) at sleepq_switch+0xf0
sleepq_catch_signals(e94a6bc4,c0741bbd,c0bba440,1,5c,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0bb2264,0,c0a9d0dd,da,0,...) at sleepq_timedwait_sig+0x17
_sleep(c0bb2264,0,15c,c0a9d8a1,927c1,...) at _sleep+0x331
kern_nanosleep(c6ee8880,e94a6c64,e94a6c6c,258,0,...) at kern_nanosleep+0xc1
nanosleep(c6ee8880,e94a6cfc,8,e94a6d38,c0b4a260,...) at nanosleep+0x6f
syscall(e94a6d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813826f, esp = 0xbfbfeccc, ebp = 0xbfbfed08 ---

Tracing command watchdogd pid 809 tid 100171 td 0xc6f26cc0
sched_switch(c6f26cc0,0,1,180,3b90172f,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f26cc0,0,c0aa0187,19b,c714c7f8,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba140,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c714c7f8,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c714c7f8,c714c888,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c6f26cc0,af3,e94e7c2c,0,0,...) at kern_wait+0xa66
wait4(c6f26cc0,e94e7cfc,10,e94e7d38,c0b48c88,...) at wait4+0x3b
syscall(e94e7d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280fa81b, esp = 0xbfbfeafc, ebp = 0xbfbfeb98 ---

Tracing command sh pid 783 tid 100100 td 0xc6ce2660
sched_switch(c6ce2660,0,1,180,d4efbd54,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce2660,0,c0aa0187,19b,c6d93aa0,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba0c0,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6d93aa0,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6d93aa0,c6d93b30,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c6ce2660,ffffffff,e9367c2c,2,0,...) at kern_wait+0xa66
wait4(c6ce2660,e9367cfc,10,c0aa2275,c0b48c88,...) at wait4+0x3b
syscall(e9367d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 ---

Tracing command tcsh pid 762 tid 100052 td 0xc6b01880
sched_switch(c6b01880,0,1,180,25ab4e3f,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6b01880,0,c0aa0187,19b,c6b00b00,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba0c0,1,c0a9b50e,68,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6b00b00,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6b00b00,c6b00b30,168,c0a5fb3b,0,...) at _sleep+0x359
kern_sigsuspend(c6b01880,0,0,0,0,...) at kern_sigsuspend+0xe4
sigsuspend(c6b01880,e7104cfc,4,c0aa2170,c0b4abd8,...) at sigsuspend+0x4d
syscall(e7104d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28163e27, esp = 0xbfbfe7fc, ebp = 0xbfbfe868 ---

Tracing command sshd pid 761 tid 100065 td 0xc6cc2220
sched_switch(c6cc2220,0,1,180,d4e2acea,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2220,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f5a,c0c03804,0,c0a9b50e,c6cc2220,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0381c,c0c03804,c0ab9a9d,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0381c,c0c03804,c0aa1cff,30f,c0ab312e,...) at _cv_wait_sig+0x1fc
kern_select(c6cc2220,9,285030d4,285030d8,0,0,0,280dfd08) at kern_select+0x6cc
select(c6cc2220,e9311cfc,14,c0a8d581,c0b49498,...) at select+0x5e
syscall(e9311d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x283e6003, esp = 0xbfbfe5fc, ebp = 0xbfbfe648 ---

Tracing command sshd pid 757 tid 100107 td 0xc6e54000
sched_switch(c6e54000,0,1,180,a6a6bf6f,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e54000,0,c0aa0187,19b,c6e2eea8,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba1c0,1,c0a9b50e,58,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6e2eea8,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6e2eea8,c6e2ee60,158,c0aa4f08,0) at _sleep+0x359
sbwait(c6e2ee3c,1,c0aa501d,5ae,c6e2ee60,...) at sbwait+0x76
soreceive_generic(c6e2edec,0,e93d4c60,0,0,...) at soreceive_generic+0x42f
soreceive(c6e2edec,0,e93d4c60,0,0,...) at soreceive+0x4d
soo_read(c6cda168,e93d4c60,c70ba900,0,c6e54000,...) at soo_read+0x3b
dofileread(e93d4c60,ffffffff,ffffffff,0,c6cda168,...) at dofileread+0x96
kern_readv(c6e54000,5,e93d4c60,bfbfe64c,4,...) at kern_readv+0x58
read(c6e54000,e93d4cfc,c,c0ab7222,c0b48c28,...) at read+0x4f
syscall(e93d4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x283e6083, esp = 0xbfbfe5fc, ebp = 0xbfbfe628 ---

Tracing command sh pid 753 tid 100049 td 0xc68a9660
sched_switch(c68a9660,0,1,180,b993101d,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c68a9660,0,c0aa0187,19b,c6b002a8,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba0c0,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6b002a8,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6b002a8,c6b00338,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c68a9660,ffffffff,e6e6ec2c,2,0,...) at kern_wait+0xa66
wait4(c68a9660,e6e6ecfc,10,c0aa2275,c0b48c88,...) at wait4+0x3b
syscall(e6e6ed38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfe9ec, ebp = 0xbfbfea08 ---

Tracing command csh pid 749 tid 100088 td 0xc6d91220
sched_switch(c6d91220,0,1,180,ea20c9c0,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d91220,0,c0aa0187,19b,c6d8fb00,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba0c0,1,c0a9b50e,68,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6d8fb00,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6d8fb00,c6d8fb30,168,c0a5fb3b,0,...) at _sleep+0x359
kern_sigsuspend(c6d91220,0,0,0,0,...) at kern_sigsuspend+0xe4
sigsuspend(c6d91220,e939ccfc,4,c0aa2170,c0b4abd8,...) at sigsuspend+0x4d
syscall(e939cd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28163e27, esp = 0xbfbfe87c, ebp = 0xbfbfe8e8 ---

Tracing command login pid 674 tid 100116 td 0xc6d91aa0
sched_switch(c6d91aa0,0,1,180,5f8c9526,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d91aa0,0,c0aa0187,19b,c6e56550,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba1c0,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6e56550,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6e56550,c6e565e0,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c6d91aa0,2ed,e93a8c2c,0,0,...) at kern_wait+0xa66
wait4(c6d91aa0,e93a8cfc,10,e93a8d38,c0b48c88,...) at wait4+0x3b
syscall(e93a8d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2810381b, esp = 0xbfbfed9c, ebp = 0xbfbfedb8 ---

Tracing command getty pid 673 tid 100117 td 0xc6d91880
sched_switch(c6d91880,0,1,180,84800d0,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d91880,0,c0aa0187,19b,c68fbc10,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba140,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c68fbc10,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c68fbc10,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c68fbc00,c68fbc10,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c68fbc00,e93a5c60,0,e93a5b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c000,e93a5c60,0,e93a5bb8,c071d9b8,...) at ttyread+0x39
scread(c690c000,e93a5c60,0,168,0,...) at scread+0x2d
giant_read(c690c000,e93a5c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6dfd9d8,e93a5c60,c6786400,0,c6d91880,...) at devfs_read_f+0x71
dofileread(e93a5c60,ffffffff,ffffffff,0,c6dfd9d8,...) at dofileread+0x96
kern_readv(c6d91880,0,e93a5c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6d91880,e93a5cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e93a5d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 672 tid 100118 td 0xc6d91660
sched_switch(c6d91660,0,1,180,855c32e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d91660,0,c0aa0187,19b,c690e010,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba240,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690e010,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690e010,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690e000,c690e010,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690e000,e93a2c60,0,e93a2b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c100,e93a2c60,0,e93a2bb8,c071d9b8,...) at ttyread+0x39
scread(c690c100,e93a2c60,0,168,0,...) at scread+0x2d
giant_read(c690c100,e93a2c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6cf95e8,e93a2c60,c6786400,0,c6d91660,...) at devfs_read_f+0x71
dofileread(e93a2c60,ffffffff,ffffffff,0,c6cf95e8,...) at dofileread+0x96
kern_readv(c6d91660,0,e93a2c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6d91660,e93a2cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e93a2d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 671 tid 100119 td 0xc6e59cc0
sched_switch(c6e59cc0,0,1,180,80e7978,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e59cc0,0,c0aa0187,19b,c690e410,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba440,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690e410,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690e410,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690e400,c690e410,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690e400,e9410c60,0,e9410b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c200,e9410c60,0,e9410bb8,c071d9b8,...) at ttyread+0x39
scread(c690c200,e9410c60,0,168,0,...) at scread+0x2d
giant_read(c690c200,e9410c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c7021a20,e9410c60,c6786400,0,c6e59cc0,...) at devfs_read_f+0x71
dofileread(e9410c60,ffffffff,ffffffff,0,c7021a20,...) at dofileread+0x96
kern_readv(c6e59cc0,0,e9410c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6e59cc0,e9410cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e9410d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 670 tid 100120 td 0xc6e66880
sched_switch(c6e66880,0,1,180,82ad199,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e66880,0,c0aa0187,19b,c690e810,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba1c0,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690e810,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690e810,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690e800,c690e810,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690e800,e9449c60,0,e9449b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c300,e9449c60,0,e9449bb8,c071d9b8,...) at ttyread+0x39
scread(c690c300,e9449c60,0,168,0,...) at scread+0x2d
giant_read(c690c300,e9449c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6cc6c60,e9449c60,c6786400,0,c6e66880,...) at devfs_read_f+0x71
dofileread(e9449c60,ffffffff,ffffffff,0,c6cc6c60,...) at dofileread+0x96
kern_readv(c6e66880,0,e9449c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6e66880,e9449cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e9449d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 669 tid 100121 td 0xc6e66660
sched_switch(c6e66660,0,1,180,8354616,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e66660,0,c0aa0187,19b,c690ec10,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba2c0,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690ec10,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690ec10,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690ec00,c690ec10,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690ec00,e9446c60,0,e9446b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c400,e9446c60,0,e9446bb8,c071d9b8,...) at ttyread+0x39
scread(c690c400,e9446c60,0,168,0,...) at scread+0x2d
giant_read(c690c400,e9446c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6edf240,e9446c60,c6786400,0,c6e66660,...) at devfs_read_f+0x71
dofileread(e9446c60,ffffffff,ffffffff,0,c6edf240,...) at dofileread+0x96
kern_readv(c6e66660,0,e9446c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6e66660,e9446cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e9446d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 668 tid 100122 td 0xc6e66440
sched_switch(c6e66440,0,1,180,7dd8246,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e66440,0,c0aa0187,19b,c690f010,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba3c0,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690f010,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690f010,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690f000,c690f010,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690f000,e9443c60,0,e9443b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c500,e9443c60,0,e9443bb8,c071d9b8,...) at ttyread+0x39
scread(c690c500,e9443c60,0,168,0,...) at scread+0x2d
giant_read(c690c500,e9443c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6ff7750,e9443c60,c6786400,0,c6e66440,...) at devfs_read_f+0x71
dofileread(e9443c60,ffffffff,ffffffff,0,c6ff7750,...) at dofileread+0x96
kern_readv(c6e66440,0,e9443c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6e66440,e9443cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e9443d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 667 tid 100123 td 0xc6e66220
sched_switch(c6e66220,0,1,180,5a0ea1e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e66220,0,c0aa0187,19b,c690f410,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba1c0,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690f410,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690f410,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690f400,c690f410,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690f400,e9440c60,0,e9440b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c600,e9440c60,0,e9440bb8,c071d9b8,...) at ttyread+0x39
scread(c690c600,e9440c60,0,168,0,...) at scread+0x2d
giant_read(c690c600,e9440c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6cda438,e9440c60,c6786400,0,c6e66220,...) at devfs_read_f+0x71
dofileread(e9440c60,ffffffff,ffffffff,0,c6cda438,...) at dofileread+0x96
kern_readv(c6e66220,0,e9440c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6e66220,e9440cfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e9440d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 666 tid 100124 td 0xc6e66000
sched_switch(c6e66000,0,1,180,7d37970,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e66000,0,c0aa0187,19b,c690f810,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba340,1,c0a9b50e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690f810,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690f810,0,159,c0aa3af4,0,...) at _sleep+0x359
ttysleep(c690f800,c690f810,159,c0aa3af4,0,...) at ttysleep+0x39
ttread(c690f800,e943dc60,0,e943db9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c700,e943dc60,0,e943dbb8,c071d9b8,...) at ttyread+0x39
scread(c690c700,e943dc60,0,168,0,...) at scread+0x2d
giant_read(c690c700,e943dc60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6fda3f0,e943dc60,c6786400,0,c6e66000,...) at devfs_read_f+0x71
dofileread(e943dc60,ffffffff,ffffffff,0,c6fda3f0,...) at dofileread+0x96
kern_readv(c6e66000,0,e943dc60,bfbfee4b,1,...) at kern_readv+0x58
read(c6e66000,e943dcfc,c,c0ace459,c0b48c28,...) at read+0x4f
syscall(e943dd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command cron pid 628 tid 100073 td 0xc6ce1cc0
sched_switch(c6ce1cc0,0,1,180,3c9cb237,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce1cc0,0,c0aa0187,19b,c0bb2264,...) at sleepq_switch+0xf0
sleepq_catch_signals(e935bbc4,c0741bbd,c0bba240,1,5c,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0bb2264,0,c0a9d0dd,da,0,...) at sleepq_timedwait_sig+0x17
_sleep(c0bb2264,0,15c,c0a9d8a1,ea61,...) at _sleep+0x331
kern_nanosleep(c6ce1cc0,e935bc64,e935bc6c,3c,0,...) at kern_nanosleep+0xc1
nanosleep(c6ce1cc0,e935bcfc,8,c0aa23da,c0b4a260,...) at nanosleep+0x6f
syscall(e935bd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815326f, esp = 0xbfbfed0c, ebp = 0xbfbfed38 ---

Tracing command sendmail pid 622 tid 100114 td 0xc6e50000
sched_switch(c6e50000,0,1,180,8ee3ad6e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6e50000,0,c0aa0187,19b,c6e56060,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba0c0,1,c0a9b50e,68,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6e56060,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6e56060,c6e56090,168,c0a5fb3b,0,...) at _sleep+0x359
kern_sigsuspend(c6e50000,0,0,0,0,...) at kern_sigsuspend+0xe4
sigsuspend(c6e50000,e93bfcfc,4,c0aa2170,c0b4abd8,...) at sigsuspend+0x4d
syscall(e93bfd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28309e27, esp = 0xbfbfdb1c, ebp = 0xbfbfdb48 ---

Tracing command sendmail pid 618 tid 100085 td 0xc6cdc220
sched_switch(c6cdc220,0,1,180,c2b67a2a,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cdc220,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e9337a84,c0741f5a,c0c03804,0,c6cdc220,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0381c,1389,c0ab9a9d,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0381c,c0c03804,1389,30f,c073f13d,...) at _cv_timedwait_sig+0x20b
kern_select(c6cdc220,4,bfbfd12c,0,0,e9337c70,5,0) at kern_select+0x6b4
select(c6cdc220,e9337cfc,14,c0aa268f,c0b49498,...) at select+0x5e
syscall(e9337d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x2839e003, esp = 0xbfbfd09c, ebp = 0xbfbfdb38 ---

Tracing command sshd pid 612 tid 100071 td 0xc6cbf440
sched_switch(c6cbf440,0,1,180,a4b7d64e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cbf440,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f5a,c0c03804,0,c0a9b50e,c6cbf440,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0381c,c0c03804,c0ab9a9d,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0381c,c0c03804,c0aa1cff,30f,e92ffafc,...) at _cv_wait_sig+0x1fc
kern_select(c6cbf440,7,2850b0bc,0,0,0,c,e92ffc98) at kern_select+0x6cc
select(c6cbf440,e92ffcfc,14,e92ffd38,c0b49498,...) at select+0x5e
syscall(e92ffd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x283e6003, esp = 0xbfbfe6cc, ebp = 0xbfbfee98 ---

Tracing command rpc.lockd pid 558 tid 100059 td 0xc68dd880
sched_switch(c68dd880,0,1,180,a6f1e8ca,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c68dd880,0,c0aa0187,19b,c0c09e08,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba240,1,c0a9b50e,58,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c09e08,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c0c09e08,c0c09dec,158,c0ab72a3,0,...) at _sleep+0x359
nfslock_read(c67fe700,e6ecec60,4,0,194,...) at nfslock_read+0x7c
devfs_read_f(c6cf9120,e6ecec60,c6affa00,0,c68dd880,...) at devfs_read_f+0x71
dofileread(e6ecec60,ffffffff,ffffffff,0,c6cf9120,...) at dofileread+0x96
kern_readv(c68dd880,8,e6ecec60,bfbfec48,194,...) at kern_readv+0x58
read(c68dd880,e6ececfc,c,c0aa2618,c0b48c28,...) at read+0x4f
syscall(e6eced38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28173083, esp = 0xbfbfebfc, ebp = 0xbfbfede8 ---

Tracing command rpc.lockd pid 553 tid 100050 td 0xc6b01cc0
sched_switch(c6b01cc0,0,1,180,d84ff516,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6b01cc0,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e710aa84,c0741f5a,c0c03804,0,c6b01cc0,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0381c,7531,c0ab9a9d,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0381c,c0c03804,7531,30f,e710aafc,...) at _cv_timedwait_sig+0x20b
kern_select(c6b01cc0,7,bfbfed5c,0,0,e710ac70,1e,0) at kern_select+0x6b4
select(c6b01cc0,e710acfc,14,c0aa23da,c0b49498,...) at select+0x5e
syscall(e710ad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28173003, esp = 0xbfbfecac, ebp = 0xbfbfede8 ---

Tracing command rpc.statd pid 548 tid 100074 td 0xc6ce1aa0
sched_switch(c6ce1aa0,0,1,180,da35fe86,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce1aa0,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e9358a84,c0741f5a,c0c03804,0,c6ce1aa0,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0381c,7531,c0ab9a9d,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0381c,c0c03804,7531,30f,1c,...) at _cv_timedwait_sig+0x20b
kern_select(c6ce1aa0,a,bfbfed6c,0,0,e9358c70,1e,0) at kern_select+0x6b4
select(c6ce1aa0,e9358cfc,14,c0aa23da,c0b49498,...) at select+0x5e
syscall(e9358d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x2815f003, esp = 0xbfbfecbc, ebp = 0xbfbfedf8 ---

Tracing command md1 pid 518 tid 100112 td 0xc6e50440
sched_switch(c6e50440,0,1,180,bd8431f3,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6e50440,...) at mi_switch+0x217
sleepq_switch(c6e50440,0,c0aa0187,21d,4c,...) at sleepq_switch+0xf0
sleepq_wait(c6de8000,c6de8020,c0a7aa64,0,0,...) at sleepq_wait+0x60
_sleep(c6de8000,c6de8020,24c,c0a7aa64,0,...) at _sleep+0x369
md_kthread(c6de8000,e93c5d38,c0a9916f,313,c6e55aa0,...) at md_kthread+0x125
fork_exit(c05e1880,c6de8000,e93c5d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe93c5d70, ebp = 0 ---

Tracing command rpcbind pid 498 tid 100047 td 0xc68a9aa0
sched_switch(c68a9aa0,0,1,180,da1aac6e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c68a9aa0,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e6e74ad8,c0741f5a,c0c03804,0,c68a9aa0,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0381c,7531,c0ab9a9d,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0381c,c0c03804,7531,3bb,c0c03720,...) at _cv_timedwait_sig+0x20b
poll(c68a9aa0,e6e74cfc,c,c0aa23da,c0b49f78,...) at poll+0x554
syscall(e6e74d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (209, FreeBSD ELF32, poll), eip = 0x2811be5b, esp = 0xbfbfcc7c, ebp = 0xbfbfee48 ---

Tracing command syslogd pid 476 tid 100093 td 0xc6d90660
sched_switch(c6d90660,0,1,180,29d94d7e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d90660,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f5a,c0c03804,0,c0a9b50e,c6d90660,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0381c,c0c03804,c0ab9a9d,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0381c,c0c03804,c0aa1cff,30f,da80fe48,...) at _cv_wait_sig+0x1fc
kern_select(c6d90660,9,282200bc,0,0,0,c6dd55d0,28203000) at kern_select+0x6cc
select(c6d90660,e938dcfc,14,c0abb20e,c0b49498,...) at select+0x5e
syscall(e938dd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28169003, esp = 0xbfbfdf3c, ebp = 0xbfbfee88 ---

Tracing command devd pid 430 tid 100090 td 0xc6d90cc0
sched_switch(c6d90cc0,0,1,180,4d542496,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d90cc0,0,c0aa0187,19b,c0c0381c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f5a,c0c03804,0,c0a9b50e,c6d90cc0,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0381c,c0c03804,c0ab9a9d,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0381c,c0c03804,c0aa1cff,30f,e9396afc,...) at _cv_wait_sig+0x1fc
kern_select(c6d90cc0,5,bfbfedf8,0,0,0,0,0) at kern_select+0x6cc
select(c6d90cc0,e9396cfc,14,c0aa25dd,c0b49498,...) at select+0x5e
syscall(e9396d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x8081daf, esp = 0xbfbfe9bc, ebp = 0xbfbfee98 ---

Tracing command md0 pid 114 tid 100076 td 0xc6ce1660
sched_switch(c6ce1660,0,1,180,29d82380,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6ce1660,...) at mi_switch+0x217
sleepq_switch(c6ce1660,0,c0aa0187,21d,4c,...) at sleepq_switch+0xf0
sleepq_wait(c6da6800,c6da6820,c0a7aa64,0,0,...) at sleepq_wait+0x60
_sleep(c6da6800,c6da6820,24c,c0a7aa64,0,...) at _sleep+0x369
md_kthread(c6da6800,e9352d38,c0a9916f,313,c6cdbaa0,...) at md_kthread+0x125
fork_exit(c05e1880,c6da6800,e9352d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe9352d70, ebp = 0 ---

Tracing command softdepflush pid 47 tid 100055 td 0xc6b01220
sched_switch(c6b01220,0,1,180,e085ce6e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,44,...) at mi_switch+0x217
sleepq_switch(c6b01220,0,c0aa0187,240,44,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c0f5a4,3e8,c0abb68b,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c0f5a4,c0c0f57c,44,c0abb68b,3e8,...) at _sleep+0x345
softdep_flush(0,e70fbd38,c0a9916f,313,c6b022a8,...) at softdep_flush+0x2d2
fork_exit(c09337e0,0,e70fbd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe70fbd70, ebp = 0 ---

Tracing command syncer pid 46 tid 100056 td 0xc6b01000
sched_switch(c6b01000,0,1,180,1d0d2974,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6b01000,...) at mi_switch+0x217
sleepq_switch(c6b01000,0,c0aa0187,21d,68,...) at sleepq_switch+0xf0
sleepq_wait(c0bb208c,0,c0aa8762,0,0,...) at sleepq_wait+0x60
_sleep(c0bb208c,c0c03fa4,68,c0aa8762,0,...) at _sleep+0x369
sched_sync(0,e70f8d38,c0a9916f,313,c6b02550,...) at sched_sync+0x56e
fork_exit(c07cbf50,0,e70f8d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe70f8d70, ebp = 0 ---

Tracing command vnlru pid 45 tid 100034 td 0xc68a8440
sched_switch(c68a8440,0,1,180,e3dc5703,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,50,...) at mi_switch+0x217
sleepq_switch(c68a8440,0,c0aa0187,240,50,...) at sleepq_switch+0xf0
sleepq_timedwait(c68acaa0,3e8,c0aa880c,0,0,...) at sleepq_timedwait+0x68
_sleep(c68acaa0,c0c03f78,250,c0aa880c,3e8,...) at _sleep+0x345
vnlru_proc(0,e6e56d38,c0a9916f,313,c68acaa0,...) at vnlru_proc+0x114
fork_exit(c07ccd20,0,e6e56d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e56d70, ebp = 0 ---

Tracing command bufdaemon pid 44 tid 100035 td 0xc68a8220
sched_switch(c68a8220,0,1,180,e0692e94,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,44,...) at mi_switch+0x217
sleepq_switch(c68a8220,0,c0aa0187,240,44,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c03cc4,3e8,c0aa63ec,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c03cc4,c0c03cc8,44,c0aa63ec,3e8,...) at _sleep+0x345
buf_daemon(0,e6e53d38,c0a9916f,313,c68acd48,...) at buf_daemon+0x21e
fork_exit(c07b7500,0,e6e53d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e53d70, ebp = 0 ---

Tracing command pagezero pid 43 tid 100036 td 0xc68a8000
sched_switch(c68a8000,0,1,180,bf360d7,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c68a8000,0,c0aa0187,240,0,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c10058,493e0,c0abff7e,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c10058,c0c0fd00,0,c0abff7e,493e0,...) at _sleep+0x345
vm_pagezero(0,e6e50d38,c0a9916f,313,c68db000,...) at vm_pagezero+0xdc
fork_exit(c096cdf0,0,e6e50d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e50d70, ebp = 0 ---

Tracing command vmdaemon pid 42 tid 100037 td 0xc6790cc0
sched_switch(c6790cc0,0,1,180,f0de55c7,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6790cc0,...) at mi_switch+0x217
sleepq_switch(c6790cc0,0,c0aa0187,21d,68,...) at sleepq_switch+0xf0
sleepq_wait(c0c0fd74,0,c0a9d0dd,da,0,...) at sleepq_wait+0x60
_sleep(c0c0fd74,c0c0fd78,68,c0aa63ec,0,...) at _sleep+0x369
vm_daemon(0,e5427d38,c0a9916f,313,c68db2a8,...) at vm_daemon+0x59
fork_exit(c0968470,0,e5427d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5427d70, ebp = 0 ---

Tracing command pagedaemon pid 41 tid 100038 td 0xc68dd000
sched_switch(c68dd000,0,1,180,fa1801a7,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,44,...) at mi_switch+0x217
sleepq_switch(c68dd000,0,c0aa0187,240,44,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c0fd3c,1388,c0aa63ec,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c0fd3c,c0c0fd00,44,c0aa63ec,1388,...) at _sleep+0x345
vm_pageout(0,e6ec2d38,c0a9916f,313,c68db550,...) at vm_pageout+0x2bb
fork_exit(c0969030,0,e6ec2d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ec2d70, ebp = 0 ---

Tracing command sctp_iterator pid 40 tid 100039 td 0xc68dccc0
sched_switch(c68dccc0,0,1,180,31b7340,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c68dccc0,...) at mi_switch+0x217
sleepq_switch(c68dccc0,0,c0aa0187,21d,0,...) at sleepq_switch+0xf0
sleepq_wait(c0c05a2c,c0c05934,c0aaf14d,0,0,...) at sleepq_wait+0x60
_sleep(c0c05a2c,c0c05934,0,c0aaf14d,0,...) at _sleep+0x369
sctp_iterator_thread(0,e70f5d38,c0a9916f,313,c68db7f8,...) at sctp_iterator_thread+0x60
fork_exit(c0831d90,0,e70f5d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe70f5d70, ebp = 0 ---

Tracing command swi0: sio pid 39 tid 100040 td 0xc68dcaa0
sched_switch(c68dcaa0,0,1,180,c2ab1f26,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c6938b64,...) at mi_switch+0x217
ithread_loop(c690d110,e6ebcd38,c0a9916f,313,c68dbaa0,...) at ithread_loop+0x34c
fork_exit(c0732210,c690d110,e6ebcd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ebcd70, ebp = 0 ---

Tracing command irq1: atkbd0 pid 38 tid 100041 td 0xc68dc880
fork_trampoline() at fork_trampoline

Tracing command irq15: ata1 pid 37 tid 100042 td 0xc68dc660
fork_trampoline() at fork_trampoline

Tracing command irq14: ata0 pid 36 tid 100043 td 0xc68dc440
sched_switch(c68dc440,0,1,180,c2c00517,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c67ca464,...) at mi_switch+0x217
ithread_loop(c68ec340,e6eb3d38,c0a9916f,313,c68df2a8,...) at ithread_loop+0x34c
fork_exit(c0732210,c68ec340,e6eb3d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6eb3d70, ebp = 0 ---

Tracing command usb3 pid 35 tid 100044 td 0xc68dc220
sched_switch(c68dc220,0,1,180,a6e19a7f,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c68dc220,0,c0aa0187,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c687a210,ea60,c0a910fc,0,0,...) at sleepq_timedwait+0x68
_sleep(c687a210,0,5c,c0a910fc,ea60,...) at _sleep+0x345
usb_event_thread(c68d5640,e6eb0d38,c0a9916f,313,c68df550,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68d5640,e6eb0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6eb0d70, ebp = 0 ---

Tracing command usb2 pid 34 tid 100024 td 0xc6780aa0
sched_switch(c6780aa0,0,1,180,a6fe8e9f,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c6780aa0,0,c0aa0187,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c68cc210,ea60,c0a910fc,0,0,...) at sleepq_timedwait+0x68
_sleep(c68cc210,0,5c,c0a910fc,ea60,...) at _sleep+0x345
usb_event_thread(c68a6940,e53edd38,c0a9916f,313,c68a7000,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68a6940,e53edd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53edd70, ebp = 0 ---

Tracing command irq18: uhci2 pid 33 tid 100025 td 0xc6780880
fork_trampoline() at fork_trampoline

Tracing command usb1 pid 32 tid 100026 td 0xc6780660
sched_switch(c6780660,0,1,180,a6fe6245,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c6780660,0,c0aa0187,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c68bc210,ea60,c0a910fc,0,0,...) at sleepq_timedwait+0x68
_sleep(c68bc210,0,5c,c0a910fc,ea60,...) at _sleep+0x345
usb_event_thread(c68b7300,e53e7d38,c0a9916f,313,c68a7550,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68b7300,e53e7d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53e7d70, ebp = 0 ---

Tracing command irq19: uhci1+ pid 31 tid 100027 td 0xc68a9440
sched_switch(c68a9440,0,1,180,bd8dc06c,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c67ca1e4,...) at mi_switch+0x217
ithread_loop(c68c4010,e6e6bd38,c0a9916f,313,c68a77f8,...) at ithread_loop+0x34c
fork_exit(c0732210,c68c4010,e6e6bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e6bd70, ebp = 0 ---

Tracing command usbtask-dr pid 30 tid 100028 td 0xc68a9220
sched_switch(c68a9220,0,1,180,aff7347a,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c68a9220,...) at mi_switch+0x217
sleepq_switch(c68a9220,0,c0aa0187,21d,5c,...) at sleepq_switch+0xf0
sleepq_wait(c0baf994,0,c0a9d0dd,da,0,...) at sleepq_wait+0x60
_sleep(c0baf994,0,5c,c0a91139,0,...) at _sleep+0x369
usb_task_thread(c0baf994,e6e68d38,c0a9916f,313,c68a7aa0,...) at usb_task_thread+0x62
fork_exit(c06cabb0,c0baf994,e6e68d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e68d70, ebp = 0 ---

Tracing command usbtask-hc pid 29 tid 100029 td 0xc68a9000
sched_switch(c68a9000,0,1,180,aff71b36,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c68a9000,...) at mi_switch+0x217
sleepq_switch(c68a9000,0,c0aa0187,21d,5c,...) at sleepq_switch+0xf0
sleepq_wait(c0baf980,0,c0a9d0dd,da,0,...) at sleepq_wait+0x60
_sleep(c0baf980,0,5c,c0a91139,0,...) at _sleep+0x369
usb_task_thread(c0baf980,e6e65d38,c0a9916f,313,c68a7d48,...) at usb_task_thread+0x62
fork_exit(c06cabb0,c0baf980,e6e65d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e65d70, ebp = 0 ---

Tracing command usb0 pid 28 tid 100030 td 0xc68a8cc0
sched_switch(c68a8cc0,0,1,180,a6fe2250,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c68a8cc0,0,c0aa0187,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c689b210,ea60,c0a910fc,0,0,...) at sleepq_timedwait+0x68
_sleep(c689b210,0,5c,c0a910fc,ea60,...) at _sleep+0x345
usb_event_thread(c68b7d00,e6e62d38,c0a9916f,313,c68ac000,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68b7d00,e6e62d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e62d70, ebp = 0 ---

Tracing command irq17: uhci0 ehci0 pid 27 tid 100031 td 0xc68a8aa0
fork_trampoline() at fork_trampoline

Tracing command em1 taskq pid 9 tid 100032 td 0xc68a8880
sched_switch(c68a8880,0,1,180,adb7cce1,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c68a8880,...) at mi_switch+0x217
sleepq_switch(c68a8880,0,c0aa0187,21d,c68a8880,...) at sleepq_switch+0xf0
sleepq_wait(c6884980,0,c0a9d135,c0a9416a,0,...) at sleepq_wait+0x60
msleep_spin(c6884980,c688499c,c0a9416a,0,c0a9b50e,...) at msleep_spin+0x20d
taskqueue_thread_loop(c687daec,e6e5cd38,c0a9916f,313,c68ac550,...) at taskqueue_thread_loop+0x8a
fork_exit(c077fb60,c687daec,e6e5cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e5cd70, ebp = 0 ---

Tracing command em0 taskq pid 8 tid 100033 td 0xc68a8660
sched_switch(c68a8660,0,1,180,74a3b561,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c68a8660,...) at mi_switch+0x217
sleepq_switch(c68a8660,0,c0aa0187,21d,c68a8660,...) at sleepq_switch+0xf0
sleepq_wait(c6884500,0,c0a9d135,c0a9416a,0,...) at sleepq_wait+0x60
msleep_spin(c6884500,c688451c,c0a9416a,0,c0a9b50e,...) at msleep_spin+0x20d
taskqueue_thread_loop(c687d2ec,e6e59d38,c0a9916f,313,c68ac7f8,...) at taskqueue_thread_loop+0x8a
fork_exit(c077fb60,c687d2ec,e6e59d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e59d70, ebp = 0 ---

Tracing command swi6: Giant taskq pid 26 tid 100015 td 0xc677e440
fork_trampoline() at fork_trampoline

Tracing command thread taskq pid 7 tid 100016 td 0xc677e220
sched_switch(c677e220,0,1,180,d7372498,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c677e220,...) at mi_switch+0x217
sleepq_switch(c677e220,0,c0aa0187,21d,0,...) at sleepq_switch+0xf0
sleepq_wait(c6884100,c688411c,c0a9416a,0,0,...) at sleepq_wait+0x60
_sleep(c6884100,c688411c,0,c0a9416a,0,...) at _sleep+0x369
taskqueue_thread_loop(c0bbc238,e53ccd38,c0a9916f,313,c678faa0,...) at taskqueue_thread_loop+0xb4
fork_exit(c077fb60,c0bbc238,e53ccd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53ccd70, ebp = 0 ---

Tracing command swi5: + pid 25 tid 100017 td 0xc6790aa0
sched_switch(c6790aa0,0,1,180,3827b848,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c67ca564,...) at mi_switch+0x217
ithread_loop(c68781f0,e5424d38,c0a9916f,313,c678fd48,...) at ithread_loop+0x34c
fork_exit(c0732210,c68781f0,e5424d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5424d70, ebp = 0 ---

Tracing command swi2: cambio pid 24 tid 100018 td 0xc6790880
fork_trampoline() at fork_trampoline

Tracing command xpt_thrd pid 6 tid 100019 td 0xc6790660
sched_switch(c6790660,0,1,180,aff6df7e,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6790660,...) at mi_switch+0x217
sleepq_switch(c6790660,0,c0aa0187,21d,4c,...) at sleepq_switch+0xf0
sleepq_wait(c0b80b94,0,c0a9d0dd,da,0,...) at sleepq_wait+0x60
_sleep(c0b80b94,c0b80bac,4c,c0a536c2,0,...) at _sleep+0x369
xpt_scanner_thread(0,e541ed38,c0a9916f,313,c67d42a8,...) at xpt_scanner_thread+0x41
fork_exit(c0468330,0,e541ed38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe541ed70, ebp = 0 ---

Tracing command kqueue taskq pid 5 tid 100020 td 0xc6790440
sched_switch(c6790440,0,1,180,aff7b004,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c6790440,...) at mi_switch+0x217
sleepq_switch(c6790440,0,c0aa0187,21d,0,...) at sleepq_switch+0xf0
sleepq_wait(c67ca800,c67ca81c,c0a9416a,0,0,...) at sleepq_wait+0x60
_sleep(c67ca800,c67ca81c,0,c0a9416a,0,...) at _sleep+0x369
taskqueue_thread_loop(c0bb090c,e541bd38,c0a9916f,313,c67d4550,...) at taskqueue_thread_loop+0xb4
fork_exit(c077fb60,c0bb090c,e541bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe541bd70, ebp = 0 ---

Tracing command swi6: task queue pid 23 tid 100021 td 0xc6790220
sched_switch(c6790220,0,1,180,3276c693,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c67ca8e4,...) at mi_switch+0x217
ithread_loop(c6878290,e5418d38,c0a9916f,313,c67d47f8,...) at ithread_loop+0x34c
fork_exit(c0732210,c6878290,e5418d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5418d70, ebp = 0 ---

Tracing command yarrow pid 22 tid 100022 td 0xc6790000
sched_switch(c6790000,0,1,180,30a211c4,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6790000,0,c0aa0187,240,0,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb2094,64,c0a9416a,2,0,...) at sleepq_timedwait+0x68
_sleep(c0bb2094,0,0,c0a9416a,64,...) at _sleep+0x345
pause(c0a9416a,64,c0a88b5c,112,0,...) at pause+0x47
random_kthread(0,e5415d38,c0a9916f,313,c67d4aa0,...) at random_kthread+0x1d9
fork_exit(c06554b0,0,e5415d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5415d70, ebp = 0 ---

Tracing command g_down pid 4 tid 100023 td 0xc6780cc0
sched_switch(c6780cc0,0,1,180,34dcb1ff,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,4c,...) at mi_switch+0x217
sleepq_switch(c6780cc0,0,c0aa0187,240,4c,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb010c,64,c0a9416a,0,0,...) at sleepq_timedwait+0x68
_sleep(c0bb010c,c0bb0028,24c,c0a9416a,64,...) at _sleep+0x345
g_io_schedule_down(c6780cc0,0,c0a9582d,74,0,...) at g_io_schedule_down+0x6b
g_down_procbody(0,e53f0d38,c0a9916f,313,c67d4d48,...) at g_down_procbody+0x8d
fork_exit(c0701640,0,e53f0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53f0d70, ebp = 0 ---

Tracing command g_up pid 3 tid 100007 td 0xc677c000
sched_switch(c677c000,0,1,180,34f93768,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,4c,...) at mi_switch+0x217
sleepq_switch(c677c000,0,c0aa0187,240,4c,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb0108,64,c0a9416a,0,0,...) at sleepq_timedwait+0x68
_sleep(c0bb0108,c0bb0068,24c,c0a9416a,64,...) at _sleep+0x345
g_io_schedule_up(c677c000,0,c0a9582d,5d,0,...) at g_io_schedule_up+0x133
g_up_procbody(0,e53b4d38,c0a9916f,313,c677f2a8,...) at g_up_procbody+0x8d
fork_exit(c07016d0,0,e53b4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53b4d70, ebp = 0 ---

Tracing command g_event pid 2 tid 100008 td 0xc6780440
cpustop_handler(4,e53e4b3c,c0a048fd,e53e4ad0,6a94,...) at cpustop_handler+0x32
ipi_nmi_handler(e53e4ad0,6a94,2c00,0,c677f550,...) at ipi_nmi_handler+0x2f
trap(e53e4b48) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09dc2ef, esp = 0xe53e4b88, ebp = 0xe53e4bac ---
siointr1(c0c1ca4c,0,c0ac45f4,56f,e53e4bec,...) at siointr1+0x3bf
siointr(c6934c00,0,0,c6780440,c6778e80,...) at siointr+0x32
intr_execute_handlers(c676ecd0,e53e4c0c,e53e4c50,c09eac24,38,...) at intr_execute_handlers+0xec
lapic_handle_intr(38,e53e4c0c) at lapic_handle_intr+0x3f
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0xc09f6c1b, esp = 0xe53e4c4c, ebp = 0xe53e4c50 ---
spinlock_exit(c0bba1c0,1,c0a9b50e,f4) at spinlock_exit+0x2b
_mtx_unlock_spin_flags(c0bba1c0,0,c0aa0187,243,4c,...) at _mtx_unlock_spin_flags+0xfd
sleepq_timedwait(c0bb0100,64,c0a9416a,0,0,...) at sleepq_timedwait+0x91
_sleep(c0bb0100,0,4c,c0a9416a,64,...) at _sleep+0x345
g_event_procbody(0,e53e4d38,c0a9916f,313,c677f550,...) at g_event_procbody+0xcb
fork_exit(c0701760,0,e53e4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53e4d70, ebp = 0 ---

Tracing command swi1: net pid 21 tid 100009 td 0xc6780220
sched_switch(c6780220,0,1,180,a65fc92d,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c67c9164,...) at mi_switch+0x217
ithread_loop(c677a230,e53e1d38,c0a9916f,313,c677f7f8,...) at ithread_loop+0x34c
fork_exit(c0732210,c677a230,e53e1d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53e1d70, ebp = 0 ---

Tracing command swi3: vm pid 20 tid 100010 td 0xc6780000
fork_trampoline() at fork_trampoline

Tracing command swi4: clock sio pid 19 tid 100011 td 0xc677ecc0
sched_switch(c677ecc0,0,1,180,366b451d,...) at sched_switch+0x491
mi_switch(1,0,c0a993f3,46b,c67c9264,...) at mi_switch+0x217
ithread_loop(c677a250,e53dbd38,c0a9916f,313,c677fd48,...) at ithread_loop+0x34c
fork_exit(c0732210,c677a250,e53dbd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53dbd70, ebp = 0 ---

Tracing command idle: cpu0 pid 18 tid 100012 td 0xc677eaa0
cpustop_handler(1,e53d8c6c,c0a048fd,0,80000000,...) at cpustop_handler+0x32
ipi_nmi_handler(0,80000000,1234de,0,c678f000,...) at ipi_nmi_handler+0x2f
trap(e53d8c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3b95, esp = 0xe53d8cb8, ebp = 0xe53d8cb8 ---
cpu_idle_default(e53d8cf8,c076b6b2,c0bba0c0,0,c0a9e2a4,...) at cpu_idle_default+0x5
cpu_idle(c0bba0c0,0,c0a9e2a4,2fc,c0bb3cc0,...) at cpu_idle+0x28
sched_idletd(0,e53d8d38,c0a9916f,313,c678f000,...) at sched_idletd+0x1c2
fork_exit(c076b4f0,0,e53d8d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53d8d70, ebp = 0 ---

Tracing command idle: cpu1 pid 17 tid 100013 td 0xc677e880
sched_switch(c677e880,0,6,17b,6b85e9e7,...) at sched_switch+0x491
mi_switch(6,0,c0ac8b6a,495,1,...) at mi_switch+0x217
ipi_bitmap_handler(e53d0008,28,3c0028,f,ff,...) at ipi_bitmap_handler+0x72
Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2e
--- interrupt, eip = 0x20, esp = 0xc09f5c08, ebp = 0xe53d5ca4 ---
uart_z8530_class(c09f3b95,20,246,e53d5cc0,c09f5c08,...) at 0x20

Tracing command idle: cpu2 pid 16 tid 100014 td 0xc677e660
sched_switch(c677e660,0,6,17b,2bdaf18a,...) at sched_switch+0x491
mi_switch(6,0,c0ac8b6a,495,2,...) at mi_switch+0x217
ipi_bitmap_handler(e53d0008,28,3c0028,f,ff,...) at ipi_bitmap_handler+0x72
Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2e
--- interrupt, eip = 0x20, esp = 0xc09f5c08, ebp = 0xe53d2ca4 ---
uart_z8530_class(c09f3b95,20,246,e53d2cc0,c09f5c08,...) at 0x20

Tracing command idle: cpu3 pid 15 tid 100000 td 0xc677e000
cpustop_handler(8,e53c9c6c,c0a048fd,c076a1f8,e53c9c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(c076a1f8,e53c9c1c,c076ac1d,c677b000,c677b000,...) at ipi_nmi_handler+0x2f
trap(e53c9c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3b95, esp = 0xe53c9cb8, ebp = 0xe53c9cb8 ---
cpu_idle_default(e53c9cf8,c076b6b2,c0bba240,0,c0a9e2a4,...) at cpu_idle_default+0x5
cpu_idle(c0bba240,0,c0a9e2a4,2fc,c0bb4f80,...) at cpu_idle+0x28
sched_idletd(0,e53c9d38,c0a9916f,313,c677b000,...) at sched_idletd+0x1c2
fork_exit(c076b4f0,0,e53c9d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c9d70, ebp = 0 ---

Tracing command idle: cpu4 pid 14 tid 100001 td 0xc677ccc0
cpustop_handler(10,e53c6c6c,c0a048fd,e53c6c24,e53c6c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(e53c6c24,e53c6c1c,c076ac1d,c677b2a8,c677b2a8,...) at ipi_nmi_handler+0x2f
trap(e53c6c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3b95, esp = 0xe53c6cb8, ebp = 0xe53c6cb8 ---
cpu_idle_default(e53c6cf8,c076b6b2,c0bba2c0,0,c0a9e2a4,...) at cpu_idle_default+0x5
cpu_idle(c0bba2c0,0,c0a9e2a4,2fc,c0bb55c0,...) at cpu_idle+0x28
sched_idletd(0,e53c6d38,c0a9916f,313,c677b2a8,...) at sched_idletd+0x1c2
fork_exit(c076b4f0,0,e53c6d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c6d70, ebp = 0 ---

Tracing command idle: cpu5 pid 13 tid 100002 td 0xc677caa0
cpustop_handler(20,e53c3c6c,c0a048fd,e53c3c24,e53c3c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(e53c3c24,e53c3c1c,c076ac1d,c677b550,c677b550,...) at ipi_nmi_handler+0x2f
trap(e53c3c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3b95, esp = 0xe53c3cb8, ebp = 0xe53c3cb8 ---
cpu_idle_default(e53c3cf8,c076b6b2,c0bba340,0,c0a9e2a4,...) at cpu_idle_default+0x5
cpu_idle(c0bba340,0,c0a9e2a4,2fc,c0bb5c00,...) at cpu_idle+0x28
sched_idletd(0,e53c3d38,c0a9916f,313,c677b550,...) at sched_idletd+0x1c2
fork_exit(c076b4f0,0,e53c3d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c3d70, ebp = 0 ---

Tracing command idle: cpu6 pid 12 tid 100003 td 0xc677c880
cpustop_handler(40,e53c0c6c,c0a048fd,c076a1f8,e53c0c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(c076a1f8,e53c0c1c,c076ac1d,c677b7f8,c677b7f8,...) at ipi_nmi_handler+0x2f
trap(e53c0c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3b95, esp = 0xe53c0cb8, ebp = 0xe53c0cb8 ---
cpu_idle_default(e53c0cf8,c076b6b2,c0bba3c0,0,c0a9e2a4,...) at cpu_idle_default+0x5
cpu_idle(c0bba3c0,0,c0a9e2a4,2fc,c0bb6240,...) at cpu_idle+0x28
sched_idletd(0,e53c0d38,c0a9916f,313,c677b7f8,...) at sched_idletd+0x1c2
fork_exit(c076b4f0,0,e53c0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c0d70, ebp = 0 ---

Tracing command idle: cpu7 pid 11 tid 100004 td 0xc677c660
cpustop_handler(80,e53bdc6c,c0a048fd,c076a1f8,e53bdc1c,...) at cpustop_handler+0x32
ipi_nmi_handler(c076a1f8,e53bdc1c,c076ac1d,c677baa0,c677baa0,...) at ipi_nmi_handler+0x2f
trap(e53bdc78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3b95, esp = 0xe53bdcb8, ebp = 0xe53bdcb8 ---
cpu_idle_default(e53bdcf8,c076b6b2,c0bba440,0,c0a9e2a4,...) at cpu_idle_default+0x5
cpu_idle(c0bba440,0,c0a9e2a4,2fc,c0bb6880,...) at cpu_idle+0x28
sched_idletd(0,e53bdd38,c0a9916f,313,c677baa0,...) at sched_idletd+0x1c2
fork_exit(c076b4f0,0,e53bdd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53bdd70, ebp = 0 ---

Tracing command init pid 1 tid 100005 td 0xc677c440
sched_switch(c677c440,0,1,180,c14e6623,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,0,...) at mi_switch+0x217
sleepq_switch(c677c440,0,c0aa0187,19b,c677bd48,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bbd,c0bba3c0,1,c0a9b50e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c677bd48,0,c0a9d0dd,da,0,...) at sleepq_wait_sig+0x14
_sleep(c677bd48,c677bdd8,15c,c0aa2296,0,...) at _sleep+0x359
kern_wait(c677c440,ffffffff,e53bac2c,0,0,...) at kern_wait+0xa66
wait4(c677c440,e53bacfc,10,c0aa20b1,c0b48c88,...) at wait4+0x3b
syscall(e53bad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054a1b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 ---

Tracing command audit pid 10 tid 100006 td 0xc677c220
sched_switch(c677c220,0,1,180,aff4636c,...) at sched_switch+0x491
mi_switch(1,0,c0aa0187,1bf,c677c220,...) at mi_switch+0x217
sleepq_switch(c677c220,0,c0aa0187,21d,c677c220,...) at sleepq_switch+0xf0
sleepq_wait(c0c0f014,c0c0eff4,c0ab91d3,1,0,...) at sleepq_wait+0x60
_cv_wait(c0c0f014,c0c0eff4,c0ab9b78,1c2,0,...) at _cv_wait+0x1fc
audit_worker(0,e53b7d38,c0a9916f,313,c677f000,...) at audit_worker+0x99
fork_exit(c0918fd0,0,e53b7d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53b7d70, ebp = 0 ---

Tracing command swapper pid 0 tid 0 td 0xc0bb0470
sched_switch(c0bb0470,0,1,180,f8cbbf0f,...) at sched_switch+0x491
mi_switch(1,0,c0abddad,2d5,80000006,...) at mi_switch+0x217
scheduler(0,101ec00,101ec00,101e000,1028000,...) at scheduler+0x2c0
mi_startup() at mi_startup+0x96
begin() at begin+0x2c
db> call doadump
Physical memory: 3314 MB
Dumping 105 MB: 90 74 58 42 26 10
Dump complete
= 0xf
db> c
        dev fmaster
KDB: stack backtrace:
db_trace_self_wrapper(c0a9f59e,e94e4984,c07c7a63,0,c0acd6a5,...) at db_trace_self_wrapper+0x26
kdb_backtrace(0,c0acd6a5,c74056cc,c0b45ac0,0,...) at kdb_backtrace+0x29
vfs_badlock(e94e49a8,c0a1854c,c74056cc,c0acd6a5,c6f26aa0,...) at vfs_badlock+0x23
assert_vi_unlocked(c74056cc,c0acd6a5,c6f26aa0,c6f26aa0,c74056cc,...) at assert_vi_unlocked+0x33
VOP_PRINT_APV(c0b45ac0,e94e49c4,1,1,c73d4000,...) at VOP_PRINT_APV+0xec
vn_printf(c74056cc,c0aa6dc9,c0aa7d3c,86f,60,...) at vn_printf+0x4af
vput(c74056cc,ffffffdf,c70ba000,0,c6f26aa0,...) at vput+0xc5
kern_lstat(c6f26aa0,2821b918,0,e94e4c18,e94e4c24,...) at kern_lstat+0xb5
lstat(c6f26aa0,e94e4cfc,8,c0aa213c,c0b49db0,...) at lstat+0x2f
syscall(e94e4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (190, FreeBSD ELF32, lstat), eip = 0x2819a3bf, esp = 0xbfbfe4ec, ebp = 0xbfbfe578 ---
VOP_PRINT: 0xc74056cc interlock is locked but should not be
KDB: enter: lock violation
[thread pid 2804 tid 100172 ]
Stopped at      kdb_enter+0x32: leave
db> c
panic: vput: missed vn_close
cpuid = 1
KDB: enter: panic
[thread pid 2804 tid 100172 ]
Stopped at      kdb_enter+0x32: leave
db> c
Uptime: 1h6m30s
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...
cpu_reset: Stopping other CPUs

(kgdb) bt
#0  doadump () at pcpu.h:195
#1  0xc048cfe9 in db_fncall (dummy1=-1065917998, dummy2=0, dummy3=-1, dummy4=0xe94e4770 "") at ../../../ddb/db_command.c:486
#2  0xc048d555 in db_command_loop () at ../../../ddb/db_command.c:401
#3  0xc048ecc5 in db_trap (type=3, code=0) at ../../../ddb/db_main.c:222
#4  0xc0776056 in kdb_trap (type=3, code=0, tf=0xe94e4918) at ../../../kern/subr_kdb.c:502
#5  0xc0a04e3b in trap (frame=0xe94e4918) at ../../../i386/i386/trap.c:621
#6  0xc09ea85b in calltrap () at ../../../i386/i386/exception.s:139
#7  0xc07761d2 in kdb_enter (msg=0xc0aa7f1a "lock violation") at cpufunc.h:60
#8  0xc07c7a99 in vfs_badlock (msg=0xc0aa7f34 "interlock is locked but should not be", str=0xc0acd6a5 "VOP_PRINT", vp=0xc74056cc) at ../../../kern/vfs_subr.c:3432
#9  0xc07c7ae3 in assert_vi_unlocked (vp=0xc74056cc, str=0xc0acd6a5 "VOP_PRINT") at ../../../kern/vfs_subr.c:3448
#10 0xc0a184dd in VOP_PRINT_APV (vop=0xc0b45ac0, a=0xe94e49c4) at vnode_if.c:1871
#11 0xc07c85df in vn_printf (vp=0xc74056cc, fmt=0xc0aa6dc9 "VNASSERT failed\n") at vnode_if.h:978
#12 0xc07cae45 in vput (vp=0xc74056cc) at ../../../kern/vfs_subr.c:2161
#13 0xc07cde95 in kern_lstat (td=0xc6f26aa0, path=0x2821b918 <Address 0x2821b918 out of bounds>, pathseg=UIO_USERSPACE, sbp=0xe94e4c18) at ../../../kern/vfs_syscalls.c:2170
#14 0xc07cdf1f in lstat (td=0xc6f26aa0, uap=0xe94e4cfc) at ../../../kern/vfs_syscalls.c:2147
#15 0xc0a045f3 in syscall (frame=0xe94e4d38) at ../../../i386/i386/trap.c:1008
#16 0xc09ea8c0 in Xint0x80_syscall () at ../../../i386/i386/exception.s:196
#17 0x00000033 in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb) f 12
#12 0xc07cae45 in vput (vp=0xc74056cc) at ../../../kern/vfs_subr.c:2161
2161           VNASSERT(vp->v_writecount < vp->v_usecount || vp->v_usecount < 1, vp,
(kgdb) l
2156           KASSERT(vp != NULL, ("vput: null vp"));
2157           ASSERT_VOP_LOCKED(vp, "vput");
2158           VFS_ASSERT_GIANT(vp->v_mount);
2159           VI_LOCK(vp);
2160           /* Skip this v_writecount check if we're going to panic below. */
2161           VNASSERT(vp->v_writecount < vp->v_usecount || vp->v_usecount < 1, vp,
2162               ("vput: missed vn_close"));
2163           error = 0;
2164
2165           if (vp->v_usecount > 1 || ((vp->v_iflag & VI_DOINGINACT) &&
(kgdb) p *vp
$1 = {v_type = VCHR, v_tag = 0xc0a93369 "devfs", v_op = 0xc0b45ac0, v_data = 0xc6e85580, v_mount = 0xc6b59000, v_nmntvnodes = {tqe_next = 0xc742a414, tqe_prev = 0xc7380584},
  v_un = {vu_mount = 0xc73d4000, vu_socket = 0xc73d4000, vu_cdev = 0xc73d4000, vu_fifoinfo = 0xc73d4000}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_hash = 0,
  v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xc74056fc}, v_dd = 0x0, v_cstart = 0, v_lasta = 0, v_lastw = 0, v_clen = 0, v_lock = {
    lk_object = {lo_name = 0xc0a93369 "devfs", lo_type = 0xc0a93369 "devfs", lo_flags = 70844416, lo_witness_data = {lod_list = {stqe_next = 0x0}, lod_witness = 0x0}},
    lk_interlock = 0xc0bb1998, lk_flags = 262272, lk_sharecount = 0, lk_waitcount = 0, lk_exclusivecount = 1, lk_prio = 80, lk_timo = 51, lk_lockholder = 0xc6f26aa0,
    lk_newlock = 0x0, lk_stack = {depth = 14, pcs = {3228818192, 3229338688, 3231823013, 3229445432, 3229399376, 3228453829, 3228457331, 3231827525, 3229352350, 3229355214,
        3229408815, 3229409055, 3231729139, 3231623360, 0, 0, 0, 0}}}, v_interlock = {lock_object = {lo_name = 0xc0aa1b98 "vnode interlock",
      lo_type = 0xc0aa1b98 "vnode interlock", lo_flags = 16973824, lo_witness_data = {lod_list = {stqe_next = 0xc0bc6a98}, lod_witness = 0xc0bc6a98}}, mtx_lock = 3337775778,
    mtx_recurse = 0}, v_vnlock = 0xc7405724, v_holdcnt = 1, v_usecount = 1, v_iflag = 0, v_vflag = 0, v_writecount = 1, v_freelist = {tqe_next = 0x0, tqe_prev = 0xc6e44d40},
  v_bufobj = {bo_mtx = 0xc74057a0, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xc74057dc}, bv_root = 0x0, bv_cnt = 0}, bo_dirty = {bv_hd = {tqh_first = 0x0,
        tqh_last = 0xc74057ec}, bv_root = 0x0, bv_cnt = 0}, bo_numoutput = 0, bo_flag = 0, bo_ops = 0xc0b56c20, bo_bsize = 512, bo_object = 0x0, bo_synclist = {le_next = 0x0,
      le_prev = 0x0}, bo_private = 0xc74056cc, __bo_vnode = 0xc74056cc}, v_pollinfo = 0x0, v_label = 0x0}

--
Test scenario: fclone.sh