Genereic HEAD from Sep 19 12:00 UTC + fdclone.4.patch, vmcore.3

KDB: debugger backends: ddb
KDB: current backend: ddb
786432K of memory above 4GB ignored
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-CURRENT #0: Wed Sep 19 12:11:55 UTC 2007
    test@hydra2.netperf.freebsd.org:/m2/src/sys/i386/compile/ULE
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU           E5320  @ 1.86GHz (1866.75-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f7  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
  AMD Features=0x20100000<NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 4
real memory  = 3489005568 (3327 MB)
avail memory = 3409276928 (3251 MB)
MPTable: <INTEL    Bridge CRB  >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0: Assuming intbase of 0
:
Trying to mount root from nfs:
NFS ROOT: 192.168.5.1:/zoo/hydra2
em0: link state changed to UP
Interface em0 IP-Address 192.168.5.111 Broadcast 192.168.5.255
Loading configuration files.
No suitable dump device was found.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
mount_nfs: can't update /var/db/mounttab for 192.168.5.1:/zoo/hydra2
Setting hostuuid: 7634a964-b127-0430-c299-0030488f5548.
Setting hostid: 0x20c74c48.
Mounting local file systems:.
Setting hostname: hydra2.netperf.freebsd.org.
net.inet6.ip6.auto_linklocal: 1 -> 0
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
        inet6 ::1 prefixlen 128
        inet 127.0.0.1 netmask 0xff000000
Additional routing options:.
Starting devd.
em1: link state changed to UP
Additional IP options:.
Mounting NFS file systems:.
Creating and/or trimming log files:.
Starting syslogd.
/etc/rc: WARNING: Dump device does not exist.  Savecore not run.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout
Initial i386 initialization:.
Additional ABI support:.
Starting rpcbind.
NFS access cache time=60
Clearing /tmp (X related).
Starting statd.
Starting lockd.
Starting local daemons:.
Updating motd.
Mounting late file systems:.
Configuring syscons: blanktime.
Starting sshd.
Starting cron.
Local package initialization:.
Starting background file system checks in 60 seconds.

Wed Sep 19 13:32:29 UTC 2007

FreeBSD/i386 (hydra2.netperf.freebsd.org) (ttyd0)

login: test
Password:
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.

FreeBSD 7.0-CURRENT (ULE) #0: Wed Sep 19 12:11:55 UTC 2007

Welcome to FreeBSD!

Before seeking technical support, please use the following resources:

o  Security advisories and updated errata information for all releases are
   at http://www.FreeBSD.org/releases/ - always consult the ERRATA section
   for your release first as it's updated frequently.

o  The Handbook and FAQ documents are at http://www.FreeBSD.org/ and,
   along with the mailing lists, can be searched by going to
   http://www.FreeBSD.org/search/.  If the doc distribution has
   been installed, they're also available formatted in /usr/share/doc.

If you still have a question or problem, please take the output of
`uname -a', along with any relevant error messages, and email it
as a question to the questions@FreeBSD.org mailing list.  If you are
unfamiliar with FreeBSD's directory layout, please refer to the hier(7)
manual page.  If you are not familiar with manual pages, type `man man'.

You may also use sysinstall(8) to re-enter the installation and
configuration utility.  Edit /etc/motd to change this login announcement.

You can open up a new split-screen window in (n)vi with :N or :E and then
use ^w to switch between the two.
> cd pho
> ./leaks2.sh&
[1] 689
> ./keepalive.sh
Wed Sep 19 15:34:22 CEST 2007 3:34PM  up 2 mins, 1 user, load averages: 0.17, 0.17, 0.08
Sep 19 13:35:40 hydra2 su: test to root on /dev/ttyp0
13:36:29 "vmstat -z VM OBJECT" may be leaking, size 1284
13:36:29 "vmstat -z MAP ENTRY" may be leaking, size 929
13:36:39 "vmstat -z UMA RCntSlabs" may be leaking, size 608
13:36:39 "vmstat -z mbuf_cluster" may be leaking, size 1152
13:36:40 "vmstat -z TURNSTILE" may be leaking, size 288
13:36:40 "vmstat -z THREAD" may be leaking, size 234
13:36:40 "vmstat -z SLEEPQUEUE" may be leaking, size 288
13:36:40 "vmstat -z ksiginfo" may be leaking, size 186
13:36:53 "vmstat -z UMA Slabs" may be leaking, size 814
13:38:44 "vmstat -z VNODE" may be leaking, size 21075
13:38:44 "vmstat -z S VFS Cache" may be leaking, size 514
13:38:44 "vmstat -z FFS inode" may be leaking, size 100
13:38:44 "vmstat -z FFS2 dinode" may be leaking, size 100
13:39:00 "vmstat -z THREAD" may be leaking, size 276
13:39:00 "vmstat -z ksiginfo" may be leaking, size 228
13:39:33 "vmstat -z UMA Slabs" may be leaking, size 854
13:40:07 "vmstat -z TURNSTILE" may be leaking, size 316
13:40:07 "vmstat -z SLEEPQUEUE" may be leaking, size 316
13:40:18 "vmstat -z UMA RCntSlabs" may be leaking, size 736
13:40:18 "vmstat -z mbuf_cluster" may be leaking, size 1408
13:40:56 "vmstat -z VNODE" may be leaking, size 25482
13:41:57 "vmstat -z UMA Slabs" may be leaking, size 896
13:43:01 "vmstat -z VM OBJECT" may be leaking, size 1455
13:43:03 "vmstat -z TURNSTILE" may be leaking, size 372
13:43:03 "vmstat -z THREAD" may be leaking, size 306
13:43:03 "vmstat -z SLEEPQUEUE" may be leaking, size 372
13:43:03 "vmstat -z ksiginfo" may be leaking, size 258
Wed Sep 19 15:44:22 CEST 2007 3:44PM  up 12 mins, 2 users, load averages: 0.25, 0.43, 0.25
13:50:24 "vmstat -z UMA Slabs" may be leaking, size 919
13:50:44 "vmstat -z UMA RCntSlabs" may be leaking, size 800
13:50:44 "vmstat -z mbuf_cluster" may be leaking, size 1536
13:52:32 "vmstat -z TURNSTILE" may be leaking, size 400
13:52:32 "vmstat -z THREAD" may be leaking, size 318
13:52:32 "vmstat -z SLEEPQUEUE" may be leaking, size 400
13:52:32 "vmstat -z ksiginfo" may be leaking, size 270
Wed Sep 19 15:54:22 CEST 2007 3:54PM  up 22 mins, 2 users, load averages: 0.57, 0.63, 0.42
Wed Sep 19 16:04:22 CEST 2007 4:04PM  up 32 mins, 2 users, load averages: 0.02, 0.35, 0.41
14:04:32 "vmstat -z UMA Slabs" may be leaking, size 932
14:04:33 "vmstat -z TURNSTILE" may be leaking, size 435
14:04:33 "vmstat -z THREAD" may be leaking, size 348
14:04:33 "vmstat -z SLEEPQUEUE" may be leaking, size 435
14:04:33 "vmstat -z ksiginfo" may be leaking, size 300
14:09:05 "vmstat -z UMA RCntSlabs" may be leaking, size 864
14:09:05 "vmstat -z mbuf_cluster" may be leaking, size 1664
Wed Sep 19 16:14:22 CEST 2007 4:14PM  up 42 mins, 2 users, load averages: 0.55, 0.85, 0.65
14:23:37 "vmstat -z UMA Slabs" may be leaking, size 982
Wed Sep 19 16:24:22 CEST 2007 4:24PM  up 52 mins, 2 users, load averages: 0.49, 0.67, 0.64
14:31:42 "vmstat -z UMA RCntSlabs" may be leaking, size 928
14:31:42 "vmstat -z mbuf_cluster" may be leaking, size 1792
Wed Sep 19 16:34:22 CEST 2007 4:34PM  up  1:02, 2 users, load averages: 0.90, 0.86, 0.77
14:35:29 "vmstat -z UMA Slabs" may be leaking, size 998
14:37:49 "vmstat -z UMA Slabs" may be leaking, size 1018
14:42:10 "vmstat -z Files" may be leaking, size 139
14:42:10 "vmstat -z PROC" may be leaking, size 104
14:42:10 "vmstat -z VMSPACE" may be leaking, size 56
Wed Sep 19 16:44:22 CEST 2007 4:44PM  up  1:12, 2 users, load averages: 0.91, 0.77, 0.77
14:46:23 "vmstat -z NAMEI" may be leaking, size 20
14:52:24 "vmstat -z UMA Slabs" may be leaking, size 1035
Wed Sep 19 16:54:22 CEST 2007 4:54PM  up  1:22, 2 users, load averages: 1.37, 0.84, 0.76
14:58:20 "vmstat -z UMA RCntSlabs" may be leaking, size 992
14:58:20 "vmstat -z mbuf_cluster" may be leaking, size 1920
Wed Sep 19 17:04:22 CEST 2007 5:04PM  up  1:32, 2 users, load averages: 1.93, 0.95, 0.79
Wed Sep 19 17:14:22 CEST 2007 5:14PM  up  1:42, 2 users, load averages: 0.09, 0.49, 0.66
Wed Sep 19 17:24:22 CEST 2007 5:24PM  up  1:52, 2 users, load averages: 0.07, 0.36, 0.51
panic: kmem_malloc(94208): kmem_map too small: 335368192 total allocated
cpuid = 3
KDB: enter: panic
[thread pid 63084 tid 100258 ]
Stopped at      kdb_enter+0x32: leave
db> where
Tracing pid 63084 tid 100258 td 0xc71c4cc0
kdb_enter(c0a9c7be,3,c0abe053,e95db99c,3,...) at kdb_enter+0x32
panic(c0abe053,17000,13fd5000,e95db9dc,c1474088,...) at panic+0x124
kmem_malloc(c147108c,17000,102,e95dba2c,c09538d0,...) at kmem_malloc+0x215
page_alloc(0,17000,e95dba1f,102,2abd455,...) at page_alloc+0x27
uma_large_malloc(17000,102,c0a9b54e,2,52,...) at uma_large_malloc+0x50
malloc(16e81,c0b4d360,102,b35,c1474708,...) at malloc+0x108
sysctl_vm_zone_stats(c0b69ee0,0,0,e95dbba4,e95dbba4,...) at sysctl_vm_zone_stats+0xd0
sysctl_root(e95dbba4,0,c0a9d2de,574,c71c4cc0,...) at sysctl_root+0x137
userland_sysctl(c71c4cc0,e95dbc14,2,28202000,bfbfe41c,...) at userland_sysctl+0x115
__sysctl(c71c4cc0,e95dbcfc,18,c0aa26cf,c0b49f10,...) at __sysctl+0xbc
syscall(e95dbd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (202, FreeBSD ELF32, __sysctl), eip = 0x2816a40b, esp = 0xbfbfe2ec, ebp = 0xbfbfe318 ---
db> set $lines 0
db> show allpcpu
Current CPU: 3

cpuid        = 0
curthread    = 0xc6ee9660: pid 63087 "awk"
curpcb       = 0xe94ded90
fpcurthread  = none
idlethread   = 0xc677eaa0: pid 18 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
spin locks held:

cpuid        = 1
curthread    = 0xc677e880: pid 17 "idle: cpu1"
curpcb       = 0xe53d5d90
fpcurthread  = none
idlethread   = 0xc677e880: pid 17 "idle: cpu1"
APIC ID      = 1
currentldt   = 0x50
spin locks held:

cpuid        = 2
curthread    = 0xc677e660: pid 16 "idle: cpu2"
curpcb       = 0xe53d2d90
fpcurthread  = none
idlethread   = 0xc677e660: pid 16 "idle: cpu2"
APIC ID      = 2
currentldt   = 0x50
spin locks held:

cpuid        = 3
curthread    = 0xc71c4cc0: pid 63084 "vmstat"
curpcb       = 0xe95dbd90
fpcurthread  = 0xc71c4cc0: pid 63084 "vmstat"
idlethread   = 0xc677e000: pid 15 "idle: cpu3"
APIC ID      = 3
currentldt   = 0x50
spin locks held:

cpuid        = 4
curthread    = 0xc677ccc0: pid 14 "idle: cpu4"
curpcb       = 0xe53c6d90
fpcurthread  = none
idlethread   = 0xc677ccc0: pid 14 "idle: cpu4"
APIC ID      = 4
currentldt   = 0x50
spin locks held:

cpuid        = 5
curthread    = 0xc677caa0: pid 13 "idle: cpu5"
curpcb       = 0xe53c3d90
fpcurthread  = none
idlethread   = 0xc677caa0: pid 13 "idle: cpu5"
APIC ID      = 5
currentldt   = 0x50
spin locks held:

cpuid        = 6
curthread    = 0xc677c880: pid 12 "idle: cpu6"
curpcb       = 0xe53c0d90
fpcurthread  = none
idlethread   = 0xc677c880: pid 12 "idle: cpu6"
APIC ID      = 6
currentldt   = 0x50
spin locks held:

cpuid        = 7
curthread    = 0xc677c660: pid 11 "idle: cpu7"
curpcb       = 0xe53bdd90
fpcurthread  = none
idlethread   = 0xc677c660: pid 11 "idle: cpu7"
APIC ID      = 7
currentldt   = 0x50
spin locks held:

db> show alllocks
Process 63084 (vmstat) thread 0xc71c4cc0 (100258)
exclusive sx sysctl lock r = 0 (0xc0bb2114) locked @ kern/kern_sysctl.c:1396
exclusive sleep mutex Giant r = 0 (0xc0bb1b70) locked @ kern/kern_sysctl.c:1334
Process 768 (sshd) thread 0xc6ee6880 (100163)
exclusive sx so_rcv_sx r = 0 (0xc6f3e9d4) locked @ kern/uipc_sockbuf.c:145
db> show lockedvnods
Locked vnodes
db> ps
  pid  ppid  pgrp   uid   state   wmesg     wchan    cmd
63087   690   689  1001  R+      CPU 0               awk
63086   690   689  1001  S+      piperd   0xc71f3dec sed
63085   690   689  1001  S+      piperd   0xc6d5c000 sed
63084   690   689  1001  R+      CPU 3               vmstat
63083  1226 63083  1001  S+      nanslp   0xc0bb22a4 sleep
59681   728   728  1001  S+      nanslp   0xc0bb22a4 sleep
 1941     1  1941     0  Ss      nanslp   0xc0bb22a4 watchdogd
 1226   790  1226  1001  S+      wait     0xc6ee4aa0 sh
  790   789   790  1001  Ss+     pause    0xc6ee8308 tcsh
  789   768   768  1001  S       select   0xc0c0385c sshd
  768   610   768     0  Ss      sbwait   0xc6f3ea04 sshd
  728   685   728  1001  S+      wait     0xc6f97d48 sh
  691   689   689  1001  S+      piperd   0xc6de718c awk
  690   689   689  1001  S+      wait     0xc6d99d48 sh
  689   685   689  1001  S+      wait     0xc6f977f8 sh
  685   672   685  1001  S+      pause    0xc6f92858 tcsh
  672     1   672     0  Ss+     wait     0xc6cbe000 login
  671     1   671     0  Ss+     ttyin    0xc68fbc10 getty
  670     1   670     0  Ss+     ttyin    0xc690e010 getty
  669     1   669     0  Ss+     ttyin    0xc690e410 getty
  668     1   668     0  Ss+     ttyin    0xc690e810 getty
  667     1   667     0  Ss+     ttyin    0xc690ec10 getty
  666     1   666     0  Ss+     ttyin    0xc690f010 getty
  665     1   665     0  Ss+     ttyin    0xc690f410 getty
  664     1   664     0  Ss+     ttyin    0xc690f810 getty
  626     1   626     0  Ss      nanslp   0xc0bb22a4 cron
  620     1   620    25  Ss      pause    0xc6f5fb00 sendmail
  616     1   616     0  Ss      select   0xc0c0385c sendmail
  610     1   610     0  Ss      select   0xc0c0385c sshd
  558   553   553     0  S       nfslockd 0xc0c09e48 rpc.lockd
  553     1   553     0  Ss      select   0xc0c0385c rpc.lockd
  548     1   548     0  Ss      select   0xc0c0385c rpc.statd
  518     0     0     0  SL      mdwait   0xc6e6a000 [md1]
  498     1   498     0  Ss      select   0xc0c0385c rpcbind
  476     1   476     0  Ss      select   0xc0c0385c syslogd
  430     1   430     0  Ss      select   0xc0c0385c devd
  114     0     0     0  SL      mdwait   0xc6de4800 [md0]
   47     0     0     0  SL      sdflush  0xc0c0f5e4 [softdepflush]
   46     0     0     0  SL      syncer   0xc0bb20cc [syncer]
   45     0     0     0  SL      vlruwt   0xc68acaa0 [vnlru]
   44     0     0     0  SL      psleep   0xc0c03d04 [bufdaemon]
   43     0     0     0  SL      pgzero   0xc0c10098 [pagezero]
   42     0     0     0  SL      psleep   0xc0c0fdb4 [vmdaemon]
   41     0     0     0  SL      psleep   0xc0c0fd7c [pagedaemon]
   40     0     0     0  SL      waiting_ 0xc0c05a6c [sctp_iterator]
   39     0     0     0  WL                          [swi0: sio]
   38     0     0     0  WL                          [irq1: atkbd0]
   37     0     0     0  WL                          [irq15: ata1]
   36     0     0     0  WL                          [irq14: ata0]
   35     0     0     0  SL      usbevt   0xc687a210 [usb3]
   34     0     0     0  SL      usbevt   0xc68cc210 [usb2]
   33     0     0     0  WL                          [irq18: uhci2]
   32     0     0     0  SL      usbevt   0xc68bc210 [usb1]
   31     0     0     0  WL                          [irq19: uhci1+]
   30     0     0     0  SL      usbtsk   0xc0baf9d4 [usbtask-dr]
   29     0     0     0  SL      usbtsk   0xc0baf9c0 [usbtask-hc]
   28     0     0     0  SL      usbevt   0xc689b210 [usb0]
   27     0     0     0  WL                          [irq17: uhci0 ehci0]
    9     0     0     0  SL      -        0xc6884980 [em1 taskq]
    8     0     0     0  SL      -        0xc6884500 [em0 taskq]
   26     0     0     0  WL                          [swi6: Giant taskq]
    7     0     0     0  SL      -        0xc6884100 [thread taskq]
   25     0     0     0  WL                          [swi5: +]
   24     0     0     0  WL                          [swi2: cambio]
    6     0     0     0  SL      ccb_scan 0xc0b80bd4 [xpt_thrd]
    5     0     0     0  SL      -        0xc67ca800 [kqueue taskq]
   23     0     0     0  WL                          [swi6: task queue]
   22     0     0     0  SL      -        0xc0bb20d4 [yarrow]
    4     0     0     0  SL      -        0xc0bb014c [g_down]
    3     0     0     0  SL      -        0xc0bb0148 [g_up]
    2     0     0     0  SL      -        0xc0bb0140 [g_event]
   21     0     0     0  WL                          [swi1: net]
   20     0     0     0  WL                          [swi3: vm]
   19     0     0     0  RL                          [swi4: clock sio]
   18     0     0     0  RL                          [idle: cpu0]
   17     0     0     0  RL      CPU 1               [idle: cpu1]
   16     0     0     0  RL      CPU 2               [idle: cpu2]
   15     0     0     0  RL                          [idle: cpu3]
   14     0     0     0  RL      CPU 4               [idle: cpu4]
   13     0     0     0  RL      CPU 5               [idle: cpu5]
   12     0     0     0  RL      CPU 6               [idle: cpu6]
   11     0     0     0  RL      CPU 7               [idle: cpu7]
    1     0     1     0  SLs     wait     0xc677bd48 [init]
   10     0     0     0  SL      audit_wo 0xc0c0f054 [audit]
    0     0     0     0  WLs                         [swapper]
db> allt

Tracing command awk pid 63087 tid 100157 td 0xc6ee9660
cpustop_handler(1,e94deb50,c0a0493d,0,80000000,...) at cpustop_handler+0x32
ipi_nmi_handler(0,80000000,1234de,0,c6f1b2a8,...) at ipi_nmi_handler+0x2f
trap(e94deb5c) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc0742238, esp = 0xe94deb9c, ebp = 0xe94debb8 ---
_mtx_lock_sleep(c0bb1b70,c6ee9660,0,c0a9d2de,536,...) at _mtx_lock_sleep+0x108
_mtx_lock_flags(c0bb1b70,0,c0a9d2de,536,c0c03760,...) at _mtx_lock_flags+0xef
__sysctl(c6ee9660,e94decfc,18,e94ded38,c0b49f10,...) at __sysctl+0x73
syscall(e94ded38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (202, FreeBSD ELF32, __sysctl), eip = 0x2818740b, esp = 0xbfbfeaac, ebp = 0xbfbfeae8 ---

Tracing command sed pid 63086 tid 100089 td 0xc6d97000
sched_switch(c6d97000,0,1,180,3185fd64,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d97000,0,c0aa01c7,19b,c71f3dec,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,4c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c71f3dec,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c71f3dec,c71f3f5c,14c,c0aa1ef8,0,...) at _sleep+0x359
pipe_read(c705c438,e9399c60,c6f99300,0,c6d97000,...) at pipe_read+0x3f6
dofileread(e9399c60,ffffffff,ffffffff,0,c705c438,...) at dofileread+0x96
kern_readv(c6d97000,0,e9399c60,2820a000,1000,...) at kern_readv+0x58
read(c6d97000,e9399cfc,c,c0aa2205,c0b48c68,...) at read+0x4f
syscall(e9399d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x2815b083, esp = 0xbfbfea4c, ebp = 0xbfbfea68 ---

Tracing command sed pid 63085 tid 100155 td 0xc6ee9aa0
sched_switch(c6ee9aa0,0,1,180,318ced26,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee9aa0,0,c0aa01c7,19b,c6d5c000,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba200,1,c0a9b54e,4c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6d5c000,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6d5c000,c6d5c170,14c,c0aa1ef8,0,...) at _sleep+0x359
pipe_read(c6f0b318,e94e4c60,c6f99300,0,c6ee9aa0,...) at pipe_read+0x3f6
dofileread(e94e4c60,ffffffff,ffffffff,0,c6f0b318,...) at dofileread+0x96
kern_readv(c6ee9aa0,0,e94e4c60,28206000,1000,...) at kern_readv+0x58
read(c6ee9aa0,e94e4cfc,c,c0aa2205,c0b48c68,...) at read+0x4f
syscall(e94e4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x2815b083, esp = 0xbfbfea7c, ebp = 0xbfbfea98 ---

Tracing command vmstat pid 63084 tid 100258 td 0xc71c4cc0
kdb_enter(c0a9c7be,3,c0abe053,e95db99c,3,...) at kdb_enter+0x32
panic(c0abe053,17000,13fd5000,e95db9dc,c1474088,...) at panic+0x124
kmem_malloc(c147108c,17000,102,e95dba2c,c09538d0,...) at kmem_malloc+0x215
page_alloc(0,17000,e95dba1f,102,2abd455,...) at page_alloc+0x27
uma_large_malloc(17000,102,c0a9b54e,2,52,...) at uma_large_malloc+0x50
malloc(16e81,c0b4d360,102,b35,c1474708,...) at malloc+0x108
sysctl_vm_zone_stats(c0b69ee0,0,0,e95dbba4,e95dbba4,...) at sysctl_vm_zone_stats+0xd0
sysctl_root(e95dbba4,0,c0a9d2de,574,c71c4cc0,...) at sysctl_root+0x137
userland_sysctl(c71c4cc0,e95dbc14,2,28202000,bfbfe41c,...) at userland_sysctl+0x115
__sysctl(c71c4cc0,e95dbcfc,18,c0aa26cf,c0b49f10,...) at __sysctl+0xbc
syscall(e95dbd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (202, FreeBSD ELF32, __sysctl), eip = 0x2816a40b, esp = 0xbfbfe2ec, ebp = 0xbfbfe318 ---

Tracing command sleep pid 63083 tid 100329 td 0xcc5e5000
sched_switch(cc5e5000,0,1,180,1b0494b8,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(cc5e5000,0,c0aa01c7,19b,c0bb22a4,...) at sleepq_switch+0xf0
sleepq_catch_signals(e98f7bc4,c0741bfd,c0bba180,1,5c,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0bb22a4,0,c0a9d11d,da,0,...) at sleepq_timedwait_sig+0x17
_sleep(c0bb22a4,0,15c,c0a9d8e1,ea61,...) at _sleep+0x331
kern_nanosleep(cc5e5000,e98f7c64,e98f7c6c,3c,0,...) at kern_nanosleep+0xc1
nanosleep(cc5e5000,e98f7cfc,8,e98f7d38,c0b4a2a0,...) at nanosleep+0x6f
syscall(e98f7d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813826f, esp = 0xbfbfec2c, ebp = 0xbfbfec68 ---

Tracing command sleep pid 59681 tid 100129 td 0xc6ec1aa0
sched_switch(c6ec1aa0,0,1,180,f06a949b,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ec1aa0,0,c0aa01c7,19b,c0bb22a4,...) at sleepq_switch+0xf0
sleepq_catch_signals(e946abc4,c0741bfd,c0bba180,1,5c,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0bb22a4,0,c0a9d11d,da,0,...) at sleepq_timedwait_sig+0x17
_sleep(c0bb22a4,0,15c,c0a9d8e1,927c1,...) at _sleep+0x331
kern_nanosleep(c6ec1aa0,e946ac64,e946ac6c,258,0,...) at kern_nanosleep+0xc1
nanosleep(c6ec1aa0,e946acfc,8,e946ad38,c0b4a2a0,...) at nanosleep+0x6f
syscall(e946ad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813826f, esp = 0xbfbfecbc, ebp = 0xbfbfecf8 ---

Tracing command watchdogd pid 1941 tid 100088 td 0xc6d97220
sched_switch(c6d97220,0,1,180,c0b0e871,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6d97220,0,c0aa01c7,19b,c0bb22a4,...) at sleepq_switch+0xf0
sleepq_catch_signals(e939cbc4,c0741bfd,c0bba180,1,5c,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0bb22a4,0,c0a9d11d,da,0,...) at sleepq_timedwait_sig+0x17
_sleep(c0bb22a4,0,15c,c0a9d8e1,ea61,...) at _sleep+0x331
kern_nanosleep(c6d97220,e939cc64,e939cc6c,3c,0,...) at kern_nanosleep+0xc1
nanosleep(c6d97220,e939ccfc,8,c0ace499,c0b4a2a0,...) at nanosleep+0x6f
syscall(e939cd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815c26f, esp = 0xbfbfeb3c, ebp = 0xbfbfeb68 ---

Tracing command sh pid 1226 tid 100136 td 0xc6ee5cc0
sched_switch(c6ee5cc0,0,1,180,1aaa0926,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee5cc0,0,c0aa01c7,19b,c6ee4aa0,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6ee4aa0,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6ee4aa0,c6ee4b30,15c,c0aa22d6,0,...) at _sleep+0x359
kern_wait(c6ee5cc0,ffffffff,e94bdc2c,2,0,...) at kern_wait+0xa66
wait4(c6ee5cc0,e94bdcfc,10,c0aa22b5,c0b48cc8,...) at wait4+0x3b
syscall(e94bdd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfe96c, ebp = 0xbfbfe988 ---

Tracing command tcsh pid 790 tid 100145 td 0xc6ec7880
sched_switch(c6ec7880,0,1,180,c370c1aa,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ec7880,0,c0aa01c7,19b,c6ee8308,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba100,1,c0a9b54e,68,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6ee8308,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6ee8308,c6ee8338,168,c0a5fb7b,0,...) at _sleep+0x359
kern_sigsuspend(c6ec7880,0,0,0,0,...) at kern_sigsuspend+0xe4
sigsuspend(c6ec7880,e9491cfc,4,c0aa21b0,c0b4ac18,...) at sigsuspend+0x4d
syscall(e9491d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28163e27, esp = 0xbfbfe7fc, ebp = 0xbfbfe868 ---

Tracing command sshd pid 789 tid 100166 td 0xc6f1eaa0
sched_switch(c6f1eaa0,0,1,180,a2cda466,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f1eaa0,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f9a,c0c03844,0,c0a9b54e,c6f1eaa0,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0385c,c0c03844,c0ab9add,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0385c,c0c03844,c0aa1d3f,30f,c0ab316e,...) at _cv_wait_sig+0x1fc
kern_select(c6f1eaa0,9,285030d4,285030d8,0,0,0,280dfd08) at kern_select+0x6cc
select(c6f1eaa0,e9523cfc,14,c0a8d5c1,c0b494d8,...) at select+0x5e
syscall(e9523d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x283e6003, esp = 0xbfbfe5fc, ebp = 0xbfbfe648 ---

Tracing command sshd pid 768 tid 100163 td 0xc6ee6880
sched_switch(c6ee6880,0,1,180,20a2bae9,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee6880,0,c0aa01c7,19b,c6f3ea04,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,58,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6f3ea04,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6f3ea04,c6f3e9bc,158,c0aa4f48,0) at _sleep+0x359
sbwait(c6f3e998,1,c0aa505d,5ae,c6f3e9bc,...) at sbwait+0x76
soreceive_generic(c6f3e948,0,e94ccc60,0,0,...) at soreceive_generic+0x42f
soreceive(c6f3e948,0,e94ccc60,0,0,...) at soreceive+0x4d
soo_read(c6cc6af8,e94ccc60,c6d9c700,0,c6ee6880,...) at soo_read+0x3b
dofileread(e94ccc60,ffffffff,ffffffff,0,c6cc6af8,...) at dofileread+0x96
kern_readv(c6ee6880,5,e94ccc60,bfbfe64c,4,...) at kern_readv+0x58
read(c6ee6880,e94cccfc,c,c0ab7262,c0b48c68,...) at read+0x4f
syscall(e94ccd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x283e6083, esp = 0xbfbfe5fc, ebp = 0xbfbfe628 ---

Tracing command sh pid 728 tid 100191 td 0xc6f93aa0
sched_switch(c6f93aa0,0,1,180,efcccbfb,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f93aa0,0,c0aa01c7,19b,c6f97d48,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6f97d48,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6f97d48,c6f97dd8,15c,c0aa22d6,0,...) at _sleep+0x359
kern_wait(c6f93aa0,ffffffff,e955ac2c,2,0,...) at kern_wait+0xa66
wait4(c6f93aa0,e955acfc,10,c0aa22b5,c0b48cc8,...) at wait4+0x3b
syscall(e955ad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfe9dc, ebp = 0xbfbfe9f8 ---

Tracing command awk pid 691 tid 100100 td 0xc6ce2660
sched_switch(c6ce2660,0,1,180,bf4b91d8,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce2660,0,c0aa01c7,19b,c6de718c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,4c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6de718c,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6de718c,c6de72fc,14c,c0aa1ef8,0,...) at _sleep+0x359
pipe_read(c6cda240,e9367c60,c6f99300,0,c6ce2660,...) at pipe_read+0x3f6
dofileread(e9367c60,ffffffff,ffffffff,0,c6cda240,...) at dofileread+0x96
kern_readv(c6ce2660,0,e9367c60,2822e000,1000,...) at kern_readv+0x58
read(c6ce2660,e9367cfc,c,16,c0b48c68,...) at read+0x4f
syscall(e9367d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28187083, esp = 0xbfbfe8ec, ebp = 0xbfbfe908 ---

Tracing command sh pid 690 tid 100101 td 0xc6ce2440
sched_switch(c6ce2440,0,1,180,304c9fff,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce2440,0,c0aa01c7,19b,c6d99d48,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba300,1,c0a9b54e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6d99d48,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6d99d48,c6d99dd8,15c,c0aa22d6,0,...) at _sleep+0x359
kern_wait(c6ce2440,ffffffff,e9364c2c,2,0,...) at kern_wait+0xa66
wait4(c6ce2440,e9364cfc,10,c0aa22b5,c0b48cc8,...) at wait4+0x3b
syscall(e9364d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfea0c, ebp = 0xbfbfea28 ---

Tracing command sh pid 689 tid 100189 td 0xc6f95000
sched_switch(c6f95000,0,1,180,a6c14864,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f95000,0,c0aa01c7,19b,c6f977f8,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba200,1,c0a9b54e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6f977f8,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6f977f8,c6f97888,15c,c0aa22d6,0,...) at _sleep+0x359
kern_wait(c6f95000,ffffffff,e9560c2c,2,0,...) at kern_wait+0xa66
wait4(c6f95000,e9560cfc,10,e9560d38,c0b48cc8,...) at wait4+0x3b
syscall(e9560d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814681b, esp = 0xbfbfeb8c, ebp = 0xbfbfeba8 ---

Tracing command tcsh pid 685 tid 100183 td 0xc6f95cc0
sched_switch(c6f95cc0,0,1,180,40320bc0,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f95cc0,0,c0aa01c7,19b,c6f92858,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba100,1,c0a9b54e,68,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6f92858,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6f92858,c6f92888,168,c0a5fb7b,0,...) at _sleep+0x359
kern_sigsuspend(c6f95cc0,0,0,0,0,...) at kern_sigsuspend+0xe4
sigsuspend(c6f95cc0,e9572cfc,4,c0aa21b0,c0b4ac18,...) at sigsuspend+0x4d
syscall(e9572d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28163e27, esp = 0xbfbfe86c, ebp = 0xbfbfe8d8 ---

Tracing command login pid 672 tid 100060 td 0xc6cc2cc0
sched_switch(c6cc2cc0,0,1,180,987758be,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2cc0,0,c0aa01c7,19b,c6cbe000,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6cbe000,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6cbe000,c6cbe090,15c,c0aa22d6,0,...) at _sleep+0x359
kern_wait(c6cc2cc0,2ad,e9320c2c,0,0,...) at kern_wait+0xa66
wait4(c6cc2cc0,e9320cfc,10,e9320d38,c0b48cc8,...) at wait4+0x3b
syscall(e9320d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2810381b, esp = 0xbfbfed9c, ebp = 0xbfbfedb8 ---

Tracing command getty pid 671 tid 100061 td 0xc6cc2aa0
sched_switch(c6cc2aa0,0,1,180,39cb0b28,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2aa0,0,c0aa01c7,19b,c68fbc10,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba400,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c68fbc10,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c68fbc10,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c68fbc00,c68fbc10,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c68fbc00,e931dc60,0,e931db9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c000,e931dc60,0,e931dbb8,c071da18,...) at ttyread+0x39
scread(c690c000,e931dc60,0,168,0,...) at scread+0x2d
giant_read(c690c000,e931dc60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6dd5cf0,e931dc60,c6786400,0,c6cc2aa0,...) at devfs_read_f+0x71
dofileread(e931dc60,ffffffff,ffffffff,0,c6dd5cf0,...) at dofileread+0x96
kern_readv(c6cc2aa0,0,e931dc60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cc2aa0,e931dcfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e931dd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 670 tid 100062 td 0xc6cc2880
sched_switch(c6cc2880,0,1,180,39822dd3,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2880,0,c0aa01c7,19b,c690e010,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba280,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690e010,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690e010,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690e000,c690e010,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690e000,e931ac60,0,e931ab9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c100,e931ac60,0,e931abb8,c071da18,...) at ttyread+0x39
scread(c690c100,e931ac60,0,168,0,...) at scread+0x2d
giant_read(c690c100,e931ac60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6f442d0,e931ac60,c6786400,0,c6cc2880,...) at devfs_read_f+0x71
dofileread(e931ac60,ffffffff,ffffffff,0,c6f442d0,...) at dofileread+0x96
kern_readv(c6cc2880,0,e931ac60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cc2880,e931acfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e931ad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 669 tid 100063 td 0xc6cc2660
sched_switch(c6cc2660,0,1,180,39a5b4c4,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2660,0,c0aa01c7,19b,c690e410,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba380,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690e410,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690e410,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690e400,c690e410,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690e400,e9317c60,0,e9317b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c200,e9317c60,0,e9317bb8,c071da18,...) at ttyread+0x39
scread(c690c200,e9317c60,0,168,0,...) at scread+0x2d
giant_read(c690c200,e9317c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6ebfdc8,e9317c60,c6786400,0,c6cc2660,...) at devfs_read_f+0x71
dofileread(e9317c60,ffffffff,ffffffff,0,c6ebfdc8,...) at dofileread+0x96
kern_readv(c6cc2660,0,e9317c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cc2660,e9317cfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e9317d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 668 tid 100064 td 0xc6cc2440
sched_switch(c6cc2440,0,1,180,38eb789d,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2440,0,c0aa01c7,19b,c690e810,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba200,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690e810,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690e810,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690e800,c690e810,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690e800,e9314c60,0,e9314b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c300,e9314c60,0,e9314bb8,c071da18,...) at ttyread+0x39
scread(c690c300,e9314c60,0,168,0,...) at scread+0x2d
giant_read(c690c300,e9314c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6cdaaf8,e9314c60,c6786400,0,c6cc2440,...) at devfs_read_f+0x71
dofileread(e9314c60,ffffffff,ffffffff,0,c6cdaaf8,...) at dofileread+0x96
kern_readv(c6cc2440,0,e9314c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cc2440,e9314cfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e9314d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 667 tid 100065 td 0xc6cc2220
sched_switch(c6cc2220,0,1,180,371aa1ed,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2220,0,c0aa01c7,19b,c690ec10,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba280,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690ec10,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690ec10,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690ec00,c690ec10,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690ec00,e9311c60,0,e9311b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c400,e9311c60,0,e9311bb8,c071da18,...) at ttyread+0x39
scread(c690c400,e9311c60,0,168,0,...) at scread+0x2d
giant_read(c690c400,e9311c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6fa0510,e9311c60,c6786400,0,c6cc2220,...) at devfs_read_f+0x71
dofileread(e9311c60,ffffffff,ffffffff,0,c6fa0510,...) at dofileread+0x96
kern_readv(c6cc2220,0,e9311c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cc2220,e9311cfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e9311d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 666 tid 100066 td 0xc6cc2000
sched_switch(c6cc2000,0,1,180,38f90f7a,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cc2000,0,c0aa01c7,19b,c690f010,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba180,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690f010,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690f010,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690f000,c690f010,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690f000,e930ec60,0,e930eb9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c500,e930ec60,0,e930ebb8,c071da18,...) at ttyread+0x39
scread(c690c500,e930ec60,0,168,0,...) at scread+0x2d
giant_read(c690c500,e930ec60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6cdaa68,e930ec60,c6786400,0,c6cc2000,...) at devfs_read_f+0x71
dofileread(e930ec60,ffffffff,ffffffff,0,c6cdaa68,...) at dofileread+0x96
kern_readv(c6cc2000,0,e930ec60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cc2000,e930ecfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e930ed38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 665 tid 100067 td 0xc6cbfcc0
sched_switch(c6cbfcc0,0,1,180,38e12020,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cbfcc0,0,c0aa01c7,19b,c690f410,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba480,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690f410,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690f410,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690f400,c690f410,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690f400,e930bc60,0,e930bb9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c600,e930bc60,0,e930bbb8,c071da18,...) at ttyread+0x39
scread(c690c600,e930bc60,0,168,0,...) at scread+0x2d
giant_read(c690c600,e930bc60,0,0,1,...) at giant_read+0x48
devfs_read_f(c705c900,e930bc60,c6786400,0,c6cbfcc0,...) at devfs_read_f+0x71
dofileread(e930bc60,ffffffff,ffffffff,0,c705c900,...) at dofileread+0x96
kern_readv(c6cbfcc0,0,e930bc60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cbfcc0,e930bcfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e930bd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command getty pid 664 tid 100068 td 0xc6cbfaa0
sched_switch(c6cbfaa0,0,1,180,399ea5ac,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cbfaa0,0,c0aa01c7,19b,c690f810,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba300,1,c0a9b54e,59,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c690f810,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c690f810,0,159,c0aa3b34,0,...) at _sleep+0x359
ttysleep(c690f800,c690f810,159,c0aa3b34,0,...) at ttysleep+0x39
ttread(c690f800,e9308c60,0,e9308b9c,c0678d3d,...) at ttread+0x4e7
ttyread(c690c700,e9308c60,0,e9308bb8,c071da18,...) at ttyread+0x39
scread(c690c700,e9308c60,0,168,0,...) at scread+0x2d
giant_read(c690c700,e9308c60,0,0,1,...) at giant_read+0x48
devfs_read_f(c6fa03a8,e9308c60,c6786400,0,c6cbfaa0,...) at devfs_read_f+0x71
dofileread(e9308c60,ffffffff,ffffffff,0,c6fa03a8,...) at dofileread+0x96
kern_readv(c6cbfaa0,0,e9308c60,bfbfee4b,1,...) at kern_readv+0x58
read(c6cbfaa0,e9308cfc,c,c0ace499,c0b48c68,...) at read+0x4f
syscall(e9308d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28166083, esp = 0xbfbfee1c, ebp = 0xbfbfee58 ---

Tracing command cron pid 626 tid 100168 td 0xc6f1e660
sched_switch(c6f1e660,0,1,180,cf2e1408,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f1e660,0,c0aa01c7,19b,c0bb22a4,...) at sleepq_switch+0xf0
sleepq_catch_signals(e951dbc4,c0741bfd,c0bba200,1,5c,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0bb22a4,0,c0a9d11d,da,0,...) at sleepq_timedwait_sig+0x17
_sleep(c0bb22a4,0,15c,c0a9d8e1,ea61,...) at _sleep+0x331
kern_nanosleep(c6f1e660,e951dc64,e951dc6c,3c,0,...) at kern_nanosleep+0xc1
nanosleep(c6f1e660,e951dcfc,8,c0aa241a,c0b4a2a0,...) at nanosleep+0x6f
syscall(e951dd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815326f, esp = 0xbfbfed0c, ebp = 0xbfbfed38 ---

Tracing command sendmail pid 620 tid 100178 td 0xc6f1d000
sched_switch(c6f1d000,0,1,180,170d0547,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f1d000,0,c0aa01c7,19b,c6f5fb00,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba100,1,c0a9b54e,68,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c6f5fb00,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c6f5fb00,c6f5fb30,168,c0a5fb7b,0,...) at _sleep+0x359
kern_sigsuspend(c6f1d000,0,0,0,0,...) at kern_sigsuspend+0xe4
sigsuspend(c6f1d000,e94ffcfc,4,c0aa21b0,c0b4ac18,...) at sigsuspend+0x4d
syscall(e94ffd38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28309e27, esp = 0xbfbfdb1c, ebp = 0xbfbfdb48 ---

Tracing command sendmail pid 616 tid 100176 td 0xc6f1d440
sched_switch(c6f1d440,0,1,180,ebc5756e,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6f1d440,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e9505a84,c0741f9a,c0c03844,0,c6f1d440,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0385c,1389,c0ab9add,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0385c,c0c03844,1389,30f,c073f17d,...) at _cv_timedwait_sig+0x20b
kern_select(c6f1d440,4,bfbfd12c,0,0,e9505c70,5,0) at kern_select+0x6b4
select(c6f1d440,e9505cfc,14,c0aa26cf,c0b494d8,...) at select+0x5e
syscall(e9505d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x2839e003, esp = 0xbfbfd09c, ebp = 0xbfbfdb38 ---

Tracing command sshd pid 610 tid 100164 td 0xc6ee6660
sched_switch(c6ee6660,0,1,180,1ef4d7f2,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee6660,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f9a,c0c03844,0,c0a9b54e,c6ee6660,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0385c,c0c03844,c0ab9add,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0385c,c0c03844,c0aa1d3f,30f,e94c9afc,...) at _cv_wait_sig+0x1fc
kern_select(c6ee6660,7,2850b0bc,0,0,0,c,e94c9c98) at kern_select+0x6cc
select(c6ee6660,e94c9cfc,14,e94c9d38,c0b494d8,...) at select+0x5e
syscall(e94c9d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x283e6003, esp = 0xbfbfe6cc, ebp = 0xbfbfee98 ---

Tracing command rpc.lockd pid 558 tid 100072 td 0xc6ce2000
sched_switch(c6ce2000,0,1,180,5d8c4970,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce2000,0,c0aa01c7,19b,c0c09e48,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba200,1,c0a9b54e,58,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c09e48,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c0c09e48,c0c09e2c,158,c0ab72e3,0,...) at _sleep+0x359
nfslock_read(c67fe700,e935ec60,4,0,194,...) at nfslock_read+0x7c
devfs_read_f(c6f0bc18,e935ec60,c6f07400,0,c6ce2000,...) at devfs_read_f+0x71
dofileread(e935ec60,ffffffff,ffffffff,0,c6f0bc18,...) at dofileread+0x96
kern_readv(c6ce2000,8,e935ec60,bfbfec48,194,...) at kern_readv+0x58
read(c6ce2000,e935ecfc,c,c0ab7262,c0b48c68,...) at read+0x4f
syscall(e935ed38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28173083, esp = 0xbfbfebfc, ebp = 0xbfbfede8 ---

Tracing command rpc.lockd pid 553 tid 100159 td 0xc6ee9220
sched_switch(c6ee9220,0,1,180,6dc0cf35,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee9220,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e94d8a84,c0741f9a,c0c03844,0,c6ee9220,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0385c,7531,c0ab9add,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0385c,c0c03844,7531,30f,c6ee9220,...) at _cv_timedwait_sig+0x20b
kern_select(c6ee9220,7,bfbfed5c,0,0,e94d8c70,1e,0) at kern_select+0x6b4
select(c6ee9220,e94d8cfc,14,c0aa241a,c0b494d8,...) at select+0x5e
syscall(e94d8d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28173003, esp = 0xbfbfecac, ebp = 0xbfbfede8 ---

Tracing command rpc.statd pid 548 tid 100156 td 0xc6ee9880
sched_switch(c6ee9880,0,1,180,2f5be5f7,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee9880,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e94e1a84,c0741f9a,c0c03844,0,c6ee9880,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0385c,7531,c0ab9add,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0385c,c0c03844,7531,30f,c6ee9880,...) at _cv_timedwait_sig+0x20b
kern_select(c6ee9880,a,bfbfed6c,0,0,e94e1c70,1e,0) at kern_select+0x6b4
select(c6ee9880,e94e1cfc,14,c0aa241a,c0b494d8,...) at select+0x5e
syscall(e94e1d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x2815f003, esp = 0xbfbfecbc, ebp = 0xbfbfedf8 ---

Tracing command md1 pid 518 tid 100151 td 0xc6eeb440
sched_switch(c6eeb440,0,1,180,f9779751,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c6eeb440,...) at mi_switch+0x217
sleepq_switch(c6eeb440,0,c0aa01c7,21d,4c,...) at sleepq_switch+0xf0
sleepq_wait(c6e6a000,c6e6a020,c0a7aaa4,0,0,...) at sleepq_wait+0x60
_sleep(c6e6a000,c6e6a020,24c,c0a7aaa4,0,...) at _sleep+0x369
md_kthread(c6e6a000,e94f0d38,c0a991af,313,c6f1a2a8,...) at md_kthread+0x125
fork_exit(c05e1880,c6e6a000,e94f0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe94f0d70, ebp = 0 ---

Tracing command rpcbind pid 498 tid 100074 td 0xc6ce1aa0
sched_switch(c6ce1aa0,0,1,180,6e725340,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ce1aa0,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(e9358ad8,c0741f9a,c0c03844,0,c6ce1aa0,...) at sleepq_catch_signals+0x21e
sleepq_timedwait_sig(c0c0385c,7531,c0ab9add,101,0,...) at sleepq_timedwait_sig+0x17
_cv_timedwait_sig(c0c0385c,c0c03844,7531,3bb,c0c037d0,...) at _cv_timedwait_sig+0x20b
poll(c6ce1aa0,e9358cfc,c,c0aa241a,c0b49fb8,...) at poll+0x554
syscall(e9358d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (209, FreeBSD ELF32, poll), eip = 0x2811be5b, esp = 0xbfbfcc7c, ebp = 0xbfbfee48 ---

Tracing command syslogd pid 476 tid 100084 td 0xc6cdc440
sched_switch(c6cdc440,0,1,180,f9f3e9d4,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6cdc440,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f9a,c0c03844,0,c0a9b54e,c6cdc440,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0385c,c0c03844,c0ab9add,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0385c,c0c03844,c0aa1d3f,30f,0,...) at _cv_wait_sig+0x1fc
kern_select(c6cdc440,9,282200bc,0,0,0,539ca,2817a938) at kern_select+0x6cc
select(c6cdc440,e933acfc,14,c0aa22c5,c0b494d8,...) at select+0x5e
syscall(e933ad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28169003, esp = 0xbfbfdf3c, ebp = 0xbfbfee88 ---

Tracing command devd pid 430 tid 100139 td 0xc6ee5660
sched_switch(c6ee5660,0,1,180,8fa5b5de,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6ee5660,0,c0aa01c7,19b,c0c0385c,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741f9a,c0c03844,0,c0a9b54e,c6ee5660,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c0c0385c,c0c03844,c0ab9add,101,0,...) at sleepq_wait_sig+0x14
_cv_wait_sig(c0c0385c,c0c03844,c0aa1d3f,30f,e94b4afc,...) at _cv_wait_sig+0x1fc
kern_select(c6ee5660,5,bfbfedf8,0,0,0,0,0) at kern_select+0x6cc
select(c6ee5660,e94b4cfc,14,c0aa261d,c0b494d8,...) at select+0x5e
syscall(e94b4d38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x8081daf, esp = 0xbfbfe9bc, ebp = 0xbfbfee98 ---

Tracing command md0 pid 114 tid 100080 td 0xc6cdccc0
sched_switch(c6cdccc0,0,1,180,9fed3cc6,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c6cdccc0,...) at mi_switch+0x217
sleepq_switch(c6cdccc0,0,c0aa01c7,21d,4c,...) at sleepq_switch+0xf0
sleepq_wait(c6de4800,c6de4820,c0a7aaa4,0,0,...) at sleepq_wait+0x60
_sleep(c6de4800,c6de4820,24c,c0a7aaa4,0,...) at _sleep+0x369
md_kthread(c6de4800,e9346d38,c0a991af,313,c6ce5550,...) at md_kthread+0x125
fork_exit(c05e1880,c6de4800,e9346d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe9346d70, ebp = 0 ---

Tracing command softdepflush pid 47 tid 100055 td 0xc6b01220
sched_switch(c6b01220,0,1,180,1697c577,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,44,...) at mi_switch+0x217
sleepq_switch(c6b01220,0,c0aa01c7,240,44,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c0f5e4,3e8,c0abb6cb,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c0f5e4,c0c0f5bc,44,c0abb6cb,3e8,...) at _sleep+0x345
softdep_flush(0,e70fbd38,c0a991af,313,c6b022a8,...) at softdep_flush+0x2d2
fork_exit(c0933820,0,e70fbd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe70fbd70, ebp = 0 ---

Tracing command syncer pid 46 tid 100056 td 0xc6b01000
sched_switch(c6b01000,0,1,180,e1f99102,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c6b01000,...) at mi_switch+0x217
sleepq_switch(c6b01000,0,c0aa01c7,21d,68,...) at sleepq_switch+0xf0
sleepq_wait(c0bb20cc,0,c0aa87a2,0,0,...) at sleepq_wait+0x60
_sleep(c0bb20cc,c0c03fe4,68,c0aa87a2,0,...) at _sleep+0x369
sched_sync(0,e70f8d38,c0a991af,313,c6b02550,...) at sched_sync+0x56e
fork_exit(c07cbf90,0,e70f8d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe70f8d70, ebp = 0 ---

Tracing command vnlru pid 45 tid 100034 td 0xc68a8440
sched_switch(c68a8440,0,1,180,16d2c0a1,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,50,...) at mi_switch+0x217
sleepq_switch(c68a8440,0,c0aa01c7,240,50,...) at sleepq_switch+0xf0
sleepq_timedwait(c68acaa0,3e8,c0aa884c,0,0,...) at sleepq_timedwait+0x68
_sleep(c68acaa0,c0c03fb8,250,c0aa884c,3e8,...) at _sleep+0x345
vnlru_proc(0,e6e56d38,c0a991af,313,c68acaa0,...) at vnlru_proc+0x114
fork_exit(c07ccd60,0,e6e56d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e56d70, ebp = 0 ---

Tracing command bufdaemon pid 44 tid 100035 td 0xc68a8220
sched_switch(c68a8220,0,1,180,12cf8700,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,44,...) at mi_switch+0x217
sleepq_switch(c68a8220,0,c0aa01c7,240,44,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c03d04,3e8,c0aa642c,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c03d04,c0c03d08,44,c0aa642c,3e8,...) at _sleep+0x345
buf_daemon(0,e6e53d38,c0a991af,313,c68acd48,...) at buf_daemon+0x21e
fork_exit(c07b7540,0,e6e53d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e53d70, ebp = 0 ---

Tracing command pagezero pid 43 tid 100036 td 0xc68a8000
sched_switch(c68a8000,0,1,180,4a8bd6b3,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c68a8000,0,c0aa01c7,240,0,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c10098,493e0,c0abffbe,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c10098,c0c0fd40,0,c0abffbe,493e0,...) at _sleep+0x345
vm_pagezero(0,e6e50d38,c0a991af,313,c68db000,...) at vm_pagezero+0xdc
fork_exit(c096ce30,0,e6e50d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e50d70, ebp = 0 ---

Tracing command vmdaemon pid 42 tid 100037 td 0xc6790cc0
sched_switch(c6790cc0,0,1,180,49bd007a,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c6790cc0,...) at mi_switch+0x217
sleepq_switch(c6790cc0,0,c0aa01c7,21d,68,...) at sleepq_switch+0xf0
sleepq_wait(c0c0fdb4,0,c0a9d11d,da,0,...) at sleepq_wait+0x60
_sleep(c0c0fdb4,c0c0fdb8,68,c0aa642c,0,...) at _sleep+0x369
vm_daemon(0,e5427d38,c0a991af,313,c68db2a8,...) at vm_daemon+0x59
fork_exit(c09684b0,0,e5427d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5427d70, ebp = 0 ---

Tracing command pagedaemon pid 41 tid 100038 td 0xc68dd000
sched_switch(c68dd000,0,1,180,349d39b3,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,44,...) at mi_switch+0x217
sleepq_switch(c68dd000,0,c0aa01c7,240,44,...) at sleepq_switch+0xf0
sleepq_timedwait(c0c0fd7c,1388,c0aa642c,0,0,...) at sleepq_timedwait+0x68
_sleep(c0c0fd7c,c0c0fd40,44,c0aa642c,1388,...) at _sleep+0x345
vm_pageout(0,e6ec2d38,c0a991af,313,c68db550,...) at vm_pageout+0x2bb
fork_exit(c0969070,0,e6ec2d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ec2d70, ebp = 0 ---

Tracing command sctp_iterator pid 40 tid 100039 td 0xc68dccc0
sched_switch(c68dccc0,0,1,180,471a7a5e,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c68dccc0,...) at mi_switch+0x217
sleepq_switch(c68dccc0,0,c0aa01c7,21d,0,...) at sleepq_switch+0xf0
sleepq_wait(c0c05a6c,c0c05974,c0aaf18d,0,0,...) at sleepq_wait+0x60
_sleep(c0c05a6c,c0c05974,0,c0aaf18d,0,...) at _sleep+0x369
sctp_iterator_thread(0,e70f5d38,c0a991af,313,c68db7f8,...) at sctp_iterator_thread+0x60
fork_exit(c0831dd0,0,e70f5d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe70f5d70, ebp = 0 ---

Tracing command swi0: sio pid 39 tid 100040 td 0xc68dcaa0
sched_switch(c68dcaa0,0,1,180,f8e4165c,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c6938b64,...) at mi_switch+0x217
ithread_loop(c690d110,e6ebcd38,c0a991af,313,c68dbaa0,...) at ithread_loop+0x34c
fork_exit(c0732250,c690d110,e6ebcd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ebcd70, ebp = 0 ---

Tracing command irq1: atkbd0 pid 38 tid 100041 td 0xc68dc880
fork_trampoline() at fork_trampoline

Tracing command irq15: ata1 pid 37 tid 100042 td 0xc68dc660
fork_trampoline() at fork_trampoline

Tracing command irq14: ata0 pid 36 tid 100043 td 0xc68dc440
sched_switch(c68dc440,0,1,180,1c7fb968,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c67ca464,...) at mi_switch+0x217
ithread_loop(c68ec340,e6eb3d38,c0a991af,313,c68df2a8,...) at ithread_loop+0x34c
fork_exit(c0732250,c68ec340,e6eb3d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6eb3d70, ebp = 0 ---

Tracing command usb3 pid 35 tid 100044 td 0xc68dc220
sched_switch(c68dc220,0,1,180,e659630,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c68dc220,0,c0aa01c7,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c687a210,ea60,c0a9113c,0,0,...) at sleepq_timedwait+0x68
_sleep(c687a210,0,5c,c0a9113c,ea60,...) at _sleep+0x345
usb_event_thread(c68d5640,e6eb0d38,c0a991af,313,c68df550,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68d5640,e6eb0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6eb0d70, ebp = 0 ---

Tracing command usb2 pid 34 tid 100024 td 0xc6780aa0
sched_switch(c6780aa0,0,1,180,e823ab7,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c6780aa0,0,c0aa01c7,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c68cc210,ea60,c0a9113c,0,0,...) at sleepq_timedwait+0x68
_sleep(c68cc210,0,5c,c0a9113c,ea60,...) at _sleep+0x345
usb_event_thread(c68a6940,e53edd38,c0a991af,313,c68a7000,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68a6940,e53edd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53edd70, ebp = 0 ---

Tracing command irq18: uhci2 pid 33 tid 100025 td 0xc6780880
fork_trampoline() at fork_trampoline

Tracing command usb1 pid 32 tid 100026 td 0xc6780660
sched_switch(c6780660,0,1,180,e828732,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c6780660,0,c0aa01c7,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c68bc210,ea60,c0a9113c,0,0,...) at sleepq_timedwait+0x68
_sleep(c68bc210,0,5c,c0a9113c,ea60,...) at _sleep+0x345
usb_event_thread(c68b7300,e53e7d38,c0a991af,313,c68a7550,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68b7300,e53e7d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53e7d70, ebp = 0 ---

Tracing command irq19: uhci1+ pid 31 tid 100027 td 0xc68a9440
sched_switch(c68a9440,0,1,180,f97ffc89,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c67ca1e4,...) at mi_switch+0x217
ithread_loop(c68c4010,e6e6bd38,c0a991af,313,c68a77f8,...) at ithread_loop+0x34c
fork_exit(c0732250,c68c4010,e6e6bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e6bd70, ebp = 0 ---

Tracing command usbtask-dr pid 30 tid 100028 td 0xc68a9220
sched_switch(c68a9220,0,1,180,9b6a9e0,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c68a9220,...) at mi_switch+0x217
sleepq_switch(c68a9220,0,c0aa01c7,21d,5c,...) at sleepq_switch+0xf0
sleepq_wait(c0baf9d4,0,c0a9d11d,da,0,...) at sleepq_wait+0x60
_sleep(c0baf9d4,0,5c,c0a91179,0,...) at _sleep+0x369
usb_task_thread(c0baf9d4,e6e68d38,c0a991af,313,c68a7aa0,...) at usb_task_thread+0x62
fork_exit(c06cabb0,c0baf9d4,e6e68d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e68d70, ebp = 0 ---

Tracing command usbtask-hc pid 29 tid 100029 td 0xc68a9000
sched_switch(c68a9000,0,1,180,9b690f7,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c68a9000,...) at mi_switch+0x217
sleepq_switch(c68a9000,0,c0aa01c7,21d,5c,...) at sleepq_switch+0xf0
sleepq_wait(c0baf9c0,0,c0a9d11d,da,0,...) at sleepq_wait+0x60
_sleep(c0baf9c0,0,5c,c0a91179,0,...) at _sleep+0x369
usb_task_thread(c0baf9c0,e6e65d38,c0a991af,313,c68a7d48,...) at usb_task_thread+0x62
fork_exit(c06cabb0,c0baf9c0,e6e65d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e65d70, ebp = 0 ---

Tracing command usb0 pid 28 tid 100030 td 0xc68a8cc0
sched_switch(c68a8cc0,0,1,180,e827550,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,5c,...) at mi_switch+0x217
sleepq_switch(c68a8cc0,0,c0aa01c7,240,5c,...) at sleepq_switch+0xf0
sleepq_timedwait(c689b210,ea60,c0a9113c,0,0,...) at sleepq_timedwait+0x68
_sleep(c689b210,0,5c,c0a9113c,ea60,...) at _sleep+0x345
usb_event_thread(c68b7d00,e6e62d38,c0a991af,313,c68ac000,...) at usb_event_thread+0xca
fork_exit(c06ca430,c68b7d00,e6e62d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e62d70, ebp = 0 ---

Tracing command irq17: uhci0 ehci0 pid 27 tid 100031 td 0xc68a8aa0
fork_trampoline() at fork_trampoline

Tracing command em1 taskq pid 9 tid 100032 td 0xc68a8880
sched_switch(c68a8880,0,1,180,7773a6e,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c68a8880,...) at mi_switch+0x217
sleepq_switch(c68a8880,0,c0aa01c7,21d,c68a8880,...) at sleepq_switch+0xf0
sleepq_wait(c6884980,0,c0a9d175,c0a941aa,0,...) at sleepq_wait+0x60
msleep_spin(c6884980,c688499c,c0a941aa,0,c0a9b54e,...) at msleep_spin+0x20d
taskqueue_thread_loop(c687daec,e6e5cd38,c0a991af,313,c68ac550,...) at taskqueue_thread_loop+0x8a
fork_exit(c077fba0,c687daec,e6e5cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e5cd70, ebp = 0 ---

Tracing command em0 taskq pid 8 tid 100033 td 0xc68a8660
sched_switch(c68a8660,0,1,180,317fd680,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c68a8660,...) at mi_switch+0x217
sleepq_switch(c68a8660,0,c0aa01c7,21d,c68a8660,...) at sleepq_switch+0xf0
sleepq_wait(c6884500,0,c0a9d175,c0a941aa,0,...) at sleepq_wait+0x60
msleep_spin(c6884500,c688451c,c0a941aa,0,c0a9b54e,...) at msleep_spin+0x20d
taskqueue_thread_loop(c687d2ec,e6e59d38,c0a991af,313,c68ac7f8,...) at taskqueue_thread_loop+0x8a
fork_exit(c077fba0,c687d2ec,e6e59d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6e59d70, ebp = 0 ---

Tracing command swi6: Giant taskq pid 26 tid 100015 td 0xc677e440
sched_switch(c677e440,0,1,180,249fe0cd,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c6884064,...) at mi_switch+0x217
ithread_loop(c68781d0,e53cfd38,c0a991af,313,c678f7f8,...) at ithread_loop+0x34c
fork_exit(c0732250,c68781d0,e53cfd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53cfd70, ebp = 0 ---

Tracing command thread taskq pid 7 tid 100016 td 0xc677e220
sched_switch(c677e220,0,1,180,3013c3e8,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c677e220,...) at mi_switch+0x217
sleepq_switch(c677e220,0,c0aa01c7,21d,0,...) at sleepq_switch+0xf0
sleepq_wait(c6884100,c688411c,c0a941aa,0,0,...) at sleepq_wait+0x60
_sleep(c6884100,c688411c,0,c0a941aa,0,...) at _sleep+0x369
taskqueue_thread_loop(c0bbc278,e53ccd38,c0a991af,313,c678faa0,...) at taskqueue_thread_loop+0xb4
fork_exit(c077fba0,c0bbc278,e53ccd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53ccd70, ebp = 0 ---

Tracing command swi5: + pid 25 tid 100017 td 0xc6790aa0
sched_switch(c6790aa0,0,1,180,92182033,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c67ca564,...) at mi_switch+0x217
ithread_loop(c68781f0,e5424d38,c0a991af,313,c678fd48,...) at ithread_loop+0x34c
fork_exit(c0732250,c68781f0,e5424d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5424d70, ebp = 0 ---

Tracing command swi2: cambio pid 24 tid 100018 td 0xc6790880
fork_trampoline() at fork_trampoline

Tracing command xpt_thrd pid 6 tid 100019 td 0xc6790660
sched_switch(c6790660,0,1,180,9b65347,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c6790660,...) at mi_switch+0x217
sleepq_switch(c6790660,0,c0aa01c7,21d,4c,...) at sleepq_switch+0xf0
sleepq_wait(c0b80bd4,0,c0a9d11d,da,0,...) at sleepq_wait+0x60
_sleep(c0b80bd4,c0b80bec,4c,c0a53702,0,...) at _sleep+0x369
xpt_scanner_thread(0,e541ed38,c0a991af,313,c67d42a8,...) at xpt_scanner_thread+0x41
fork_exit(c0468350,0,e541ed38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe541ed70, ebp = 0 ---

Tracing command kqueue taskq pid 5 tid 100020 td 0xc6790440
sched_switch(c6790440,0,1,180,9b726f9,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c6790440,...) at mi_switch+0x217
sleepq_switch(c6790440,0,c0aa01c7,21d,0,...) at sleepq_switch+0xf0
sleepq_wait(c67ca800,c67ca81c,c0a941aa,0,0,...) at sleepq_wait+0x60
_sleep(c67ca800,c67ca81c,0,c0a941aa,0,...) at _sleep+0x369
taskqueue_thread_loop(c0bb094c,e541bd38,c0a991af,313,c67d4550,...) at taskqueue_thread_loop+0xb4
fork_exit(c077fba0,c0bb094c,e541bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe541bd70, ebp = 0 ---

Tracing command swi6: task queue pid 23 tid 100021 td 0xc6790220
sched_switch(c6790220,0,1,180,73e05f46,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c67ca8e4,...) at mi_switch+0x217
ithread_loop(c6878290,e5418d38,c0a991af,313,c67d47f8,...) at ithread_loop+0x34c
fork_exit(c0732250,c6878290,e5418d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5418d70, ebp = 0 ---

Tracing command yarrow pid 22 tid 100022 td 0xc6790000
sched_switch(c6790000,0,1,180,28d6c34a,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c6790000,0,c0aa01c7,240,0,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb20d4,64,c0a941aa,2,0,...) at sleepq_timedwait+0x68
_sleep(c0bb20d4,0,0,c0a941aa,64,...) at _sleep+0x345
pause(c0a941aa,64,c0a88b9c,112,0,...) at pause+0x47
random_kthread(0,e5415d38,c0a991af,313,c67d4aa0,...) at random_kthread+0x1d9
fork_exit(c06554b0,0,e5415d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5415d70, ebp = 0 ---

Tracing command g_down pid 4 tid 100023 td 0xc6780cc0
sched_switch(c6780cc0,0,1,180,2fd9165f,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,4c,...) at mi_switch+0x217
sleepq_switch(c6780cc0,0,c0aa01c7,240,4c,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb014c,64,c0a941aa,0,0,...) at sleepq_timedwait+0x68
_sleep(c0bb014c,c0bb0068,24c,c0a941aa,64,...) at _sleep+0x345
g_io_schedule_down(c6780cc0,0,c0a9586d,74,0,...) at g_io_schedule_down+0x6b
g_down_procbody(0,e53f0d38,c0a991af,313,c67d4d48,...) at g_down_procbody+0x8d
fork_exit(c07016a0,0,e53f0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53f0d70, ebp = 0 ---

Tracing command g_up pid 3 tid 100007 td 0xc677c000
sched_switch(c677c000,0,1,180,2fd93b34,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,4c,...) at mi_switch+0x217
sleepq_switch(c677c000,0,c0aa01c7,240,4c,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb0148,64,c0a941aa,0,0,...) at sleepq_timedwait+0x68
_sleep(c0bb0148,c0bb00a8,24c,c0a941aa,64,...) at _sleep+0x345
g_io_schedule_up(c677c000,0,c0a9586d,5d,0,...) at g_io_schedule_up+0x133
g_up_procbody(0,e53b4d38,c0a991af,313,c677f2a8,...) at g_up_procbody+0x8d
fork_exit(c0701730,0,e53b4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53b4d70, ebp = 0 ---

Tracing command g_event pid 2 tid 100008 td 0xc6780440
sched_switch(c6780440,0,1,180,2e66ea3b,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,4c,...) at mi_switch+0x217
sleepq_switch(c6780440,0,c0aa01c7,240,4c,...) at sleepq_switch+0xf0
sleepq_timedwait(c0bb0140,64,c0a941aa,0,0,...) at sleepq_timedwait+0x68
_sleep(c0bb0140,0,4c,c0a941aa,64,...) at _sleep+0x345
g_event_procbody(0,e53e4d38,c0a991af,313,c677f550,...) at g_event_procbody+0xcb
fork_exit(c07017c0,0,e53e4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53e4d70, ebp = 0 ---

Tracing command swi1: net pid 21 tid 100009 td 0xc6780220
sched_switch(c6780220,0,1,180,206e56db,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c67c9164,...) at mi_switch+0x217
ithread_loop(c677a230,e53e1d38,c0a991af,313,c677f7f8,...) at ithread_loop+0x34c
fork_exit(c0732250,c677a230,e53e1d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53e1d70, ebp = 0 ---

Tracing command swi3: vm pid 20 tid 100010 td 0xc6780000
fork_trampoline() at fork_trampoline

Tracing command swi4: clock sio pid 19 tid 100011 td 0xc677ecc0
sched_switch(c677ecc0,0,1,180,30d96652,...) at sched_switch+0x491
mi_switch(1,0,c0a99433,46b,c67c9264,...) at mi_switch+0x217
ithread_loop(c677a250,e53dbd38,c0a991af,313,c677fd48,...) at ithread_loop+0x34c
fork_exit(c0732250,c677a250,e53dbd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53dbd70, ebp = 0 ---

Tracing command idle: cpu0 pid 18 tid 100012 td 0xc677eaa0
sched_switch(c677eaa0,0,6,17b,317a1f41,...) at sched_switch+0x491
mi_switch(6,0,c0ac8baa,495,0,...) at mi_switch+0x217
ipi_bitmap_handler(c09e0008,28,6c0028,f,ff,...) at ipi_bitmap_handler+0x72
Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2e
--- interrupt, eip = 0x20, esp = 0xc09f5c48, ebp = 0xe53d8ca4 ---
uart_z8530_class(c09f3bd5,20,246,e53d8cc0,c09f5c48,...) at 0x20

Tracing command idle: cpu1 pid 17 tid 100013 td 0xc677e880
cpustop_handler(2,e53d5c6c,c0a0493d,c076a238,e53d5c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(c076a238,e53d5c1c,c076ac5d,c678f2a8,c678f2a8,...) at ipi_nmi_handler+0x2f
trap(e53d5c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3bd5, esp = 0xe53d5cb8, ebp = 0xe53d5cb8 ---
cpu_idle_default(e53d5cf8,c076b6f2,c0bba180,0,c0a9e2e4,...) at cpu_idle_default+0x5
cpu_idle(c0bba180,0,c0a9e2e4,2fc,c0bb4340,...) at cpu_idle+0x28
sched_idletd(0,e53d5d38,c0a991af,313,c678f2a8,...) at sched_idletd+0x1c2
fork_exit(c076b530,0,e53d5d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53d5d70, ebp = 0 ---

Tracing command idle: cpu2 pid 16 tid 100014 td 0xc677e660
cpustop_handler(4,e53d2ba8,c0a0493d,c677e660,e53d2b40,...) at cpustop_handler+0x32
ipi_nmi_handler(c677e660,e53d2b40,c0768ffa,c0bba200,c678f550,...) at ipi_nmi_handler+0x2f
trap(e53d2bb4) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09dc1bd, esp = 0xe53d2bf4, ebp = 0xe53d2c18 ---
siointr1(c0c1ca8c,0,c0ac4634,56f,e53d2c58,...) at siointr1+0x24d
siointr(c6934c00,0,0,c677e660,c6778e80,...) at siointr+0x32
intr_execute_handlers(c676ecd0,e53d2c78,e53d2cb8,c09eac64,38,...) at intr_execute_handlers+0xec
lapic_handle_intr(38,e53d2c78) at lapic_handle_intr+0x3f
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0xc09f3bd5, esp = 0xe53d2cb8, ebp = 0xe53d2cb8 ---
cpu_idle_default(e53d2cf8,c076b6f2,c0bba200,0,c0a9e2e4,...) at cpu_idle_default+0x5
cpu_idle(c0bba200,0,c0a9e2e4,2fc,c0bb4980,...) at cpu_idle+0x28
sched_idletd(0,e53d2d38,c0a991af,313,c678f550,...) at sched_idletd+0x1c2
fork_exit(c076b530,0,e53d2d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53d2d70, ebp = 0 ---

Tracing command idle: cpu3 pid 15 tid 100000 td 0xc677e000
sched_switch(c677e000,0,6,17b,317f6a54,...) at sched_switch+0x491
mi_switch(6,0,c0ac8baa,495,3,...) at mi_switch+0x217
ipi_bitmap_handler(c09e0008,c09e0028,6c0028,f,ff,...) at ipi_bitmap_handler+0x72
Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2e
--- interrupt, eip = 0x20, esp = 0xc09f5c48, ebp = 0xe53c9ca4 ---
uart_z8530_class(c09f3bd5,20,246,e53c9cc0,c09f5c48,...) at 0x20

Tracing command idle: cpu4 pid 14 tid 100001 td 0xc677ccc0
cpustop_handler(10,e53c6c6c,c0a0493d,e53c6bec,e53c6c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(e53c6bec,e53c6c1c,c076ac5d,c677b2a8,c677b2a8,...) at ipi_nmi_handler+0x2f
trap(e53c6c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3bd5, esp = 0xe53c6cb8, ebp = 0xe53c6cb8 ---
cpu_idle_default(e53c6cf8,c076b6f2,c0bba300,0,c0a9e2e4,...) at cpu_idle_default+0x5
cpu_idle(c0bba300,0,c0a9e2e4,2fc,c0bb5600,...) at cpu_idle+0x28
sched_idletd(0,e53c6d38,c0a991af,313,c677b2a8,...) at sched_idletd+0x1c2
fork_exit(c076b530,0,e53c6d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c6d70, ebp = 0 ---

Tracing command idle: cpu5 pid 13 tid 100002 td 0xc677caa0
cpustop_handler(20,e53c3c6c,c0a0493d,c076a238,e53c3c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(c076a238,e53c3c1c,c076ac5d,c677b550,c677b550,...) at ipi_nmi_handler+0x2f
trap(e53c3c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3bd5, esp = 0xe53c3cb8, ebp = 0xe53c3cb8 ---
cpu_idle_default(e53c3cf8,c076b6f2,c0bba380,0,c0a9e2e4,...) at cpu_idle_default+0x5
cpu_idle(c0bba380,0,c0a9e2e4,2fc,c0bb5c40,...) at cpu_idle+0x28
sched_idletd(0,e53c3d38,c0a991af,313,c677b550,...) at sched_idletd+0x1c2
fork_exit(c076b530,0,e53c3d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c3d70, ebp = 0 ---

Tracing command idle: cpu6 pid 12 tid 100003 td 0xc677c880
cpustop_handler(40,e53c0c6c,c0a0493d,e53c0bec,e53c0c1c,...) at cpustop_handler+0x32
ipi_nmi_handler(e53c0bec,e53c0c1c,c076ac5d,c677b7f8,c677b7f8,...) at ipi_nmi_handler+0x2f
trap(e53c0c78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3bd5, esp = 0xe53c0cb8, ebp = 0xe53c0cb8 ---
cpu_idle_default(e53c0cf8,c076b6f2,c0bba400,0,c0a9e2e4,...) at cpu_idle_default+0x5
cpu_idle(c0bba400,0,c0a9e2e4,2fc,c0bb6280,...) at cpu_idle+0x28
sched_idletd(0,e53c0d38,c0a991af,313,c677b7f8,...) at sched_idletd+0x1c2
fork_exit(c076b530,0,e53c0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53c0d70, ebp = 0 ---

Tracing command idle: cpu7 pid 11 tid 100004 td 0xc677c660
cpustop_handler(80,e53bdc6c,c0a0493d,c076a238,e53bdc1c,...) at cpustop_handler+0x32
ipi_nmi_handler(c076a238,e53bdc1c,c076ac5d,c677baa0,c677baa0,...) at ipi_nmi_handler+0x2f
trap(e53bdc78) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc09f3bd5, esp = 0xe53bdcb8, ebp = 0xe53bdcb8 ---
cpu_idle_default(e53bdcf8,c076b6f2,c0bba480,0,c0a9e2e4,...) at cpu_idle_default+0x5
cpu_idle(c0bba480,0,c0a9e2e4,2fc,c0bb68c0,...) at cpu_idle+0x28
sched_idletd(0,e53bdd38,c0a991af,313,c677baa0,...) at sched_idletd+0x1c2
fork_exit(c076b530,0,e53bdd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53bdd70, ebp = 0 ---

Tracing command init pid 1 tid 100005 td 0xc677c440
sched_switch(c677c440,0,1,180,586b353,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,0,...) at mi_switch+0x217
sleepq_switch(c677c440,0,c0aa01c7,19b,c677bd48,...) at sleepq_switch+0xf0
sleepq_catch_signals(c0741bfd,c0bba300,1,c0a9b54e,5c,...) at sleepq_catch_signals+0x21e
sleepq_wait_sig(c677bd48,0,c0a9d11d,da,0,...) at sleepq_wait_sig+0x14
_sleep(c677bd48,c677bdd8,15c,c0aa22d6,0,...) at _sleep+0x359
kern_wait(c677c440,ffffffff,e53bac2c,0,0,...) at kern_wait+0xa66
wait4(c677c440,e53bacfc,10,c0aa20f1,c0b48cc8,...) at wait4+0x3b
syscall(e53bad38) at syscall+0x2b3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054a1b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 ---

Tracing command audit pid 10 tid 100006 td 0xc677c220
sched_switch(c677c220,0,1,180,9b3d877,...) at sched_switch+0x491
mi_switch(1,0,c0aa01c7,1bf,c677c220,...) at mi_switch+0x217
sleepq_switch(c677c220,0,c0aa01c7,21d,c677c220,...) at sleepq_switch+0xf0
sleepq_wait(c0c0f054,c0c0f034,c0ab9213,1,0,...) at sleepq_wait+0x60
_cv_wait(c0c0f054,c0c0f034,c0ab9bb8,1c2,0,...) at _cv_wait+0x1fc
audit_worker(0,e53b7d38,c0a991af,313,c677f000,...) at audit_worker+0x99
fork_exit(c0919010,0,e53b7d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe53b7d70, ebp = 0 ---

Tracing command swapper pid 0 tid 0 td 0xc0bb04b0
sched_switch(c0bb04b0,0,1,180,51a69b09,...) at sched_switch+0x491
mi_switch(1,0,c0abdded,2d5,80000006,...) at mi_switch+0x217
scheduler(0,101ec00,101ec00,101e000,1028000,...) at scheduler+0x2c0
mi_startup() at mi_startup+0x96
begin() at begin+0x2c
db> call doadump
Physical memory: 3314 MB
Dumping 410 MB: 395 379 363 347 331 315 299 283 267 251 235 219 203 187 171 155 139 123 107 91 75 59 43 27 11
Dump complete
= 0xf
db> c
Uptime: 1h58m24s
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...

--
Test scenario: running the fclone.sh test once every minute.