GENERIC HEAD from Oct 18 + vm_page_cache_remove.patch, vmcore.2

GDB: no debug ports present
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.0-CURRENT #2: Thu Oct 25 04:41:11 UTC 2007
    test@orangutan.netperf.freebsd.org:/pho/src/sys/i386/compile/PHO
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) XEON(TM) CPU 2.20GHz (2192.90-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf24  Stepping = 4
  Features=0x3febfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM>
real memory  = 2147352576 (2047 MB)
avail memory = 2091339776 (1994 MB)
ACPI APIC Table: <DELL   PE2650  >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  6
ioapic0: Changing APIC ID to 8
ioapic1: Changing APIC ID to 9
ioapic2: Changing APIC ID to 10
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-15 on motherboard
:
Trying to mount root from nfs:
bNgFeS0 :R OlOiTn:k  1s9t2a.t1e6 8c.h5a.n1g:e/dz otoo/ oDrOaWnNgu
tan
bge0: link state changed to UP
Interface bge0 IP-Address 192.168.5.105 Broadcast 192.168.5.255
Loading configuration files.
No suitable dump device was found.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
mount_nfs: can't update /var/db/mounttab for 192.168.5.1:/zoo/orangutan
Setting hostuuid: 44454c4c-5800-1036-8038-c6c04f5a3131.
Setting hostid: 0xb59b50bc.
Mounting local file systems:.
Setting hostname: orangutan.netperf.freebsd.org.
net.inet6.ip6.auto_linklocal: 1 -> 0
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
        inet6 ::1 prefixlen 128
        inet 127.0.0.1 netmask 0xff000000
Additional routing options:.
Starting devd.
bge1: link state changed to UP
fxp0: link state changed to DOWN
hw.acpi.cpu.cx_lowest: C1
sysctl: hw.acpi.cpu.cx_lowest: Invalid argument
Additional IP options:.
Mounting NFS file systems:.
Creating and/or trimming log files:.
Starting syslogd.
/etc/rc: WARNING: Dump device does not exist.  Savecore not run.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout
Initial i386 initialization:.
Additional ABI support:.
Starting auditd.
Clearing /tmp (X related).
Starting rpcbind.
Starting mountd.
Starting nfsd.
Starting local daemons:.
Updating motd.
Mounting late file systems:.
Configuring syscons: blanktime.
Starting sshd.
sendmail_submit: /etc/mail/aliases newer than /etc/mail/aliases.db, regenerating
cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported
Alias file /etc/mail/aliases is locked (maybe being rebuilt)
Oct 27 09:11:21 orangutan sendmail[764]: NOQUEUE: SYSERR(root): cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported
sendmail_clientmqueue: /etc/mail/aliases newer than /etc/mail/aliases.db, regenerating
cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported
Alias file /etc/mail/aliases is locked (maybe being rebuilt)
Oct 27 09:11:21 orangutan sendmail[766]: NOQUEUE: SYSERR(root): cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported
Starting cron.
Local package initialization:.
Starting background file system checks in 60 seconds.

Sat Oct 27 09:11:22 UTC 2007

FreeBSD/i386 (orangutan.netperf.freebsd.org) (ttyd0)

login: Oct 27 09:12:19 orangutan sshd[824]: in openpam_dispatch(): pam_nologin.so: no pam_sm_authenticate()
Oct 27 09:12:20 orangutan sshd[825]: in openpam_dispatch(): pam_nologin.so: no pam_sm_setcred()
Oct 27 09:12:23 orangutan su: test to root on /dev/ttyp0
GEOM_LABEL: Label ufs/root removed.
GEOM_LABEL: Label for provider aacd0s1a is ufs/root.
GWARNING: /m2 was not properly dismounted
/m2: mount pendEOM_LABEL: Label ufs/root removed.
ing error: blocks 0 files 1
Oct 27 09:12:48 orangutan savecore: reboot after panic: vm_page_cache_transfer: object 0xc5c771f0's type is incompatible with cached pages
GEOM_LABEL: Label for provider aacd0s1a is ufs/root.
GEOM_LABEL: Label ufs/root removed.
GEOM_LABEL: Label for provider aacd0s1a is ufs/root.
GEOM_LABEL: Label ufs/root removed.
test
Password:Oct 27 09:36:46 orangutan login: in openpam_dispatch(): pam_nologin.so: no pam_sm_authenticate()

Last login: Sat Oct 27 09:12:21 from 192.168.5.1
Oct 27 09:36:49 orangutan login: in openpam_dispatch(): pam_nologin.so: no pam_sm_setcred()
./Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.

FreeBSD 8.0-CURRENT (PHO) #2: Thu Oct 25 04:41:11 UTC 2007

Welcome to FreeBSD!

Before seeking technical support, please use the following resources:

o  Security advisories and updated errata information for all releases are
   at http://www.FreeBSD.org/releases/ - always consult the ERRATA section
   for your release first as it's updated frequently.

o  The Handbook and FAQ documents are at http://www.FreeBSD.org/ and,
   along with the mailing lists, can be searched by going to
   http://www.FreeBSD.org/search/.  If the doc distribution has
   been installed, they're also available formatted in /usr/share/doc.

If you still have a question or problem, please take the output of
`uname -a', along with any relevant error messages, and email it
as a question to the questions@FreeBSD.org mailing list.  If you are
unfamiliar with FreeBSD's directory layout, please refer to the hier(7)
manual page.  If you are not familiar with manual pages, type `man man'.

You may also use sysinstall(8) to re-enter the installation and
configuration utility.  Edit /etc/motd to change this login announcement.

pho/kIf you are running xterm, the default TERM variable will be 'xterm'.  If you
set this environment variable to 'xterm-color' instead, a lot of programs will
use colors.  You can do this by

        TERM=xterm-color; export TERM

in Bourne-derived shells, and

        setenv TERM xterm-color

in csh-derived shells.
ee> ./pho/keepalive.sh
Sat Oct 27 11:37:12 CEST 2007 11:37AM  up 26 mins, 2 users, load averages: 13.57, 3.32, 1.20
Sat Oct 27 11:47:15 CEST 2007 11:47AM  up 36 mins, 2 users, load averages: 197.18, 983.02, 435.35
Limiting icmp unreach response from 24936 to 200 packets/sec
Limiting icmp unreach response from 7581 to 200 packets/sec
Limiting icmp unreach response from 443 to 200 packets/sec
:
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
Sat Oct 27 16:39:23 CEST 2007  4:39PM  up  5:28, 2 users, load averages: 39.08, 107.11, 137.25
panic: vm_page_cache_transfer: object 0xc755c3e0's type is incompatible with cached pages
cpuid = 0
KDB: enter: panic
[thread pid 23714 tid 101825 ]
Stopped at      kdb_enter+0x32: leave
db> where
Tracing pid 23714 tid 101825 td 0xc7762000
kdb_enter(c0a6c254,0,c0a8e9e2,f1d39b4c,0,...) at kdb_enter+0x32
panic(c0a8e9e2,c755c3e0,0,3ae,80000000,...) at panic+0x124
vm_page_cache_transfer(c6d447c0,0,0,c755c3e0,0,...) at vm_page_cache_transfer+0x1a5
vm_object_split(c742a50c,0,c0a8da5d,9c1,28086000,...) at vm_object_split+0x480
vmspace_fork(c7377570,1,c0a6afe4,ce,c6fb3d00,...) at vmspace_fork+0x304
vm_forkproc(c7762000,c5cda550,c5cdc630,14,0,...) at vm_forkproc+0xbc
fork1(c7762000,14,0,f1d39c78,c7762000,...) at fork1+0x10a4
fork(c7762000,f1d39cfc,c0a99df5,c0a71873,c0b18a30,...) at fork+0x29
syscall(f1d39d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe6ac, ebp = 0xbfbfe6d8 ---
db> show object 0xc755c3e0
Object 0xc755c3e0: type=0, size=0x5, res=4, ref=1, flags=0x2100
 sref=0, backing_object(0)=(0)+0x0
  memory:=(off=0x0,page=0x67c44000),(off=0x1,page=0x2032000),(off=0x2,page=0x15672000),(off=0x4,page=0x47b35000)
db> show object 0xc6d447c0
Object 0xc6d447c0: type=1, size=0x16, res=11, ref=2, flags=0x2104
 sref=0, backing_object(0)=(0)+0x0
  memory:=(off=0x5,page=0x51cf9000),(off=0x6,page=0x51cfb000),(off=0x7,page=0x4aa3a000),(off=0x8,page=0x41516000),(off=0x9,page=0x41517000),(off=0xa,page=0x29bd7000)
   ...(off=0xb,page=0x29792000),(off=0xc,page=0x29793000),(off=0xd,page=0xec12000),(off=0xe,page=0xec13000),(off=0xf,page=0x24368000)
db> set $lines 0
db> show allpcpu
Current CPU: 0

cpuid        = 0
curthread    = 0xc7762000: pid 23714 "sh"
curpcb       = 0xf1d39d90
fpcurthread  = none
idlethread   = 0xc50fb840: pid 12 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
spin locks held:

cpuid        = 1
curthread    = 0xc777d000: pid 23716 "sh"
curpcb       = 0xf1e86d90
fpcurthread  = none
idlethread   = 0xc50fb630: pid 11 "idle: cpu1"
APIC ID      = 6
currentldt   = 0x50
spin locks held:

db> show alllocks
Process 23721 (sh) thread 0xc736f840 (100214)
exclusive sx user map r = 0 (0xc7378cf4) locked @ vm/vm_map.c:3090
Process 23720 (sh) thread 0xc7353a50 (100179)
exclusive sx user map r = 0 (0xc5100c0c) locked @ vm/vm_map.c:3090
Process 23718 (sh) thread 0xc7373420 (100202)
exclusive sx user map r = 0 (0xc5cb9cf4) locked @ vm/vm_map.c:3090
Process 23716 (sh) thread 0xc777d000 (101849)
exclusive sleep mutex pmap r = 0 (0xc830a08c) locked @ i386/i386/pmap.c:2789
exclusive sleep mutex pmap r = 0 (0xc5c35174) locked @ i386/i386/pmap.c:2788
exclusive sleep mutex vm page queue mutex r = 0 (0xc0be85bc) locked @ i386/i386/pmap.c:2786
exclusive sx user map r = 0 (0xc830a044) locked @ vm/vm_map.c:2582
Process 23715 (sh) thread 0xc76fca50 (101856)
exclusive sleep mutex vm object (standard object) r = 0 (0xc68656c8) locked @ vm/vm_map.c:2497
exclusive sx user map r = 0 (0xc5a23c0c) locked @ vm/vm_map.c:2582
Process 23714 (sh) thread 0xc7762000 (101825)
exclusive sleep mutex vm page queue free mutex r = 0 (0xc0be85a4) locked @ vm/vm_page.c:942
exclusive sleep mutex vm object (standard object) r = 0 (0xc6d447c0) locked @ vm/vm_object.c:1299
exclusive sleep mutex vm object (standard object) r = 0 (0xc755c3e0) locked @ vm/vm_object.c:1298
exclusive sx user map r = 0 (0xc73775b4) locked @ vm/vm_map.c:2582
Process 23713 (sh) thread 0xc5781630 (100171)
exclusive sx user map r = 0 (0xc7377b24) locked @ vm/vm_map.c:3090
Process 23712 (sh) thread 0xc777d210 (101850)
exclusive sx user map r = 0 (0xc73773e4) locked @ vm/vm_map.c:3090
Process 23665 (swap) thread 0xc7353210 (100183)
exclusive sleep mutex vm object (standard object) r = 0 (0xc76b445c) locked @ vm/vm_fault.c:293
exclusive sx user map r = 0 (0xc5a2086c) locked @ vm/vm_map.c:3090
Process 23643 (swap) thread 0xc5cb6630 (100166)
exclusive sx user map r = 0 (0xc574ec0c) locked @ vm/vm_map.c:3090
Process 23619 (swap) thread 0xc5780c60 (100093)
exclusive sleep mutex vm object (standard object) r = 0 (0xc74ab6c8) locked @ vm/vm_fault.c:886
exclusive sx user map r = 0 (0xc51012fc) locked @ vm/vm_map.c:3090
Process 822 (sshd) thread 0xc5700c60 (100076)
exclusive sx so_rcv_sx r = 0 (0xc577b3a4) locked @ kern/uipc_sockbuf.c:145
db> ps
  pid  ppid  pgrp   uid   state   wmesg     wchan    cmd
23728 23714  2605  1001  N+                          sh
23727 23716  2501     0  N                           sh
23726 23715  2605  1001  N+                          sh
23725 23622  2605  1001  R+                          sh
23724 23630  2605  1001  R+                          sh
23723 23632  2605  1001  R+                          sh
23722 23634  2605  1001  R+                          sh
23721 23626  2605  1001  RL+                         sh
23720 23638  2605  1001  RL+                         sh
23719 23642  2605  1001  R+                          sh
23718 23624  2605  1001  RL+                         sh
23717 23640  2605  1001  R+                          sh
23716  2501  2501     0  RL      CPU 1               sh
23715 23644  2605  1001  RL+                         sh
23714 23628  2605  1001  RL+     CPU 0               sh
23713 23636  2605  1001  RL+                         sh
23712 23645  2605  1001  RL+                         sh
23711 23710  2605  1001  S+      flswai   0xc0bdc57c sysctl
23710 23646  2605  1001  S+      wait     0xc5eda7f8 sh
23665 23617  2605  1001  RL+                         swap
23664 23617  2605  1001  R+                          swap
23663 23617  2605  1001  R+                          swap
23662 23617  2605  1001  R+                          swap
23661 23617  2605  1001  RL+                         swap
23660 23617  2605  1001  R+                          swap
23659 23617  2605  1001  R+                          swap
23658 23617  2605  1001  R+                          swap
23657 23617  2605  1001  R+                          swap
23656 23617  2605  1001  R+                          swap
23655 23617  2605  1001  R+                          swap
23654 23617  2605  1001  R+                          swap
23653 23617  2605  1001  R+                          swap
23652 23617  2605  1001  R+                          swap
23651 23617  2605  1001  R+                          swap
23650 23617  2605  1001  R+                          swap
23649 23617  2605  1001  R+                          swap
23648 23617  2605  1001  R+                          swap
23647 23617  2605  1001  R+                          swap
23646 23618  2605  1001  S+      wait     0xc58e7000 sysctl
23645 23618  2605  1001  S+      wait     0xc739cd48 sysctl
23644 23618  2605  1001  S+      wait     0xc577e550 sysctl
23643 23617  2605  1001  RL+                         swap
23642 23618  2605  1001  S+      wait     0xc60cbd48 sysctl
23641 23617  2605  1001  R+                          swap
23640 23618  2605  1001  S+      wait     0xc5d20000 sysctl
23639 23617  2605  1001  R+                          swap
23638 23618  2605  1001  S+      wait     0xc7397d48 sysctl
23637 23617  2605  1001  R+                          swap
23636 23618  2605  1001  S+      wait     0xc5eda550 sysctl
23635 23617  2605  1001  R+                          swap
23634 23618  2605  1001  S+      wait     0xc5c99000 sysctl
23633 23617  2605  1001  R+                          swap
23632 23618  2605  1001  S+      wait     0xc5ce02a8 sysctl
23631 23617  2605  1001  R+                          swap
23630 23618  2605  1001  S+      wait     0xc58e7aa0 sysctl
23629 23617  2605  1001  RL+                         swap
23628 23618  2605  1001  S+      wait     0xc5cdaaa0 sysctl
23627 23617  2605  1001  RL+                         swap
23626 23618  2605  1001  S+      wait     0xc60bb000 sysctl
23625 23617  2605  1001  R+                          swap
23624 23618  2605  1001  S+      wait     0xc736aaa0 sysctl
23623 23617  2605  1001  R+                          swap
23622 23618  2605  1001  S+      wait     0xc60e0aa0 sysctl
23621 23617  2605  1001  R+                          swap
23620 23617  2605  1001  RL+                         swap
23619 23617  2605  1001  RL+                         swap
23618 23585  2605  1001  S+      wait     0xc58e77f8 sysctl
23617 23582  2605  1001  S+      wait     0xc7371d48 swap
23616 23611  2605  1001  S+      flswai   0xc0bdc57c rw
23615 23611  2605  1001  S+      flswai   0xc0bdc57c rw
23614 23611  2605  1001  S+      flswai   0xc0bdc57c rw
23613 23611  2605  1001  S+      flswai   0xc0bdc57c rw
23612 23611  2605  1001  R+                          rw
23611 23579  2605  1001  S+      wait     0xc589b7f8 rw
23610 23594  2605  1001  S+      getblk   0xd930e4a0 mkdir
23609 23594  2605  1001  S+      getblk   0xd930e4a0 mkdir
23608 23594  2605  1001  S+      flswai   0xc0bdc57c mkdir
23607 23594  2605  1001  S+      flswai   0xc0bdc57c mkdir
23606 23594  2605  1001  R+                          mkdir
23605 23594  2605  1001  S+      flswai   0xc0bdc57c mkdir
23604 23594  2605  1001  S+      flswai   0xc0bdc57c mkdir
23603 23594  2605  1001  S+      flswai   0xc0bdc57c mkdir
23602 23594  2605  1001  R+                          mkdir
23601 23594  2605  1001  S+      getblk   0xd930e4a0 mkdir
23600 23594  2605  1001  S+      flswai   0xc0bdc57c mkdir
23599 23594  2605  1001  S+      getblk   0xd930e4a0 mkdir
23598 23594  2605  1001  R+                          mkdir
23597 23594  2605  1001  S+      getblk   0xd930e4a0 mkdir
23596 23594  2605  1001  RL+                         mkdir
23595 23594  2605  1001  R+                          mkdir
23594 23575  2605  1001  S+      wait     0xc5252aa0 mkdir
23585 23257  2605  1001  S+      nanslp   0xc0b8f464 sysctl
23582 23257  2605  1001  S+      nanslp   0xc0b8f464 swap
23579 23257  2605  1001  S+      nanslp   0xc0b8f464 rw
23575 23257  2605  1001  S+      nanslp   0xc0b8f464 mkdir
23525     0     0     0  SL      -        0xc0be2480 [nfsiod 0]
23257 23256  2605  1001  R+                          run
23256 23255  2605  1001  S+      wait     0xc736a000 run
23255 23242  2605  1001  S+      wait     0xc7370d48 run
23242  2605  2605  1001  S+      wait     0xc56fed48 sh
23088  2682  2682  1001  S+      nanslp   0xc0b8f464 sleep
 2682  2678  2682  1001  S+      wait     0xc5cdf550 sh
 2678   821  2678  1001  S+      pause    0xc577e060 tcsh
 2605   826  2605  1001  S+      wait     0xc5782000 sh
 2501     1  2501     0  Ss      wait     0xc589fd48 watchdogd
  826   825   826  1001  Ss+     pause    0xc577fb00 tcsh
  825   822   822  1001  S       select   0xc0bdc09c sshd
  822   759   822     0  Ss      sbwait   0xc577b3d4 sshd
  821     1   821     0  Ss+     wait     0xc569b000 login
  820     1   820     0  Ss+     ttyin    0xc5300410 getty
  819     1   819     0  Ss+     ttyin    0xc530d410 getty
  818     1   818     0  Ss+     ttyin    0xc52ffc10 getty
  817     1   817     0  Ss+     ttyin    0xc5300810 getty
  816     1   816     0  Ss+     ttyin    0xc530c410 getty
  815     1   815     0  Ss+     ttyin    0xc530c010 getty
  814     1   814     0  Ss+     ttyin    0xc530d010 getty
  813     1   813     0  Ss+     ttyin    0xc530cc10 getty
  771     1   771     0  Ss      nanslp   0xc0b8f464 cron
  759     1   759     0  Ss      select   0xc0bdc09c sshd
  703   698   698     0  S       -        0xc5548400 nfsd
  702   698   698     0  S       -        0xc5523600 nfsd
  700   698   698     0  S       -        0xc5548600 nfsd
  699   698   698     0  S       -        0xc5548800 nfsd
  698     1   698     0  Ss      select   0xc0bdc09c nfsd
  696     1   696     0  Ss      select   0xc0bdc09c mountd
  675     1   675     0  Ss      select   0xc0bdc09c rpcbind
  630     0     0     0  SL      mdwait   0xc5738800 [md1]
  590     1   590     0  Ss      select   0xc0bdc09c syslogd
  546     1   546     0  Ss      select   0xc0bdc09c devd
  111     0     0     0  SL      mdwait   0xc551a000 [md0]
   43     0     0     0  SL      -        0xc0b8f294 [schedcpu]
   42     0     0     0  SL      flswai   0xc0bdc57c [softdepflush]
   41     0     0     0  SL      syncer   0xc0b8f28c [syncer]
   40     0     0     0  SL      vlruwt   0xc54db7f8 [vnlru]
   39     0     0     0  RL                          [bufdaemon]
   38     0     0     0  SL      pgzero   0xc0be8a00 [pagezero]
   37     0     0     0  SL      psleep   0xc0be8618 [vmdaemon]
   36     0     0     0  SL      psleep   0xc0be85e0 [pagedaemon]
   35     0     0     0  SL      waiting_ 0xc0bde2ac [sctp_iterator]
   34     0     0     0  WL                          [irq1: atkbd0]
   33     0     0     0  SL      -        0xc5204c3c [fdc0]
   32     0     0     0  WL                          [irq20: fxp0]
   31     0     0     0  WL                          [irq29: bge1]
   30     0     0     0  WL                          [irq28: bge0]
   29     0     0     0  SL      aifthd   0xc524fd48 [aac0aif]
   28     0     0     0  SL      usbtsk   0xc0b7fb34 [usbtask-dr]
   27     0     0     0  SL      usbtsk   0xc0b7fb20 [usbtask-hc]
   26     0     0     0  SL      usbevt   0xc5206210 [usb0]
   25     0     0     0  WL                          [irq15: ata1]
   24     0     0     0  WL                          [irq14: ata0]
   23     0     0     0  WL                          [swi0: uart sio]
   22     0     0     0  WL                          [irq9: ohci0 acpi0]
   21     0     0     0  SL      -        0xc5141d80 [kqueue taskq]
   20     0     0     0  WL                          [swi2: cambio]
    9     0     0     0  SL      ccb_scan 0xc0b50d14 [xpt_thrd]
   19     0     0     0  WL                          [swi6: task queue]
    8     0     0     0  SL      -        0xc514d180 [acpi_task_2]
    7     0     0     0  SL      -        0xc514d180 [acpi_task_1]
    6     0     0     0  SL      -        0xc514d180 [acpi_task_0]
   18     0     0     0  WL                          [swi6: Giant taskq]
    5     0     0     0  SL      -        0xc514d300 [thread taskq]
   17     0     0     0  WL                          [swi5: +]
   16     0     0     0  SL      -        0xc0b8f294 [yarrow]
    4     0     0     0  SL      -        0xc0b802ac [g_down]
    3     0     0     0  SL      -        0xc0b802a8 [g_up]
    2     0     0     0  SL      -        0xc0b802a0 [g_event]
   15     0     0     0  WL                          [swi1: net]
   14     0     0     0  WL                          [swi3: vm]
   13     0     0     0  RL                          [swi4: clock sio]
   12     0     0     0  RL                          [idle: cpu0]
   11     0     0     0  RL                          [idle: cpu1]
    1     0     1     0  SLs     wait     0xc50fad48 [init]
   10     0     0     0  SL      audit_wo 0xc0be78b4 [audit]
    0     0     0     0  WLs                         [swapper]
23588 23257  2605  1001  Z+                          initial thread
23577 23257  2605  1001  Z+                          mmap
23581 23257  2605  1001  Z+                          socket
23593 23257  2605  1001  Z+                          initial thread
23578 23257  2605  1001  Z+                          pty
23590 23257  2605  1001  Z+                          aio
23589 23257  2605  1001  Z+                          udp
23586 23257  2605  1001  Z+                          tcp
23591 23257  2605  1001  Z+                          link
23592 23257  2605  1001  Z+                          lockf2
23583 23257  2605  1001  Z+                          symlink
23576 23257  2605  1001  Z+                          mkfifo
23587 23257  2605  1001  Z+                          initial thread
23584 23257  2605  1001  Z+                          syscall
23580 23257  2605  1001  Z+                          shm
db> allt

Tracing command sh pid 23728 tid 100152 td 0xc5cdc630
sched_switch(0,c5cdc630,c0b95954,c5cdc630,efe0a9c8,...) at sched_switch+0x1a6

Tracing command sh pid 23727 tid 101822 td 0xc7762630
sched_switch(c0b95954,f1d42b64,c0728464,c0b95954,1,...) at sched_switch+0x1a6
spinlock_exit(c0b95954,1,c0a6afe4,f4) at spinlock_exit+0x10
_mtx_unlock_spin_flags(c0b95954,c54dd814,c7762630,c7762630) at _mtx_unlock_spin_flags+0xf1
witness_lock_list_free(c54dd814,0,f1d42bb0,c074daeb,c0b90ee0,...) at witness_lock_list_free+0x5e
runq(f18ec83,880c45b6,c189e445,b81fe183,ffffffff,...) at runq

Tracing command sh pid 23726 tid 101885 td 0xc73b4630
sched_switch(c0b95954,effb7b64,c0728464,c0b95954,1,...) at sched_switch+0x1a6
spinlock_exit(c0b95954,1,c0a6afe4,f4) at spinlock_exit+0x10
_mtx_unlock_spin_flags(c0b95954,c7372c34,c73b4630,c73b4630) at _mtx_unlock_spin_flags+0xf1
witness_lock_list_free(c7372c34,0,effb7bb0,c074daeb,c0b90ee0,...) at witness_lock_list_free+0x5e
runq(f18ec83,880c45b6,c189e445,b81fe183,ffffffff,...) at runq

Tracing command sh pid 23725 tid 100058 td 0xc54dda50
sched_switch(c54dda50,0,2,17b,64350e76,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(eda56d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sh pid 23724 tid 100218 td 0xc650fa50
sched_switch(c650fa50,0,1,17b,643ba9ae,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c741f690,...) at mi_switch+0x209
turnstile_wait(c741f690,c5cdba50,0,17a,c567b0d4,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c567b0d4,c650fa50,0,c0a7748e,7e3,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c567b0d4,0,c0a7748e,7e3,52c,...) at _mtx_lock_flags+0xe3
vget(c567b000,2,c650fa50,52c,f15a4af4,...) at vget+0x7a
vm_mmap(c5100cb0,f15a4c40,15000,5,7,...) at vm_mmap+0x2c1
mmap(c650fa50,f15a4c64,0,15000,5,...) at mmap+0x36e
freebsd6_mmap(c650fa50,f15a4cfc,20,c0a25c43,c0b19c78,...) at freebsd6_mmap+0x44
syscall(f15a4d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (198, FreeBSD ELF32, nosys), eip = 0x28074b8b, esp = 0xbfbfe3cc, ebp = 0xbfbfe408 ---

Tracing command sh pid 23723 tid 100101 td 0xc5703a50
sched_switch(c5703a50,0,2,17b,647b1aa2,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209
ast(efcd4d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sh pid 23722 tid 100198 td 0xc736b420
sched_switch(c736b420,0,2,17b,6441da1a,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209
ast(efe57d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sh pid 23721 tid 100214 td 0xc736f840
sched_switch(c736f840,0,1,17b,6484faaa,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c740ecd0,...) at mi_switch+0x209
turnstile_wait(c740ecd0,c7762000,0,17a,c566307c,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c566307c,c736f840,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c566307c,0,c0a8d45e,125,efe87be8,...) at _mtx_lock_flags+0xe3
vm_fault(c7378cb0,8048000,1,0,8048f27,...) at vm_fault+0x1c6
trap_pfault(5,0,c0a99ec2,2ae,c739caa0,...) at trap_pfault+0x117
trap(efe87d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x280649ad, esp = 0xbfbfe480, ebp = 0xbfbfe4a8 ---

Tracing command sh pid 23720 tid 100179 td 0xc7353a50
sched_switch(c7353a50,0,1,17b,644d9b52,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c74715f0,...) at mi_switch+0x209
turnstile_wait(c74715f0,c5cdba50,0,17a,c566307c,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c566307c,c7353a50,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c566307c,0,c0a8d45e,125,efe36be8,...) at _mtx_lock_flags+0xe3
vm_fault(c5100bc8,8048000,1,0,8048d71,...) at vm_fault+0x1c6
trap_pfault(5,0,c0a99ec2,2ae,c7355d48,...) at trap_pfault+0x117
trap(efe36d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x280649ad, esp = 0xbfbfe480, ebp = 0xbfbfe4a8 ---

Tracing command sh pid 23719 tid 100157 td 0xc5cdba50
sched_switch(c5cdba50,0,2,17b,6453ba18,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209
ast(efdfbd38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sh pid 23718 tid 100202 td 0xc7373420
sched_switch(c7373420,0,1,17b,64108f62,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c83467d0,...) at mi_switch+0x209
turnstile_wait(c83467d0,c777d210,0,17a,c566307c,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c566307c,c7373420,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c566307c,0,c0a8d45e,125,efeabbe8,...) at _mtx_lock_flags+0xe3
vm_fault(c5cb9cb0,8048000,1,0,8048f27,...) at vm_fault+0x1c6
trap_pfault(5,0,c0a99ec2,2ae,c7371aa0,...) at trap_pfault+0x117
trap(efeabd38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x280649ad, esp = 0xbfbfe480, ebp = 0xbfbfe4a8 ---

Tracing command sh pid 23717 tid 100148 td 0xc5cb4630
sched_switch(c5cb4630,0,2,17b,649ba5cc,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209
ast(efd94d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sh pid 23716 tid 101849 td 0xc777d000
cpustop_handler(2,f1e86a74,c09d40f2,0,0,...) at cpustop_handler+0x39
ipi_nmi_handler(0,0,c777d000,c0b90e40,c5e8faa0,...) at ipi_nmi_handler+0x2f
trap(f1e86a80) at trap+0x2d
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc0728a1a, esp = 0xf1e86ac0, ebp = 0xf1e86adc ---
_mtx_lock_sleep(c0be85a4,c777d000,0,c0a8e881,406,...) at _mtx_lock_sleep+0xfc
_mtx_lock_flags(c0be85a4,0,c0a8e881,406,100,...) at _mtx_lock_flags+0xe3
vm_page_alloc(0,2fe,0,160,2fe,...) at vm_page_alloc+0xb2
_pmap_allocpte(c0a990d6,0,bf8,76672405,bfbfd000,...) at _pmap_allocpte+0x4c
pmap_allocpte(c830a08c,0,c0a990d6,ae5,bfc00000,...) at pmap_allocpte+0x8d
pmap_copy(c5c35174,c830a08c,bfbe0000,20000,bfbe0000,...) at pmap_copy+0x212
vmspace_fork(c830a000,1,c0a6afe4,ce,c6211200,...) at vmspace_fork+0x3a2
vm_forkproc(c777d000,c5d202a8,c7762630,14,0,...) at vm_forkproc+0xbc
fork1(c777d000,14,0,f1e86c78,c0761edc,...) at fork1+0x10a4
fork(c777d000,f1e86cfc,c777d000,f1e86d38,c0b18a30,...) at fork+0x29
syscall(f1e86d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe9ec, ebp = 0xbfbfea18 ---

Tracing command sh pid 23715 tid 101856 td 0xc76fca50
sched_switch(c76fca50,0,1,17b,6406a8d0,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c83467d0,...) at mi_switch+0x209
turnstile_wait(c83467d0,c777d210,0,17a,c566307c,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c566307c,c76fca50,0,c0a8e351,65b,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c566307c,0,c0a8e351,65b,8,...) at _mtx_lock_flags+0xe3
vm_object_collapse(c68656c8,0,c0a8da5d,9c1,8048000,...) at vm_object_collapse+0x69
vmspace_fork(c5a23bc8,1,c0a6afe4,ce,c6211800,...) at vmspace_fork+0x2ec
vm_forkproc(c76fca50,c60e8aa0,c73b4630,14,0,...) at vm_forkproc+0xbc
fork1(c76fca50,14,0,f196dc78,c0761edc,...) at fork1+0x10a4
fork(c76fca50,f196dcfc,c76fca50,f196dd38,c0b18a30,...) at fork+0x29
syscall(f196dd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe6ac, ebp = 0xbfbfe6d8 ---

Tracing command sh pid 23714 tid 101825 td 0xc7762000
kdb_enter(c0a6c254,0,c0a8e9e2,f1d39b4c,0,...) at kdb_enter+0x32
panic(c0a8e9e2,c755c3e0,0,3ae,80000000,...) at panic+0x124
vm_page_cache_transfer(c6d447c0,0,0,c755c3e0,0,...) at vm_page_cache_transfer+0x1a5
vm_object_split(c742a50c,0,c0a8da5d,9c1,28086000,...) at vm_object_split+0x480
vmspace_fork(c7377570,1,c0a6afe4,ce,c6fb3d00,...) at vmspace_fork+0x304
vm_forkproc(c7762000,c5cda550,c5cdc630,14,0,...) at vm_forkproc+0xbc
fork1(c7762000,14,0,f1d39c78,c7762000,...) at fork1+0x10a4
fork(c7762000,f1d39cfc,c0a99df5,c0a71873,c0b18a30,...) at fork+0x29
syscall(f1d39d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe6ac, ebp = 0xbfbfe6d8 ---

Tracing command sh pid 23713 tid 100171 td 0xc5781630
sched_switch(c5781630,0,1,17b,6420aa5e,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c83467d0,...) at mi_switch+0x209
turnstile_wait(c83467d0,c777d210,0,17a,c566307c,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c566307c,c5781630,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c566307c,0,c0a8d45e,125,efd09be8,...) at _mtx_lock_flags+0xe3
vm_fault(c7377ae0,804b000,1,0,804be53,...) at vm_fault+0x1c6
trap_pfault(5,0,c0a99ec2,c5781630,c73527f8,...) at trap_pfault+0x117
trap(efd09d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x804be53, esp = 0xbfbfe380, ebp = 0xbfbfe858 ---

Tracing command sh pid 23712 tid 101850 td 0xc777d210
sched_switch(c777d210,0,1,17b,644df25e,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c74715f0,...) at mi_switch+0x209
turnstile_wait(c74715f0,c5cdba50,0,17a,c566307c,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c566307c,c777d210,0,c0a8f9e1,4c2,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c566307c,0,c0a8f9e1,4c2,c566307c,...) at _mtx_lock_flags+0xe3
vnode_pager_lock(c566307c,0,c0a8d45e,125,f1e89be8,...) at vnode_pager_lock+0x268
vm_fault(c73773a0,8051000,1,0,805182c,...) at vm_fault+0x1dc
trap_pfault(5,0,c0a99ec2,2ae,c5e8fd48,...) at trap_pfault+0x117
trap(f1e89d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x805182c, esp = 0xbfbfe570, ebp = 0xbfbfe698 ---

Tracing command sysctl pid 23711 tid 100047 td 0xc5251a50
sched_switch(c5251a50,0,1,180,6442f08c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5251a50,...) at mi_switch+0x209
sleepq_switch(c5251a50,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c7a9772c,1,e57e8c1c,c070e3f9,c7a9772c,...) at bwillwrite+0xef
dofilewrite(e57e8c60,ffffffff,ffffffff,0,c55a8000,...) at dofilewrite+0x69
kern_writev(c5251a50,1,e57e8c60,bfbfd010,c,...) at kern_writev+0x52
write(c5251a50,e57e8cfc,c,e57e8d38,c0b18a60,...) at write+0x4f
syscall(e57e8d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2815630b, esp = 0xbfbfcebc, ebp = 0xbfbfced8 ---

Tracing command sh pid 23710 tid 101854 td 0xc7762c60

Tracing command swap pid 23665 tid 100183 td 0xc7353210
sched_switch(c7353210,0,1,17b,52e8b958,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c73bb7d0,...) at mi_switch+0x209
turnstile_wait(c73bb7d0,c54dd630,0,17a,c0be85a4,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c0be85a4,c7353210,0,c0a8e881,406,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c0be85a4,0,c0a8e881,406,0,...) at _mtx_lock_flags+0xe3
vm_page_alloc(c76b445c,158,0,40,efe2abe8,...) at vm_page_alloc+0xb2
vm_fault(c5a20828,28458000,2,8,28458000,...) at vm_fault+0x6bc
trap_pfault(5,0,c0a99ec2,2ae,c73567f8,...) at trap_pfault+0x117
trap(efe2ad38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23664 tid 100210 td 0xc7372210
sched_switch(c7372210,0,6,17b,51c57570,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,c739c000,0,c7372210,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,efe93d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,efe93d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23663 tid 100115 td 0xc589c840
sched_switch(c589c840,c5251210,6,17b,57353d9c,...) at sched_switch+0x1a6
mi_switch(6,c5251210,c0a6dd73,eb,c5251210,...) at mi_switch+0x209
maybe_preempt(c5251210,1,c0a6dbe6,43f,8,...) at maybe_preempt+0x143
sched_add(c5251210,4,c0a68e36,2c2,c09c15c9,...) at sched_add+0x347
intr_event_schedule_thread(c5141500,0,c0a676a7,c589c840,c5141500,...) at intr_event_schedule_thread+0xe3
intr_execute_handlers(c50ed9f0,efd21d38,bfbfe7e8,c09bb7a4,35,...) at intr_execute_handlers+0x12d
lapic_handle_intr(35,efd21d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23662 tid 100217 td 0xc63f9840
sched_switch(c63f9840,0,6,17b,4f0efe6e,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049257,0) at critical_exit+0x99
lapic_handle_timer(f11c6d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23661 tid 100194 td 0xc736bc60
sched_switch(c736bc60,0,1,180,54bfb364,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c736bc60,...) at mi_switch+0x209
sleepq_switch(c736bc60,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7
sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f
vm_waitpfault(c5fd3364,325f,0,125,efe63be8,...) at vm_waitpfault+0x75
vm_fault(c8309910,2b55f000,2,8,2b55f000,...) at vm_fault+0x6d6
trap_pfault(5,0,c0a99ec2,c736bc60,c7370550,...) at trap_pfault+0x117
trap(efe63d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command swap pid 23660 tid 101866 td 0xc740a210
sched_switch(c740a210,0,2,17b,4b0d45e0,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(f0545d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command swap pid 23659 tid 101835 td 0xc775d840
sched_switch(c775d840,0,6,17b,c6142580,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,c5d57550,0,c775d840,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,f1d1bd38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,f1d1bd38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23658 tid 100149 td 0xc5cb4420
sched_switch(c5cb4420,0,6,17b,4dc052be,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049251,0) at critical_exit+0x99
lapic_handle_timer(efd91d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23657 tid 101868 td 0xc746ba50
sched_switch(c746ba50,0,2,17b,4aef1844,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(f0ad0d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command swap pid 23656 tid 101830 td 0xc7761420
sched_switch(c7761420,0,6,17b,cc5a534e,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049257,0) at critical_exit+0x99
lapic_handle_timer(f1d2ad38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23655 tid 100102 td 0xc5703840
sched_switch(c5703840,0,2,17b,de4d3794,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(efcd1d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command swap pid 23654 tid 101834 td 0xc775da50
sched_switch(c775da50,0,6,17b,505d8b2a,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049254,0) at critical_exit+0x99
lapic_handle_timer(f1d1ed38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23653 tid 100566 td 0xc6e94840
sched_switch(c6e94840,0,6,17b,51980426,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049257,0) at critical_exit+0x99
lapic_handle_timer(f0407d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23652 tid 100128 td 0xc5c97a50
sched_switch(c5c97a50,0,6,17b,4bec0c1c,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,1010004,efd70d2c,c5c97a50,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,efd70d38,bfbfe748,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,efd70d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command swap pid 23651 tid 101880 td 0xc7450630
sched_switch(c7450630,0,6,17b,4fcc07b0,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,0,c0a676a7,c7450630,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,f0926d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,f0926d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23650 tid 100193 td 0xc736d000
sched_switch(c736d000,0,6,17b,518aa282,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049254,0) at critical_exit+0x99
lapic_handle_timer(efe66d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23649 tid 100069 td 0xc56b7840
sched_switch(c56b7840,0,6,17b,4c8c327c,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,c56bc7f8,c0a676a7,c56b7840,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,efc6cd38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,efc6cd38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command swap pid 23648 tid 100130 td 0xc5c97630
sched_switch(c5c97630,0,2,17b,4c675314,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(efd6ad38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command swap pid 23647 tid 101877 td 0xc7451000
sched_switch(c7451000,0,2,17b,e25dc2e8,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(f0932d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sysctl pid 23646 tid 101857 td 0xc76fc210

Tracing command sysctl pid 23645 tid 100215 td 0xc736f630

Tracing command sysctl pid 23644 tid 100086 td 0xc56ff630

Tracing command swap pid 23643 tid 100166 td 0xc5cb6630
sched_switch(c5cb6630,0,1,17b,5b1caa88,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c736c500,...) at mi_switch+0x209
turnstile_wait(c736c500,c7762840,0,17a,c0be85bc,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c0be85bc,c5cb6630,0,c0a990d6,913,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c0be85bc,0,c0a990d6,913,c0a8d407,...) at _mtx_lock_flags+0xe3
pmap_enter(c574ec54,2b7e9000,c3589360,7,0,...) at pmap_enter+0x40
vm_fault(c574ebc8,2b7e9000,2,8,2b7e9000,...) at vm_fault+0x16db
trap_pfault(5,0,c0a99ec2,2ae,c5ce0aa0,...) at trap_pfault+0x117
trap(efdbed38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command sysctl pid 23642 tid 101874 td 0xc73e6000
sched_switch(c73e6000,0,1,180,5d0d3262,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c73e6000,0,c0a6f89a,19b,c60cbd48,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c60cbd48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c60cbd48,c60cbdd8,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c73e6000,5ca7,f02bac2c,0,0,...) at kern_wait+0xa3e
wait4(c73e6000,f02bacfc,10,f02bad38,c0b18aa8,...) at wait4+0x3d
syscall(f02bad38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23641 tid 101872 td 0xc7483210
sched_switch(c7483210,0,6,17b,50c051f4,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,0,c0a676a7,c7483210,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,f0c53d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,f0c53d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command sysctl pid 23640 tid 101821 td 0xc7762840
sched_switch(c7762840,0,1,180,5b52fd0a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c7762840,0,c0a6f89a,19b,c5d20000,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c5d20000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c5d20000,c5d20090,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c7762840,5ca5,f1d45c2c,0,0,...) at kern_wait+0xa3e
wait4(c7762840,f1d45cfc,10,f1d45d38,c0b18aa8,...) at wait4+0x3d
syscall(f1d45d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23639 tid 101846 td 0xc7521a50
sched_switch(c7521a50,0,6,17b,5779429c,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,c5e8f2a8,0,c7521a50,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,f1469d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,f1469d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command sysctl pid 23638 tid 100209 td 0xc7372420
sched_switch(c7372420,0,1,180,5e1df8ba,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c7372420,0,c0a6f89a,19b,c7397d48,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c7397d48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c7397d48,c7397dd8,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c7372420,5ca8,efe96c2c,0,0,...) at kern_wait+0xa3e
wait4(c7372420,efe96cfc,10,0,c0b18aa8,...) at wait4+0x3d
syscall(efe96d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23637 tid 100192 td 0xc736d210
sched_switch(c736d210,0,6,17b,576cbac2,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049257,0) at critical_exit+0x99
lapic_handle_timer(efe69d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command sysctl pid 23636 tid 101853 td 0xc7762a50

Tracing command swap pid 23635 tid 100072 td 0xc54dd630
sched_switch(c54dd630,0,2,17b,56f5a64e,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(eda50d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sysctl pid 23634 tid 100126 td 0xc5c98000
sched_switch(c5c98000,0,1,180,5a66d3ae,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c5c98000,0,c0a6f89a,19b,c5c99000,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c5c99000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c5c99000,c5c99090,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c5c98000,5caa,efd76c2c,0,0,...) at kern_wait+0xa3e
wait4(c5c98000,efd76cfc,10,efd76d38,c0b18aa8,...) at wait4+0x3d
syscall(efd76d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23633 tid 100180 td 0xc7353840
sched_switch(c7353840,0,6,17b,4c2ed4f6,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049251,0) at critical_exit+0x99
lapic_handle_timer(efe33d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command sysctl pid 23632 tid 100163 td 0xc5cb6c60
sched_switch(c5cb6c60,0,1,180,5a731d14,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c5cb6c60,0,c0a6f89a,19b,c5ce02a8,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c5ce02a8,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c5ce02a8,c5ce0338,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c5cb6c60,5cab,efdc7c2c,0,0,...) at kern_wait+0xa3e
wait4(c5cb6c60,efdc7cfc,10,efdc7d38,c0b18aa8,...) at wait4+0x3d
syscall(efdc7d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23631 tid 100063 td 0xc56bb630
sched_switch(c56bb630,0,2,17b,4bc56b08,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(efc7ed38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command sysctl pid 23630 tid 101861 td 0xc7500000
sched_switch(c7500000,0,1,180,5a01e258,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c7500000,0,c0a6f89a,19b,c58e7aa0,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c58e7aa0,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c58e7aa0,c58e7b30,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c7500000,5cac,f1277c2c,0,0,...) at kern_wait+0xa3e
wait4(c7500000,f1277cfc,10,f1277d38,c0b18aa8,...) at wait4+0x3d
syscall(f1277d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23629 tid 100140 td 0xc5cb5840
sched_switch(c5cb5840,0,1,180,2aec2d3c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5cb5840,...) at mi_switch+0x209
sleepq_switch(c5cb5840,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7
sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f
vm_waitpfault(c79f445c,37df,0,125,efdacbe8,...) at vm_waitpfault+0x75
vm_fault(c51009f8,2badf000,2,8,2badf000,...) at vm_fault+0x6d6
trap_pfault(5,0,c0a99ec2,2ae,c5cb7550,...) at trap_pfault+0x117
trap(efdacd38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command sysctl pid 23628 tid 100154 td 0xc5cdc210

Tracing command swap pid 23627 tid 100169 td 0xc5781a50
sched_switch(c5781a50,0,1,180,595b8796,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5781a50,...) at mi_switch+0x209
sleepq_switch(c5781a50,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7
sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f
vm_waitpfault(c6526d14,3966,0,125,efd0fbe8,...) at vm_waitpfault+0x75
vm_fault(c5c35570,2bc66000,2,8,2bc66000,...) at vm_fault+0x6d6
trap_pfault(5,0,c0a99ec2,2ae,c73522a8,...) at trap_pfault+0x117
trap(efd0fd38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command sysctl pid 23626 tid 101863 td 0xc73cb210
sched_switch(c73cb210,0,1,180,5e755c5a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c73cb210,0,c0a6f89a,19b,c60bb000,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c60bb000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c60bb000,c60bb090,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c73cb210,5ca9,f0101c2c,0,0,...) at kern_wait+0xa3e
wait4(c73cb210,f0101cfc,10,f0101d38,c0b18aa8,...) at wait4+0x3d
syscall(f0101d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23625 tid 100199 td 0xc736b210
sched_switch(c736b210,0,6,17b,4b8e3514,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209
critical_exit(c50eda38,c0b90e40,0,c736b210,c5141400,...) at critical_exit+0x99
intr_execute_handlers(c50eda38,efe54d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147
lapic_handle_intr(34,efe54d38) at lapic_handle_intr+0x39
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command sysctl pid 23624 tid 100190 td 0xc736d630
sched_switch(c736d630,0,1,180,5d02598a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c736d630,0,c0a6f89a,19b,c736aaa0,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c736aaa0,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c736aaa0,c736ab30,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c736d630,5ca6,efe6fc2c,0,0,...) at kern_wait+0xa3e
wait4(c736d630,efe6fcfc,10,efe6fd38,c0b18aa8,...) at wait4+0x3d
syscall(efe6fd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23623 tid 101870 td 0xc7464420
sched_switch(c7464420,0,6,17b,c71fefce,...) at sched_switch+0x1a6
mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209
critical_exit(1,8049257,0) at critical_exit+0x99
lapic_handle_timer(f0a49d38) at lapic_handle_timer+0x15c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 ---

Tracing command sysctl pid 23622 tid 101879 td 0xc7451420
sched_switch(c7451420,0,1,180,5961c6e8,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c7451420,0,c0a6f89a,19b,c60e0aa0,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c60e0aa0,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c60e0aa0,c60e0b30,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c7451420,5cad,f0938c2c,0,0,...) at kern_wait+0xa3e
wait4(c7451420,f0938cfc,10,f0938d38,c0b18aa8,...) at wait4+0x3d
syscall(f0938d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 ---

Tracing command swap pid 23621 tid 100110 td 0xc589d420
sched_switch(c589d420,0,2,17b,c2d16d34,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209
ast(efd30d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command swap pid 23620 tid 100138 td 0xc5cb5c60
sched_switch(c5cb5c60,0,1,180,2aea9430,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5cb5c60,...) at mi_switch+0x209
sleepq_switch(c5cb5c60,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7
sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f
vm_waitpfault(c5d5a45c,3684,0,125,efdb2be8,...) at vm_waitpfault+0x75
vm_fault(c8478ae0,2b984000,2,8,2b984000,...) at vm_fault+0x6d6
trap_pfault(5,0,c0a99ec2,2ae,c5cb7000,...) at trap_pfault+0x117
trap(efdb2d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command swap pid 23619 tid 100093 td 0xc5780c60
sched_switch(c5780c60,0,1,17b,55a86306,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c750a550,...) at mi_switch+0x209
turnstile_wait(c750a550,c7762840,0,17a,c0be85bc,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c0be85bc,c5780c60,0,c0a8d45e,377,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c0be85bc,0,c0a8d45e,377,0,...) at _mtx_lock_flags+0xe3
vm_fault(c51012b8,2b4f2000,2,8,2b4f2000,...) at vm_fault+0x1bd4
trap_pfault(5,0,c0a99ec2,2ae,c577f7f8,...) at trap_pfault+0x117
trap(efcfdd38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 ---

Tracing command sysctl pid 23618 tid 101860 td 0xc76fc000

Tracing command swap pid 23617 tid 100203 td 0xc7373210

Tracing command rw pid 23616 tid 101867 td 0xc746b630
sched_switch(c746b630,0,1,180,64428582,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c746b630,...) at mi_switch+0x209
sleepq_switch(c746b630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c691d72c,4,f0acac1c,c070e3f9,c691d72c,...) at bwillwrite+0xef
dofilewrite(f0acac60,ffffffff,ffffffff,0,c6d70cf0,...) at dofilewrite+0x69
kern_writev(c746b630,4,f0acac60,bfbfd7dc,1000,...) at kern_writev+0x52
write(c746b630,f0acacfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f
syscall(f0acad38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 ---

Tracing command rw pid 23615 tid 100116 td 0xc589c630
sched_switch(c589c630,0,1,180,644315ae,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c589c630,...) at mi_switch+0x209
sleepq_switch(c589c630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c691d42c,4,efd1ec1c,c070e3f9,c691d42c,...) at bwillwrite+0xef
dofilewrite(efd1ec60,ffffffff,ffffffff,0,c6c0b1f8,...) at dofilewrite+0x69
kern_writev(c589c630,4,efd1ec60,bfbfd7dc,1000,...) at kern_writev+0x52
write(c589c630,efd1ecfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f
syscall(efd1ed38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 ---

Tracing command rw pid 23614 tid 101859 td 0xc76fc630
sched_switch(c76fc630,0,1,180,6442a8f0,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c76fc630,...) at mi_switch+0x209
sleepq_switch(c76fc630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c691d62c,4,f1967c1c,c070e3f9,c691d62c,...) at bwillwrite+0xef
dofilewrite(f1967c60,ffffffff,ffffffff,0,c6d8a288,...) at dofilewrite+0x69
kern_writev(c76fc630,4,f1967c60,bfbfd7dc,1000,...) at kern_writev+0x52
write(c76fc630,f1967cfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f
syscall(f1967d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 ---

Tracing command rw pid 23613 tid 100127 td 0xc5c97c60
sched_switch(c5c97c60,0,1,180,6442c84e,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5c97c60,...) at mi_switch+0x209
sleepq_switch(c5c97c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c691d02c,4,efd73c1c,c070e3f9,c691d02c,...) at bwillwrite+0xef
dofilewrite(efd73c60,ffffffff,ffffffff,0,c561f5e8,...) at dofilewrite+0x69
kern_writev(c5c97c60,4,efd73c60,bfbfd7dc,1000,...) at kern_writev+0x52
write(c5c97c60,efd73cfc,c,0,c0b18a60,...) at write+0x4f
syscall(efd73d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 ---

Tracing command rw pid 23612 tid 101844 td 0xc7522000
sched_switch(c7522000,0,1,17b,6fd23ab6,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c589e000,...) at mi_switch+0x209
turnstile_wait(c589e000,c736dc60,0,17a,c579a1f0,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c579a1f0,c7522000,0,c0a75244,916,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c579a1f0,0,c0a75244,916,c0a894e0,...) at _mtx_lock_flags+0xe3
bdwrite(d9399e80,0,c0a894d7,597,0,...) at bdwrite+0x14c
ffs_alloccg(c56055ac,f,168cb8,0,4000,...) at ffs_alloccg+0x1f1
ffs_hashalloc(168cb8,0,4000,c08f1404,0,...) at ffs_hashalloc+0x65
ffs_alloc(c56055ac,5d5,0,168cb8,0,...) at ffs_alloc+0x25a
ffs_balloc_ufs2(c5e5f570,1754000,0,1000,c5798b00,...) at ffs_balloc_ufs2+0x19af
ffs_write(f146fbc4,c0a9dd02,f146fb30,0,c0b39660,...) at ffs_write+0x34c
VOP_WRITE_APV(c0b39660,f146fbc4,c7522000,c0a78383,242,...) at VOP_WRITE_APV+0x144
vn_write(c85be750,f146fc60,c5798b00,0,c7522000,...) at vn_write+0x230
dofilewrite(f146fc60,ffffffff,ffffffff,0,c85be750,...) at dofilewrite+0x8e
kern_writev(c7522000,4,f146fc60,bfbfd7dc,1000,...) at kern_writev+0x52
write(c7522000,f146fcfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f
syscall(f146fd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 ---

Tracing command rw pid 23611 tid 100105 td 0xc5703210

Tracing command mkdir pid 23610 tid 100211 td 0xc7372000
sched_switch(c7372000,0,1,180,849ff62a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c7372000,...) at mi_switch+0x209
sleepq_switch(c7372000,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f
acquire(efe90820,efe90818,c0a69b93,d7,c7372000,...) at acquire+0x73
_lockmgr(d930e4a0,202122,c5898e6c,c7372000,c0a757cf,...) at _lockmgr+0x4a2
getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af
breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44
bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c
ffs_vget(c55495d0,5c23d,2,efe90b48,c56f3000,...) at ffs_vget+0x360
ffs_valloc(c6beb828,41f8,c5798b00,efe90b48,c0a69b93,...) at ffs_valloc+0x52c
ufs_mkdir(efe90b90,c0a9dc06,0,efe90b90,efe90ba4,...) at ufs_mkdir+0x95
VOP_MKDIR_APV(c0b39660,efe90b90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7
kern_mkdir(c7372000,bfbf1ae7,0,1f8,efe90d2c,...) at kern_mkdir+0x2b0
mkdir(c7372000,efe90cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efe90d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf168c, ebp = 0xbfbf1ab8 ---

Tracing command mkdir pid 23609 tid 100176 td 0xc7354210
sched_switch(c7354210,0,1,180,f1afdc18,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c7354210,...) at mi_switch+0x209
sleepq_switch(c7354210,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f
acquire(efe3fa14,efe3fa0c,c0a69b93,d7,c7354210,...) at acquire+0x73
_lockmgr(d930e4a0,202122,c5898e6c,c7354210,c0a757cf,...) at _lockmgr+0x4a2
getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af
breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44
bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c
ffs_update(c69386cc,0,1,c69386cc,efe3fb64,...) at ffs_update+0x195
ufs_inactive(efe3fb98,c0a9d40d,c69387a0,c69387a0,c69386cc,...) at ufs_inactive+0x353
VOP_INACTIVE_APV(c0b39660,efe3fb98,c0a7748e,8e3,c0b505a0,...) at VOP_INACTIVE_APV+0xc6
vinactive(c69387a0,0,c0a7748e,853,852,...) at vinactive+0xa5
vrele(c69386cc,c0a78219,330,32d,c5a21b00,...) at vrele+0x182
kern_chdir(c7354210,804b0cc,0,efe3fd2c,c09d3e05,...) at kern_chdir+0x1d6
chdir(c7354210,efe3fcfc,4,c0a9df26,c0b18b20,...) at chdir+0x22
syscall(efe3fd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (12, FreeBSD ELF32, chdir), eip = 0x280c4d6b, esp = 0xbfbf449c, ebp = 0xbfbf48c8 ---

Tracing command mkdir pid 23608 tid 100145 td 0xc5cb4c60
sched_switch(c5cb4c60,0,1,180,64423152,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5cb4c60,...) at mi_switch+0x209
sleepq_switch(c5cb4c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0a6afe4,ce,c7f86d98,c7f86e6c,c5cb4c60,...) at bwillwrite+0xef
kern_mkdir(c5cb4c60,bfbefd97,0,1f8,efd9dd2c,...) at kern_mkdir+0x2c
mkdir(c5cb4c60,efd9dcfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efd9dd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbef93c, ebp = 0xbfbefd68 ---

Tracing command mkdir pid 23607 tid 100108 td 0xc589d840
sched_switch(c589d840,0,1,180,64411ba4,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c589d840,...) at mi_switch+0x209
sleepq_switch(c589d840,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0a6afe4,ce,c5c6c414,c5c6c4e8,c589d840,...) at bwillwrite+0xef
kern_mkdir(c589d840,bfbec2f7,0,1f8,efd36d2c,...) at kern_mkdir+0x2c
mkdir(c589d840,efd36cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efd36d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbebe9c, ebp = 0xbfbec2c8 ---

Tracing command mkdir pid 23606 tid 100119 td 0xc589c000
sched_switch(c589c000,0,2,17b,8488b2f2,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,2820a06c,...) at mi_switch+0x209
ast(efd15d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command mkdir pid 23605 tid 100147 td 0xc5cb4840
sched_switch(c5cb4840,0,1,180,6441b83c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5cb4840,...) at mi_switch+0x209
sleepq_switch(c5cb4840,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0a6afe4,ce,c80bbd98,c80bbe6c,c5cb4840,...) at bwillwrite+0xef
kern_mkdir(c5cb4840,bfbd6337,0,1f8,efd97d2c,...) at kern_mkdir+0x2c
mkdir(c5cb4840,efd97cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efd97d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbd5edc, ebp = 0xbfbd6308 ---

Tracing command mkdir pid 23604 tid 100067 td 0xc56b7c60
sched_switch(c56b7c60,0,1,180,6440d244,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c56b7c60,...) at mi_switch+0x209
sleepq_switch(c56b7c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0a6afe4,ce,c5b42984,c5b42a58,c56b7c60,...) at bwillwrite+0xef
kern_mkdir(c56b7c60,bfbdb2c7,0,1f8,efc72d2c,...) at kern_mkdir+0x2c
mkdir(c56b7c60,efc72cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efc72d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbdae6c, ebp = 0xbfbdb298 ---

Tracing command mkdir pid 23603 tid 100167 td 0xc5cb6420
sched_switch(c5cb6420,0,1,180,64420418,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5cb6420,...) at mi_switch+0x209
sleepq_switch(c5cb6420,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0a6afe4,ce,c5ecbd98,c5ecbe6c,c5cb6420,...) at bwillwrite+0xef
kern_mkdir(c5cb6420,bfbdd017,0,1f8,efdbbd2c,...) at kern_mkdir+0x2c
mkdir(c5cb6420,efdbbcfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efdbbd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbdcbbc, ebp = 0xbfbdcfe8 ---

Tracing command mkdir pid 23602 tid 100075 td 0xc5703000
sched_switch(c5703000,0,1,17b,7a488806,...) at sched_switch+0x1a6
mi_switch(1,0,c0a70036,2e2,c8574b90,...) at mi_switch+0x209
turnstile_wait(c8574b90,c7521630,0,17a,c579a1f0,...) at turnstile_wait+0x4bd
_mtx_lock_sleep(c579a1f0,c5703000,0,c0a75244,916,...) at _mtx_lock_sleep+0x14d
_mtx_lock_flags(c579a1f0,0,c0a75244,916,c571a5ac,...) at _mtx_lock_flags+0xe3
bdwrite(d930e440,c5f68a00,100,4000,0,...) at bdwrite+0x14c
ffs_update(c59e9d98,0,0,0,0,...) at ffs_update+0x342
ffs_truncate(c59e9d98,0,0,0,c5798b00,...) at ffs_truncate+0x7d0
handle_workitem_remove(c0be7e1c,0,c0a8a260,cb8,0,...) at handle_workitem_remove+0x1f0
softdep_setup_remove(d9270460,c71cc084,c571a5ac,1,efcc5b7c,...) at softdep_setup_remove+0x124
ufs_dirremove(c76c7ae0,c571a5ac,500800c,1,efcc5bc8,...) at ufs_dirremove+0x160
ufs_rmdir(efcc5bfc,c0a9dbc5,0,efcc5bfc,c59e9d98,...) at ufs_rmdir+0xd3
VOP_RMDIR_APV(c0b39660,efcc5bfc,2,330,c0b50520,...) at VOP_RMDIR_APV+0xec
kern_rmdir(c5703000,bfbf6647,0,efcc5d2c,c09d3e05,...) at kern_rmdir+0x1b5
rmdir(c5703000,efcc5cfc,4,c0a7181a,c0b196d8,...) at rmdir+0x22
syscall(efcc5d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (137, FreeBSD ELF32, rmdir), eip = 0x280c484b, esp = 0xbfbf61ec, ebp = 0xbfbf6618 ---

Tracing command mkdir pid 23601 tid 100100 td 0xc5703c60
sched_switch(c5703c60,0,1,180,847ec2b4,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5703c60,...) at mi_switch+0x209
sleepq_switch(c5703c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f
acquire(efcd7820,efcd7818,c0a69b93,d7,c5703c60,...) at acquire+0x73
_lockmgr(d930e4a0,202122,c5898e6c,c5703c60,c0a757cf,...) at _lockmgr+0x4a2
getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af
breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44
bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c
ffs_vget(c55495d0,5c23b,2,efcd7b48,c56f3000,...) at ffs_vget+0x360
ffs_valloc(c5c63d98,41f8,c5798b00,efcd7b48,c0a69b93,...) at ffs_valloc+0x52c
ufs_mkdir(efcd7b90,c0a9dc06,0,efcd7b90,efcd7ba4,...) at ufs_mkdir+0x95
VOP_MKDIR_APV(c0b39660,efcd7b90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7
kern_mkdir(c5703c60,bfbf5157,0,1f8,efcd7d2c,...) at kern_mkdir+0x2b0
mkdir(c5703c60,efcd7cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efcd7d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf4cfc, ebp = 0xbfbf5128 ---

Tracing command mkdir pid 23600 tid 101848 td 0xc7521630
sched_switch(c7521630,0,1,180,64416568,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c7521630,...) at mi_switch+0x209
sleepq_switch(c7521630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0a6afe4,ce,c6b9915c,c6b99230,c7521630,...) at bwillwrite+0xef
kern_mkdir(c7521630,bfbf5de7,0,1f8,f1463d2c,...) at kern_mkdir+0x2c
mkdir(c7521630,f1463cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(f1463d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf598c, ebp = 0xbfbf5db8 ---

Tracing command mkdir pid 23599 tid 100170 td 0xc5781840
sched_switch(c5781840,0,1,180,84728e7c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5781840,...) at mi_switch+0x209
sleepq_switch(c5781840,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f
acquire(efd0c820,efd0c818,c0a69b93,d7,c5781840,...) at acquire+0x73
_lockmgr(d930e4a0,202122,c5898e6c,c5781840,c0a757cf,...) at _lockmgr+0x4a2
getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af
breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44
bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c
ffs_vget(c55495d0,5c23a,2,efd0cb48,c56f3000,...) at ffs_vget+0x360
ffs_valloc(c7efb15c,41f8,c5798b00,efd0cb48,c0a69b93,...) at ffs_valloc+0x52c
ufs_mkdir(efd0cb90,c0a9dc06,0,efd0cb90,efd0cba4,...) at ufs_mkdir+0x95
VOP_MKDIR_APV(c0b39660,efd0cb90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7
kern_mkdir(c5781840,bfbfb1a7,0,1f8,efd0cd2c,...) at kern_mkdir+0x2b0
mkdir(c5781840,efd0ccfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(efd0cd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbfad4c, ebp = 0xbfbfb178 ---

Tracing command mkdir pid 23598 tid 100187 td 0xc736dc60
sched_switch(c736dc60,0,2,17b,6fdd9b06,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,2820a04c,...) at mi_switch+0x209
ast(efe78d38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command mkdir pid 23597 tid 101824 td 0xc7762210
sched_switch(c7762210,0,1,180,84b419ce,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c7762210,...) at mi_switch+0x209
sleepq_switch(c7762210,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f
acquire(f1d3c820,f1d3c818,c0a69b93,d7,c7762210,...) at acquire+0x73
_lockmgr(d930e4a0,202122,c5898e6c,c7762210,c0a757cf,...) at _lockmgr+0x4a2
getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af
breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44
bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c
ffs_vget(c55495d0,5c23f,2,f1d3cb48,c56f3000,...) at ffs_vget+0x360
ffs_valloc(c63b9d98,41f8,c5798b00,f1d3cb48,c0a69b93,...) at ffs_valloc+0x52c
ufs_mkdir(f1d3cb90,c0a9dc06,0,f1d3cb90,f1d3cba4,...) at ufs_mkdir+0x95
VOP_MKDIR_APV(c0b39660,f1d3cb90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7
kern_mkdir(c7762210,bfbf7b37,0,1f8,f1d3cd2c,...) at kern_mkdir+0x2b0
mkdir(c7762210,f1d3ccfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29
syscall(f1d3cd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf76dc, ebp = 0xbfbf7b08 ---

Tracing command mkdir pid 23596 tid 100114 td 0xc589ca50
sched_switch(c589ca50,0,1,180,239dbbf0,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c589ca50,...) at mi_switch+0x209
sleepq_switch(c589ca50,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7
sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f
vm_waitpfault(c5a1ed90,1d,0,125,efd24be8,...) at vm_waitpfault+0x75
vm_fault(c5c35e80,bfbfd000,1,0,bfbfd2f8,...) at vm_fault+0x6d6
trap_pfault(5,0,c0a99ec2,2ae,c58a0000,...) at trap_pfault+0x117
trap(efd24d38) at trap+0x262
calltrap() at calltrap+0x6
--- trap 0xc, eip = 0x804923f, esp = 0xbfbfced0, ebp = 0xbfbfd2f8 ---

Tracing command mkdir pid 23595 tid 101840 td 0xc7522840
sched_switch(c7522840,0,2,17b,72134c08,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6ff9f,ec,f147bd28,...) at mi_switch+0x209
ast(f147bd38) at ast+0x2aa
doreti_ast() at doreti_ast+0x17

Tracing command mkdir pid 23594 tid 100034 td 0xc5250420

Tracing command sysctl pid 23585 tid 100061 td 0xc56bba50
sched_switch(c56bba50,0,1,180,f2b51a5e,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c56bba50,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7
sleepq_catch_signals(efc84bc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221
sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11
_sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317
kern_nanosleep(c56bba50,efc84c64,efc84c6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c56bba50,efc84cfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69
syscall(efc84d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813931f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 ---

Tracing command swap pid 23582 tid 100201 td 0xc7354c60
sched_switch(c7354c60,0,1,180,f2b5daf2,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c7354c60,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7
sleepq_catch_signals(efe4ebc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221
sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11
_sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317
kern_nanosleep(c7354c60,efe4ec64,efe4ec6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c7354c60,efe4ecfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69
syscall(efe4ed38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813a31f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 ---

Tracing command rw pid 23579 tid 101852 td 0xc775d000
sched_switch(c775d000,0,1,180,f2d6c786,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c775d000,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7
sleepq_catch_signals(f1d0fbc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221
sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11
_sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317
kern_nanosleep(c775d000,f1d0fc64,f1d0fc6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c775d000,f1d0fcfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69
syscall(f1d0fd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2814331f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 ---

Tracing command mkdir pid 23575 tid 100111 td 0xc589d210
sched_switch(c589d210,0,1,180,f2d60026,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c589d210,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7
sleepq_catch_signals(efd2dbc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221
sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11
_sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317
kern_nanosleep(c589d210,efd2dc64,efd2dc6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c589d210,efd2dcfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69
syscall(efd2dd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813a31f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 ---

Tracing command nfsiod 0 pid 23525 tid 100135 td 0xc589da50
sched_switch(c589da50,0,1,180,23ac9990,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c589da50,0,c0a6f89a,19b,c0be2480,...) at sleepq_switch+0xf7
sleepq_catch_signals(efd39c70,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221
sleepq_timedwait_sig(c0be2480,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11
_sleep(c0be2480,c0be244c,15c,c0a63bad,1d4c0,...) at _sleep+0x317
nfssvc_iod(c0be1e00,efd39d38,c0a68bb2,314,c5cb37f8,...) at nfssvc_iod+0xcf
fork_exit(c08a63e7,c0be1e00,efd39d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xefd39d70, ebp = 0 ---

Tracing command run pid 23257 tid 100206 td 0xc7372a50
sched_switch(c7372a50,0,1,180,a51cd130,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c7372a50,...) at mi_switch+0x209
sleepq_switch(c7372a50,0,c0a6f89a,21d,c0b8ede8,...) at sleepq_switch+0xf7
sleepq_wait(c0b8ede8,0,c0a6b5d9,3,0,...) at sleepq_wait+0x60
_sx_xlock_hard(c0b8ede8,c7372a50,0,c0a68a72,2ac,...) at _sx_xlock_hard+0x26d
_sx_xlock(c0b8ede8,0,c0a68a72,2ac,0,...) at _sx_xlock+0xb2
kern_wait(c7372a50,5c17,efe9fc2c,0,0,...) at kern_wait+0x125
wait4(c7372a50,efe9fcfc,10,c0a7220e,c0b18aa8,...) at wait4+0x3d
syscall(efe9fd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe0fc, ebp = 0xbfbfe118 ---

Tracing command run pid 23256 tid 100186 td 0xc736f000
sched_switch(c736f000,0,1,180,56105428,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c736f000,0,c0a6f89a,19b,c736a000,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c736a000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c736a000,c736a090,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c736f000,5ad9,efe7bc2c,0,0,...) at kern_wait+0xa3e
wait4(c736f000,efe7bcfc,10,efe7bd38,c0b18aa8,...) at wait4+0x3d
syscall(efe7bd38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe5ac, ebp = 0xbfbfe5c8 ---

Tracing command run pid 23255 tid 100197 td 0xc736b630
sched_switch(c736b630,0,1,180,5653b50a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c736b630,0,c0a6f89a,19b,c7370d48,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c7370d48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c7370d48,c7370dd8,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c736b630,5ad8,efe5ac2c,0,0,...) at kern_wait+0xa3e
wait4(c736b630,efe5acfc,10,efe5ad38,c0b18aa8,...) at wait4+0x3d
syscall(efe5ad38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe5dc, ebp = 0xbfbfe5f8 ---

Tracing command sh pid 23242 tid 100077 td 0xc5700a50

Tracing command sleep pid 23088 tid 101876 td 0xc73eba50

Tracing command sh pid 2682 tid 100158 td 0xc5cdb840

Tracing command tcsh pid 2678 tid 100084 td 0xc56ffa50

Tracing command sh pid 2605 tid 100096 td 0xc5780630

Tracing command watchdogd pid 2501 tid 100113 td 0xc589cc60
sched_switch(c589cc60,0,1,180,555fb0e4,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c589cc60,0,c0a6f89a,19b,c589fd48,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c589fd48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c589fd48,c589fdd8,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c589cc60,5ca4,efd27c2c,0,0,...) at kern_wait+0xa3e
wait4(c589cc60,efd27cfc,10,efd27d38,c0b18aa8,...) at wait4+0x3d
syscall(efd27d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280fa80b, esp = 0xbfbfeaec, ebp = 0xbfbfeb88 ---

Tracing command tcsh pid 826 tid 100094 td 0xc5780a50

Tracing command sshd pid 825 tid 100088 td 0xc56ff210

Tracing command sshd pid 822 tid 100076 td 0xc5700c60

Tracing command login pid 821 tid 100054 td 0xc569a420

Tracing command getty pid 820 tid 100049 td 0xc5251630

Tracing command getty pid 819 tid 100078 td 0xc5700840

Tracing command getty pid 818 tid 100090 td 0xc5781420

Tracing command getty pid 817 tid 100074 td 0xc54dd210

Tracing command getty pid 816 tid 100095 td 0xc5780840

Tracing command getty pid 815 tid 100087 td 0xc56ff420

Tracing command getty pid 814 tid 100082 td 0xc5700000

Tracing command getty pid 813 tid 100085 td 0xc56ff840

Tracing command cron pid 771 tid 100045 td 0xc54dc000

Tracing command sshd pid 759 tid 100057 td 0xc54ddc60

Tracing command nfsd pid 703 tid 100048 td 0xc5251840

Tracing command nfsd pid 702 tid 100091 td 0xc5781210

Tracing command nfsd pid 700 tid 100092 td 0xc5781000

Tracing command nfsd pid 699 tid 100055 td 0xc569a210

Tracing command nfsd pid 698 tid 100060 td 0xc56bbc60

Tracing command mountd pid 696 tid 100098 td 0xc5780210

Tracing command rpcbind pid 675 tid 100056 td 0xc569a000

Tracing command md1 pid 630 tid 100046 td 0xc5251c60
sched_switch(c5251c60,0,1,180,f3fde6c4,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5251c60,...) at mi_switch+0x209
sleepq_switch(c5251c60,0,c0a6f89a,21d,4c,...) at sleepq_switch+0xf7
sleepq_wait(c5738800,c5738820,c0a4a433,0,0,...) at sleepq_wait+0x60
_sleep(c5738800,c5738820,24c,c0a4a433,0,...) at _sleep+0x34f
md_kthread(c5738800,e57ebd38,c0a68bb2,314,c54dfaa0,...) at md_kthread+0x11f
fork_exit(c05d3a37,c5738800,e57ebd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57ebd70, ebp = 0 ---

Tracing command syslogd pid 590 tid 100051 td 0xc569aa50

Tracing command devd pid 546 tid 100050 td 0xc569ac60

Tracing command md0 pid 111 tid 100079 td 0xc5700630
sched_switch(c5700630,0,1,180,6370e3e8,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5700630,...) at mi_switch+0x209
sleepq_switch(c5700630,0,c0a6f89a,21d,4c,...) at sleepq_switch+0xf7
sleepq_wait(c551a000,c551a020,c0a4a433,0,0,...) at sleepq_wait+0x60
_sleep(c551a000,c551a020,24c,c0a4a433,0,...) at _sleep+0x34f
md_kthread(c551a000,efcb9d38,c0a68bb2,314,c57052a8,...) at md_kthread+0x11f
fork_exit(c05d3a37,c551a000,efcb9d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xefcb9d70, ebp = 0 ---

Tracing command schedcpu pid 43 tid 100036 td 0xc5250000
sched_switch(c5250000,0,1,180,51a962d6,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c5250000,0,c0a6f89a,240,0,...) at sleepq_switch+0xf7
sleepq_timedwait(c0b8f294,3e8,c0a63bad,2,0,...) at sleepq_timedwait+0x61
_sleep(c0b8f294,0,0,c0a63bad,3e8,...) at _sleep+0x32b
pause(c0a63bad,3e8,1d1,1cf,d6dc6,...) at pause+0x40
schedcpu_thread(0,e57c4d38,c0a68bb2,314,c54db000,...) at schedcpu_thread+0x248
fork_exit(c074e7a6,0,e57c4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57c4d70, ebp = 0 ---

Tracing command softdepflush pid 42 tid 100037 td 0xc5143c60
sched_switch(c5143c60,0,1,180,64425e14,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5143c60,...) at mi_switch+0x209
sleepq_switch(c5143c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7
sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60
_sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f
bwillwrite(c0be7e1c,0,c0a8a260,365,c5143c60,...) at bwillwrite+0xef
softdep_process_worklist(c55495d0,0,c0bdc740,c5143c60,3e8,...) at softdep_process_worklist+0xfd
softdep_flush(0,e5792d38,c0a68bb2,314,c54db2a8,...) at softdep_flush+0x30f
fork_exit(c0908052,0,e5792d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5792d70, ebp = 0 ---

Tracing command syncer pid 41 tid 100038 td 0xc54dd000
sched_switch(c54dd000,0,1,180,e2f99796,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c54dd000,...) at mi_switch+0x209
sleepq_switch(c54dd000,0,c0a6f89a,21d,68,...) at sleepq_switch+0xf7
sleepq_wait(c0b8f28c,0,c0a77eb4,0,0,...) at sleepq_wait+0x60
_sleep(c0b8f28c,c0bdc824,68,c0a77eb4,0,...) at _sleep+0x34f
sched_sync(0,eda47d38,c0a68bb2,314,c54db550,...) at sched_sync+0x557
fork_exit(c07aacc7,0,eda47d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda47d70, ebp = 0 ---

Tracing command vnlru pid 40 tid 100039 td 0xc54dcc60
sched_switch(c54dcc60,0,1,180,f2721352,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,50,...) at mi_switch+0x209
sleepq_switch(c54dcc60,0,c0a6f89a,240,50,...) at sleepq_switch+0xf7
sleepq_timedwait(c54db7f8,3e8,c0a77f5e,0,0,...) at sleepq_timedwait+0x61
_sleep(c54db7f8,c0bdc7f8,250,c0a77f5e,3e8,...) at _sleep+0x32b
vnlru_proc(0,eda44d38,c0a68bb2,314,c54db7f8,...) at vnlru_proc+0x114
fork_exit(c07aba17,0,eda44d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda44d70, ebp = 0 ---

Tracing command bufdaemon pid 39 tid 100040 td 0xc54dca50
sched_switch(c54dca50,0,2,17b,bf9c634e,...) at sched_switch+0x1a6
mi_switch(2,0,c0a6c760,1c9,c54dbb30,...) at mi_switch+0x209
uio_yield(c54dbaa0,0,c0a75244,80b,3e8,...) at uio_yield+0x1c1
buf_daemon(0,eda41d38,c0a68bb2,314,c54dbaa0,...) at buf_daemon+0x19e
fork_exit(c0796e9d,0,eda41d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda41d70, ebp = 0 ---

Tracing command pagezero pid 38 tid 100041 td 0xc54dc840
sched_switch(c54dc840,0,1,180,4aeb2f2e,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c54dc840,0,c0a6f89a,240,0,...) at sleepq_switch+0xf7
sleepq_timedwait(c0be8a00,493e0,c0a8f9c7,0,0,...) at sleepq_timedwait+0x61
_sleep(c0be8a00,c0be85a4,0,c0a8f9c7,493e0,...) at _sleep+0x32b
vm_pagezero(0,eda3ed38,c0a68bb2,314,c54dbd48,...) at vm_pagezero+0xe0
fork_exit(c093fd0b,0,eda3ed38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda3ed70, ebp = 0 ---

Tracing command vmdaemon pid 37 tid 100042 td 0xc54dc630
sched_switch(c54dc630,0,1,180,16d90600,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c54dc630,...) at mi_switch+0x209
sleepq_switch(c54dc630,0,c0a6f89a,21d,68,...) at sleepq_switch+0xf7
sleepq_wait(c0be8618,c0be861c,c0a75b31,0,0,...) at sleepq_wait+0x60
_sleep(c0be8618,c0be861c,68,c0a75b31,0,...) at _sleep+0x34f
vm_daemon(0,eda3bd38,c0a68bb2,314,c54df000,...) at vm_daemon+0x59
fork_exit(c093b405,0,eda3bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda3bd70, ebp = 0 ---

Tracing command pagedaemon pid 36 tid 100043 td 0xc54dc420
sched_switch(c54dc420,0,1,180,dfb1a1ea,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,44,...) at mi_switch+0x209
sleepq_switch(c54dc420,0,c0a6f89a,240,44,...) at sleepq_switch+0xf7
sleepq_timedwait(c0be85e0,1388,c0a75b31,0,0,...) at sleepq_timedwait+0x61
_sleep(c0be85e0,c0be85a4,44,c0a75b31,1388,...) at _sleep+0x32b
vm_pageout(0,eda38d38,c0a68bb2,314,c54df2a8,...) at vm_pageout+0x2cc
fork_exit(c093bf54,0,eda38d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda38d70, ebp = 0 ---

Tracing command sctp_iterator pid 35 tid 100044 td 0xc54dc210
sched_switch(c54dc210,0,1,180,341dfa2c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c54dc210,...) at mi_switch+0x209
sleepq_switch(c54dc210,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7
sleepq_wait(c0bde2ac,c0bde1b4,c0a7e89f,0,0,...) at sleepq_wait+0x60
_sleep(c0bde2ac,c0bde1b4,0,c0a7e89f,0,...) at _sleep+0x34f
sctp_iterator_thread(0,eda5cd38,c0a68bb2,314,c54df550,...) at sctp_iterator_thread+0x60
fork_exit(c080d0c6,0,eda5cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xeda5cd70, ebp = 0 ---

Tracing command irq1: atkbd0 pid 34 tid 100024 td 0xc50ffa50
fork_trampoline() at fork_trampoline

Tracing command fdc0 pid 33 tid 100025 td 0xc50ff840
sched_switch(c50ff840,0,1,180,e7fce262,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209
sleepq_switch(c50ff840,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7
sleepq_timedwait(c5204c3c,3e8,c0a63bad,0,0,...) at sleepq_timedwait+0x61
_sleep(c5204c3c,c5204cf0,4c,c0a63bad,3e8,...) at _sleep+0x32b
fdc_thread(c5204c00,e3d52d38,c0a68bb2,314,c524f2a8,...) at fdc_thread+0x2a2
fork_exit(c0996dd5,c5204c00,e3d52d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d52d70, ebp = 0 ---

Tracing command irq20: fxp0 pid 32 tid 100026 td 0xc50ff630
fork_trampoline() at fork_trampoline

Tracing command irq29: bge1 pid 31 tid 100027 td 0xc5251420
fork_trampoline() at fork_trampoline

Tracing command irq28: bge0 pid 30 tid 100028 td 0xc5251210
sched_switch(c5251210,0,1,180,648fbdcc,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c5141564,...) at mi_switch+0x209
ithread_loop(c5266880,e57dcd38,c0a68bb2,314,c524faa0,...) at ithread_loop+0x339
fork_exit(c0719220,c5266880,e57dcd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57dcd70, ebp = 0 ---

Tracing command aac0aif pid 29 tid 100029 td 0xc5251000
sched_switch(c5251000,0,1,180,3fa40386,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209
sleepq_switch(c5251000,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7
sleepq_timedwait(c524fd48,4e20,c0a2a7e6,0,0,...) at sleepq_timedwait+0x61
_sleep(c524fd48,c5267128,4c,c0a2a7e6,4e20,...) at _sleep+0x32b
aac_command_thread(c5267000,e57d9d38,c0a68bb2,314,c524fd48,...) at aac_command_thread+0x8b
fork_exit(c04926c7,c5267000,e57d9d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57d9d70, ebp = 0 ---

Tracing command usbtask-dr pid 28 tid 100030 td 0xc5250c60
sched_switch(c5250c60,0,1,180,6f50878c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5250c60,...) at mi_switch+0x209
sleepq_switch(c5250c60,0,c0a6f89a,21d,5c,...) at sleepq_switch+0xf7
sleepq_wait(c0b7fb34,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0b7fb34,0,5c,c0a60bc4,0,...) at _sleep+0x34f
usb_task_thread(c0b7fb34,e57d6d38,c0a68bb2,314,c5252000,...) at usb_task_thread+0x62
fork_exit(c06b5e79,c0b7fb34,e57d6d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57d6d70, ebp = 0 ---

Tracing command usbtask-hc pid 27 tid 100031 td 0xc5250a50
sched_switch(c5250a50,0,1,180,6f506448,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5250a50,...) at mi_switch+0x209
sleepq_switch(c5250a50,0,c0a6f89a,21d,5c,...) at sleepq_switch+0xf7
sleepq_wait(c0b7fb20,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0b7fb20,0,5c,c0a60bc4,0,...) at _sleep+0x34f
usb_task_thread(c0b7fb20,e57d3d38,c0a68bb2,314,c52522a8,...) at usb_task_thread+0x62
fork_exit(c06b5e79,c0b7fb20,e57d3d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57d3d70, ebp = 0 ---

Tracing command usb0 pid 26 tid 100032 td 0xc5250840
sched_switch(c5250840,0,1,180,9d699a26,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,5c,...) at mi_switch+0x209
sleepq_switch(c5250840,0,c0a6f89a,240,5c,...) at sleepq_switch+0xf7
sleepq_timedwait(c5206210,ea60,c0a60b87,0,0,...) at sleepq_timedwait+0x61
_sleep(c5206210,0,5c,c0a60b87,ea60,...) at _sleep+0x32b
usb_event_thread(c5245440,e57d0d38,c0a68bb2,314,c5252550,...) at usb_event_thread+0xc8
fork_exit(c06b575e,c5245440,e57d0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe57d0d70, ebp = 0 ---

Tracing command irq15: ata1 pid 25 tid 100033 td 0xc5250630
fork_trampoline() at fork_trampoline

Tracing command irq14: ata0 pid 24 tid 100015 td 0xc50fd420
sched_switch(c50fd420,0,1,180,dac2254,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c50f70e4,...) at mi_switch+0x209
ithread_loop(c52485e0,e3d37d38,c0a68bb2,314,c51427f8,...) at ithread_loop+0x339
fork_exit(c0719220,c52485e0,e3d37d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d37d70, ebp = 0 ---

Tracing command swi0: uart sio pid 23 tid 100016 td 0xc50fd210
sched_switch(c50fd210,0,1,180,c3bb2bbc,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c5229364,...) at mi_switch+0x209
ithread_loop(c523fae0,e3d34d38,c0a68bb2,314,c5142aa0,...) at ithread_loop+0x339
fork_exit(c0719220,c523fae0,e3d34d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d34d70, ebp = 0 ---

Tracing command irq9: ohci0 acpi0 pid 22 tid 100017 td 0xc5143a50
fork_trampoline() at fork_trampoline

Tracing command kqueue taskq pid 21 tid 100018 td 0xc5143840
sched_switch(c5143840,0,1,180,6f86f138,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5143840,...) at mi_switch+0x209
sleepq_switch(c5143840,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7
sleepq_wait(c5141d80,c5141d9c,c0a63bad,0,0,...) at sleepq_wait+0x60
_sleep(c5141d80,c5141d9c,0,c0a63bad,0,...) at _sleep+0x34f
taskqueue_thread_loop(c0b80aac,e578cd38,c0a68bb2,314,c5202000,...) at taskqueue_thread_loop+0xae
fork_exit(c0761b41,c0b80aac,e578cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe578cd70, ebp = 0 ---

Tracing command swi2: cambio pid 20 tid 100019 td 0xc5143630
fork_trampoline() at fork_trampoline

Tracing command xpt_thrd pid 9 tid 100020 td 0xc5143420
sched_switch(c5143420,0,1,180,6f500338,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5143420,...) at mi_switch+0x209
sleepq_switch(c5143420,0,c0a6f89a,21d,4c,...) at sleepq_switch+0xf7
sleepq_wait(c0b50d14,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60
_sleep(c0b50d14,c0b50d2c,4c,c0a22ee2,0,...) at _sleep+0x34f
xpt_scanner_thread(0,e5786d38,c0a68bb2,314,c5202550,...) at xpt_scanner_thread+0x3a
fork_exit(c0466479,0,e5786d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5786d70, ebp = 0 ---

Tracing command swi6: task queue pid 19 tid 100021 td 0xc5143210
sched_switch(c5143210,0,1,180,d0b187a6,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c514d0e4,...) at mi_switch+0x209
ithread_loop(c51f1180,e5783d38,c0a68bb2,314,c52027f8,...) at ithread_loop+0x339
fork_exit(c0719220,c51f1180,e5783d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5783d70, ebp = 0 ---

Tracing command acpi_task_2 pid 8 tid 100022 td 0xc5143000
sched_switch(c5143000,0,1,180,6f86c754,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c5143000,...) at mi_switch+0x209
sleepq_switch(c5143000,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7
sleepq_wait(c514d180,c514d19c,c0a63bad,0,0,...) at sleepq_wait+0x60
_sleep(c514d180,c514d19c,0,c0a63bad,0,...) at _sleep+0x34f
taskqueue_thread_loop(c0d59efc,e5780d38,c0a68bb2,314,c5202aa0,...) at taskqueue_thread_loop+0xae
fork_exit(c0761b41,c0d59efc,e5780d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe5780d70, ebp = 0 ---

Tracing command acpi_task_1 pid 7 tid 100023 td 0xc50ffc60
sched_switch(c50ffc60,0,1,180,6f86a314,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c50ffc60,...) at mi_switch+0x209
sleepq_switch(c50ffc60,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7
sleepq_wait(c514d180,c514d19c,c0a63bad,0,0,...) at sleepq_wait+0x60
_sleep(c514d180,c514d19c,0,c0a63bad,0,...) at _sleep+0x34f
taskqueue_thread_loop(c0d59efc,e3d58d38,c0a68bb2,314,c5202d48,...) at taskqueue_thread_loop+0xae
fork_exit(c0761b41,c0d59efc,e3d58d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d58d70, ebp = 0 ---

Tracing command acpi_task_0 pid 6 tid 100007 td 0xc50fb000
sched_switch(c50fb000,0,1,180,6f867750,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c50fb000,...) at mi_switch+0x209
sleepq_switch(c50fb000,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7
sleepq_wait(c514d180,c514d19c,c0a63bad,0,0,...) at sleepq_wait+0x60
_sleep(c514d180,c514d19c,0,c0a63bad,0,...) at _sleep+0x34f
taskqueue_thread_loop(c0d59efc,e3d1cd38,c0a68bb2,314,c50fe2a8,...) at taskqueue_thread_loop+0xae
fork_exit(c0761b41,c0d59efc,e3d1cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d1cd70, ebp = 0 ---

Tracing command swi6: Giant taskq pid 18 tid 100008 td 0xc50ff420
fork_trampoline() at fork_trampoline

Tracing command thread taskq pid 5 tid 100009 td 0xc50ff210
sched_switch(c50ff210,0,1,180,6f93a150,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c50ff210,...) at mi_switch+0x209
sleepq_switch(c50ff210,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7
sleepq_wait(c514d300,c514d31c,c0a63bad,0,0,...) at sleepq_wait+0x60
_sleep(c514d300,c514d31c,0,c0a63bad,0,...) at _sleep+0x34f
taskqueue_thread_loop(c0b94ab8,e3d49d38,c0a68bb2,314,c50fe7f8,...) at taskqueue_thread_loop+0xae
fork_exit(c0761b41,c0b94ab8,e3d49d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d49d70, ebp = 0 ---

Tracing command swi5: + pid 17 tid 100010 td 0xc50ff000
sched_switch(c50ff000,0,1,180,617e9322,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c514d3e4,...) at mi_switch+0x209
ithread_loop(c51f11c0,e3d46d38,c0a68bb2,314,c50feaa0,...) at ithread_loop+0x339
fork_exit(c0719220,c51f11c0,e3d46d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d46d70, ebp = 0 ---

Tracing command yarrow pid 16 tid 100011 td 0xc50fdc60
sched_switch(c50fdc60,0,1,180,60457496,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c50fdc60,0,c0a6f89a,240,0,...) at sleepq_switch+0xf7
sleepq_timedwait(c0b8f294,64,c0a63bad,2,0,...) at sleepq_timedwait+0x61
_sleep(c0b8f294,0,0,c0a63bad,64,...) at _sleep+0x32b
pause(c0a63bad,64,c0a58583,112,0,...) at pause+0x40
random_kthread(0,e3d43d38,c0a68bb2,314,c50fed48,...) at random_kthread+0x1d1
fork_exit(c06444c2,0,e3d43d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d43d70, ebp = 0 ---

Tracing command g_down pid 4 tid 100012 td 0xc50fda50
sched_switch(c50fda50,0,1,180,636afab4,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209
sleepq_switch(c50fda50,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7
sleepq_timedwait(c0b802ac,64,c0a63bad,0,0,...) at sleepq_timedwait+0x61
_sleep(c0b802ac,c0b801c8,24c,c0a63bad,64,...) at _sleep+0x32b
g_io_schedule_down(c50fda50,0,c0a65270,74,0,...) at g_io_schedule_down+0x64
g_down_procbody(0,e3d40d38,c0a68bb2,314,c5142000,...) at g_down_procbody+0x8d
fork_exit(c06e9f7f,0,e3d40d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d40d70, ebp = 0 ---

Tracing command g_up pid 3 tid 100013 td 0xc50fd840
sched_switch(c50fd840,0,1,180,637227c8,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209
sleepq_switch(c50fd840,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7
sleepq_timedwait(c0b802a8,64,c0a63bad,0,0,...) at sleepq_timedwait+0x61
_sleep(c0b802a8,c0b80208,24c,c0a63bad,64,...) at _sleep+0x32b
g_io_schedule_up(c50fd840,0,c0a65270,5d,0,...) at g_io_schedule_up+0x132
g_up_procbody(0,e3d3dd38,c0a68bb2,314,c51422a8,...) at g_up_procbody+0x8d
fork_exit(c06ea00e,0,e3d3dd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d3dd70, ebp = 0 ---

Tracing command g_event pid 2 tid 100014 td 0xc50fd630
sched_switch(c50fd630,0,1,180,5a5ab90a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209
sleepq_switch(c50fd630,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7
sleepq_timedwait(c0b802a0,64,c0a63bad,0,0,...) at sleepq_timedwait+0x61
_sleep(c0b802a0,0,4c,c0a63bad,64,...) at _sleep+0x32b
g_event_procbody(0,e3d3ad38,c0a68bb2,314,c5142550,...) at g_event_procbody+0xcb
fork_exit(c06ea09d,0,e3d3ad38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d3ad70, ebp = 0 ---

Tracing command swi1: net pid 15 tid 100000 td 0xc50fd000
sched_switch(c50fd000,0,1,180,e0f2206a,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c50f8964,...) at mi_switch+0x209
ithread_loop(c50f9290,e3d31d38,c0a68bb2,314,c50fa000,...) at ithread_loop+0x339
fork_exit(c0719220,c50f9290,e3d31d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d31d70, ebp = 0 ---

Tracing command swi3: vm pid 14 tid 100001 td 0xc50fbc60
fork_trampoline() at fork_trampoline

Tracing command swi4: clock sio pid 13 tid 100002 td 0xc50fba50
sched_switch(c50fba50,0,1,180,64283f04,...) at sched_switch+0x1a6
mi_switch(1,0,c0a68e36,46b,c50f8a64,...) at mi_switch+0x209
ithread_loop(c50f92b0,e3d2bd38,c0a68bb2,314,c50fa550,...) at ithread_loop+0x339
fork_exit(c0719220,c50f92b0,e3d2bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d2bd70, ebp = 0 ---

Tracing command idle: cpu0 pid 12 tid 100003 td 0xc50fb840
sched_switch(c50fb840,0,1,17b,88f7bd96,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6dbe6,565,e3d28d24,...) at mi_switch+0x209
sched_idletd(0,e3d28d38,c0a68bb2,314,c50fa7f8,...) at sched_idletd+0x7a
fork_exit(c074ea47,0,e3d28d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d28d70, ebp = 0 ---

Tracing command idle: cpu1 pid 11 tid 100004 td 0xc50fb630
sched_switch(c50fb630,0,1,17b,69dbf35c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6dbe6,565,e3d25d24,...) at mi_switch+0x209
sched_idletd(0,e3d25d38,c0a68bb2,314,c50faaa0,...) at sched_idletd+0x7a
fork_exit(c074ea47,0,e3d25d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d25d70, ebp = 0 ---

Tracing command init pid 1 tid 100005 td 0xc50fb420
sched_switch(c50fb420,0,1,180,1e99776c,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209
sleepq_switch(c50fb420,0,c0a6f89a,19b,c50fad48,...) at sleepq_switch+0xf7
sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221
sleepq_wait_sig(c50fad48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10
_sleep(c50fad48,c50fadd8,15c,c0a719db,0,...) at _sleep+0x33f
kern_wait(c50fb420,ffffffff,e3d22c2c,0,0,...) at kern_wait+0xa3e
wait4(c50fb420,e3d22cfc,10,c0a717fc,c0b18aa8,...) at wait4+0x3d
syscall(e3d22d38) at syscall+0x2a0
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054c3b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 ---

Tracing command audit pid 10 tid 100006 td 0xc50fb210
sched_switch(c50fb210,0,1,180,70135154,...) at sched_switch+0x1a6
mi_switch(1,0,c0a6f89a,1bf,c50fb210,...) at mi_switch+0x209
sleepq_switch(c50fb210,0,c0a6f89a,21d,c50fb210,...) at sleepq_switch+0xf7
sleepq_wait(c0be78b4,c0be7894,c0a8897d,1,0,...) at sleepq_wait+0x60
_cv_wait(c0be78b4,c0be7894,c0a89322,1c2,0,...) at _cv_wait+0x1f3
audit_worker(0,e3d1fd38,c0a68bb2,314,c50fe000,...) at audit_worker+0x99
fork_exit(c08ee282,0,e3d1fd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe3d1fd70, ebp = 0 ---

Tracing command swapper pid 0 tid 0 td 0xc0b80610
sched_switch(c0b80610,0,1,180,55fd8366,...) at sched_switch+0x1a6
mi_switch(1,0,c0a8d5d6,2d9,c5697568,...) at mi_switch+0x209
scheduler(0,101ec00,101ec00,101e000,1028000,...) at scheduler+0x2ed
mi_startup() at mi_startup+0x90
begin() at begin+0x2c
db> call doadump
Physical memory: 2035 MB
Dumping 205 MB: 190 174 158 142 126 110 94 78 62 46 30 14
Dump complete
= 0xf
db> c
Uptime: 5h38m18s
aac0: shutting down controller...done
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...
cpu_reset: Stopping other CPUs

(kgdb) bt
#0  doadump () at pcpu.h:195
#1  0xc0489d57 in db_fncall (dummy1=-959166528, dummy2=0, dummy3=-1, dummy4=0xf1d39924 "") at ../../../ddb/db_command.c:486
#2  0xc048a28c in db_command_loop () at ../../../ddb/db_command.c:401
#3  0xc048b8d7 in db_trap (type=3, code=0) at ../../../ddb/db_main.c:222
#4  0xc0758692 in kdb_trap (type=3, code=0, tf=0xf1d39acc) at ../../../kern/subr_kdb.c:502
#5  0xc09d462b in trap (frame=0xf1d39acc) at ../../../i386/i386/trap.c:621
#6  0xc09bb3db in calltrap () at ../../../i386/i386/exception.s:139
#7  0xc07587eb in kdb_enter (msg=0xc0a6c254 "panic") at cpufunc.h:60
#8  0xc073393e in panic (fmt=0xc0a8e9e2 "vm_page_cache_transfer: object %p's type is incompatible with cached pages") at ../../../kern/kern_shutdown.c:547
#9  0xc0938db2 in vm_page_cache_transfer (orig_object=0xc6d447c0, offidxstart=0, new_object=0xc755c3e0) at ../../../vm/vm_page.c:982
#10 0xc09383cc in vm_object_split (entry=0xc742a50c) at ../../../vm/vm_object.c:1368
#11 0xc0930884 in vmspace_fork (vm1=0xc7377570) at ../../../vm/vm_map.c:2503
#12 0xc092c3ed in vm_forkproc (td=0xc7762000, p2=0xc5cda550, td2=0xc5cdc630, flags=20) at ../../../vm/vm_glue.c:541
#13 0xc0717bb0 in fork1 (td=0xc7762000, flags=Variable "flags" is not available.
) at ../../../kern/kern_fork.c:655
#14 0xc0718247 in fork (td=0xc7762000, uap=0xf1d39cfc) at ../../../kern/kern_fork.c:94
#15 0xc09d3e05 in syscall (frame=0xf1d39d38) at ../../../i386/i386/trap.c:1008
#16 0xc09bb440 in Xint0x80_syscall () at ../../../i386/i386/exception.s:196
#17 0x00000033 in ?? ()
(kgdb) f 10
#10 0xc09383cc in vm_object_split (entry=0xc742a50c) at ../../../vm/vm_object.c:1368
1368                            vm_page_cache_transfer(orig_object, offidxstart,
(kgdb) l
1363
1364                    /*
1365                     * Transfer any cached pages from orig_object to new_object.
1366                     */
1367                    if (__predict_false(orig_object->cache != NULL))
1368                            vm_page_cache_transfer(orig_object, offidxstart,
1369                                new_object);
1370            }
1371            VM_OBJECT_UNLOCK(orig_object);
1372            TAILQ_FOREACH(m, &new_object->memq, listq)
(kgdb) info loc
m = 0xc28b06a0
m_next = 0xc2b885c0
orig_object = 0xc6d447c0
new_object = 0xc755c3e0
source = 0xc2b885c0
idx = Variable "idx" is not available.
(kgdb) p *m
$1 = {pageq = {tqe_next = 0xc2b88650, tqe_prev = 0xc183eb30}, listq = {tqe_next = 0x0, tqe_prev = 0xc1a8afd0}, left = 0xc1a8afc8, right = 0x0, object = 0xc755c3e0,
  pindex = 4, phys_addr = 1202933760, md = {pv_list_count = 1, pv_list = {tqh_first = 0xc3dd3784, tqh_last = 0xc3dd3788}}, queue = 2 '\002', segind = 2 '\002', flags = 144,
  order = 11 '\v', pool = 0 '\0', wire_count = 0, cow = 0, hold_count = 0, oflags = 1, act_count = 5 '\005', busy = 0 '\0', valid = 255 'ÿ', dirty = 255 'ÿ'}
(kgdb) p *m_next
$2 = {pageq = {tqe_next = 0xc2cb6dc8, tqe_prev = 0xc3080ff8}, listq = {tqe_next = 0xc2b88650, tqe_prev = 0xc6d447ec}, left = 0x0, right = 0x0, object = 0xc6d447c0,
  pindex = 5, phys_addr = 1372557312, md = {pv_list_count = 1, pv_list = {tqh_first = 0xc3dd31f0, tqh_last = 0xc3dd31f4}}, queue = 1 '\001', segind = 2 '\002', flags = 128,
  order = 11 '\v', pool = 0 '\0', wire_count = 0, cow = 0, hold_count = 0, oflags = 0, act_count = 5 '\005', busy = 0 '\0', valid = 255 'ÿ', dirty = 255 'ÿ'}
(kgdb) p *orig_object
$3 = {mtx = {lock_object = {lo_name = 0xc0a8cf21 "vm object", lo_type = 0xc0a8e50a "standard object", lo_flags = 21168128, lo_witness_data = {lod_list = {
          stqe_next = 0xc0b9e3f0}, lod_witness = 0xc0b9e3f0}}, mtx_lock = 3346407424, mtx_recurse = 0}, object_list = {tqe_next = 0xc7a32364, tqe_prev = 0xc77db7d8},
  shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xc7a6eba0, le_prev = 0xc69e9214}, memq = {tqh_first = 0xc2b885c0, tqh_last = 0xc1eb5500}, root = 0xc2984008,
  size = 22, generation = 28, ref_count = 2, shadow_count = 0, type = 1 '\001', flags = 8452, pg_color = 0, paging_in_progress = 0, resident_page_count = 11,
  backing_object = 0x0, backing_object_offset = 0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, cache = 0x0, handle = 0x0, un_pager = {vnp = {vnp_size = 0}, devp = {
      devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_bcount = 0}}}
(kgdb) p *new_object
$4 = {mtx = {lock_object = {lo_name = 0xc0a8cf21 "vm object", lo_type = 0xc0a8e50a "standard object", lo_flags = 21168128, lo_witness_data = {lod_list = {
          stqe_next = 0xc0b9e3f0}, lod_witness = 0xc0b9e3f0}}, mtx_lock = 3346407424, mtx_recurse = 0}, object_list = {tqe_next = 0xc767a3e0, tqe_prev = 0xc75eb18c},
  shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xc84cc3e0, le_prev = 0xc7429cb8}, memq = {tqh_first = 0xc31b52d8, tqh_last = 0xc28b06a8}, root = 0xc28b06a0,
  size = 5, generation = 5, ref_count = 1, shadow_count = 0, type = 0 '\0', flags = 8448, pg_color = 0, paging_in_progress = 0, resident_page_count = 4, backing_object = 0x0,
  backing_object_offset = 0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, cache = 0xc2107d68, handle = 0x0, un_pager = {vnp = {vnp_size = 0}, devp = {devp_pglist = {
        tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_bcount = 0}}}
(kgdb) p *source
$5 = {mtx = {lock_object = {lo_name = 0xc2cb6dc8 "ø?ØÂÀ\205¸Â", lo_type = 0xc3080ff8 "À\205¸Â\200§}ÁÐ\020\bÃ\210§}Á", lo_flags = 3266872912, lo_witness_data = {lod_list = {
          stqe_next = 0xc6d447ec}, lod_witness = 0xc6d447ec}}, mtx_lock = 0, mtx_recurse = 0}, object_list = {tqe_next = 0xc6d447c0, tqe_prev = 0x5}, shadow_head = {
    lh_first = 0x0}, shadow_list = {le_next = 0x51cf9000, le_prev = 0x1}, memq = {tqh_first = 0xc3dd31f0, tqh_last = 0xc3dd31f4}, root = 0x800201, size = 11, generation = 0,
  ref_count = -65531, shadow_count = -1024722984, type = 120 'x', flags = 49848, pg_color = 63448, paging_in_progress = 49899, resident_page_count = -1028094592,
  backing_object = 0xc2b88578, backing_object_offset = -4143501443195731968, pager_object_list = {tqe_next = 0x3398, tqe_prev = 0x0}, cache = 0x51cfa000, handle = 0x1,
  un_pager = {vnp = {vnp_size = -4345348341430601552}, devp = {devp_pglist = {tqh_first = 0xc3b238b0, tqh_last = 0xc3b238b4}}, swp = {swp_bcount = -1011730256}}}
(kgdb) p *entry
$6 = {prev = 0xc6e39374, next = 0xc742a330, left = 0xc6e39374, right = 0xc742a330, start = 671645696, end = 671666176, avail_ssize = 0, adj_free = 0, max_free = 0, object = {
    vm_object = 0xc6d447c0, sub_map = 0xc6d447c0}, offset = 0, eflags = 0, protection = 3 '\003', max_protection = 7 '\a', inheritance = 1 '\001', wired_count = 0, lastr = 2}
(kgdb)

--
Test scenario: vfs.sh + all.sh