GENERIC HEAD from Oct 18 + vm_page_cache_remove.patch, vmcore.2 GDB: no debug ports present GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-CURRENT #2: Thu Oct 25 04:41:11 UTC 2007 test@orangutan.netperf.freebsd.org:/pho/src/sys/i386/compile/PHO WARNING: WITNESS option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) XEON(TM) CPU 2.20GHz (2192.90-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf24 Stepping = 4 Features=0x3febfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM> real memory = 2147352576 (2047 MB) avail memory = 2091339776 (1994 MB) ACPI APIC Table: <DELL PE2650 > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 6 ioapic0: Changing APIC ID to 8 ioapic1: Changing APIC ID to 9 ioapic2: Changing APIC ID to 10 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 <Version 1.1> irqs 0-15 on motherboard : Trying to mount root from nfs: bNgFeS0 :R OlOiTn:k 1s9t2a.t1e6 8c.h5a.n1g:e/dz otoo/ oDrOaWnNgu tan bge0: link state changed to UP Interface bge0 IP-Address 192.168.5.105 Broadcast 192.168.5.255 Loading configuration files. No suitable dump device was found. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: mount_nfs: can't update /var/db/mounttab for 192.168.5.1:/zoo/orangutan Setting hostuuid: 44454c4c-5800-1036-8038-c6c04f5a3131. Setting hostid: 0xb59b50bc. Mounting local file systems:. Setting hostname: orangutan.netperf.freebsd.org. net.inet6.ip6.auto_linklocal: 1 -> 0 lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet6 ::1 prefixlen 128 inet 127.0.0.1 netmask 0xff000000 Additional routing options:. Starting devd. bge1: link state changed to UP fxp0: link state changed to DOWN hw.acpi.cpu.cx_lowest: C1 sysctl: hw.acpi.cpu.cx_lowest: Invalid argument Additional IP options:. Mounting NFS file systems:. Creating and/or trimming log files:. Starting syslogd. /etc/rc: WARNING: Dump device does not exist. Savecore not run. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Initial i386 initialization:. Additional ABI support:. Starting auditd. Clearing /tmp (X related). Starting rpcbind. Starting mountd. Starting nfsd. Starting local daemons:. Updating motd. Mounting late file systems:. Configuring syscons: blanktime. Starting sshd. sendmail_submit: /etc/mail/aliases newer than /etc/mail/aliases.db, regenerating cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported Alias file /etc/mail/aliases is locked (maybe being rebuilt) Oct 27 09:11:21 orangutan sendmail[764]: NOQUEUE: SYSERR(root): cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported sendmail_clientmqueue: /etc/mail/aliases newer than /etc/mail/aliases.db, regenerating cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported Alias file /etc/mail/aliases is locked (maybe being rebuilt) Oct 27 09:11:21 orangutan sendmail[766]: NOQUEUE: SYSERR(root): cannot flock(/etc/mail/aliases, fd=3, type=6, omode=40002, euid=0): Operation not supported Starting cron. Local package initialization:. Starting background file system checks in 60 seconds. Sat Oct 27 09:11:22 UTC 2007 FreeBSD/i386 (orangutan.netperf.freebsd.org) (ttyd0) login: Oct 27 09:12:19 orangutan sshd[824]: in openpam_dispatch(): pam_nologin.so: no pam_sm_authenticate() Oct 27 09:12:20 orangutan sshd[825]: in openpam_dispatch(): pam_nologin.so: no pam_sm_setcred() Oct 27 09:12:23 orangutan su: test to root on /dev/ttyp0 GEOM_LABEL: Label ufs/root removed. GEOM_LABEL: Label for provider aacd0s1a is ufs/root. GWARNING: /m2 was not properly dismounted /m2: mount pendEOM_LABEL: Label ufs/root removed. ing error: blocks 0 files 1 Oct 27 09:12:48 orangutan savecore: reboot after panic: vm_page_cache_transfer: object 0xc5c771f0's type is incompatible with cached pages GEOM_LABEL: Label for provider aacd0s1a is ufs/root. GEOM_LABEL: Label ufs/root removed. GEOM_LABEL: Label for provider aacd0s1a is ufs/root. GEOM_LABEL: Label ufs/root removed. test Password:Oct 27 09:36:46 orangutan login: in openpam_dispatch(): pam_nologin.so: no pam_sm_authenticate() Last login: Sat Oct 27 09:12:21 from 192.168.5.1 Oct 27 09:36:49 orangutan login: in openpam_dispatch(): pam_nologin.so: no pam_sm_setcred() ./Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 8.0-CURRENT (PHO) #2: Thu Oct 25 04:41:11 UTC 2007 Welcome to FreeBSD! Before seeking technical support, please use the following resources: o Security advisories and updated errata information for all releases are at http://www.FreeBSD.org/releases/ - always consult the ERRATA section for your release first as it's updated frequently. o The Handbook and FAQ documents are at http://www.FreeBSD.org/ and, along with the mailing lists, can be searched by going to http://www.FreeBSD.org/search/. If the doc distribution has been installed, they're also available formatted in /usr/share/doc. If you still have a question or problem, please take the output of `uname -a', along with any relevant error messages, and email it as a question to the questions@FreeBSD.org mailing list. If you are unfamiliar with FreeBSD's directory layout, please refer to the hier(7) manual page. If you are not familiar with manual pages, type `man man'. You may also use sysinstall(8) to re-enter the installation and configuration utility. Edit /etc/motd to change this login announcement. pho/kIf you are running xterm, the default TERM variable will be 'xterm'. If you set this environment variable to 'xterm-color' instead, a lot of programs will use colors. You can do this by TERM=xterm-color; export TERM in Bourne-derived shells, and setenv TERM xterm-color in csh-derived shells. ee> ./pho/keepalive.sh Sat Oct 27 11:37:12 CEST 2007 11:37AM up 26 mins, 2 users, load averages: 13.57, 3.32, 1.20 Sat Oct 27 11:47:15 CEST 2007 11:47AM up 36 mins, 2 users, load averages: 197.18, 983.02, 435.35 Limiting icmp unreach response from 24936 to 200 packets/sec Limiting icmp unreach response from 7581 to 200 packets/sec Limiting icmp unreach response from 443 to 200 packets/sec : kern.ipc.maxpipekva exceeded; see tuning(7) kern.ipc.maxpipekva exceeded; see tuning(7) kern.ipc.maxpipekva exceeded; see tuning(7) kern.ipc.maxpipekva exceeded; see tuning(7) Sat Oct 27 16:39:23 CEST 2007 4:39PM up 5:28, 2 users, load averages: 39.08, 107.11, 137.25 panic: vm_page_cache_transfer: object 0xc755c3e0's type is incompatible with cached pages cpuid = 0 KDB: enter: panic [thread pid 23714 tid 101825 ] Stopped at kdb_enter+0x32: leave db> where Tracing pid 23714 tid 101825 td 0xc7762000 kdb_enter(c0a6c254,0,c0a8e9e2,f1d39b4c,0,...) at kdb_enter+0x32 panic(c0a8e9e2,c755c3e0,0,3ae,80000000,...) at panic+0x124 vm_page_cache_transfer(c6d447c0,0,0,c755c3e0,0,...) at vm_page_cache_transfer+0x1a5 vm_object_split(c742a50c,0,c0a8da5d,9c1,28086000,...) at vm_object_split+0x480 vmspace_fork(c7377570,1,c0a6afe4,ce,c6fb3d00,...) at vmspace_fork+0x304 vm_forkproc(c7762000,c5cda550,c5cdc630,14,0,...) at vm_forkproc+0xbc fork1(c7762000,14,0,f1d39c78,c7762000,...) at fork1+0x10a4 fork(c7762000,f1d39cfc,c0a99df5,c0a71873,c0b18a30,...) at fork+0x29 syscall(f1d39d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe6ac, ebp = 0xbfbfe6d8 --- db> show object 0xc755c3e0 Object 0xc755c3e0: type=0, size=0x5, res=4, ref=1, flags=0x2100 sref=0, backing_object(0)=(0)+0x0 memory:=(off=0x0,page=0x67c44000),(off=0x1,page=0x2032000),(off=0x2,page=0x15672000),(off=0x4,page=0x47b35000) db> show object 0xc6d447c0 Object 0xc6d447c0: type=1, size=0x16, res=11, ref=2, flags=0x2104 sref=0, backing_object(0)=(0)+0x0 memory:=(off=0x5,page=0x51cf9000),(off=0x6,page=0x51cfb000),(off=0x7,page=0x4aa3a000),(off=0x8,page=0x41516000),(off=0x9,page=0x41517000),(off=0xa,page=0x29bd7000) ...(off=0xb,page=0x29792000),(off=0xc,page=0x29793000),(off=0xd,page=0xec12000),(off=0xe,page=0xec13000),(off=0xf,page=0x24368000) db> set $lines 0 db> show allpcpu Current CPU: 0 cpuid = 0 curthread = 0xc7762000: pid 23714 "sh" curpcb = 0xf1d39d90 fpcurthread = none idlethread = 0xc50fb840: pid 12 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 curthread = 0xc777d000: pid 23716 "sh" curpcb = 0xf1e86d90 fpcurthread = none idlethread = 0xc50fb630: pid 11 "idle: cpu1" APIC ID = 6 currentldt = 0x50 spin locks held: db> show alllocks Process 23721 (sh) thread 0xc736f840 (100214) exclusive sx user map r = 0 (0xc7378cf4) locked @ vm/vm_map.c:3090 Process 23720 (sh) thread 0xc7353a50 (100179) exclusive sx user map r = 0 (0xc5100c0c) locked @ vm/vm_map.c:3090 Process 23718 (sh) thread 0xc7373420 (100202) exclusive sx user map r = 0 (0xc5cb9cf4) locked @ vm/vm_map.c:3090 Process 23716 (sh) thread 0xc777d000 (101849) exclusive sleep mutex pmap r = 0 (0xc830a08c) locked @ i386/i386/pmap.c:2789 exclusive sleep mutex pmap r = 0 (0xc5c35174) locked @ i386/i386/pmap.c:2788 exclusive sleep mutex vm page queue mutex r = 0 (0xc0be85bc) locked @ i386/i386/pmap.c:2786 exclusive sx user map r = 0 (0xc830a044) locked @ vm/vm_map.c:2582 Process 23715 (sh) thread 0xc76fca50 (101856) exclusive sleep mutex vm object (standard object) r = 0 (0xc68656c8) locked @ vm/vm_map.c:2497 exclusive sx user map r = 0 (0xc5a23c0c) locked @ vm/vm_map.c:2582 Process 23714 (sh) thread 0xc7762000 (101825) exclusive sleep mutex vm page queue free mutex r = 0 (0xc0be85a4) locked @ vm/vm_page.c:942 exclusive sleep mutex vm object (standard object) r = 0 (0xc6d447c0) locked @ vm/vm_object.c:1299 exclusive sleep mutex vm object (standard object) r = 0 (0xc755c3e0) locked @ vm/vm_object.c:1298 exclusive sx user map r = 0 (0xc73775b4) locked @ vm/vm_map.c:2582 Process 23713 (sh) thread 0xc5781630 (100171) exclusive sx user map r = 0 (0xc7377b24) locked @ vm/vm_map.c:3090 Process 23712 (sh) thread 0xc777d210 (101850) exclusive sx user map r = 0 (0xc73773e4) locked @ vm/vm_map.c:3090 Process 23665 (swap) thread 0xc7353210 (100183) exclusive sleep mutex vm object (standard object) r = 0 (0xc76b445c) locked @ vm/vm_fault.c:293 exclusive sx user map r = 0 (0xc5a2086c) locked @ vm/vm_map.c:3090 Process 23643 (swap) thread 0xc5cb6630 (100166) exclusive sx user map r = 0 (0xc574ec0c) locked @ vm/vm_map.c:3090 Process 23619 (swap) thread 0xc5780c60 (100093) exclusive sleep mutex vm object (standard object) r = 0 (0xc74ab6c8) locked @ vm/vm_fault.c:886 exclusive sx user map r = 0 (0xc51012fc) locked @ vm/vm_map.c:3090 Process 822 (sshd) thread 0xc5700c60 (100076) exclusive sx so_rcv_sx r = 0 (0xc577b3a4) locked @ kern/uipc_sockbuf.c:145 db> ps pid ppid pgrp uid state wmesg wchan cmd 23728 23714 2605 1001 N+ sh 23727 23716 2501 0 N sh 23726 23715 2605 1001 N+ sh 23725 23622 2605 1001 R+ sh 23724 23630 2605 1001 R+ sh 23723 23632 2605 1001 R+ sh 23722 23634 2605 1001 R+ sh 23721 23626 2605 1001 RL+ sh 23720 23638 2605 1001 RL+ sh 23719 23642 2605 1001 R+ sh 23718 23624 2605 1001 RL+ sh 23717 23640 2605 1001 R+ sh 23716 2501 2501 0 RL CPU 1 sh 23715 23644 2605 1001 RL+ sh 23714 23628 2605 1001 RL+ CPU 0 sh 23713 23636 2605 1001 RL+ sh 23712 23645 2605 1001 RL+ sh 23711 23710 2605 1001 S+ flswai 0xc0bdc57c sysctl 23710 23646 2605 1001 S+ wait 0xc5eda7f8 sh 23665 23617 2605 1001 RL+ swap 23664 23617 2605 1001 R+ swap 23663 23617 2605 1001 R+ swap 23662 23617 2605 1001 R+ swap 23661 23617 2605 1001 RL+ swap 23660 23617 2605 1001 R+ swap 23659 23617 2605 1001 R+ swap 23658 23617 2605 1001 R+ swap 23657 23617 2605 1001 R+ swap 23656 23617 2605 1001 R+ swap 23655 23617 2605 1001 R+ swap 23654 23617 2605 1001 R+ swap 23653 23617 2605 1001 R+ swap 23652 23617 2605 1001 R+ swap 23651 23617 2605 1001 R+ swap 23650 23617 2605 1001 R+ swap 23649 23617 2605 1001 R+ swap 23648 23617 2605 1001 R+ swap 23647 23617 2605 1001 R+ swap 23646 23618 2605 1001 S+ wait 0xc58e7000 sysctl 23645 23618 2605 1001 S+ wait 0xc739cd48 sysctl 23644 23618 2605 1001 S+ wait 0xc577e550 sysctl 23643 23617 2605 1001 RL+ swap 23642 23618 2605 1001 S+ wait 0xc60cbd48 sysctl 23641 23617 2605 1001 R+ swap 23640 23618 2605 1001 S+ wait 0xc5d20000 sysctl 23639 23617 2605 1001 R+ swap 23638 23618 2605 1001 S+ wait 0xc7397d48 sysctl 23637 23617 2605 1001 R+ swap 23636 23618 2605 1001 S+ wait 0xc5eda550 sysctl 23635 23617 2605 1001 R+ swap 23634 23618 2605 1001 S+ wait 0xc5c99000 sysctl 23633 23617 2605 1001 R+ swap 23632 23618 2605 1001 S+ wait 0xc5ce02a8 sysctl 23631 23617 2605 1001 R+ swap 23630 23618 2605 1001 S+ wait 0xc58e7aa0 sysctl 23629 23617 2605 1001 RL+ swap 23628 23618 2605 1001 S+ wait 0xc5cdaaa0 sysctl 23627 23617 2605 1001 RL+ swap 23626 23618 2605 1001 S+ wait 0xc60bb000 sysctl 23625 23617 2605 1001 R+ swap 23624 23618 2605 1001 S+ wait 0xc736aaa0 sysctl 23623 23617 2605 1001 R+ swap 23622 23618 2605 1001 S+ wait 0xc60e0aa0 sysctl 23621 23617 2605 1001 R+ swap 23620 23617 2605 1001 RL+ swap 23619 23617 2605 1001 RL+ swap 23618 23585 2605 1001 S+ wait 0xc58e77f8 sysctl 23617 23582 2605 1001 S+ wait 0xc7371d48 swap 23616 23611 2605 1001 S+ flswai 0xc0bdc57c rw 23615 23611 2605 1001 S+ flswai 0xc0bdc57c rw 23614 23611 2605 1001 S+ flswai 0xc0bdc57c rw 23613 23611 2605 1001 S+ flswai 0xc0bdc57c rw 23612 23611 2605 1001 R+ rw 23611 23579 2605 1001 S+ wait 0xc589b7f8 rw 23610 23594 2605 1001 S+ getblk 0xd930e4a0 mkdir 23609 23594 2605 1001 S+ getblk 0xd930e4a0 mkdir 23608 23594 2605 1001 S+ flswai 0xc0bdc57c mkdir 23607 23594 2605 1001 S+ flswai 0xc0bdc57c mkdir 23606 23594 2605 1001 R+ mkdir 23605 23594 2605 1001 S+ flswai 0xc0bdc57c mkdir 23604 23594 2605 1001 S+ flswai 0xc0bdc57c mkdir 23603 23594 2605 1001 S+ flswai 0xc0bdc57c mkdir 23602 23594 2605 1001 R+ mkdir 23601 23594 2605 1001 S+ getblk 0xd930e4a0 mkdir 23600 23594 2605 1001 S+ flswai 0xc0bdc57c mkdir 23599 23594 2605 1001 S+ getblk 0xd930e4a0 mkdir 23598 23594 2605 1001 R+ mkdir 23597 23594 2605 1001 S+ getblk 0xd930e4a0 mkdir 23596 23594 2605 1001 RL+ mkdir 23595 23594 2605 1001 R+ mkdir 23594 23575 2605 1001 S+ wait 0xc5252aa0 mkdir 23585 23257 2605 1001 S+ nanslp 0xc0b8f464 sysctl 23582 23257 2605 1001 S+ nanslp 0xc0b8f464 swap 23579 23257 2605 1001 S+ nanslp 0xc0b8f464 rw 23575 23257 2605 1001 S+ nanslp 0xc0b8f464 mkdir 23525 0 0 0 SL - 0xc0be2480 [nfsiod 0] 23257 23256 2605 1001 R+ run 23256 23255 2605 1001 S+ wait 0xc736a000 run 23255 23242 2605 1001 S+ wait 0xc7370d48 run 23242 2605 2605 1001 S+ wait 0xc56fed48 sh 23088 2682 2682 1001 S+ nanslp 0xc0b8f464 sleep 2682 2678 2682 1001 S+ wait 0xc5cdf550 sh 2678 821 2678 1001 S+ pause 0xc577e060 tcsh 2605 826 2605 1001 S+ wait 0xc5782000 sh 2501 1 2501 0 Ss wait 0xc589fd48 watchdogd 826 825 826 1001 Ss+ pause 0xc577fb00 tcsh 825 822 822 1001 S select 0xc0bdc09c sshd 822 759 822 0 Ss sbwait 0xc577b3d4 sshd 821 1 821 0 Ss+ wait 0xc569b000 login 820 1 820 0 Ss+ ttyin 0xc5300410 getty 819 1 819 0 Ss+ ttyin 0xc530d410 getty 818 1 818 0 Ss+ ttyin 0xc52ffc10 getty 817 1 817 0 Ss+ ttyin 0xc5300810 getty 816 1 816 0 Ss+ ttyin 0xc530c410 getty 815 1 815 0 Ss+ ttyin 0xc530c010 getty 814 1 814 0 Ss+ ttyin 0xc530d010 getty 813 1 813 0 Ss+ ttyin 0xc530cc10 getty 771 1 771 0 Ss nanslp 0xc0b8f464 cron 759 1 759 0 Ss select 0xc0bdc09c sshd 703 698 698 0 S - 0xc5548400 nfsd 702 698 698 0 S - 0xc5523600 nfsd 700 698 698 0 S - 0xc5548600 nfsd 699 698 698 0 S - 0xc5548800 nfsd 698 1 698 0 Ss select 0xc0bdc09c nfsd 696 1 696 0 Ss select 0xc0bdc09c mountd 675 1 675 0 Ss select 0xc0bdc09c rpcbind 630 0 0 0 SL mdwait 0xc5738800 [md1] 590 1 590 0 Ss select 0xc0bdc09c syslogd 546 1 546 0 Ss select 0xc0bdc09c devd 111 0 0 0 SL mdwait 0xc551a000 [md0] 43 0 0 0 SL - 0xc0b8f294 [schedcpu] 42 0 0 0 SL flswai 0xc0bdc57c [softdepflush] 41 0 0 0 SL syncer 0xc0b8f28c [syncer] 40 0 0 0 SL vlruwt 0xc54db7f8 [vnlru] 39 0 0 0 RL [bufdaemon] 38 0 0 0 SL pgzero 0xc0be8a00 [pagezero] 37 0 0 0 SL psleep 0xc0be8618 [vmdaemon] 36 0 0 0 SL psleep 0xc0be85e0 [pagedaemon] 35 0 0 0 SL waiting_ 0xc0bde2ac [sctp_iterator] 34 0 0 0 WL [irq1: atkbd0] 33 0 0 0 SL - 0xc5204c3c [fdc0] 32 0 0 0 WL [irq20: fxp0] 31 0 0 0 WL [irq29: bge1] 30 0 0 0 WL [irq28: bge0] 29 0 0 0 SL aifthd 0xc524fd48 [aac0aif] 28 0 0 0 SL usbtsk 0xc0b7fb34 [usbtask-dr] 27 0 0 0 SL usbtsk 0xc0b7fb20 [usbtask-hc] 26 0 0 0 SL usbevt 0xc5206210 [usb0] 25 0 0 0 WL [irq15: ata1] 24 0 0 0 WL [irq14: ata0] 23 0 0 0 WL [swi0: uart sio] 22 0 0 0 WL [irq9: ohci0 acpi0] 21 0 0 0 SL - 0xc5141d80 [kqueue taskq] 20 0 0 0 WL [swi2: cambio] 9 0 0 0 SL ccb_scan 0xc0b50d14 [xpt_thrd] 19 0 0 0 WL [swi6: task queue] 8 0 0 0 SL - 0xc514d180 [acpi_task_2] 7 0 0 0 SL - 0xc514d180 [acpi_task_1] 6 0 0 0 SL - 0xc514d180 [acpi_task_0] 18 0 0 0 WL [swi6: Giant taskq] 5 0 0 0 SL - 0xc514d300 [thread taskq] 17 0 0 0 WL [swi5: +] 16 0 0 0 SL - 0xc0b8f294 [yarrow] 4 0 0 0 SL - 0xc0b802ac [g_down] 3 0 0 0 SL - 0xc0b802a8 [g_up] 2 0 0 0 SL - 0xc0b802a0 [g_event] 15 0 0 0 WL [swi1: net] 14 0 0 0 WL [swi3: vm] 13 0 0 0 RL [swi4: clock sio] 12 0 0 0 RL [idle: cpu0] 11 0 0 0 RL [idle: cpu1] 1 0 1 0 SLs wait 0xc50fad48 [init] 10 0 0 0 SL audit_wo 0xc0be78b4 [audit] 0 0 0 0 WLs [swapper] 23588 23257 2605 1001 Z+ initial thread 23577 23257 2605 1001 Z+ mmap 23581 23257 2605 1001 Z+ socket 23593 23257 2605 1001 Z+ initial thread 23578 23257 2605 1001 Z+ pty 23590 23257 2605 1001 Z+ aio 23589 23257 2605 1001 Z+ udp 23586 23257 2605 1001 Z+ tcp 23591 23257 2605 1001 Z+ link 23592 23257 2605 1001 Z+ lockf2 23583 23257 2605 1001 Z+ symlink 23576 23257 2605 1001 Z+ mkfifo 23587 23257 2605 1001 Z+ initial thread 23584 23257 2605 1001 Z+ syscall 23580 23257 2605 1001 Z+ shm db> allt Tracing command sh pid 23728 tid 100152 td 0xc5cdc630 sched_switch(0,c5cdc630,c0b95954,c5cdc630,efe0a9c8,...) at sched_switch+0x1a6 Tracing command sh pid 23727 tid 101822 td 0xc7762630 sched_switch(c0b95954,f1d42b64,c0728464,c0b95954,1,...) at sched_switch+0x1a6 spinlock_exit(c0b95954,1,c0a6afe4,f4) at spinlock_exit+0x10 _mtx_unlock_spin_flags(c0b95954,c54dd814,c7762630,c7762630) at _mtx_unlock_spin_flags+0xf1 witness_lock_list_free(c54dd814,0,f1d42bb0,c074daeb,c0b90ee0,...) at witness_lock_list_free+0x5e runq(f18ec83,880c45b6,c189e445,b81fe183,ffffffff,...) at runq Tracing command sh pid 23726 tid 101885 td 0xc73b4630 sched_switch(c0b95954,effb7b64,c0728464,c0b95954,1,...) at sched_switch+0x1a6 spinlock_exit(c0b95954,1,c0a6afe4,f4) at spinlock_exit+0x10 _mtx_unlock_spin_flags(c0b95954,c7372c34,c73b4630,c73b4630) at _mtx_unlock_spin_flags+0xf1 witness_lock_list_free(c7372c34,0,effb7bb0,c074daeb,c0b90ee0,...) at witness_lock_list_free+0x5e runq(f18ec83,880c45b6,c189e445,b81fe183,ffffffff,...) at runq Tracing command sh pid 23725 tid 100058 td 0xc54dda50 sched_switch(c54dda50,0,2,17b,64350e76,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(eda56d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sh pid 23724 tid 100218 td 0xc650fa50 sched_switch(c650fa50,0,1,17b,643ba9ae,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c741f690,...) at mi_switch+0x209 turnstile_wait(c741f690,c5cdba50,0,17a,c567b0d4,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c567b0d4,c650fa50,0,c0a7748e,7e3,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c567b0d4,0,c0a7748e,7e3,52c,...) at _mtx_lock_flags+0xe3 vget(c567b000,2,c650fa50,52c,f15a4af4,...) at vget+0x7a vm_mmap(c5100cb0,f15a4c40,15000,5,7,...) at vm_mmap+0x2c1 mmap(c650fa50,f15a4c64,0,15000,5,...) at mmap+0x36e freebsd6_mmap(c650fa50,f15a4cfc,20,c0a25c43,c0b19c78,...) at freebsd6_mmap+0x44 syscall(f15a4d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (198, FreeBSD ELF32, nosys), eip = 0x28074b8b, esp = 0xbfbfe3cc, ebp = 0xbfbfe408 --- Tracing command sh pid 23723 tid 100101 td 0xc5703a50 sched_switch(c5703a50,0,2,17b,647b1aa2,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209 ast(efcd4d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sh pid 23722 tid 100198 td 0xc736b420 sched_switch(c736b420,0,2,17b,6441da1a,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209 ast(efe57d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sh pid 23721 tid 100214 td 0xc736f840 sched_switch(c736f840,0,1,17b,6484faaa,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c740ecd0,...) at mi_switch+0x209 turnstile_wait(c740ecd0,c7762000,0,17a,c566307c,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c566307c,c736f840,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c566307c,0,c0a8d45e,125,efe87be8,...) at _mtx_lock_flags+0xe3 vm_fault(c7378cb0,8048000,1,0,8048f27,...) at vm_fault+0x1c6 trap_pfault(5,0,c0a99ec2,2ae,c739caa0,...) at trap_pfault+0x117 trap(efe87d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x280649ad, esp = 0xbfbfe480, ebp = 0xbfbfe4a8 --- Tracing command sh pid 23720 tid 100179 td 0xc7353a50 sched_switch(c7353a50,0,1,17b,644d9b52,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c74715f0,...) at mi_switch+0x209 turnstile_wait(c74715f0,c5cdba50,0,17a,c566307c,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c566307c,c7353a50,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c566307c,0,c0a8d45e,125,efe36be8,...) at _mtx_lock_flags+0xe3 vm_fault(c5100bc8,8048000,1,0,8048d71,...) at vm_fault+0x1c6 trap_pfault(5,0,c0a99ec2,2ae,c7355d48,...) at trap_pfault+0x117 trap(efe36d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x280649ad, esp = 0xbfbfe480, ebp = 0xbfbfe4a8 --- Tracing command sh pid 23719 tid 100157 td 0xc5cdba50 sched_switch(c5cdba50,0,2,17b,6453ba18,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209 ast(efdfbd38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sh pid 23718 tid 100202 td 0xc7373420 sched_switch(c7373420,0,1,17b,64108f62,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c83467d0,...) at mi_switch+0x209 turnstile_wait(c83467d0,c777d210,0,17a,c566307c,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c566307c,c7373420,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c566307c,0,c0a8d45e,125,efeabbe8,...) at _mtx_lock_flags+0xe3 vm_fault(c5cb9cb0,8048000,1,0,8048f27,...) at vm_fault+0x1c6 trap_pfault(5,0,c0a99ec2,2ae,c7371aa0,...) at trap_pfault+0x117 trap(efeabd38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x280649ad, esp = 0xbfbfe480, ebp = 0xbfbfe4a8 --- Tracing command sh pid 23717 tid 100148 td 0xc5cb4630 sched_switch(c5cb4630,0,2,17b,649ba5cc,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,0,...) at mi_switch+0x209 ast(efd94d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sh pid 23716 tid 101849 td 0xc777d000 cpustop_handler(2,f1e86a74,c09d40f2,0,0,...) at cpustop_handler+0x39 ipi_nmi_handler(0,0,c777d000,c0b90e40,c5e8faa0,...) at ipi_nmi_handler+0x2f trap(f1e86a80) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0728a1a, esp = 0xf1e86ac0, ebp = 0xf1e86adc --- _mtx_lock_sleep(c0be85a4,c777d000,0,c0a8e881,406,...) at _mtx_lock_sleep+0xfc _mtx_lock_flags(c0be85a4,0,c0a8e881,406,100,...) at _mtx_lock_flags+0xe3 vm_page_alloc(0,2fe,0,160,2fe,...) at vm_page_alloc+0xb2 _pmap_allocpte(c0a990d6,0,bf8,76672405,bfbfd000,...) at _pmap_allocpte+0x4c pmap_allocpte(c830a08c,0,c0a990d6,ae5,bfc00000,...) at pmap_allocpte+0x8d pmap_copy(c5c35174,c830a08c,bfbe0000,20000,bfbe0000,...) at pmap_copy+0x212 vmspace_fork(c830a000,1,c0a6afe4,ce,c6211200,...) at vmspace_fork+0x3a2 vm_forkproc(c777d000,c5d202a8,c7762630,14,0,...) at vm_forkproc+0xbc fork1(c777d000,14,0,f1e86c78,c0761edc,...) at fork1+0x10a4 fork(c777d000,f1e86cfc,c777d000,f1e86d38,c0b18a30,...) at fork+0x29 syscall(f1e86d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe9ec, ebp = 0xbfbfea18 --- Tracing command sh pid 23715 tid 101856 td 0xc76fca50 sched_switch(c76fca50,0,1,17b,6406a8d0,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c83467d0,...) at mi_switch+0x209 turnstile_wait(c83467d0,c777d210,0,17a,c566307c,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c566307c,c76fca50,0,c0a8e351,65b,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c566307c,0,c0a8e351,65b,8,...) at _mtx_lock_flags+0xe3 vm_object_collapse(c68656c8,0,c0a8da5d,9c1,8048000,...) at vm_object_collapse+0x69 vmspace_fork(c5a23bc8,1,c0a6afe4,ce,c6211800,...) at vmspace_fork+0x2ec vm_forkproc(c76fca50,c60e8aa0,c73b4630,14,0,...) at vm_forkproc+0xbc fork1(c76fca50,14,0,f196dc78,c0761edc,...) at fork1+0x10a4 fork(c76fca50,f196dcfc,c76fca50,f196dd38,c0b18a30,...) at fork+0x29 syscall(f196dd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe6ac, ebp = 0xbfbfe6d8 --- Tracing command sh pid 23714 tid 101825 td 0xc7762000 kdb_enter(c0a6c254,0,c0a8e9e2,f1d39b4c,0,...) at kdb_enter+0x32 panic(c0a8e9e2,c755c3e0,0,3ae,80000000,...) at panic+0x124 vm_page_cache_transfer(c6d447c0,0,0,c755c3e0,0,...) at vm_page_cache_transfer+0x1a5 vm_object_split(c742a50c,0,c0a8da5d,9c1,28086000,...) at vm_object_split+0x480 vmspace_fork(c7377570,1,c0a6afe4,ce,c6fb3d00,...) at vmspace_fork+0x304 vm_forkproc(c7762000,c5cda550,c5cdc630,14,0,...) at vm_forkproc+0xbc fork1(c7762000,14,0,f1d39c78,c7762000,...) at fork1+0x10a4 fork(c7762000,f1d39cfc,c0a99df5,c0a71873,c0b18a30,...) at fork+0x29 syscall(f1d39d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (2, FreeBSD ELF32, fork), eip = 0x2814f82b, esp = 0xbfbfe6ac, ebp = 0xbfbfe6d8 --- Tracing command sh pid 23713 tid 100171 td 0xc5781630 sched_switch(c5781630,0,1,17b,6420aa5e,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c83467d0,...) at mi_switch+0x209 turnstile_wait(c83467d0,c777d210,0,17a,c566307c,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c566307c,c5781630,0,c0a8d45e,125,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c566307c,0,c0a8d45e,125,efd09be8,...) at _mtx_lock_flags+0xe3 vm_fault(c7377ae0,804b000,1,0,804be53,...) at vm_fault+0x1c6 trap_pfault(5,0,c0a99ec2,c5781630,c73527f8,...) at trap_pfault+0x117 trap(efd09d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x804be53, esp = 0xbfbfe380, ebp = 0xbfbfe858 --- Tracing command sh pid 23712 tid 101850 td 0xc777d210 sched_switch(c777d210,0,1,17b,644df25e,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c74715f0,...) at mi_switch+0x209 turnstile_wait(c74715f0,c5cdba50,0,17a,c566307c,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c566307c,c777d210,0,c0a8f9e1,4c2,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c566307c,0,c0a8f9e1,4c2,c566307c,...) at _mtx_lock_flags+0xe3 vnode_pager_lock(c566307c,0,c0a8d45e,125,f1e89be8,...) at vnode_pager_lock+0x268 vm_fault(c73773a0,8051000,1,0,805182c,...) at vm_fault+0x1dc trap_pfault(5,0,c0a99ec2,2ae,c5e8fd48,...) at trap_pfault+0x117 trap(f1e89d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x805182c, esp = 0xbfbfe570, ebp = 0xbfbfe698 --- Tracing command sysctl pid 23711 tid 100047 td 0xc5251a50 sched_switch(c5251a50,0,1,180,6442f08c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5251a50,...) at mi_switch+0x209 sleepq_switch(c5251a50,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c7a9772c,1,e57e8c1c,c070e3f9,c7a9772c,...) at bwillwrite+0xef dofilewrite(e57e8c60,ffffffff,ffffffff,0,c55a8000,...) at dofilewrite+0x69 kern_writev(c5251a50,1,e57e8c60,bfbfd010,c,...) at kern_writev+0x52 write(c5251a50,e57e8cfc,c,e57e8d38,c0b18a60,...) at write+0x4f syscall(e57e8d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (4, FreeBSD ELF32, write), eip = 0x2815630b, esp = 0xbfbfcebc, ebp = 0xbfbfced8 --- Tracing command sh pid 23710 tid 101854 td 0xc7762c60 Tracing command swap pid 23665 tid 100183 td 0xc7353210 sched_switch(c7353210,0,1,17b,52e8b958,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c73bb7d0,...) at mi_switch+0x209 turnstile_wait(c73bb7d0,c54dd630,0,17a,c0be85a4,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c0be85a4,c7353210,0,c0a8e881,406,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c0be85a4,0,c0a8e881,406,0,...) at _mtx_lock_flags+0xe3 vm_page_alloc(c76b445c,158,0,40,efe2abe8,...) at vm_page_alloc+0xb2 vm_fault(c5a20828,28458000,2,8,28458000,...) at vm_fault+0x6bc trap_pfault(5,0,c0a99ec2,2ae,c73567f8,...) at trap_pfault+0x117 trap(efe2ad38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23664 tid 100210 td 0xc7372210 sched_switch(c7372210,0,6,17b,51c57570,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,c739c000,0,c7372210,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,efe93d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,efe93d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23663 tid 100115 td 0xc589c840 sched_switch(c589c840,c5251210,6,17b,57353d9c,...) at sched_switch+0x1a6 mi_switch(6,c5251210,c0a6dd73,eb,c5251210,...) at mi_switch+0x209 maybe_preempt(c5251210,1,c0a6dbe6,43f,8,...) at maybe_preempt+0x143 sched_add(c5251210,4,c0a68e36,2c2,c09c15c9,...) at sched_add+0x347 intr_event_schedule_thread(c5141500,0,c0a676a7,c589c840,c5141500,...) at intr_event_schedule_thread+0xe3 intr_execute_handlers(c50ed9f0,efd21d38,bfbfe7e8,c09bb7a4,35,...) at intr_execute_handlers+0x12d lapic_handle_intr(35,efd21d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23662 tid 100217 td 0xc63f9840 sched_switch(c63f9840,0,6,17b,4f0efe6e,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049257,0) at critical_exit+0x99 lapic_handle_timer(f11c6d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23661 tid 100194 td 0xc736bc60 sched_switch(c736bc60,0,1,180,54bfb364,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c736bc60,...) at mi_switch+0x209 sleepq_switch(c736bc60,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7 sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f vm_waitpfault(c5fd3364,325f,0,125,efe63be8,...) at vm_waitpfault+0x75 vm_fault(c8309910,2b55f000,2,8,2b55f000,...) at vm_fault+0x6d6 trap_pfault(5,0,c0a99ec2,c736bc60,c7370550,...) at trap_pfault+0x117 trap(efe63d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command swap pid 23660 tid 101866 td 0xc740a210 sched_switch(c740a210,0,2,17b,4b0d45e0,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(f0545d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command swap pid 23659 tid 101835 td 0xc775d840 sched_switch(c775d840,0,6,17b,c6142580,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,c5d57550,0,c775d840,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,f1d1bd38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,f1d1bd38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23658 tid 100149 td 0xc5cb4420 sched_switch(c5cb4420,0,6,17b,4dc052be,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049251,0) at critical_exit+0x99 lapic_handle_timer(efd91d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23657 tid 101868 td 0xc746ba50 sched_switch(c746ba50,0,2,17b,4aef1844,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(f0ad0d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command swap pid 23656 tid 101830 td 0xc7761420 sched_switch(c7761420,0,6,17b,cc5a534e,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049257,0) at critical_exit+0x99 lapic_handle_timer(f1d2ad38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23655 tid 100102 td 0xc5703840 sched_switch(c5703840,0,2,17b,de4d3794,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(efcd1d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command swap pid 23654 tid 101834 td 0xc775da50 sched_switch(c775da50,0,6,17b,505d8b2a,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049254,0) at critical_exit+0x99 lapic_handle_timer(f1d1ed38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23653 tid 100566 td 0xc6e94840 sched_switch(c6e94840,0,6,17b,51980426,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049257,0) at critical_exit+0x99 lapic_handle_timer(f0407d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23652 tid 100128 td 0xc5c97a50 sched_switch(c5c97a50,0,6,17b,4bec0c1c,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,1010004,efd70d2c,c5c97a50,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,efd70d38,bfbfe748,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,efd70d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command swap pid 23651 tid 101880 td 0xc7450630 sched_switch(c7450630,0,6,17b,4fcc07b0,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,0,c0a676a7,c7450630,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,f0926d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,f0926d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23650 tid 100193 td 0xc736d000 sched_switch(c736d000,0,6,17b,518aa282,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049254,0) at critical_exit+0x99 lapic_handle_timer(efe66d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23649 tid 100069 td 0xc56b7840 sched_switch(c56b7840,0,6,17b,4c8c327c,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,c56bc7f8,c0a676a7,c56b7840,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,efc6cd38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,efc6cd38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command swap pid 23648 tid 100130 td 0xc5c97630 sched_switch(c5c97630,0,2,17b,4c675314,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(efd6ad38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command swap pid 23647 tid 101877 td 0xc7451000 sched_switch(c7451000,0,2,17b,e25dc2e8,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(f0932d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sysctl pid 23646 tid 101857 td 0xc76fc210 Tracing command sysctl pid 23645 tid 100215 td 0xc736f630 Tracing command sysctl pid 23644 tid 100086 td 0xc56ff630 Tracing command swap pid 23643 tid 100166 td 0xc5cb6630 sched_switch(c5cb6630,0,1,17b,5b1caa88,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c736c500,...) at mi_switch+0x209 turnstile_wait(c736c500,c7762840,0,17a,c0be85bc,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c0be85bc,c5cb6630,0,c0a990d6,913,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c0be85bc,0,c0a990d6,913,c0a8d407,...) at _mtx_lock_flags+0xe3 pmap_enter(c574ec54,2b7e9000,c3589360,7,0,...) at pmap_enter+0x40 vm_fault(c574ebc8,2b7e9000,2,8,2b7e9000,...) at vm_fault+0x16db trap_pfault(5,0,c0a99ec2,2ae,c5ce0aa0,...) at trap_pfault+0x117 trap(efdbed38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command sysctl pid 23642 tid 101874 td 0xc73e6000 sched_switch(c73e6000,0,1,180,5d0d3262,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c73e6000,0,c0a6f89a,19b,c60cbd48,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c60cbd48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c60cbd48,c60cbdd8,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c73e6000,5ca7,f02bac2c,0,0,...) at kern_wait+0xa3e wait4(c73e6000,f02bacfc,10,f02bad38,c0b18aa8,...) at wait4+0x3d syscall(f02bad38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23641 tid 101872 td 0xc7483210 sched_switch(c7483210,0,6,17b,50c051f4,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,0,c0a676a7,c7483210,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,f0c53d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,f0c53d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049254, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command sysctl pid 23640 tid 101821 td 0xc7762840 sched_switch(c7762840,0,1,180,5b52fd0a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c7762840,0,c0a6f89a,19b,c5d20000,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c5d20000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c5d20000,c5d20090,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c7762840,5ca5,f1d45c2c,0,0,...) at kern_wait+0xa3e wait4(c7762840,f1d45cfc,10,f1d45d38,c0b18aa8,...) at wait4+0x3d syscall(f1d45d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23639 tid 101846 td 0xc7521a50 sched_switch(c7521a50,0,6,17b,5779429c,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,c5e8f2a8,0,c7521a50,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,f1469d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,f1469d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command sysctl pid 23638 tid 100209 td 0xc7372420 sched_switch(c7372420,0,1,180,5e1df8ba,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c7372420,0,c0a6f89a,19b,c7397d48,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c7397d48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c7397d48,c7397dd8,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c7372420,5ca8,efe96c2c,0,0,...) at kern_wait+0xa3e wait4(c7372420,efe96cfc,10,0,c0b18aa8,...) at wait4+0x3d syscall(efe96d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23637 tid 100192 td 0xc736d210 sched_switch(c736d210,0,6,17b,576cbac2,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049257,0) at critical_exit+0x99 lapic_handle_timer(efe69d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command sysctl pid 23636 tid 101853 td 0xc7762a50 Tracing command swap pid 23635 tid 100072 td 0xc54dd630 sched_switch(c54dd630,0,2,17b,56f5a64e,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(eda50d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sysctl pid 23634 tid 100126 td 0xc5c98000 sched_switch(c5c98000,0,1,180,5a66d3ae,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c5c98000,0,c0a6f89a,19b,c5c99000,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c5c99000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c5c99000,c5c99090,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c5c98000,5caa,efd76c2c,0,0,...) at kern_wait+0xa3e wait4(c5c98000,efd76cfc,10,efd76d38,c0b18aa8,...) at wait4+0x3d syscall(efd76d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23633 tid 100180 td 0xc7353840 sched_switch(c7353840,0,6,17b,4c2ed4f6,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049251,0) at critical_exit+0x99 lapic_handle_timer(efe33d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049251, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command sysctl pid 23632 tid 100163 td 0xc5cb6c60 sched_switch(c5cb6c60,0,1,180,5a731d14,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c5cb6c60,0,c0a6f89a,19b,c5ce02a8,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c5ce02a8,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c5ce02a8,c5ce0338,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c5cb6c60,5cab,efdc7c2c,0,0,...) at kern_wait+0xa3e wait4(c5cb6c60,efdc7cfc,10,efdc7d38,c0b18aa8,...) at wait4+0x3d syscall(efdc7d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23631 tid 100063 td 0xc56bb630 sched_switch(c56bb630,0,2,17b,4bc56b08,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(efc7ed38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command sysctl pid 23630 tid 101861 td 0xc7500000 sched_switch(c7500000,0,1,180,5a01e258,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c7500000,0,c0a6f89a,19b,c58e7aa0,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c58e7aa0,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c58e7aa0,c58e7b30,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c7500000,5cac,f1277c2c,0,0,...) at kern_wait+0xa3e wait4(c7500000,f1277cfc,10,f1277d38,c0b18aa8,...) at wait4+0x3d syscall(f1277d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23629 tid 100140 td 0xc5cb5840 sched_switch(c5cb5840,0,1,180,2aec2d3c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5cb5840,...) at mi_switch+0x209 sleepq_switch(c5cb5840,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7 sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f vm_waitpfault(c79f445c,37df,0,125,efdacbe8,...) at vm_waitpfault+0x75 vm_fault(c51009f8,2badf000,2,8,2badf000,...) at vm_fault+0x6d6 trap_pfault(5,0,c0a99ec2,2ae,c5cb7550,...) at trap_pfault+0x117 trap(efdacd38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command sysctl pid 23628 tid 100154 td 0xc5cdc210 Tracing command swap pid 23627 tid 100169 td 0xc5781a50 sched_switch(c5781a50,0,1,180,595b8796,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5781a50,...) at mi_switch+0x209 sleepq_switch(c5781a50,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7 sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f vm_waitpfault(c6526d14,3966,0,125,efd0fbe8,...) at vm_waitpfault+0x75 vm_fault(c5c35570,2bc66000,2,8,2bc66000,...) at vm_fault+0x6d6 trap_pfault(5,0,c0a99ec2,2ae,c73522a8,...) at trap_pfault+0x117 trap(efd0fd38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command sysctl pid 23626 tid 101863 td 0xc73cb210 sched_switch(c73cb210,0,1,180,5e755c5a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c73cb210,0,c0a6f89a,19b,c60bb000,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c60bb000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c60bb000,c60bb090,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c73cb210,5ca9,f0101c2c,0,0,...) at kern_wait+0xa3e wait4(c73cb210,f0101cfc,10,f0101d38,c0b18aa8,...) at wait4+0x3d syscall(f0101d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23625 tid 100199 td 0xc736b210 sched_switch(c736b210,0,6,17b,4b8e3514,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,0,...) at mi_switch+0x209 critical_exit(c50eda38,c0b90e40,0,c736b210,c5141400,...) at critical_exit+0x99 intr_execute_handlers(c50eda38,efe54d38,bfbfe7e8,c09bb7a4,34,...) at intr_execute_handlers+0x147 lapic_handle_intr(34,efe54d38) at lapic_handle_intr+0x39 Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command sysctl pid 23624 tid 100190 td 0xc736d630 sched_switch(c736d630,0,1,180,5d02598a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c736d630,0,c0a6f89a,19b,c736aaa0,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c736aaa0,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c736aaa0,c736ab30,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c736d630,5ca6,efe6fc2c,0,0,...) at kern_wait+0xa3e wait4(c736d630,efe6fcfc,10,efe6fd38,c0b18aa8,...) at wait4+0x3d syscall(efe6fd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23623 tid 101870 td 0xc7464420 sched_switch(c7464420,0,6,17b,c71fefce,...) at sched_switch+0x1a6 mi_switch(6,0,c0a6dd73,b6,c0bf6260,...) at mi_switch+0x209 critical_exit(1,8049257,0) at critical_exit+0x99 lapic_handle_timer(f0a49d38) at lapic_handle_timer+0x15c Xtimerint() at Xtimerint+0x1f --- interrupt, eip = 0x8049257, esp = 0xbfbfe7b0, ebp = 0xbfbfe7e8 --- Tracing command sysctl pid 23622 tid 101879 td 0xc7451420 sched_switch(c7451420,0,1,180,5961c6e8,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c7451420,0,c0a6f89a,19b,c60e0aa0,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c60e0aa0,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c60e0aa0,c60e0b30,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c7451420,5cad,f0938c2c,0,0,...) at kern_wait+0xa3e wait4(c7451420,f0938cfc,10,f0938d38,c0b18aa8,...) at wait4+0x3d syscall(f0938d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe71c, ebp = 0xbfbfe7b8 --- Tracing command swap pid 23621 tid 100110 td 0xc589d420 sched_switch(c589d420,0,2,17b,c2d16d34,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,1,...) at mi_switch+0x209 ast(efd30d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command swap pid 23620 tid 100138 td 0xc5cb5c60 sched_switch(c5cb5c60,0,1,180,2aea9430,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5cb5c60,...) at mi_switch+0x209 sleepq_switch(c5cb5c60,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7 sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f vm_waitpfault(c5d5a45c,3684,0,125,efdb2be8,...) at vm_waitpfault+0x75 vm_fault(c8478ae0,2b984000,2,8,2b984000,...) at vm_fault+0x6d6 trap_pfault(5,0,c0a99ec2,2ae,c5cb7000,...) at trap_pfault+0x117 trap(efdb2d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command swap pid 23619 tid 100093 td 0xc5780c60 sched_switch(c5780c60,0,1,17b,55a86306,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c750a550,...) at mi_switch+0x209 turnstile_wait(c750a550,c7762840,0,17a,c0be85bc,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c0be85bc,c5780c60,0,c0a8d45e,377,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c0be85bc,0,c0a8d45e,377,0,...) at _mtx_lock_flags+0xe3 vm_fault(c51012b8,2b4f2000,2,8,2b4f2000,...) at vm_fault+0x1bd4 trap_pfault(5,0,c0a99ec2,2ae,c577f7f8,...) at trap_pfault+0x117 trap(efcfdd38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28156953, esp = 0xbfbfe710, ebp = 0xbfbfe748 --- Tracing command sysctl pid 23618 tid 101860 td 0xc76fc000 Tracing command swap pid 23617 tid 100203 td 0xc7373210 Tracing command rw pid 23616 tid 101867 td 0xc746b630 sched_switch(c746b630,0,1,180,64428582,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c746b630,...) at mi_switch+0x209 sleepq_switch(c746b630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c691d72c,4,f0acac1c,c070e3f9,c691d72c,...) at bwillwrite+0xef dofilewrite(f0acac60,ffffffff,ffffffff,0,c6d70cf0,...) at dofilewrite+0x69 kern_writev(c746b630,4,f0acac60,bfbfd7dc,1000,...) at kern_writev+0x52 write(c746b630,f0acacfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f syscall(f0acad38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 --- Tracing command rw pid 23615 tid 100116 td 0xc589c630 sched_switch(c589c630,0,1,180,644315ae,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c589c630,...) at mi_switch+0x209 sleepq_switch(c589c630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c691d42c,4,efd1ec1c,c070e3f9,c691d42c,...) at bwillwrite+0xef dofilewrite(efd1ec60,ffffffff,ffffffff,0,c6c0b1f8,...) at dofilewrite+0x69 kern_writev(c589c630,4,efd1ec60,bfbfd7dc,1000,...) at kern_writev+0x52 write(c589c630,efd1ecfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f syscall(efd1ed38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 --- Tracing command rw pid 23614 tid 101859 td 0xc76fc630 sched_switch(c76fc630,0,1,180,6442a8f0,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c76fc630,...) at mi_switch+0x209 sleepq_switch(c76fc630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c691d62c,4,f1967c1c,c070e3f9,c691d62c,...) at bwillwrite+0xef dofilewrite(f1967c60,ffffffff,ffffffff,0,c6d8a288,...) at dofilewrite+0x69 kern_writev(c76fc630,4,f1967c60,bfbfd7dc,1000,...) at kern_writev+0x52 write(c76fc630,f1967cfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f syscall(f1967d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 --- Tracing command rw pid 23613 tid 100127 td 0xc5c97c60 sched_switch(c5c97c60,0,1,180,6442c84e,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5c97c60,...) at mi_switch+0x209 sleepq_switch(c5c97c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c691d02c,4,efd73c1c,c070e3f9,c691d02c,...) at bwillwrite+0xef dofilewrite(efd73c60,ffffffff,ffffffff,0,c561f5e8,...) at dofilewrite+0x69 kern_writev(c5c97c60,4,efd73c60,bfbfd7dc,1000,...) at kern_writev+0x52 write(c5c97c60,efd73cfc,c,0,c0b18a60,...) at write+0x4f syscall(efd73d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 --- Tracing command rw pid 23612 tid 101844 td 0xc7522000 sched_switch(c7522000,0,1,17b,6fd23ab6,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c589e000,...) at mi_switch+0x209 turnstile_wait(c589e000,c736dc60,0,17a,c579a1f0,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c579a1f0,c7522000,0,c0a75244,916,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c579a1f0,0,c0a75244,916,c0a894e0,...) at _mtx_lock_flags+0xe3 bdwrite(d9399e80,0,c0a894d7,597,0,...) at bdwrite+0x14c ffs_alloccg(c56055ac,f,168cb8,0,4000,...) at ffs_alloccg+0x1f1 ffs_hashalloc(168cb8,0,4000,c08f1404,0,...) at ffs_hashalloc+0x65 ffs_alloc(c56055ac,5d5,0,168cb8,0,...) at ffs_alloc+0x25a ffs_balloc_ufs2(c5e5f570,1754000,0,1000,c5798b00,...) at ffs_balloc_ufs2+0x19af ffs_write(f146fbc4,c0a9dd02,f146fb30,0,c0b39660,...) at ffs_write+0x34c VOP_WRITE_APV(c0b39660,f146fbc4,c7522000,c0a78383,242,...) at VOP_WRITE_APV+0x144 vn_write(c85be750,f146fc60,c5798b00,0,c7522000,...) at vn_write+0x230 dofilewrite(f146fc60,ffffffff,ffffffff,0,c85be750,...) at dofilewrite+0x8e kern_writev(c7522000,4,f146fc60,bfbfd7dc,1000,...) at kern_writev+0x52 write(c7522000,f146fcfc,c,c0a5cfc0,c0b18a60,...) at write+0x4f syscall(f146fd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (4, FreeBSD ELF32, write), eip = 0x2816030b, esp = 0xbfbfd6fc, ebp = 0xbfbfe7e8 --- Tracing command rw pid 23611 tid 100105 td 0xc5703210 Tracing command mkdir pid 23610 tid 100211 td 0xc7372000 sched_switch(c7372000,0,1,180,849ff62a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c7372000,...) at mi_switch+0x209 sleepq_switch(c7372000,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f acquire(efe90820,efe90818,c0a69b93,d7,c7372000,...) at acquire+0x73 _lockmgr(d930e4a0,202122,c5898e6c,c7372000,c0a757cf,...) at _lockmgr+0x4a2 getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44 bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c ffs_vget(c55495d0,5c23d,2,efe90b48,c56f3000,...) at ffs_vget+0x360 ffs_valloc(c6beb828,41f8,c5798b00,efe90b48,c0a69b93,...) at ffs_valloc+0x52c ufs_mkdir(efe90b90,c0a9dc06,0,efe90b90,efe90ba4,...) at ufs_mkdir+0x95 VOP_MKDIR_APV(c0b39660,efe90b90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7 kern_mkdir(c7372000,bfbf1ae7,0,1f8,efe90d2c,...) at kern_mkdir+0x2b0 mkdir(c7372000,efe90cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efe90d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf168c, ebp = 0xbfbf1ab8 --- Tracing command mkdir pid 23609 tid 100176 td 0xc7354210 sched_switch(c7354210,0,1,180,f1afdc18,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c7354210,...) at mi_switch+0x209 sleepq_switch(c7354210,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f acquire(efe3fa14,efe3fa0c,c0a69b93,d7,c7354210,...) at acquire+0x73 _lockmgr(d930e4a0,202122,c5898e6c,c7354210,c0a757cf,...) at _lockmgr+0x4a2 getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44 bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c ffs_update(c69386cc,0,1,c69386cc,efe3fb64,...) at ffs_update+0x195 ufs_inactive(efe3fb98,c0a9d40d,c69387a0,c69387a0,c69386cc,...) at ufs_inactive+0x353 VOP_INACTIVE_APV(c0b39660,efe3fb98,c0a7748e,8e3,c0b505a0,...) at VOP_INACTIVE_APV+0xc6 vinactive(c69387a0,0,c0a7748e,853,852,...) at vinactive+0xa5 vrele(c69386cc,c0a78219,330,32d,c5a21b00,...) at vrele+0x182 kern_chdir(c7354210,804b0cc,0,efe3fd2c,c09d3e05,...) at kern_chdir+0x1d6 chdir(c7354210,efe3fcfc,4,c0a9df26,c0b18b20,...) at chdir+0x22 syscall(efe3fd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (12, FreeBSD ELF32, chdir), eip = 0x280c4d6b, esp = 0xbfbf449c, ebp = 0xbfbf48c8 --- Tracing command mkdir pid 23608 tid 100145 td 0xc5cb4c60 sched_switch(c5cb4c60,0,1,180,64423152,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5cb4c60,...) at mi_switch+0x209 sleepq_switch(c5cb4c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0a6afe4,ce,c7f86d98,c7f86e6c,c5cb4c60,...) at bwillwrite+0xef kern_mkdir(c5cb4c60,bfbefd97,0,1f8,efd9dd2c,...) at kern_mkdir+0x2c mkdir(c5cb4c60,efd9dcfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efd9dd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbef93c, ebp = 0xbfbefd68 --- Tracing command mkdir pid 23607 tid 100108 td 0xc589d840 sched_switch(c589d840,0,1,180,64411ba4,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c589d840,...) at mi_switch+0x209 sleepq_switch(c589d840,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0a6afe4,ce,c5c6c414,c5c6c4e8,c589d840,...) at bwillwrite+0xef kern_mkdir(c589d840,bfbec2f7,0,1f8,efd36d2c,...) at kern_mkdir+0x2c mkdir(c589d840,efd36cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efd36d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbebe9c, ebp = 0xbfbec2c8 --- Tracing command mkdir pid 23606 tid 100119 td 0xc589c000 sched_switch(c589c000,0,2,17b,8488b2f2,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,2820a06c,...) at mi_switch+0x209 ast(efd15d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command mkdir pid 23605 tid 100147 td 0xc5cb4840 sched_switch(c5cb4840,0,1,180,6441b83c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5cb4840,...) at mi_switch+0x209 sleepq_switch(c5cb4840,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0a6afe4,ce,c80bbd98,c80bbe6c,c5cb4840,...) at bwillwrite+0xef kern_mkdir(c5cb4840,bfbd6337,0,1f8,efd97d2c,...) at kern_mkdir+0x2c mkdir(c5cb4840,efd97cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efd97d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbd5edc, ebp = 0xbfbd6308 --- Tracing command mkdir pid 23604 tid 100067 td 0xc56b7c60 sched_switch(c56b7c60,0,1,180,6440d244,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c56b7c60,...) at mi_switch+0x209 sleepq_switch(c56b7c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0a6afe4,ce,c5b42984,c5b42a58,c56b7c60,...) at bwillwrite+0xef kern_mkdir(c56b7c60,bfbdb2c7,0,1f8,efc72d2c,...) at kern_mkdir+0x2c mkdir(c56b7c60,efc72cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efc72d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbdae6c, ebp = 0xbfbdb298 --- Tracing command mkdir pid 23603 tid 100167 td 0xc5cb6420 sched_switch(c5cb6420,0,1,180,64420418,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5cb6420,...) at mi_switch+0x209 sleepq_switch(c5cb6420,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0a6afe4,ce,c5ecbd98,c5ecbe6c,c5cb6420,...) at bwillwrite+0xef kern_mkdir(c5cb6420,bfbdd017,0,1f8,efdbbd2c,...) at kern_mkdir+0x2c mkdir(c5cb6420,efdbbcfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efdbbd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbdcbbc, ebp = 0xbfbdcfe8 --- Tracing command mkdir pid 23602 tid 100075 td 0xc5703000 sched_switch(c5703000,0,1,17b,7a488806,...) at sched_switch+0x1a6 mi_switch(1,0,c0a70036,2e2,c8574b90,...) at mi_switch+0x209 turnstile_wait(c8574b90,c7521630,0,17a,c579a1f0,...) at turnstile_wait+0x4bd _mtx_lock_sleep(c579a1f0,c5703000,0,c0a75244,916,...) at _mtx_lock_sleep+0x14d _mtx_lock_flags(c579a1f0,0,c0a75244,916,c571a5ac,...) at _mtx_lock_flags+0xe3 bdwrite(d930e440,c5f68a00,100,4000,0,...) at bdwrite+0x14c ffs_update(c59e9d98,0,0,0,0,...) at ffs_update+0x342 ffs_truncate(c59e9d98,0,0,0,c5798b00,...) at ffs_truncate+0x7d0 handle_workitem_remove(c0be7e1c,0,c0a8a260,cb8,0,...) at handle_workitem_remove+0x1f0 softdep_setup_remove(d9270460,c71cc084,c571a5ac,1,efcc5b7c,...) at softdep_setup_remove+0x124 ufs_dirremove(c76c7ae0,c571a5ac,500800c,1,efcc5bc8,...) at ufs_dirremove+0x160 ufs_rmdir(efcc5bfc,c0a9dbc5,0,efcc5bfc,c59e9d98,...) at ufs_rmdir+0xd3 VOP_RMDIR_APV(c0b39660,efcc5bfc,2,330,c0b50520,...) at VOP_RMDIR_APV+0xec kern_rmdir(c5703000,bfbf6647,0,efcc5d2c,c09d3e05,...) at kern_rmdir+0x1b5 rmdir(c5703000,efcc5cfc,4,c0a7181a,c0b196d8,...) at rmdir+0x22 syscall(efcc5d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (137, FreeBSD ELF32, rmdir), eip = 0x280c484b, esp = 0xbfbf61ec, ebp = 0xbfbf6618 --- Tracing command mkdir pid 23601 tid 100100 td 0xc5703c60 sched_switch(c5703c60,0,1,180,847ec2b4,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5703c60,...) at mi_switch+0x209 sleepq_switch(c5703c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f acquire(efcd7820,efcd7818,c0a69b93,d7,c5703c60,...) at acquire+0x73 _lockmgr(d930e4a0,202122,c5898e6c,c5703c60,c0a757cf,...) at _lockmgr+0x4a2 getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44 bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c ffs_vget(c55495d0,5c23b,2,efcd7b48,c56f3000,...) at ffs_vget+0x360 ffs_valloc(c5c63d98,41f8,c5798b00,efcd7b48,c0a69b93,...) at ffs_valloc+0x52c ufs_mkdir(efcd7b90,c0a9dc06,0,efcd7b90,efcd7ba4,...) at ufs_mkdir+0x95 VOP_MKDIR_APV(c0b39660,efcd7b90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7 kern_mkdir(c5703c60,bfbf5157,0,1f8,efcd7d2c,...) at kern_mkdir+0x2b0 mkdir(c5703c60,efcd7cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efcd7d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf4cfc, ebp = 0xbfbf5128 --- Tracing command mkdir pid 23600 tid 101848 td 0xc7521630 sched_switch(c7521630,0,1,180,64416568,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c7521630,...) at mi_switch+0x209 sleepq_switch(c7521630,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0a6afe4,ce,c6b9915c,c6b99230,c7521630,...) at bwillwrite+0xef kern_mkdir(c7521630,bfbf5de7,0,1f8,f1463d2c,...) at kern_mkdir+0x2c mkdir(c7521630,f1463cfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(f1463d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf598c, ebp = 0xbfbf5db8 --- Tracing command mkdir pid 23599 tid 100170 td 0xc5781840 sched_switch(c5781840,0,1,180,84728e7c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5781840,...) at mi_switch+0x209 sleepq_switch(c5781840,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f acquire(efd0c820,efd0c818,c0a69b93,d7,c5781840,...) at acquire+0x73 _lockmgr(d930e4a0,202122,c5898e6c,c5781840,c0a757cf,...) at _lockmgr+0x4a2 getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44 bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c ffs_vget(c55495d0,5c23a,2,efd0cb48,c56f3000,...) at ffs_vget+0x360 ffs_valloc(c7efb15c,41f8,c5798b00,efd0cb48,c0a69b93,...) at ffs_valloc+0x52c ufs_mkdir(efd0cb90,c0a9dc06,0,efd0cb90,efd0cba4,...) at ufs_mkdir+0x95 VOP_MKDIR_APV(c0b39660,efd0cb90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7 kern_mkdir(c5781840,bfbfb1a7,0,1f8,efd0cd2c,...) at kern_mkdir+0x2b0 mkdir(c5781840,efd0ccfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(efd0cd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbfad4c, ebp = 0xbfbfb178 --- Tracing command mkdir pid 23598 tid 100187 td 0xc736dc60 sched_switch(c736dc60,0,2,17b,6fdd9b06,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,2820a04c,...) at mi_switch+0x209 ast(efe78d38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command mkdir pid 23597 tid 101824 td 0xc7762210 sched_switch(c7762210,0,1,180,84b419ce,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c7762210,...) at mi_switch+0x209 sleepq_switch(c7762210,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(d930e4a0,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(d930e4a0,c0b8e568,50,c0a75c32,0,...) at _sleep+0x34f acquire(f1d3c820,f1d3c818,c0a69b93,d7,c7762210,...) at acquire+0x73 _lockmgr(d930e4a0,202122,c5898e6c,c7762210,c0a757cf,...) at _lockmgr+0x4a2 getblk(c5898d98,5be3e0,0,4000,0,...) at getblk+0x1af breadn(c5898d98,5be3e0,0,4000,0,...) at breadn+0x44 bread(c5898d98,5be3e0,0,4000,0,...) at bread+0x4c ffs_vget(c55495d0,5c23f,2,f1d3cb48,c56f3000,...) at ffs_vget+0x360 ffs_valloc(c63b9d98,41f8,c5798b00,f1d3cb48,c0a69b93,...) at ffs_valloc+0x52c ufs_mkdir(f1d3cb90,c0a9dc06,0,f1d3cb90,f1d3cba4,...) at ufs_mkdir+0x95 VOP_MKDIR_APV(c0b39660,f1d3cb90,d95,d93,0,...) at VOP_MKDIR_APV+0xc7 kern_mkdir(c7762210,bfbf7b37,0,1f8,f1d3cd2c,...) at kern_mkdir+0x2b0 mkdir(c7762210,f1d3ccfc,8,c0a7181a,c0b196c0,...) at mkdir+0x29 syscall(f1d3cd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2814871f, esp = 0xbfbf76dc, ebp = 0xbfbf7b08 --- Tracing command mkdir pid 23596 tid 100114 td 0xc589ca50 sched_switch(c589ca50,0,1,180,239dbbf0,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c589ca50,...) at mi_switch+0x209 sleepq_switch(c589ca50,0,c0a6f89a,21d,a0,...) at sleepq_switch+0xf7 sleepq_wait(c0be83fc,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0be83fc,c0be85a4,2a0,c0a8ebed,0,...) at _sleep+0x34f vm_waitpfault(c5a1ed90,1d,0,125,efd24be8,...) at vm_waitpfault+0x75 vm_fault(c5c35e80,bfbfd000,1,0,bfbfd2f8,...) at vm_fault+0x6d6 trap_pfault(5,0,c0a99ec2,2ae,c58a0000,...) at trap_pfault+0x117 trap(efd24d38) at trap+0x262 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x804923f, esp = 0xbfbfced0, ebp = 0xbfbfd2f8 --- Tracing command mkdir pid 23595 tid 101840 td 0xc7522840 sched_switch(c7522840,0,2,17b,72134c08,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6ff9f,ec,f147bd28,...) at mi_switch+0x209 ast(f147bd38) at ast+0x2aa doreti_ast() at doreti_ast+0x17 Tracing command mkdir pid 23594 tid 100034 td 0xc5250420 Tracing command sysctl pid 23585 tid 100061 td 0xc56bba50 sched_switch(c56bba50,0,1,180,f2b51a5e,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c56bba50,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7 sleepq_catch_signals(efc84bc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221 sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11 _sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317 kern_nanosleep(c56bba50,efc84c64,efc84c6c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c56bba50,efc84cfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69 syscall(efc84d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813931f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 --- Tracing command swap pid 23582 tid 100201 td 0xc7354c60 sched_switch(c7354c60,0,1,180,f2b5daf2,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c7354c60,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7 sleepq_catch_signals(efe4ebc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221 sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11 _sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317 kern_nanosleep(c7354c60,efe4ec64,efe4ec6c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c7354c60,efe4ecfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69 syscall(efe4ed38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813a31f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 --- Tracing command rw pid 23579 tid 101852 td 0xc775d000 sched_switch(c775d000,0,1,180,f2d6c786,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c775d000,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7 sleepq_catch_signals(f1d0fbc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221 sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11 _sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317 kern_nanosleep(c775d000,f1d0fc64,f1d0fc6c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c775d000,f1d0fcfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69 syscall(f1d0fd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2814331f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 --- Tracing command mkdir pid 23575 tid 100111 td 0xc589d210 sched_switch(c589d210,0,1,180,f2d60026,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c589d210,0,c0a6f89a,19b,c0b8f464,...) at sleepq_switch+0xf7 sleepq_catch_signals(efd2dbc4,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221 sleepq_timedwait_sig(c0b8f464,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11 _sleep(c0b8f464,0,15c,c0a6d377,3e9,...) at _sleep+0x317 kern_nanosleep(c589d210,efd2dc64,efd2dc6c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c589d210,efd2dcfc,8,c0a71b1f,c0b1a080,...) at nanosleep+0x69 syscall(efd2dd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813a31f, esp = 0xbfbfe80c, ebp = 0xbfbfe838 --- Tracing command nfsiod 0 pid 23525 tid 100135 td 0xc589da50 sched_switch(c589da50,0,1,180,23ac9990,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c589da50,0,c0a6f89a,19b,c0be2480,...) at sleepq_switch+0xf7 sleepq_catch_signals(efd39c70,c0728464,c0b90e40,1,5c,...) at sleepq_catch_signals+0x221 sleepq_timedwait_sig(c0be2480,0,c0a6cbb3,da,0,...) at sleepq_timedwait_sig+0x11 _sleep(c0be2480,c0be244c,15c,c0a63bad,1d4c0,...) at _sleep+0x317 nfssvc_iod(c0be1e00,efd39d38,c0a68bb2,314,c5cb37f8,...) at nfssvc_iod+0xcf fork_exit(c08a63e7,c0be1e00,efd39d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefd39d70, ebp = 0 --- Tracing command run pid 23257 tid 100206 td 0xc7372a50 sched_switch(c7372a50,0,1,180,a51cd130,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c7372a50,...) at mi_switch+0x209 sleepq_switch(c7372a50,0,c0a6f89a,21d,c0b8ede8,...) at sleepq_switch+0xf7 sleepq_wait(c0b8ede8,0,c0a6b5d9,3,0,...) at sleepq_wait+0x60 _sx_xlock_hard(c0b8ede8,c7372a50,0,c0a68a72,2ac,...) at _sx_xlock_hard+0x26d _sx_xlock(c0b8ede8,0,c0a68a72,2ac,0,...) at _sx_xlock+0xb2 kern_wait(c7372a50,5c17,efe9fc2c,0,0,...) at kern_wait+0x125 wait4(c7372a50,efe9fcfc,10,c0a7220e,c0b18aa8,...) at wait4+0x3d syscall(efe9fd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe0fc, ebp = 0xbfbfe118 --- Tracing command run pid 23256 tid 100186 td 0xc736f000 sched_switch(c736f000,0,1,180,56105428,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c736f000,0,c0a6f89a,19b,c736a000,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c736a000,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c736a000,c736a090,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c736f000,5ad9,efe7bc2c,0,0,...) at kern_wait+0xa3e wait4(c736f000,efe7bcfc,10,efe7bd38,c0b18aa8,...) at wait4+0x3d syscall(efe7bd38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe5ac, ebp = 0xbfbfe5c8 --- Tracing command run pid 23255 tid 100197 td 0xc736b630 sched_switch(c736b630,0,1,180,5653b50a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c736b630,0,c0a6f89a,19b,c7370d48,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c7370d48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c7370d48,c7370dd8,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c736b630,5ad8,efe5ac2c,0,0,...) at kern_wait+0xa3e wait4(c736b630,efe5acfc,10,efe5ad38,c0b18aa8,...) at wait4+0x3d syscall(efe5ad38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280d880b, esp = 0xbfbfe5dc, ebp = 0xbfbfe5f8 --- Tracing command sh pid 23242 tid 100077 td 0xc5700a50 Tracing command sleep pid 23088 tid 101876 td 0xc73eba50 Tracing command sh pid 2682 tid 100158 td 0xc5cdb840 Tracing command tcsh pid 2678 tid 100084 td 0xc56ffa50 Tracing command sh pid 2605 tid 100096 td 0xc5780630 Tracing command watchdogd pid 2501 tid 100113 td 0xc589cc60 sched_switch(c589cc60,0,1,180,555fb0e4,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c589cc60,0,c0a6f89a,19b,c589fd48,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c589fd48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c589fd48,c589fdd8,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c589cc60,5ca4,efd27c2c,0,0,...) at kern_wait+0xa3e wait4(c589cc60,efd27cfc,10,efd27d38,c0b18aa8,...) at wait4+0x3d syscall(efd27d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280fa80b, esp = 0xbfbfeaec, ebp = 0xbfbfeb88 --- Tracing command tcsh pid 826 tid 100094 td 0xc5780a50 Tracing command sshd pid 825 tid 100088 td 0xc56ff210 Tracing command sshd pid 822 tid 100076 td 0xc5700c60 Tracing command login pid 821 tid 100054 td 0xc569a420 Tracing command getty pid 820 tid 100049 td 0xc5251630 Tracing command getty pid 819 tid 100078 td 0xc5700840 Tracing command getty pid 818 tid 100090 td 0xc5781420 Tracing command getty pid 817 tid 100074 td 0xc54dd210 Tracing command getty pid 816 tid 100095 td 0xc5780840 Tracing command getty pid 815 tid 100087 td 0xc56ff420 Tracing command getty pid 814 tid 100082 td 0xc5700000 Tracing command getty pid 813 tid 100085 td 0xc56ff840 Tracing command cron pid 771 tid 100045 td 0xc54dc000 Tracing command sshd pid 759 tid 100057 td 0xc54ddc60 Tracing command nfsd pid 703 tid 100048 td 0xc5251840 Tracing command nfsd pid 702 tid 100091 td 0xc5781210 Tracing command nfsd pid 700 tid 100092 td 0xc5781000 Tracing command nfsd pid 699 tid 100055 td 0xc569a210 Tracing command nfsd pid 698 tid 100060 td 0xc56bbc60 Tracing command mountd pid 696 tid 100098 td 0xc5780210 Tracing command rpcbind pid 675 tid 100056 td 0xc569a000 Tracing command md1 pid 630 tid 100046 td 0xc5251c60 sched_switch(c5251c60,0,1,180,f3fde6c4,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5251c60,...) at mi_switch+0x209 sleepq_switch(c5251c60,0,c0a6f89a,21d,4c,...) at sleepq_switch+0xf7 sleepq_wait(c5738800,c5738820,c0a4a433,0,0,...) at sleepq_wait+0x60 _sleep(c5738800,c5738820,24c,c0a4a433,0,...) at _sleep+0x34f md_kthread(c5738800,e57ebd38,c0a68bb2,314,c54dfaa0,...) at md_kthread+0x11f fork_exit(c05d3a37,c5738800,e57ebd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57ebd70, ebp = 0 --- Tracing command syslogd pid 590 tid 100051 td 0xc569aa50 Tracing command devd pid 546 tid 100050 td 0xc569ac60 Tracing command md0 pid 111 tid 100079 td 0xc5700630 sched_switch(c5700630,0,1,180,6370e3e8,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5700630,...) at mi_switch+0x209 sleepq_switch(c5700630,0,c0a6f89a,21d,4c,...) at sleepq_switch+0xf7 sleepq_wait(c551a000,c551a020,c0a4a433,0,0,...) at sleepq_wait+0x60 _sleep(c551a000,c551a020,24c,c0a4a433,0,...) at _sleep+0x34f md_kthread(c551a000,efcb9d38,c0a68bb2,314,c57052a8,...) at md_kthread+0x11f fork_exit(c05d3a37,c551a000,efcb9d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefcb9d70, ebp = 0 --- Tracing command schedcpu pid 43 tid 100036 td 0xc5250000 sched_switch(c5250000,0,1,180,51a962d6,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c5250000,0,c0a6f89a,240,0,...) at sleepq_switch+0xf7 sleepq_timedwait(c0b8f294,3e8,c0a63bad,2,0,...) at sleepq_timedwait+0x61 _sleep(c0b8f294,0,0,c0a63bad,3e8,...) at _sleep+0x32b pause(c0a63bad,3e8,1d1,1cf,d6dc6,...) at pause+0x40 schedcpu_thread(0,e57c4d38,c0a68bb2,314,c54db000,...) at schedcpu_thread+0x248 fork_exit(c074e7a6,0,e57c4d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57c4d70, ebp = 0 --- Tracing command softdepflush pid 42 tid 100037 td 0xc5143c60 sched_switch(c5143c60,0,1,180,64425e14,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5143c60,...) at mi_switch+0x209 sleepq_switch(c5143c60,0,c0a6f89a,21d,50,...) at sleepq_switch+0xf7 sleepq_wait(c0bdc57c,c0bdc580,c0a756d8,0,0,...) at sleepq_wait+0x60 _sleep(c0bdc57c,c0bdc580,50,c0a756d8,0,...) at _sleep+0x34f bwillwrite(c0be7e1c,0,c0a8a260,365,c5143c60,...) at bwillwrite+0xef softdep_process_worklist(c55495d0,0,c0bdc740,c5143c60,3e8,...) at softdep_process_worklist+0xfd softdep_flush(0,e5792d38,c0a68bb2,314,c54db2a8,...) at softdep_flush+0x30f fork_exit(c0908052,0,e5792d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5792d70, ebp = 0 --- Tracing command syncer pid 41 tid 100038 td 0xc54dd000 sched_switch(c54dd000,0,1,180,e2f99796,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c54dd000,...) at mi_switch+0x209 sleepq_switch(c54dd000,0,c0a6f89a,21d,68,...) at sleepq_switch+0xf7 sleepq_wait(c0b8f28c,0,c0a77eb4,0,0,...) at sleepq_wait+0x60 _sleep(c0b8f28c,c0bdc824,68,c0a77eb4,0,...) at _sleep+0x34f sched_sync(0,eda47d38,c0a68bb2,314,c54db550,...) at sched_sync+0x557 fork_exit(c07aacc7,0,eda47d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda47d70, ebp = 0 --- Tracing command vnlru pid 40 tid 100039 td 0xc54dcc60 sched_switch(c54dcc60,0,1,180,f2721352,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,50,...) at mi_switch+0x209 sleepq_switch(c54dcc60,0,c0a6f89a,240,50,...) at sleepq_switch+0xf7 sleepq_timedwait(c54db7f8,3e8,c0a77f5e,0,0,...) at sleepq_timedwait+0x61 _sleep(c54db7f8,c0bdc7f8,250,c0a77f5e,3e8,...) at _sleep+0x32b vnlru_proc(0,eda44d38,c0a68bb2,314,c54db7f8,...) at vnlru_proc+0x114 fork_exit(c07aba17,0,eda44d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda44d70, ebp = 0 --- Tracing command bufdaemon pid 39 tid 100040 td 0xc54dca50 sched_switch(c54dca50,0,2,17b,bf9c634e,...) at sched_switch+0x1a6 mi_switch(2,0,c0a6c760,1c9,c54dbb30,...) at mi_switch+0x209 uio_yield(c54dbaa0,0,c0a75244,80b,3e8,...) at uio_yield+0x1c1 buf_daemon(0,eda41d38,c0a68bb2,314,c54dbaa0,...) at buf_daemon+0x19e fork_exit(c0796e9d,0,eda41d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda41d70, ebp = 0 --- Tracing command pagezero pid 38 tid 100041 td 0xc54dc840 sched_switch(c54dc840,0,1,180,4aeb2f2e,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c54dc840,0,c0a6f89a,240,0,...) at sleepq_switch+0xf7 sleepq_timedwait(c0be8a00,493e0,c0a8f9c7,0,0,...) at sleepq_timedwait+0x61 _sleep(c0be8a00,c0be85a4,0,c0a8f9c7,493e0,...) at _sleep+0x32b vm_pagezero(0,eda3ed38,c0a68bb2,314,c54dbd48,...) at vm_pagezero+0xe0 fork_exit(c093fd0b,0,eda3ed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda3ed70, ebp = 0 --- Tracing command vmdaemon pid 37 tid 100042 td 0xc54dc630 sched_switch(c54dc630,0,1,180,16d90600,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c54dc630,...) at mi_switch+0x209 sleepq_switch(c54dc630,0,c0a6f89a,21d,68,...) at sleepq_switch+0xf7 sleepq_wait(c0be8618,c0be861c,c0a75b31,0,0,...) at sleepq_wait+0x60 _sleep(c0be8618,c0be861c,68,c0a75b31,0,...) at _sleep+0x34f vm_daemon(0,eda3bd38,c0a68bb2,314,c54df000,...) at vm_daemon+0x59 fork_exit(c093b405,0,eda3bd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda3bd70, ebp = 0 --- Tracing command pagedaemon pid 36 tid 100043 td 0xc54dc420 sched_switch(c54dc420,0,1,180,dfb1a1ea,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,44,...) at mi_switch+0x209 sleepq_switch(c54dc420,0,c0a6f89a,240,44,...) at sleepq_switch+0xf7 sleepq_timedwait(c0be85e0,1388,c0a75b31,0,0,...) at sleepq_timedwait+0x61 _sleep(c0be85e0,c0be85a4,44,c0a75b31,1388,...) at _sleep+0x32b vm_pageout(0,eda38d38,c0a68bb2,314,c54df2a8,...) at vm_pageout+0x2cc fork_exit(c093bf54,0,eda38d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda38d70, ebp = 0 --- Tracing command sctp_iterator pid 35 tid 100044 td 0xc54dc210 sched_switch(c54dc210,0,1,180,341dfa2c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c54dc210,...) at mi_switch+0x209 sleepq_switch(c54dc210,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7 sleepq_wait(c0bde2ac,c0bde1b4,c0a7e89f,0,0,...) at sleepq_wait+0x60 _sleep(c0bde2ac,c0bde1b4,0,c0a7e89f,0,...) at _sleep+0x34f sctp_iterator_thread(0,eda5cd38,c0a68bb2,314,c54df550,...) at sctp_iterator_thread+0x60 fork_exit(c080d0c6,0,eda5cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xeda5cd70, ebp = 0 --- Tracing command irq1: atkbd0 pid 34 tid 100024 td 0xc50ffa50 fork_trampoline() at fork_trampoline Tracing command fdc0 pid 33 tid 100025 td 0xc50ff840 sched_switch(c50ff840,0,1,180,e7fce262,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209 sleepq_switch(c50ff840,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7 sleepq_timedwait(c5204c3c,3e8,c0a63bad,0,0,...) at sleepq_timedwait+0x61 _sleep(c5204c3c,c5204cf0,4c,c0a63bad,3e8,...) at _sleep+0x32b fdc_thread(c5204c00,e3d52d38,c0a68bb2,314,c524f2a8,...) at fdc_thread+0x2a2 fork_exit(c0996dd5,c5204c00,e3d52d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d52d70, ebp = 0 --- Tracing command irq20: fxp0 pid 32 tid 100026 td 0xc50ff630 fork_trampoline() at fork_trampoline Tracing command irq29: bge1 pid 31 tid 100027 td 0xc5251420 fork_trampoline() at fork_trampoline Tracing command irq28: bge0 pid 30 tid 100028 td 0xc5251210 sched_switch(c5251210,0,1,180,648fbdcc,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c5141564,...) at mi_switch+0x209 ithread_loop(c5266880,e57dcd38,c0a68bb2,314,c524faa0,...) at ithread_loop+0x339 fork_exit(c0719220,c5266880,e57dcd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57dcd70, ebp = 0 --- Tracing command aac0aif pid 29 tid 100029 td 0xc5251000 sched_switch(c5251000,0,1,180,3fa40386,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209 sleepq_switch(c5251000,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7 sleepq_timedwait(c524fd48,4e20,c0a2a7e6,0,0,...) at sleepq_timedwait+0x61 _sleep(c524fd48,c5267128,4c,c0a2a7e6,4e20,...) at _sleep+0x32b aac_command_thread(c5267000,e57d9d38,c0a68bb2,314,c524fd48,...) at aac_command_thread+0x8b fork_exit(c04926c7,c5267000,e57d9d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57d9d70, ebp = 0 --- Tracing command usbtask-dr pid 28 tid 100030 td 0xc5250c60 sched_switch(c5250c60,0,1,180,6f50878c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5250c60,...) at mi_switch+0x209 sleepq_switch(c5250c60,0,c0a6f89a,21d,5c,...) at sleepq_switch+0xf7 sleepq_wait(c0b7fb34,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0b7fb34,0,5c,c0a60bc4,0,...) at _sleep+0x34f usb_task_thread(c0b7fb34,e57d6d38,c0a68bb2,314,c5252000,...) at usb_task_thread+0x62 fork_exit(c06b5e79,c0b7fb34,e57d6d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57d6d70, ebp = 0 --- Tracing command usbtask-hc pid 27 tid 100031 td 0xc5250a50 sched_switch(c5250a50,0,1,180,6f506448,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5250a50,...) at mi_switch+0x209 sleepq_switch(c5250a50,0,c0a6f89a,21d,5c,...) at sleepq_switch+0xf7 sleepq_wait(c0b7fb20,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0b7fb20,0,5c,c0a60bc4,0,...) at _sleep+0x34f usb_task_thread(c0b7fb20,e57d3d38,c0a68bb2,314,c52522a8,...) at usb_task_thread+0x62 fork_exit(c06b5e79,c0b7fb20,e57d3d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57d3d70, ebp = 0 --- Tracing command usb0 pid 26 tid 100032 td 0xc5250840 sched_switch(c5250840,0,1,180,9d699a26,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,5c,...) at mi_switch+0x209 sleepq_switch(c5250840,0,c0a6f89a,240,5c,...) at sleepq_switch+0xf7 sleepq_timedwait(c5206210,ea60,c0a60b87,0,0,...) at sleepq_timedwait+0x61 _sleep(c5206210,0,5c,c0a60b87,ea60,...) at _sleep+0x32b usb_event_thread(c5245440,e57d0d38,c0a68bb2,314,c5252550,...) at usb_event_thread+0xc8 fork_exit(c06b575e,c5245440,e57d0d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe57d0d70, ebp = 0 --- Tracing command irq15: ata1 pid 25 tid 100033 td 0xc5250630 fork_trampoline() at fork_trampoline Tracing command irq14: ata0 pid 24 tid 100015 td 0xc50fd420 sched_switch(c50fd420,0,1,180,dac2254,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c50f70e4,...) at mi_switch+0x209 ithread_loop(c52485e0,e3d37d38,c0a68bb2,314,c51427f8,...) at ithread_loop+0x339 fork_exit(c0719220,c52485e0,e3d37d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d37d70, ebp = 0 --- Tracing command swi0: uart sio pid 23 tid 100016 td 0xc50fd210 sched_switch(c50fd210,0,1,180,c3bb2bbc,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c5229364,...) at mi_switch+0x209 ithread_loop(c523fae0,e3d34d38,c0a68bb2,314,c5142aa0,...) at ithread_loop+0x339 fork_exit(c0719220,c523fae0,e3d34d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d34d70, ebp = 0 --- Tracing command irq9: ohci0 acpi0 pid 22 tid 100017 td 0xc5143a50 fork_trampoline() at fork_trampoline Tracing command kqueue taskq pid 21 tid 100018 td 0xc5143840 sched_switch(c5143840,0,1,180,6f86f138,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5143840,...) at mi_switch+0x209 sleepq_switch(c5143840,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7 sleepq_wait(c5141d80,c5141d9c,c0a63bad,0,0,...) at sleepq_wait+0x60 _sleep(c5141d80,c5141d9c,0,c0a63bad,0,...) at _sleep+0x34f taskqueue_thread_loop(c0b80aac,e578cd38,c0a68bb2,314,c5202000,...) at taskqueue_thread_loop+0xae fork_exit(c0761b41,c0b80aac,e578cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe578cd70, ebp = 0 --- Tracing command swi2: cambio pid 20 tid 100019 td 0xc5143630 fork_trampoline() at fork_trampoline Tracing command xpt_thrd pid 9 tid 100020 td 0xc5143420 sched_switch(c5143420,0,1,180,6f500338,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5143420,...) at mi_switch+0x209 sleepq_switch(c5143420,0,c0a6f89a,21d,4c,...) at sleepq_switch+0xf7 sleepq_wait(c0b50d14,0,c0a6cbb3,da,0,...) at sleepq_wait+0x60 _sleep(c0b50d14,c0b50d2c,4c,c0a22ee2,0,...) at _sleep+0x34f xpt_scanner_thread(0,e5786d38,c0a68bb2,314,c5202550,...) at xpt_scanner_thread+0x3a fork_exit(c0466479,0,e5786d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5786d70, ebp = 0 --- Tracing command swi6: task queue pid 19 tid 100021 td 0xc5143210 sched_switch(c5143210,0,1,180,d0b187a6,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c514d0e4,...) at mi_switch+0x209 ithread_loop(c51f1180,e5783d38,c0a68bb2,314,c52027f8,...) at ithread_loop+0x339 fork_exit(c0719220,c51f1180,e5783d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5783d70, ebp = 0 --- Tracing command acpi_task_2 pid 8 tid 100022 td 0xc5143000 sched_switch(c5143000,0,1,180,6f86c754,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c5143000,...) at mi_switch+0x209 sleepq_switch(c5143000,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7 sleepq_wait(c514d180,c514d19c,c0a63bad,0,0,...) at sleepq_wait+0x60 _sleep(c514d180,c514d19c,0,c0a63bad,0,...) at _sleep+0x34f taskqueue_thread_loop(c0d59efc,e5780d38,c0a68bb2,314,c5202aa0,...) at taskqueue_thread_loop+0xae fork_exit(c0761b41,c0d59efc,e5780d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5780d70, ebp = 0 --- Tracing command acpi_task_1 pid 7 tid 100023 td 0xc50ffc60 sched_switch(c50ffc60,0,1,180,6f86a314,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c50ffc60,...) at mi_switch+0x209 sleepq_switch(c50ffc60,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7 sleepq_wait(c514d180,c514d19c,c0a63bad,0,0,...) at sleepq_wait+0x60 _sleep(c514d180,c514d19c,0,c0a63bad,0,...) at _sleep+0x34f taskqueue_thread_loop(c0d59efc,e3d58d38,c0a68bb2,314,c5202d48,...) at taskqueue_thread_loop+0xae fork_exit(c0761b41,c0d59efc,e3d58d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d58d70, ebp = 0 --- Tracing command acpi_task_0 pid 6 tid 100007 td 0xc50fb000 sched_switch(c50fb000,0,1,180,6f867750,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c50fb000,...) at mi_switch+0x209 sleepq_switch(c50fb000,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7 sleepq_wait(c514d180,c514d19c,c0a63bad,0,0,...) at sleepq_wait+0x60 _sleep(c514d180,c514d19c,0,c0a63bad,0,...) at _sleep+0x34f taskqueue_thread_loop(c0d59efc,e3d1cd38,c0a68bb2,314,c50fe2a8,...) at taskqueue_thread_loop+0xae fork_exit(c0761b41,c0d59efc,e3d1cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d1cd70, ebp = 0 --- Tracing command swi6: Giant taskq pid 18 tid 100008 td 0xc50ff420 fork_trampoline() at fork_trampoline Tracing command thread taskq pid 5 tid 100009 td 0xc50ff210 sched_switch(c50ff210,0,1,180,6f93a150,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c50ff210,...) at mi_switch+0x209 sleepq_switch(c50ff210,0,c0a6f89a,21d,0,...) at sleepq_switch+0xf7 sleepq_wait(c514d300,c514d31c,c0a63bad,0,0,...) at sleepq_wait+0x60 _sleep(c514d300,c514d31c,0,c0a63bad,0,...) at _sleep+0x34f taskqueue_thread_loop(c0b94ab8,e3d49d38,c0a68bb2,314,c50fe7f8,...) at taskqueue_thread_loop+0xae fork_exit(c0761b41,c0b94ab8,e3d49d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d49d70, ebp = 0 --- Tracing command swi5: + pid 17 tid 100010 td 0xc50ff000 sched_switch(c50ff000,0,1,180,617e9322,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c514d3e4,...) at mi_switch+0x209 ithread_loop(c51f11c0,e3d46d38,c0a68bb2,314,c50feaa0,...) at ithread_loop+0x339 fork_exit(c0719220,c51f11c0,e3d46d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d46d70, ebp = 0 --- Tracing command yarrow pid 16 tid 100011 td 0xc50fdc60 sched_switch(c50fdc60,0,1,180,60457496,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c50fdc60,0,c0a6f89a,240,0,...) at sleepq_switch+0xf7 sleepq_timedwait(c0b8f294,64,c0a63bad,2,0,...) at sleepq_timedwait+0x61 _sleep(c0b8f294,0,0,c0a63bad,64,...) at _sleep+0x32b pause(c0a63bad,64,c0a58583,112,0,...) at pause+0x40 random_kthread(0,e3d43d38,c0a68bb2,314,c50fed48,...) at random_kthread+0x1d1 fork_exit(c06444c2,0,e3d43d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d43d70, ebp = 0 --- Tracing command g_down pid 4 tid 100012 td 0xc50fda50 sched_switch(c50fda50,0,1,180,636afab4,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209 sleepq_switch(c50fda50,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7 sleepq_timedwait(c0b802ac,64,c0a63bad,0,0,...) at sleepq_timedwait+0x61 _sleep(c0b802ac,c0b801c8,24c,c0a63bad,64,...) at _sleep+0x32b g_io_schedule_down(c50fda50,0,c0a65270,74,0,...) at g_io_schedule_down+0x64 g_down_procbody(0,e3d40d38,c0a68bb2,314,c5142000,...) at g_down_procbody+0x8d fork_exit(c06e9f7f,0,e3d40d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d40d70, ebp = 0 --- Tracing command g_up pid 3 tid 100013 td 0xc50fd840 sched_switch(c50fd840,0,1,180,637227c8,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209 sleepq_switch(c50fd840,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7 sleepq_timedwait(c0b802a8,64,c0a63bad,0,0,...) at sleepq_timedwait+0x61 _sleep(c0b802a8,c0b80208,24c,c0a63bad,64,...) at _sleep+0x32b g_io_schedule_up(c50fd840,0,c0a65270,5d,0,...) at g_io_schedule_up+0x132 g_up_procbody(0,e3d3dd38,c0a68bb2,314,c51422a8,...) at g_up_procbody+0x8d fork_exit(c06ea00e,0,e3d3dd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d3dd70, ebp = 0 --- Tracing command g_event pid 2 tid 100014 td 0xc50fd630 sched_switch(c50fd630,0,1,180,5a5ab90a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,4c,...) at mi_switch+0x209 sleepq_switch(c50fd630,0,c0a6f89a,240,4c,...) at sleepq_switch+0xf7 sleepq_timedwait(c0b802a0,64,c0a63bad,0,0,...) at sleepq_timedwait+0x61 _sleep(c0b802a0,0,4c,c0a63bad,64,...) at _sleep+0x32b g_event_procbody(0,e3d3ad38,c0a68bb2,314,c5142550,...) at g_event_procbody+0xcb fork_exit(c06ea09d,0,e3d3ad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d3ad70, ebp = 0 --- Tracing command swi1: net pid 15 tid 100000 td 0xc50fd000 sched_switch(c50fd000,0,1,180,e0f2206a,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c50f8964,...) at mi_switch+0x209 ithread_loop(c50f9290,e3d31d38,c0a68bb2,314,c50fa000,...) at ithread_loop+0x339 fork_exit(c0719220,c50f9290,e3d31d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d31d70, ebp = 0 --- Tracing command swi3: vm pid 14 tid 100001 td 0xc50fbc60 fork_trampoline() at fork_trampoline Tracing command swi4: clock sio pid 13 tid 100002 td 0xc50fba50 sched_switch(c50fba50,0,1,180,64283f04,...) at sched_switch+0x1a6 mi_switch(1,0,c0a68e36,46b,c50f8a64,...) at mi_switch+0x209 ithread_loop(c50f92b0,e3d2bd38,c0a68bb2,314,c50fa550,...) at ithread_loop+0x339 fork_exit(c0719220,c50f92b0,e3d2bd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d2bd70, ebp = 0 --- Tracing command idle: cpu0 pid 12 tid 100003 td 0xc50fb840 sched_switch(c50fb840,0,1,17b,88f7bd96,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6dbe6,565,e3d28d24,...) at mi_switch+0x209 sched_idletd(0,e3d28d38,c0a68bb2,314,c50fa7f8,...) at sched_idletd+0x7a fork_exit(c074ea47,0,e3d28d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d28d70, ebp = 0 --- Tracing command idle: cpu1 pid 11 tid 100004 td 0xc50fb630 sched_switch(c50fb630,0,1,17b,69dbf35c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6dbe6,565,e3d25d24,...) at mi_switch+0x209 sched_idletd(0,e3d25d38,c0a68bb2,314,c50faaa0,...) at sched_idletd+0x7a fork_exit(c074ea47,0,e3d25d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d25d70, ebp = 0 --- Tracing command init pid 1 tid 100005 td 0xc50fb420 sched_switch(c50fb420,0,1,180,1e99776c,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,0,...) at mi_switch+0x209 sleepq_switch(c50fb420,0,c0a6f89a,19b,c50fad48,...) at sleepq_switch+0xf7 sleepq_catch_signals(c0728464,c0b90e40,1,c0a6afe4,5c,...) at sleepq_catch_signals+0x221 sleepq_wait_sig(c50fad48,0,c0a6cbb3,da,0,...) at sleepq_wait_sig+0x10 _sleep(c50fad48,c50fadd8,15c,c0a719db,0,...) at _sleep+0x33f kern_wait(c50fb420,ffffffff,e3d22c2c,0,0,...) at kern_wait+0xa3e wait4(c50fb420,e3d22cfc,10,c0a717fc,c0b18aa8,...) at wait4+0x3d syscall(e3d22d38) at syscall+0x2a0 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054c3b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command audit pid 10 tid 100006 td 0xc50fb210 sched_switch(c50fb210,0,1,180,70135154,...) at sched_switch+0x1a6 mi_switch(1,0,c0a6f89a,1bf,c50fb210,...) at mi_switch+0x209 sleepq_switch(c50fb210,0,c0a6f89a,21d,c50fb210,...) at sleepq_switch+0xf7 sleepq_wait(c0be78b4,c0be7894,c0a8897d,1,0,...) at sleepq_wait+0x60 _cv_wait(c0be78b4,c0be7894,c0a89322,1c2,0,...) at _cv_wait+0x1f3 audit_worker(0,e3d1fd38,c0a68bb2,314,c50fe000,...) at audit_worker+0x99 fork_exit(c08ee282,0,e3d1fd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe3d1fd70, ebp = 0 --- Tracing command swapper pid 0 tid 0 td 0xc0b80610 sched_switch(c0b80610,0,1,180,55fd8366,...) at sched_switch+0x1a6 mi_switch(1,0,c0a8d5d6,2d9,c5697568,...) at mi_switch+0x209 scheduler(0,101ec00,101ec00,101e000,1028000,...) at scheduler+0x2ed mi_startup() at mi_startup+0x90 begin() at begin+0x2c db> call doadump Physical memory: 2035 MB Dumping 205 MB: 190 174 158 142 126 110 94 78 62 46 30 14 Dump complete = 0xf db> c Uptime: 5h38m18s aac0: shutting down controller...done Automatic reboot in 15 seconds - press a key on the console to abort Rebooting... cpu_reset: Stopping other CPUs (kgdb) bt #0 doadump () at pcpu.h:195 #1 0xc0489d57 in db_fncall (dummy1=-959166528, dummy2=0, dummy3=-1, dummy4=0xf1d39924 "") at ../../../ddb/db_command.c:486 #2 0xc048a28c in db_command_loop () at ../../../ddb/db_command.c:401 #3 0xc048b8d7 in db_trap (type=3, code=0) at ../../../ddb/db_main.c:222 #4 0xc0758692 in kdb_trap (type=3, code=0, tf=0xf1d39acc) at ../../../kern/subr_kdb.c:502 #5 0xc09d462b in trap (frame=0xf1d39acc) at ../../../i386/i386/trap.c:621 #6 0xc09bb3db in calltrap () at ../../../i386/i386/exception.s:139 #7 0xc07587eb in kdb_enter (msg=0xc0a6c254 "panic") at cpufunc.h:60 #8 0xc073393e in panic (fmt=0xc0a8e9e2 "vm_page_cache_transfer: object %p's type is incompatible with cached pages") at ../../../kern/kern_shutdown.c:547 #9 0xc0938db2 in vm_page_cache_transfer (orig_object=0xc6d447c0, offidxstart=0, new_object=0xc755c3e0) at ../../../vm/vm_page.c:982 #10 0xc09383cc in vm_object_split (entry=0xc742a50c) at ../../../vm/vm_object.c:1368 #11 0xc0930884 in vmspace_fork (vm1=0xc7377570) at ../../../vm/vm_map.c:2503 #12 0xc092c3ed in vm_forkproc (td=0xc7762000, p2=0xc5cda550, td2=0xc5cdc630, flags=20) at ../../../vm/vm_glue.c:541 #13 0xc0717bb0 in fork1 (td=0xc7762000, flags=Variable "flags" is not available. ) at ../../../kern/kern_fork.c:655 #14 0xc0718247 in fork (td=0xc7762000, uap=0xf1d39cfc) at ../../../kern/kern_fork.c:94 #15 0xc09d3e05 in syscall (frame=0xf1d39d38) at ../../../i386/i386/trap.c:1008 #16 0xc09bb440 in Xint0x80_syscall () at ../../../i386/i386/exception.s:196 #17 0x00000033 in ?? () (kgdb) f 10 #10 0xc09383cc in vm_object_split (entry=0xc742a50c) at ../../../vm/vm_object.c:1368 1368 vm_page_cache_transfer(orig_object, offidxstart, (kgdb) l 1363 1364 /* 1365 * Transfer any cached pages from orig_object to new_object. 1366 */ 1367 if (__predict_false(orig_object->cache != NULL)) 1368 vm_page_cache_transfer(orig_object, offidxstart, 1369 new_object); 1370 } 1371 VM_OBJECT_UNLOCK(orig_object); 1372 TAILQ_FOREACH(m, &new_object->memq, listq) (kgdb) info loc m = 0xc28b06a0 m_next = 0xc2b885c0 orig_object = 0xc6d447c0 new_object = 0xc755c3e0 source = 0xc2b885c0 idx = Variable "idx" is not available. (kgdb) p *m $1 = {pageq = {tqe_next = 0xc2b88650, tqe_prev = 0xc183eb30}, listq = {tqe_next = 0x0, tqe_prev = 0xc1a8afd0}, left = 0xc1a8afc8, right = 0x0, object = 0xc755c3e0, pindex = 4, phys_addr = 1202933760, md = {pv_list_count = 1, pv_list = {tqh_first = 0xc3dd3784, tqh_last = 0xc3dd3788}}, queue = 2 '\002', segind = 2 '\002', flags = 144, order = 11 '\v', pool = 0 '\0', wire_count = 0, cow = 0, hold_count = 0, oflags = 1, act_count = 5 '\005', busy = 0 '\0', valid = 255 'ÿ', dirty = 255 'ÿ'} (kgdb) p *m_next $2 = {pageq = {tqe_next = 0xc2cb6dc8, tqe_prev = 0xc3080ff8}, listq = {tqe_next = 0xc2b88650, tqe_prev = 0xc6d447ec}, left = 0x0, right = 0x0, object = 0xc6d447c0, pindex = 5, phys_addr = 1372557312, md = {pv_list_count = 1, pv_list = {tqh_first = 0xc3dd31f0, tqh_last = 0xc3dd31f4}}, queue = 1 '\001', segind = 2 '\002', flags = 128, order = 11 '\v', pool = 0 '\0', wire_count = 0, cow = 0, hold_count = 0, oflags = 0, act_count = 5 '\005', busy = 0 '\0', valid = 255 'ÿ', dirty = 255 'ÿ'} (kgdb) p *orig_object $3 = {mtx = {lock_object = {lo_name = 0xc0a8cf21 "vm object", lo_type = 0xc0a8e50a "standard object", lo_flags = 21168128, lo_witness_data = {lod_list = { stqe_next = 0xc0b9e3f0}, lod_witness = 0xc0b9e3f0}}, mtx_lock = 3346407424, mtx_recurse = 0}, object_list = {tqe_next = 0xc7a32364, tqe_prev = 0xc77db7d8}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xc7a6eba0, le_prev = 0xc69e9214}, memq = {tqh_first = 0xc2b885c0, tqh_last = 0xc1eb5500}, root = 0xc2984008, size = 22, generation = 28, ref_count = 2, shadow_count = 0, type = 1 '\001', flags = 8452, pg_color = 0, paging_in_progress = 0, resident_page_count = 11, backing_object = 0x0, backing_object_offset = 0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, cache = 0x0, handle = 0x0, un_pager = {vnp = {vnp_size = 0}, devp = { devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_bcount = 0}}} (kgdb) p *new_object $4 = {mtx = {lock_object = {lo_name = 0xc0a8cf21 "vm object", lo_type = 0xc0a8e50a "standard object", lo_flags = 21168128, lo_witness_data = {lod_list = { stqe_next = 0xc0b9e3f0}, lod_witness = 0xc0b9e3f0}}, mtx_lock = 3346407424, mtx_recurse = 0}, object_list = {tqe_next = 0xc767a3e0, tqe_prev = 0xc75eb18c}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xc84cc3e0, le_prev = 0xc7429cb8}, memq = {tqh_first = 0xc31b52d8, tqh_last = 0xc28b06a8}, root = 0xc28b06a0, size = 5, generation = 5, ref_count = 1, shadow_count = 0, type = 0 '\0', flags = 8448, pg_color = 0, paging_in_progress = 0, resident_page_count = 4, backing_object = 0x0, backing_object_offset = 0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, cache = 0xc2107d68, handle = 0x0, un_pager = {vnp = {vnp_size = 0}, devp = {devp_pglist = { tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_bcount = 0}}} (kgdb) p *source $5 = {mtx = {lock_object = {lo_name = 0xc2cb6dc8 "ø?ØÂÀ\205¸Â", lo_type = 0xc3080ff8 "À\205¸Â\200§}ÁÐ\020\bÃ\210§}Á", lo_flags = 3266872912, lo_witness_data = {lod_list = { stqe_next = 0xc6d447ec}, lod_witness = 0xc6d447ec}}, mtx_lock = 0, mtx_recurse = 0}, object_list = {tqe_next = 0xc6d447c0, tqe_prev = 0x5}, shadow_head = { lh_first = 0x0}, shadow_list = {le_next = 0x51cf9000, le_prev = 0x1}, memq = {tqh_first = 0xc3dd31f0, tqh_last = 0xc3dd31f4}, root = 0x800201, size = 11, generation = 0, ref_count = -65531, shadow_count = -1024722984, type = 120 'x', flags = 49848, pg_color = 63448, paging_in_progress = 49899, resident_page_count = -1028094592, backing_object = 0xc2b88578, backing_object_offset = -4143501443195731968, pager_object_list = {tqe_next = 0x3398, tqe_prev = 0x0}, cache = 0x51cfa000, handle = 0x1, un_pager = {vnp = {vnp_size = -4345348341430601552}, devp = {devp_pglist = {tqh_first = 0xc3b238b0, tqh_last = 0xc3b238b4}}, swp = {swp_bcount = -1011730256}}} (kgdb) p *entry $6 = {prev = 0xc6e39374, next = 0xc742a330, left = 0xc6e39374, right = 0xc742a330, start = 671645696, end = 671666176, avail_ssize = 0, adj_free = 0, max_free = 0, object = { vm_object = 0xc6d447c0, sub_map = 0xc6d447c0}, offset = 0, eflags = 0, protection = 3 '\003', max_protection = 7 '\a', inheritance = 1 '\001', wired_count = 0, lastr = 2} (kgdb) -- Test scenario: vfs.sh + all.sh