GENERIC HEAD from 2016-09-14 17:43:32 UTC, r305815M, vmcore.955 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #1 r305815M: Thu Sep 15 01:28:59 CEST 2016 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3524567040 (3361 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2097312 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 638820 free (1956 frags, 79608 blocks, 0.2% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 710857 free (16105 frags, 86844 blocks, 1.6% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 53087757 free (26677 frags, 6632635 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1766384 free (263216 frags, 187896 blocks, 2.6% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 5775201 free (229433 frags, 693221 blocks, 0.9% fragmentation) Mounting local file systems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc48 /usr/local/lib/mozjpeg /usr/local/lib/mysql /usr/local/lib/perl5/5.20/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/llvm37/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:. uhub5: 10 ports with 10 removable, self powered re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. Starting ddb. No core dumps found. Additional ABI support: linux. lock order reversal: 1st 0xe48f0a20 bufwait (bufwait) @ kern/vfs_bio.c:3505 2nd 0xc8f97200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 stack backtrace: #0 0xc0cb2cf4 at witness_debugger+0xc4 #1 0xc0cb262b at witness_checkorder+0x114b #2 0xc0c587f0 at _sx_xlock+0x70 #3 0xc0f4ad23 at ufsdirhash_add+0x53 #4 0xc0f4f788 at ufs_direnter+0x4b8 #5 0xc0f586af at ufs_mkdir+0x7df #6 0xc1213359 at VOP_MKDIR_APV+0xf9 #7 0xc0d2acdc at kern_mkdirat+0x22c #8 0xc0d2aaa1 at sys_mkdir+0x31 #9 0xc11e199f at syscall+0x3bf #10 0xc11cc69e at Xint0x80_syscall+0x2e Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:lock order reversal: 1st 0xca1a273c ufs (ufs) @ kern/vfs_lookup.c:522 2nd 0xe4906370 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:276 3rd 0xca1a246c ufs (ufs) @ kern/vfs_subr.c:2523 stack backtrace: #0 0xc0cb2cf4 at witness_debugger+0xc4 #1 0xc0cb262b at witness_checkorder+0x114b #2 0xc0c25612 at __lockmgr_args+0x482 #3 0xc0f45572 at _lockmgr_args+0xb2 #4 0xc0f43517 at ffs_lock+0x107 #5 0xc12140f0 at VOP_LOCK1_APV+0xe0 #6 0xc0d2df4a at _vn_lock+0xba #7 0xc0d1bede at vget+0x8e #8 0xc0d0e091 at vfs_hash_get+0xd1 #9 0xc0f3d8e4 at ffs_vgetf+0x44 #10 0xc0f33c81 at softdep_sync_buf+0xb11 #11 0xc0f44cf5 at ffs_syncvnode+0x585 #12 0xc0f17d72 at ffs_truncate+0x912 #13 0xc0f4f946 at ufs_direnter+0x676 #14 0xc0f59479 at ufs_makeinode+0x519 #15 0xc0f55240 at ufs_create+0x30 #16 0xc1210cb9 at VOP_CREATE_APV+0xf9 #17 0xc0d2d745 at vn_open_cred+0x2a5 . Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting smartd. Sep 15 10:17:47 x4 smartd[648]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Sep 15 10:17:47 x4 smartd[648]: see the following Seagate web pages: Sep 15 10:17:47 x4 smartd[648]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Sep 15 10:17:47 x4 smartd[648]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc97c48a4 ufs (ufs) @ kern/vfs_mount.c:1244 2nd 0xc919319c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1908 stack backtrace: #0 0xc0cb2cf4 at witness_debugger+0xc4 #1 0xc0cb262b at witness_checkorder+0x114b #2 0xc0c25612 at __lockmgr_args+0x482 #3 0xc0d09f43 at vop_stdlock+0x53 #4 0xc12140f0 at VOP_LOCK1_APV+0xe0 #5 0xc0d2df4a at _vn_lock+0xba #6 0xc0f21708 at softdep_flushworklist+0x68 #7 0xc0f40bfa at ffs_sync+0x2aa #8 0xc0d2f695 at vfs_write_suspend+0x1c5 #9 0xc0d2f8c5 at vfs_write_suspend_umnt+0x45 #10 0xc0f4036f at ffs_unmount+0xaf #11 0xc0d14256 at dounmount+0x806 #12 0xc0d13945 at sys_unmount+0x315 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 459915 files, 65226224 used, 53087757 free (26669 frags, 6632636 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting default moused. Starting inetd. Thu Sep 15 10:20 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Sep 15 11:06:01 x4 su: pho to root on /dev/pts/0 20160915 11:06:15 all (1/437): fdatasync.sh 20160915 11:09:27 all (2/437): nfs9.sh cache_purgevfs: error on ncp 0xcce4f2e0 cache_purgevfs: error on ncp 0xcce7e284 cache_purgevfs: error on ncp 0xcce217e8 cache_purgevfs: error on ncp 0xcce42284 cache_purgevfs: error on ncp 0xcce5e228 cache_purgevfs: error on ncp 0xcce5005c cache_purgevfs: error on ncp 0xcce42d4c cache_purgevfs: error on ncp 0xcce5f9b4 cache_purgevfs: error on ncp 0xcce70da8 cache_purgevfs: error on ncp 0xcbae36d4 cache_purgevfs: error on ncp 0xcb4d3a6c cache_purgevfs: error on ncp 0xcbb53564 cache_purgevfs: error on ncp 0xcba77c94 cache_purgevfs: error on ncp 0xcb49b05c cache_purgevfs: error on ncp 0xcbaab7e8 cache_purgevfs: error on ncp 0xcbc2a398 cache_purgevfs: error on ncp 0xcb94f2e0 cache_purgevfs: error on ncp 0xcb741d4c cache_purgevfs: error on ncp 0xccd028a0 cache_purgevfs: error on ncp 0xccf119b4 cache_purgevfs: error on ncp 0xcba69958 cache_purgevfs: error on ncp 0xcb93a170 cache_purgevfs: error on ncp 0xcbdff6d4 cache_purgevfs: error on ncp 0xcccb1c38 cache_purgevfs: error on ncp 0xcccb1c38 cache_purgevfs: error on ncp 0xcb69c730 cache_purgevfs: error on ncp 0xcb21b7e8 cache_purgevfs: error on ncp 0xcb6862e0 cache_purgevfs: error on ncp 0xccd10114 cache_purgevfs: error on ncp 0xcbbf3b24 cache_purgevfs: error on ncp 0xcb91b4ac cache_purgevfs: error on ncp 0xcb666114 cache_purgevfs: error on ncp 0xcbc298a0 cache_purgevfs: error on ncp 0xcb6d4e04 cache_purgevfs: error on ncp 0xcb61c170 cache_purgevfs: error on ncp 0xcbe2eebc cache_purgevfs: error on ncp 0xcbb39564 cache_purgevfs: error on ncp 0xcb541114 cache_purgevfs: error on ncp 0xcbce87e8 cache_purgevfs: error on ncp 0xcb801114 cache_purgevfs: error on ncp 0xccc56ebc cache_purgevfs: error on ncp 0xcb96d33c cache_purgevfs: error on ncp 0xcb69ba10 cache_purgevfs: error on ncp 0xcb23aac8 cache_purgevfs: error on ncp 0xccd021cc cache_purgevfs: error on ncp 0xcb49bbdc cache_purgevfs: error on ncp 0xcba69170 cache_purgevfs: error on ncp 0xcb61ce60 cache_purgevfs: error on ncp 0xcb854a10 cache_purgevfs: error on ncp 0xcbb03170 cache_purgevfs: error on ncp 0xcb590da8 cache_purgevfs: error on ncp 0xcb590da8 panic: SACK scoreboard must not be empty cpuid = 1 KDB: stack backtrace: db_trace_self_wrapper(c15ca648,c1859024,0,c159d5ac,f12ae778,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae748 kdb_backtrace(c17bd113,1,c15f5842,f12ae814,1,...) at kdb_backtrace+0x2d/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x115/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- KDB: enter: panic [ thread pid 12 tid 100030 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 12 tid 100030 td 0xc900f9f0 kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x776a00 curthread = 0xcc1e99f0: pid 25326 tid 100319 "newnfs 11" curpcb = 0xf3bfdd40 fpcurthread = none idlethread = 0xc8e4b6a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x23263a00 curthread = 0xc900f9f0: pid 12 tid 100030 "irq257: re0" curpcb = 0xf12aed40 fpcurthread = none idlethread = 0xc8e4b350: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x23266a00 curthread = 0xccfd2350: pid 25300 tid 100301 "swap" curpcb = 0xf3bc7d40 fpcurthread = none idlethread = 0xc8e4b000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x23269a00 curthread = 0xcc1d6350: pid 25278 tid 100279 "swap" curpcb = 0xf3b85d40 fpcurthread = none idlethread = 0xc8e4a9f0: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 25701 (ls) thread 0xcd00d9f0 (100352) shared lockmgr nfs (nfs) r = 0 (0xcc6c8cdc) locked @ kern/vfs_lookup.c:522 Process 25633 (rw) thread 0xc961b000 (100554) exclusive lockmgr bufwait (bufwait) r = 0 (0xe4aee660) locked @ kern/vfs_bio.c:3505 exclusive lockmgr nfs (nfs) r = 0 (0xcaed5cdc) locked @ kern/vfs_vnops.c:866 Process 25631 (rw) thread 0xca09a6a0 (100552) exclusive lockmgr bufwait (bufwait) r = 0 (0xe4aeafb0) locked @ kern/vfs_bio.c:3505 exclusive lockmgr nfs (nfs) r = 0 (0xcb8f2a0c) locked @ kern/vfs_vnops.c:866 Process 25628 (rw) thread 0xca09a350 (100551) exclusive lockmgr bufwait (bufwait) r = 0 (0xe4aad5c0) locked @ kern/vfs_bio.c:3505 exclusive lockmgr nfs (nfs) r = 0 (0xcb984304) locked @ kern/vfs_vnops.c:866 Process 25627 (rw) thread 0xca09a000 (100550) exclusive lockmgr bufwait (bufwait) r = 0 (0xe49eed50) locked @ kern/vfs_bio.c:3505 exclusive lockmgr nfs (nfs) r = 0 (0xcaed8e44) locked @ kern/vfs_vnops.c:866 Process 25587 (mkdir) thread 0xcab149f0 (100525) shared lockmgr nfs (nfs) r = 0 (0xc9db873c) locked @ kern/vfs_subr.c:2523 Process 25586 (mkdir) thread 0xcab146a0 (100524) shared lockmgr nfs (nfs) r = 0 (0xc97638a4) locked @ kern/vfs_lookup.c:522 Process 25585 (mkdir) thread 0xcab14350 (100523) exclusive lockmgr nfs (nfs) r = 0 (0xca6b446c) locked @ kern/vfs_lookup.c:522 Process 25584 (mkdir) thread 0xcab14000 (100522) shared lockmgr nfs (nfs) r = 0 (0xcaba619c) locked @ kern/vfs_subr.c:2523 Process 25579 (mkdir) thread 0xcc0bb9f0 (100519) shared lockmgr nfs (nfs) r = 0 (0xcccec8a4) locked @ kern/vfs_lookup.c:522 Process 25576 (mmap) thread 0xcaf459f0 (100516) exclusive lockmgr nfs (nfs) r = 0 (0xc9119a0c) locked @ kern/vfs_lookup.c:522 Process 25570 (mmap) thread 0xcc0bb350 (100413) exclusive lockmgr bufwait (bufwait) r = 0 (0xe4aede90) locked @ kern/vfs_bio.c:1454 exclusive lockmgr nfs (nfs) r = 0 (0xc9d6c5d4) locked @ kern/vfs_vnops.c:866 Process 25564 (mkdir) thread 0xcb221000 (100509) exclusive lockmgr nfs (nfs) r = 0 (0xca631304) locked @ kern/vfs_lookup.c:522 Process 25562 (mkdir) thread 0xccf926a0 (100507) shared lockmgr nfs (nfs) r = 0 (0xcaba6034) locked @ kern/vfs_subr.c:2523 Process 25557 (mkdir) thread 0xcc8f6350 (100502) shared lockmgr nfs (nfs) r = 0 (0xc9f0ecdc) locked @ kern/vfs_lookup.c:522 Process 25554 (mmap) thread 0xca1b0350 (100500) exclusive lockmgr nfs (nfs) r = 0 (0xc9db88a4) locked @ kern/vfs_subr.c:2523 Process 25553 (mmap) thread 0xca1b0000 (100499) exclusive lockmgr nfs (nfs) r = 0 (0xcc0b619c) locked @ kern/vfs_subr.c:2523 Process 25552 (mmap) thread 0xc9fd39f0 (100498) exclusive lockmgr nfs (nfs) r = 0 (0xcaac2034) locked @ kern/vfs_lookup.c:522 Process 25551 (mmap) thread 0xc9fd36a0 (100497) exclusive lockmgr nfs (nfs) r = 0 (0xcaacf034) locked @ kern/vfs_lookup.c:522 Process 25550 (mmap) thread 0xc9fd3350 (100496) exclusive lockmgr bufwait (bufwait) r = 0 (0xe48b9a70) locked @ vm/vm_pager.c:378 exclusive lockmgr nfs (nfs) r = 0 (0xc9dd419c) locked @ kern/vfs_vnops.c:442 Process 25549 (mmap) thread 0xc93909f0 (100495) exclusive lockmgr nfs (nfs) r = 0 (0xcbaf4cdc) locked @ kern/vfs_subr.c:2523 Process 25548 (mmap) thread 0xc93906a0 (100494) exclusive lockmgr nfs (nfs) r = 0 (0xcc0b6e44) locked @ kern/vfs_subr.c:2523 Process 25500 (mmap) thread 0xcd1296a0 (100350) exclusive lockmgr bufwait (bufwait) r = 0 (0xe48b8c60) locked @ vm/vm_pager.c:378 exclusive lockmgr nfs (nfs) r = 0 (0xc970dcdc) locked @ kern/vfs_vnops.c:442 Process 25499 (mmap) thread 0xcd129350 (100349) exclusive lockmgr nfs (nfs) r = 0 (0xcad48034) locked @ kern/vfs_lookup.c:522 Process 25498 (mmap) thread 0xcd129000 (100348) exclusive lockmgr nfs (nfs) r = 0 (0xcc0b9034) locked @ kern/vfs_lookup.c:522 Process 25497 (mmap) thread 0xcc1ea9f0 (100347) exclusive lockmgr nfs (nfs) r = 0 (0xcac30034) locked @ kern/vfs_vnops.c:442 Process 25496 (mmap) thread 0xcc1ea6a0 (100346) exclusive lockmgr nfs (nfs) r = 0 (0xcbaf45d4) locked @ kern/vfs_subr.c:2523 Process 25495 (mmap) thread 0xcc0806a0 (100220) exclusive lockmgr nfs (nfs) r = 0 (0xca0f0a0c) locked @ kern/vfs_lookup.c:522 Process 25485 (pty) thread 0xcce889f0 (100326) exclusive lockmgr devfs (devfs) r = 0 (0xc9657304) locked @ kern/vfs_subr.c:2523 Process 25481 (pty) thread 0xcce896a0 (100264) exclusive sx devfsmount (devfsmount) r = 0 (0xc96411d4) locked @ fs/devfs/devfs_vnops.c:245 shared lockmgr devfs (devfs) r = 0 (0xca3ece44) locked @ fs/devfs/devfs_vnops.c:244 Process 25469 (creat) thread 0xca145000 (100172) exclusive lockmgr nfs (nfs) r = 0 (0xcafbfa0c) locked @ kern/vfs_lookup.c:522 Process 25468 (creat) thread 0xcb1ff000 (100225) exclusive lockmgr nfs (nfs) r = 0 (0xcc6c8304) locked @ kern/vfs_lookup.c:522 Process 25466 (creat) thread 0xcb1fe6a0 (100227) exclusive lockmgr nfs (nfs) r = 0 (0xca2b2a0c) locked @ kern/vfs_lookup.c:522 Process 25465 (creat) thread 0xcc1ab350 (100253) exclusive lockmgr nfs (nfs) r = 0 (0xca8ed46c) locked @ kern/vfs_lookup.c:522 Process 25464 (creat) thread 0xcc1ab000 (100254) exclusive lockmgr nfs (nfs) r = 0 (0xcbaa18a4) locked @ kern/vfs_lookup.c:522 Process 25463 (creat) thread 0xcc1aa9f0 (100255) exclusive lockmgr nfs (nfs) r = 0 (0xcbaa173c) locked @ kern/vfs_lookup.c:522 Process 25462 (creat) thread 0xcb200000 (100196) exclusive lockmgr nfs (nfs) r = 0 (0xca3d273c) locked @ kern/vfs_lookup.c:522 Process 25461 (creat) thread 0xcb1ff9f0 (100198) exclusive lockmgr nfs (nfs) r = 0 (0xcbaa1cdc) locked @ kern/vfs_lookup.c:522 Process 25460 (creat) thread 0xc97ee000 (100100) exclusive lockmgr nfs (nfs) r = 0 (0xcc6cd73c) locked @ kern/vfs_lookup.c:522 Process 25459 (creat) thread 0xcb200350 (100251) exclusive lockmgr nfs (nfs) r = 0 (0xcbaa1a0c) locked @ kern/vfs_lookup.c:522 Process 25458 (creat) thread 0xcc1ea350 (100252) exclusive lockmgr nfs (nfs) r = 0 (0xcc8af46c) locked @ kern/vfs_lookup.c:522 Process 25457 (creat) thread 0xcc1d76a0 (100247) exclusive lockmgr nfs (nfs) r = 0 (0xcaad65d4) locked @ kern/vfs_lookup.c:522 Process 25456 (creat) thread 0xcc0809f0 (100218) exclusive lockmgr nfs (nfs) r = 0 (0xcaad546c) locked @ kern/vfs_lookup.c:522 Process 25455 (creat) thread 0xcc1d86a0 (100343) exclusive lockmgr nfs (nfs) r = 0 (0xc8f5e19c) locked @ kern/vfs_lookup.c:522 Process 25454 (creat) thread 0xcc1d8350 (100342) exclusive lockmgr nfs (nfs) r = 0 (0xcc6cdcdc) locked @ kern/vfs_lookup.c:522 Process 25453 (creat) thread 0xcb1fd350 (100240) exclusive lockmgr nfs (nfs) r = 0 (0xcc6cda0c) locked @ kern/vfs_lookup.c:522 Process 25452 (creat) thread 0xcc1ac350 (100231) exclusive lockmgr nfs (nfs) r = 0 (0xcb813cdc) locked @ kern/vfs_subr.c:2523 exclusive lockmgr nfs (nfs) r = 0 (0xca3d2e44) locked @ kern/vfs_lookup.c:522 Process 25451 (creat) thread 0xca4b3000 (100164) exclusive lockmgr nfs (nfs) r = 0 (0xcc8af304) locked @ kern/vfs_lookup.c:522 Process 25326 (newnfs 11) thread 0xcc1e99f0 (100319) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xca48b978) locked @ kern/uipc_sockbuf.c:283 Process 12 (intr) thread 0xc900f9f0 (100030) exclusive rw tcpinp (tcpinp) r = 0 (0xca154cc8) locked @ netinet/in_pcb.c:1964 db:0:alllocks> show lockedvnods Locked vnodes vnode 0xc96572d0: tag devfs, type VDIR usecount 5, writecount 0, refcount 12 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) lock type devfs: EXCL by thread 0xcce889f0 (pid 25485, pty, tid 100326) with exclusive waiters pending #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0b16cae at devfs_allocv+0xee #6 0xc0b16762 at devfs_root+0x52 #7 0xc0d0ff68 at lookup+0x7f8 #8 0xc0d0f3cc at namei+0x58c #9 0xc0d2d69d at vn_open_cred+0x1fd #10 0xc0d2d48d at vn_open+0x3d #11 0xc0d25995 at kern_openat+0x345 #12 0xc0d25cb3 at sys_openat+0x53 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e vnode 0xca3ece10: tag devfs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type devfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0b190fc at devfs_populate_vp+0xdc #5 0xc0b17296 at devfs_lookup+0x26 #6 0xc1210899 at VOP_LOOKUP_APV+0xf9 #7 0xc0d0fcf9 at lookup+0x589 #8 0xc0d0f3cc at namei+0x58c #9 0xc0d2d69d at vn_open_cred+0x1fd #10 0xc0d2d48d at vn_open+0x3d #11 0xc0d25995 at kern_openat+0x345 #12 0xc0d25cb3 at sys_openat+0x53 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e vnode 0xcc6c8ca8: tag nfs, type VDIR usecount 4, writecount 0, refcount 17 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xcb4958c0 ref 0 pages 22 cleanbuf 11 dirtybuf 0 lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27ace at kern_statat+0xae #7 0xc0d27c99 at sys_fstatat+0x49 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 2 fsid 0x3a00ff07 vnode 0xcc8af2d0: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xca4b3000 (pid 25451, creat, tid 100164) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068930 fsid 0x3a00ff07 vnode 0xcc8af438: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1ea350 (pid 25458, creat, tid 100252) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068931 fsid 0x3a00ff07 vnode 0xcc6cd708: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xc97ee000 (pid 25460, creat, tid 100100) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068932 fsid 0x3a00ff07 vnode 0xcc6cd9d8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb1fd350 (pid 25453, creat, tid 100240) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068933 fsid 0x3a00ff07 vnode 0xcc6cdca8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1d8350 (pid 25454, creat, tid 100342) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27097 at kern_unlinkat+0xa7 #7 0xc0d26fe2 at sys_unlink+0x32 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068934 fsid 0x3a00ff07 vnode 0xcc6c82d0: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb1ff000 (pid 25468, creat, tid 100225) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068935 fsid 0x3a00ff07 vnode 0xcbaa1708: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1aa9f0 (pid 25463, creat, tid 100255) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068937 fsid 0x3a00ff07 vnode 0xcbaa19d8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb200350 (pid 25459, creat, tid 100251) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068938 fsid 0x3a00ff07 vnode 0xcbaa1870: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1ab000 (pid 25464, creat, tid 100254) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068939 fsid 0x3a00ff07 vnode 0xcbaa1ca8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb1ff9f0 (pid 25461, creat, tid 100198) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27097 at kern_unlinkat+0xa7 #7 0xc0d26fe2 at sys_unlink+0x32 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068940 fsid 0x3a00ff07 vnode 0xca0f09d8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc0806a0 (pid 25495, mmap, tid 100220) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069349 fsid 0x3a00ff07 vnode 0xcad48000: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcd129350 (pid 25499, mmap, tid 100349) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069927 fsid 0x3a00ff07 vnode 0xcaad65a0: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1d76a0 (pid 25457, creat, tid 100247) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9068956 fsid 0x3a00ff07 vnode 0xcaad5438: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc0809f0 (pid 25456, creat, tid 100218) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069014 fsid 0x3a00ff07 vnode 0xcaac2000: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xc9fd39f0 (pid 25552, mmap, tid 100498) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069125 fsid 0x3a00ff07 vnode 0xca8ed438: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1ab350 (pid 25465, creat, tid 100253) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069156 fsid 0x3a00ff07 vnode 0xcaacf000: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xc9fd36a0 (pid 25551, mmap, tid 100497) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27097 at kern_unlinkat+0xa7 #7 0xc0d26fe2 at sys_unlink+0x32 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069174 fsid 0x3a00ff07 vnode 0xcafbf9d8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xca145000 (pid 25469, creat, tid 100172) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9069192 fsid 0x3a00ff07 vnode 0xca3d2708: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb200000 (pid 25462, creat, tid 100196) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27097 at kern_unlinkat+0xa7 #7 0xc0d26fe2 at sys_unlink+0x32 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9071639 fsid 0x3a00ff07 vnode 0xca3d2e10: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1ac350 (pid 25452, creat, tid 100231) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27097 at kern_unlinkat+0xa7 #7 0xc0d26fe2 at sys_unlink+0x32 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9071642 fsid 0x3a00ff07 vnode 0xc8f5e168: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcc1d86a0 (pid 25455, creat, tid 100343) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9071667 fsid 0x3a00ff07 vnode 0xca2b29d8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb1fe6a0 (pid 25466, creat, tid 100227) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d27097 at kern_unlinkat+0xa7 #7 0xc0d26fe2 at sys_unlink+0x32 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9071674 fsid 0x3a00ff07 vnode 0xcc0b9000: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcd129000 (pid 25498, mmap, tid 100348) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9071677 fsid 0x3a00ff07 vnode 0xc91199d8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcaf459f0 (pid 25576, mmap, tid 100516) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2d55c at vn_open_cred+0xbc #7 0xc0d2d48d at vn_open+0x3d #8 0xc0d25995 at kern_openat+0x345 #9 0xc0d25cb3 at sys_openat+0x53 #10 0xc11e199f at syscall+0x3bf #11 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9071720 fsid 0x3a00ff07 vnode 0xcaed8e10: tag nfs, type VREG usecount 1, writecount 1, refcount 85 mountedhere 0 flags (VI_ACTIVE) v_object 0xca61b140 ref 0 pages 1327 cleanbuf 0 dirtybuf 83 lock type nfs: EXCL by thread 0xca09a000 (pid 25627, rw, tid 100550) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d30c84 at vn_write+0x134 #5 0xc0d30863 at vn_io_fault_doio+0x83 #6 0xc0d2e5bf at vn_io_fault1+0x18f #7 0xc0d2c727 at vn_io_fault+0x207 #8 0xc0cb9a12 at dofilewrite+0xb2 #9 0xc0cb96c3 at kern_writev+0x93 #10 0xc0cb9629 at sys_write+0x59 #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9081037 fsid 0x3a00ff07 vnode 0xcaed5ca8: tag nfs, type VREG usecount 1, writecount 1, refcount 47 mountedhere 0 flags (VI_ACTIVE) v_object 0xca61b820 ref 0 pages 708 cleanbuf 0 dirtybuf 45 lock type nfs: EXCL by thread 0xc961b000 (pid 25633, rw, tid 100554) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d30c84 at vn_write+0x134 #5 0xc0d30863 at vn_io_fault_doio+0x83 #6 0xc0d2e5bf at vn_io_fault1+0x18f #7 0xc0d2c727 at vn_io_fault+0x207 #8 0xc0cb9a12 at dofilewrite+0xb2 #9 0xc0cb96c3 at kern_writev+0x93 #10 0xc0cb9629 at sys_write+0x59 #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9081035 fsid 0x3a00ff07 vnode 0xcb8f29d8: tag nfs, type VREG usecount 1, writecount 1, refcount 75 mountedhere 0 flags (VI_ACTIVE) v_object 0xcc1200a0 ref 0 pages 1156 cleanbuf 45 dirtybuf 28 lock type nfs: EXCL by thread 0xca09a6a0 (pid 25631, rw, tid 100552) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d30c84 at vn_write+0x134 #5 0xc0d30863 at vn_io_fault_doio+0x83 #6 0xc0d2e5bf at vn_io_fault1+0x18f #7 0xc0d2c727 at vn_io_fault+0x207 #8 0xc0cb9a12 at dofilewrite+0xb2 #9 0xc0cb96c3 at kern_writev+0x93 #10 0xc0cb9629 at sys_write+0x59 #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9081473 fsid 0x3a00ff07 vnode 0xcb813ca8: tag nfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xca5b7c80 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type nfs: EXCL by thread 0xcc1ac350 (pid 25452, creat, tid 100231) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0d0e091 at vfs_hash_get+0xd1 #6 0xc0b5ed3f at nfscl_nget+0x8f #7 0xc0b528ab at nfs_lookup+0x8db #8 0xc1210899 at VOP_LOOKUP_APV+0xf9 #9 0xc0d0fcf9 at lookup+0x589 #10 0xc0d0f3cc at namei+0x58c #11 0xc0d27097 at kern_unlinkat+0xa7 #12 0xc0d26fe2 at sys_unlink+0x32 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9082929 fsid 0x3a00ff07 vnode 0xcb9842d0: tag nfs, type VREG usecount 1, writecount 1, refcount 45 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb3226e0 ref 0 pages 677 cleanbuf 0 dirtybuf 43 lock type nfs: EXCL by thread 0xca09a350 (pid 25628, rw, tid 100551) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d30c84 at vn_write+0x134 #5 0xc0d30863 at vn_io_fault_doio+0x83 #6 0xc0d2e5bf at vn_io_fault1+0x18f #7 0xc0d2c727 at vn_io_fault+0x207 #8 0xc0cb9a12 at dofilewrite+0xb2 #9 0xc0cb96c3 at kern_writev+0x93 #10 0xc0cb9629 at sys_write+0x59 #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9083537 fsid 0x3a00ff07 vnode 0xc9dd4168: tag nfs, type VREG usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xc9feda00 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xc9fd3350 (pid 25550, mmap, tid 100496) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d2e02b at vn_close+0x6b #5 0xc0d2cc7f at vn_closefile+0x4f #6 0xc0bf9101 at _fdrop+0x21 #7 0xc0bfc43e at closef+0x21e #8 0xc0bf97ec at closefp+0xac #9 0xc0bfa160 at kern_close+0x120 #10 0xc0bfa03a at sys_close+0x1a #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070439 fsid 0x3a00ff07 vnode 0xcac30000: tag nfs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9fedaa0 ref 0 pages 5 cleanbuf 1 dirtybuf 0 lock type nfs: EXCL by thread 0xcc1ea9f0 (pid 25497, mmap, tid 100347) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d2e02b at vn_close+0x6b #5 0xc0d2cc7f at vn_closefile+0x4f #6 0xc0bf9101 at _fdrop+0x21 #7 0xc0bfc43e at closef+0x21e #8 0xc0bf97ec at closefp+0xac #9 0xc0bfa160 at kern_close+0x120 #10 0xc0bfa03a at sys_close+0x1a #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070440 fsid 0x3a00ff07 vnode 0xc9763870: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d25340 at kern_chdir+0x60 #7 0xc0d252d2 at sys_chdir+0x22 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390035 fsid 0x3a00ff07 vnode 0xc9f0eca8: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d25340 at kern_chdir+0x60 #7 0xc0d252d2 at sys_chdir+0x22 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390037 fsid 0x3a00ff07 vnode 0xcccec870: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d25340 at kern_chdir+0x60 #7 0xc0d252d2 at sys_chdir+0x22 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390038 fsid 0x3a00ff07 vnode 0xca6b4438: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcab14350 (pid 25585, mkdir, tid 100523) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2ab79 at kern_mkdirat+0xc9 #7 0xc0d2aaa1 at sys_mkdir+0x31 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390040 fsid 0x3a00ff07 vnode 0xca6312d0: tag nfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type nfs: EXCL by thread 0xcb221000 (pid 25564, mkdir, tid 100509) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d0f85f at lookup+0xef #5 0xc0d0f3cc at namei+0x58c #6 0xc0d2ab79 at kern_mkdirat+0xc9 #7 0xc0d2aaa1 at sys_mkdir+0x31 #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390041 fsid 0x3a00ff07 vnode 0xc9d6c5a0: tag nfs, type VREG usecount 1, writecount 1, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feea00 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type nfs: EXCL by thread 0xcc0bb350 (pid 25570, mmap, tid 100413) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d30c84 at vn_write+0x134 #5 0xc0d30863 at vn_io_fault_doio+0x83 #6 0xc0d2e5bf at vn_io_fault1+0x18f #7 0xc0d2c727 at vn_io_fault+0x207 #8 0xc0cb9a12 at dofilewrite+0xb2 #9 0xc0cb96c3 at kern_writev+0x93 #10 0xc0cb9629 at sys_write+0x59 #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070384 fsid 0x3a00ff07 vnode 0xc970dca8: tag nfs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feee60 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xcd1296a0 (pid 25500, mmap, tid 100350) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d2e02b at vn_close+0x6b #5 0xc0d2cc7f at vn_closefile+0x4f #6 0xc0bf9101 at _fdrop+0x21 #7 0xc0bfc43e at closef+0x21e #8 0xc0bf97ec at closefp+0xac #9 0xc0bfa160 at kern_close+0x120 #10 0xc0bfa03a at sys_close+0x1a #11 0xc11e199f at syscall+0x3bf #12 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070459 fsid 0x3a00ff07 vnode 0xcbaf45a0: tag nfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feef00 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xcc1ea6a0 (pid 25496, mmap, tid 100346) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0f75eb9 at vm_mmap_vnode+0x49 #6 0xc0d2d322 at vn_mmap+0xe2 #7 0xc0f7477b at sys_mmap+0x4ab #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070460 fsid 0x3a00ff07 vnode 0xcbaf4ca8: tag nfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feb320 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xc93909f0 (pid 25549, mmap, tid 100495) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0f75eb9 at vm_mmap_vnode+0x49 #6 0xc0d2d322 at vn_mmap+0xe2 #7 0xc0f7477b at sys_mmap+0x4ab #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070461 fsid 0x3a00ff07 vnode 0xc9db8708: tag nfs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0d0e091 at vfs_hash_get+0xd1 #6 0xc0b5ed3f at nfscl_nget+0x8f #7 0xc0b528ab at nfs_lookup+0x8db #8 0xc1210899 at VOP_LOOKUP_APV+0xf9 #9 0xc0d0fcf9 at lookup+0x589 #10 0xc0d0f3cc at namei+0x58c #11 0xc0d25340 at kern_chdir+0x60 #12 0xc0d252d2 at sys_chdir+0x22 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390043 fsid 0x3a00ff07 vnode 0xc9db8870: tag nfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feb460 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xca1b0350 (pid 25554, mmap, tid 100500) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0f75eb9 at vm_mmap_vnode+0x49 #6 0xc0d2d322 at vn_mmap+0xe2 #7 0xc0f7477b at sys_mmap+0x4ab #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070467 fsid 0x3a00ff07 vnode 0xcc0b6168: tag nfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feb640 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xca1b0000 (pid 25553, mmap, tid 100499) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0f75eb9 at vm_mmap_vnode+0x49 #6 0xc0d2d322 at vn_mmap+0xe2 #7 0xc0f7477b at sys_mmap+0x4ab #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070466 fsid 0x3a00ff07 vnode 0xcc0b6e10: tag nfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9feb780 ref 0 pages 5 cleanbuf 0 dirtybuf 1 lock type nfs: EXCL by thread 0xc93906a0 (pid 25548, mmap, tid 100494) #0 0xc0c25c73 at __lockmgr_args+0xae3 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0f75eb9 at vm_mmap_vnode+0x49 #6 0xc0d2d322 at vn_mmap+0xe2 #7 0xc0f7477b at sys_mmap+0x4ab #8 0xc11e199f at syscall+0x3bf #9 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9070462 fsid 0x3a00ff07 vnode 0xcaba6000: tag nfs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0d0e091 at vfs_hash_get+0xd1 #6 0xc0b5ed3f at nfscl_nget+0x8f #7 0xc0b528ab at nfs_lookup+0x8db #8 0xc1210899 at VOP_LOOKUP_APV+0xf9 #9 0xc0d0fcf9 at lookup+0x589 #10 0xc0d0f3cc at namei+0x58c #11 0xc0d25340 at kern_chdir+0x60 #12 0xc0d252d2 at sys_chdir+0x22 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390042 fsid 0x3a00ff07 vnode 0xcaba6168: tag nfs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type nfs: SHARED (count 1) #0 0xc0c25cf6 at __lockmgr_args+0xb66 #1 0xc0d09f43 at vop_stdlock+0x53 #2 0xc12140f0 at VOP_LOCK1_APV+0xe0 #3 0xc0d2df4a at _vn_lock+0xba #4 0xc0d1bede at vget+0x8e #5 0xc0d0e091 at vfs_hash_get+0xd1 #6 0xc0b5ed3f at nfscl_nget+0x8f #7 0xc0b528ab at nfs_lookup+0x8db #8 0xc1210899 at VOP_LOOKUP_APV+0xf9 #9 0xc0d0fcf9 at lookup+0x589 #10 0xc0d0f3cc at namei+0x58c #11 0xc0d25340 at kern_chdir+0x60 #12 0xc0d252d2 at sys_chdir+0x22 #13 0xc11e199f at syscall+0x3bf #14 0xc11cc69e at Xint0x80_syscall+0x2e fileid 9390044 fsid 0x3a00ff07 db:0:lockedvnods> show mount 0xc96482ec /dev/ada0s1a on / (ufs) 0xc96485d8 devfs on /dev (devfs) 0xc9a81000 /dev/ada0s1f on /home (ufs) 0xc9ad55d8 /dev/ada0s1d on /usr (ufs) 0xc9ad52ec /dev/ada0s1e on /var (ufs) 0xc9ad5000 procfs on /proc (procfs) 0xc9648000 /dev/label/tmp on /tmp (ufs) 0xc9ad4bb0 t1:/tmp on /mnt (nfs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 2 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 7535 vm_cnt.v_active_count: 823881 vm_cnt.v_wire_count: 31125 vm_cnt.v_free_reserved: 1173 vm_cnt.v_free_min: 5484 vm_cnt.v_free_target: 18417 vm_cnt.v_inactive_target: 27625 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 25714 25713 2250 1001 D pfault 0xc1b69970 sh 25713 25368 2250 1001 D pfault 0xc1b69970 sh 25712 12454 1119 0 D+ pfault 0xc1b69970 grep 25701 25697 497 0 S nfsreq 0xc975b800 ls 25697 497 497 0 S wait 0xcd12c000 sh 25696 0 0 0 SL nfsreq 0xc9c2ee00 [newnfs 19] 25695 0 0 0 SL nfsreq 0xcc1e2e00 [newnfs 18] 25694 0 0 0 SL nfsreq 0xccd3cc00 [newnfs 17] 25693 1 25349 1004 R+ badcode 25658 25568 25349 1004 D+ pfault 0xc1b69970 swap 25657 25568 25349 1004 D+ pfault 0xc1b69970 swap 25656 25568 25349 1004 D+ pfault 0xc1b69970 swap 25655 25568 25349 1004 D+ pfault 0xc1b69970 swap 25654 25568 25349 1004 D+ pfault 0xc1b69970 swap 25653 25568 25349 1004 D+ pfault 0xc1b69970 swap 25652 25568 25349 1004 D+ pfault 0xc1b69970 swap 25651 25568 25349 1004 D+ pfault 0xc1b69970 swap 25650 25568 25349 1004 D+ pfault 0xc1b69970 swap 25649 25568 25349 1004 D+ pfault 0xc1b69970 swap 25648 25568 25349 1004 D+ pfault 0xc1b69970 swap 25647 25568 25349 1004 D+ pfault 0xc1b69970 swap 25646 25568 25349 1004 D+ pfault 0xc1b69970 swap 25645 25568 25349 1004 D+ pfault 0xc1b69970 swap 25644 25568 25349 1004 D+ pfault 0xc1b69970 swap 25643 25568 25349 1004 D+ pfault 0xc1b69970 swap 25642 25568 25349 1004 D+ pfault 0xc1b69970 swap 25639 25568 25349 1004 D+ pfault 0xc1b69970 swap 25634 25568 25349 1004 D+ pfault 0xc1b69970 swap 25633 25626 25349 1004 D+ vmwait 0xc1b69970 rw 25631 25626 25349 1004 D+ vmwait 0xc1b69970 rw 25628 25626 25349 1004 D+ vmwait 0xc1b69970 rw 25627 25626 25349 1004 D+ vmwait 0xc1b69970 rw 25626 25429 25349 1004 SW+ wait 0xcbd0e690 rw 25615 25568 25349 1004 D+ pfault 0xc1b69970 swap 25614 25568 25349 1004 D+ pfault 0xc1b69970 swap 25612 25568 25349 1004 D+ pfault 0xc1b69970 swap 25610 25568 25349 1004 D+ pfault 0xc1b69970 swap 25609 25568 25349 1004 D+ pfault 0xc1b69970 swap 25608 25568 25349 1004 D+ pfault 0xc1b69970 swap 25607 25568 25349 1004 D+ pfault 0xc1b69970 swap 25606 25568 25349 1004 D+ pfault 0xc1b69970 swap 25604 25568 25349 1004 D+ pfault 0xc1b69970 swap 25603 25568 25349 1004 D+ pfault 0xc1b69970 swap 25602 25568 25349 1004 D+ pfault 0xc1b69970 swap 25599 25568 25349 1004 D+ pfault 0xc1b69970 swap 25598 25568 25349 1004 D+ pfault 0xc1b69970 swap 25597 25568 25349 1004 D+ pfault 0xc1b69970 swap 25596 25568 25349 1004 D+ pfault 0xc1b69970 swap 25595 25568 25349 1004 D+ pfault 0xc1b69970 swap 25594 25568 25349 1004 D+ pfault 0xc1b69970 swap 25593 25568 25349 1004 D+ pfault 0xc1b69970 swap 25592 25568 25349 1004 D+ pfault 0xc1b69970 swap 25591 25568 25349 1004 D+ pfault 0xc1b69970 swap 25587 25448 25349 1004 S+ nfsreq 0xcc1e2000 mkdir 25586 25448 25349 1004 S+ nfsreq 0xc97fcc00 mkdir 25585 25448 25349 1004 S+ nfsreq 0xc9f77000 mkdir 25584 25448 25349 1004 S+ nfsreq 0xc978ea00 mkdir 25583 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25582 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25579 25448 25349 1004 S+ nfsreq 0xcc1e2400 mkdir 25577 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25576 25447 25349 1004 D+ vmwait 0xc1b69970 mmap 25573 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25572 25568 25349 1004 D+ pfault 0xc1b69970 swap 25570 25447 25349 1004 D+ vmwait 0xc1b69970 mmap 25568 25437 25349 1004 SW+ wait 0xcaf41690 swap 25566 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25565 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25564 25448 25349 1004 S+ nfsreq 0xc9f77400 mkdir 25563 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25562 25448 25349 1004 S+ nfsreq 0xccd3ce00 mkdir 25561 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25560 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25558 25448 25349 1004 D+ pfault 0xc1b69970 mkdir 25557 25448 25349 1004 S+ nfsreq 0xc978e000 mkdir 25554 25447 25349 1004 S+ nfsreq 0xc9f77c00 mmap 25553 25447 25349 1004 S+ nfsreq 0xc9f77800 mmap 25552 25447 25349 1004 S+ nfsreq 0xc975a000 mmap 25551 25447 25349 1004 S+ nfsreq 0xc9c2e200 mmap 25550 25447 25349 1004 S+ nfsreq 0xc9f77e00 mmap 25549 25447 25349 1004 S+ nfsreq 0xc97fc200 mmap 25548 25447 25349 1004 S+ nfsreq 0xccd3c000 mmap 25500 25447 25349 1004 S+ nfsreq 0xccd3c200 mmap 25499 25447 25349 1004 S+ nfsreq 0xc97fce00 mmap 25498 25447 25349 1004 S+ nfsreq 0xcc1e2800 mmap 25497 25447 25349 1004 S+ bo_wwai 0xcac3010c mmap 25496 25447 25349 1004 S+ nfsreq 0xc975bc00 mmap 25495 25447 25349 1004 S+ nfsreq 0xc9f77600 mmap 25494 25450 25349 1004 D+ (threaded) thr1 100221 D pfault 0xc1b69970 thr1 25493 25450 25349 1004 D+ (threaded) thr1 100234 D pfault 0xc1b69970 thr1 25492 25450 25349 1004 D+ (threaded) thr1 100235 D pfault 0xc1b69970 thr1 25491 25450 25349 1004 D+ (threaded) thr1 100336 D pfault 0xc1b69970 thr1 25490 25450 25349 1004 D+ (threaded) thr1 100337 D pfault 0xc1b69970 thr1 25489 25450 25349 1004 D+ (threaded) thr1 100338 D pfault 0xc1b69970 thr1 25488 25450 25349 1004 D+ (threaded) thr1 100345 D pfault 0xc1b69970 thr1 25487 25450 25349 1004 D+ (threaded) thr1 100344 D pfault 0xc1b69970 thr1 25486 25450 25349 1004 D+ (threaded) thr1 100325 D pfault 0xc1b69970 thr1 25485 25446 25349 1004 D+ devfsmo 0xc96411d4 pty 25484 25446 25349 1004 D+ devfs 0xc9657304 pty 25483 25446 25349 1004 D+ devfs 0xc9657304 pty 25482 25446 25349 1004 D+ devfs 0xc9657304 pty 25481 25446 25349 1004 D+ vmwait 0xc1b69970 pty 25480 25446 25349 1004 D+ devfs 0xc9657304 pty 25479 25446 25349 1004 D+ devfs 0xc9657304 pty 25478 25446 25349 1004 D+ devfsmo 0xc96411d4 pty 25477 25446 25349 1004 D+ devfs 0xc9657304 pty 25476 25446 25349 1004 D+ devfs 0xc9657304 pty 25475 25446 25349 1004 D+ devfsmo 0xc96411d4 pty 25474 25446 25349 1004 D+ devfs 0xc9657304 pty 25473 25446 25349 1004 D+ devfsmo 0xc96411d4 pty 25472 25446 25349 1004 D+ devfsmo 0xc96411d4 pty 25471 25446 25349 1004 D+ devfsmo 0xc96411d4 pty 25470 25446 25349 1004 D+ devfs 0xc9657304 pty 25469 25449 25349 1004 D+ vmwait 0xc1b69970 creat 25468 25449 25349 1004 S+ nfsreq 0xc978e400 creat 25467 25449 25349 1004 D+ pfault 0xc1b69970 creat 25466 25449 25349 1004 S+ nfsreq 0xcc1e2600 creat 25465 25449 25349 1004 S+ nfsreq 0xc9c2e800 creat 25464 25449 25349 1004 S+ nfsreq 0xcc1e2200 creat 25463 25449 25349 1004 S+ nfsreq 0xc97fc800 creat 25462 25449 25349 1004 S+ nfsreq 0xc9f77a00 creat 25461 25449 25349 1004 S+ nfsreq 0xc975a200 creat 25460 25449 25349 1004 S+ nfsreq 0xccd3c600 creat 25459 25449 25349 1004 D+ vmwait 0xc1b69970 creat 25458 25449 25349 1004 D+ vmwait 0xc1b69970 creat 25457 25449 25349 1004 S+ nfsreq 0xc97fca00 creat 25456 25449 25349 1004 S+ nfsreq 0xccd3c400 creat 25455 25449 25349 1004 D+ vmwait 0xc1b69970 creat 25454 25449 25349 1004 S+ nfsreq 0xc975be00 creat 25453 25449 25349 1004 S+ nfsreq 0xc978e600 creat 25452 25449 25349 1004 S+ nfsreq 0xc978ee00 creat 25451 25449 25349 1004 D+ vmwait 0xc1b69970 creat 25450 25441 25349 1004 SW+ wait 0xc9fc4000 thr1 25449 25434 25349 1004 SW+ wait 0xcc1a7348 creat 25448 25435 25349 1004 SW+ wait 0xcc9a5690 mkdir 25447 25430 25349 1004 SW+ wait 0xcc9a5000 mmap 25446 25440 25349 1004 SW+ wait 0xcd0689d8 pty 25441 25418 25349 1004 S+ nanslp 0xc1a8d023 thr1 25440 25418 25349 1004 S+ nanslp 0xc1a8d023 pty 25437 25418 25349 1004 S+ nanslp 0xc1a8d020 swap 25435 25418 25349 1004 S+ nanslp 0xc1a8d020 mkdir 25434 25418 25349 1004 S+ nanslp 0xc1a8d022 creat 25430 25418 25349 1004 S+ nanslp 0xc1a8d023 mmap 25429 25418 25349 1004 S+ nanslp 0xc1a8d020 rw 25418 25417 25349 1004 SW+ wait 0xcc0a1690 run 25417 25416 25349 1004 SW+ wait 0xcc0a1000 run 25416 25349 25349 1004 S+ nanslp 0xc1a8d021 run 25368 2254 2250 1001 S piperd 0xcc092000 sh 25349 25347 25349 1004 SW+ wait 0xcd0ac690 sh 25347 12454 1119 0 SW+ wait 0xc97dc9d8 su 25331 0 0 0 SL nfsreq 0xc978ec00 [newnfs 16] 25330 0 0 0 SL nfsreq 0xc97fc000 [newnfs 15] 25329 0 0 0 SL nfsreq 0xc978e200 [newnfs 14] 25328 0 0 0 SL nfsreq 0xc9c2e000 [newnfs 13] 25327 0 0 0 SL nfsreq 0xc9c2ea00 [newnfs 12] 25326 0 0 0 RL CPU 0 [newnfs 11] 25325 0 0 0 SL nfsreq 0xc975b600 [newnfs 10] 25324 0 0 0 SL nfsreq 0xc9c2e400 [newnfs 9] 25323 0 0 0 SL nfsreq 0xc9f77200 [newnfs 8] 25322 0 0 0 SL nfsreq 0xccd3c800 [newnfs 7] 25321 0 0 0 SL nfsreq 0xc978e800 [newnfs 6] 25320 0 0 0 SL nfsreq 0xcc1e2a00 [newnfs 5] 25319 0 0 0 SL nfsreq 0xccd3ca00 [newnfs 4] 25318 0 0 0 SL nfsreq 0xc9c2ec00 [newnfs 3] 25317 0 0 0 SL nfsreq 0xcc1e2c00 [newnfs 2] 25316 0 0 0 SL nfsreq 0xc9c2e600 [newnfs 1] 25309 25307 22315 1004 R+ creat 25307 25216 22315 1004 SW+ wait 0xccfd59d8 creat 25305 25253 22315 1004 R+ swap 25304 25253 22315 1004 R+ swap 25303 25253 22315 1004 D+ pfault 0xc1b69970 swap 25302 25253 22315 1004 R+ swap 25301 25253 22315 1004 D+ pfault 0xc1b69970 swap 25300 25253 22315 1004 R+ CPU 2 swap 25299 25253 22315 1004 D+ pfault 0xc1b69970 swap 25298 25253 22315 1004 D+ pfault 0xc1b69970 swap 25297 25253 22315 1004 D+ pfault 0xc1b69970 swap 25296 25253 22315 1004 R+ swap 25295 25253 22315 1004 R+ swap 25294 25253 22315 1004 R+ swap 25293 25253 22315 1004 R+ swap 25292 25253 22315 1004 R+ swap 25291 25253 22315 1004 D+ pfault 0xc1b69970 swap 25290 25253 22315 1004 R+ swap 25289 25253 22315 1004 R+ swap 25288 25253 22315 1004 R+ swap 25287 25253 22315 1004 D+ pfault 0xc1b69970 swap 25286 25253 22315 1004 R+ swap 25285 25253 22315 1004 R+ swap 25284 25253 22315 1004 R+ swap 25283 25253 22315 1004 R+ swap 25282 25253 22315 1004 R+ swap 25281 25253 22315 1004 R+ swap 25280 25253 22315 1004 R+ swap 25279 25253 22315 1004 R+ swap 25278 25253 22315 1004 R+ CPU 3 swap 25277 25253 22315 1004 R+ swap 25276 25253 22315 1004 R+ swap 25274 25253 22315 1004 R+ swap 25271 25253 22315 1004 R+ swap 25269 25253 22315 1004 R+ swap 25267 25253 22315 1004 D+ pfault 0xc1b69970 swap 25265 25253 22315 1004 R+ swap 25263 25253 22315 1004 R+ swap 25261 25253 22315 1004 R+ swap 25259 25253 22315 1004 R+ swap 25257 25253 22315 1004 R+ swap 25255 25253 22315 1004 R+ swap 25253 25219 22315 1004 SW+ wait 0xcc9a5348 swap 25219 25200 22315 1004 S+ nanslp 0xc1a8d020 swap 25216 25200 22315 1004 S+ nanslp 0xc1a8d020 creat 25200 25199 22315 1004 SW+ wait 0xc9397000 run 25199 25198 22315 1004 SW+ wait 0xcc9a49d8 run 25198 22315 22315 1004 S+ nanslp 0xc1a8d020 run 22315 1 22315 1004 SW+ wait 0xc9fc3348 sh 13046 0 0 0 SL nfsreq 0xc975ba00 [newnfs 0] 12454 12452 1119 0 S+ wait 0xc9fc29d8 sh 12453 1119 1119 0 S+ piperd 0xc981a1a0 tee 12452 1119 1119 0 SW+ wait 0xcc0a49d8 sh 2257 2250 2250 1001 S piperd 0xc9818820 sh 2255 2250 2250 1001 S piperd 0xc9818680 awk 2254 2250 2250 1001 SW wait 0xcc0a39d8 sh 2251 2248 2251 1001 Ss kqread 0xc8cf1800 tail 2250 2247 2250 1001 SWs wait 0xc9ae59d8 sh 2249 2246 2249 1001 Ss+ select 0xc969ce24 top 2248 2241 2241 1001 S select 0xc96da564 sshd 2247 2242 2242 1001 S select 0xc969cee4 sshd 2246 2240 2240 1001 S select 0xc9086664 sshd 2242 687 2242 0 Ss select 0xc969cea4 sshd 2241 687 2241 0 Ss select 0xc96b40a4 sshd 2240 687 2240 0 Ss select 0xc969d164 sshd 1119 1115 1119 0 SW+ wait 0xc9ae3348 sh 1115 1113 1115 0 SW+ wait 0xc9ae39d8 bash 1113 1112 1113 0 SW+ pause 0xc9ae43ac csh 1112 763 1112 1001 SW+ wait 0xc9ae4690 su 858 1 858 0 Ss+ ttyin 0xc9111670 getty 857 1 857 0 Ss+ ttyin 0xc9110670 getty 856 1 856 0 Ss+ ttyin 0xc9110870 getty 855 1 855 0 Ss+ ttyin 0xc9110a70 getty 854 1 854 0 Ss+ ttyin 0xc9110c70 getty 853 1 853 0 Ss+ ttyin 0xc9110e70 getty 852 1 852 0 Ss+ ttyin 0xc9111070 getty 851 1 851 0 Ss+ ttyin 0xc9111270 getty 850 1 850 0 Ss+ ttyin 0xc9111470 getty 831 1 831 0 Ss select 0xc969d064 inetd 801 1 801 0 Ss select 0xc969d1e4 moused 763 762 763 1001 SWs+ wait 0xc97cd000 bash 762 758 758 1001 S select 0xc96da624 sshd 758 687 758 0 Ss select 0xc96da5a4 sshd 698 1 698 0 Ds pfault 0xc1b69970 cron 693 1 693 25 SWs pause 0xc97d2064 sendmail 690 1 690 0 Ss select 0xc969d1a4 sendmail 687 1 687 0 Ss select 0xc969d264 sshd 650 1 649 0 SW nanslp 0xc1a8d023 smartd 620 1 620 0 Ss select 0xc9083364 powerd 617 1 617 0 Ss (threaded) ntpd 100112 S select 0xc96b41e4 ntpd 563 1 563 0 Ss rpcsvc 0xc9bc8b90 NLM: master 560 1 560 0 Ss select 0xc96da6e4 rpc.statd 559 556 556 0 S (threaded) nfsd 100123 S rpcsvc 0xc9bd4490 nfsd: master 100124 S rpcsvc 0xc9bdca90 nfsd: service 100125 S rpcsvc 0xc9bc9d90 nfsd: service 100126 S rpcsvc 0xc9661690 nfsd: service 100127 S rpcsvc 0xc9661590 nfsd: service 100128 S rpcsvc 0xc9bc9c90 nfsd: service 100129 S rpcsvc 0xc9bc9b90 nfsd: service 100130 S rpcsvc 0xc9661490 nfsd: service 100131 S rpcsvc 0xc9bc9a90 nfsd: service 100132 S rpcsvc 0xc9bc9990 nfsd: service 100133 S rpcsvc 0xc9661390 nfsd: service 100134 S rpcsvc 0xc9bc9890 nfsd: service 100135 S rpcsvc 0xc9bc9790 nfsd: service 100136 S rpcsvc 0xc9bc9690 nfsd: service 100137 S rpcsvc 0xc9bc9590 nfsd: service 100138 S rpcsvc 0xc9661290 nfsd: service 100139 S rpcsvc 0xc9bc9490 nfsd: service 100140 S rpcsvc 0xc9661190 nfsd: service 100141 S rpcsvc 0xc9bc9390 nfsd: service 100142 S rpcsvc 0xc9661090 nfsd: service 100143 S rpcsvc 0xc9660e90 nfsd: service 100144 S rpcsvc 0xc9bc9290 nfsd: service 100145 S rpcsvc 0xc9660d90 nfsd: service 100146 S rpcsvc 0xc9660c90 nfsd: service 100147 S rpcsvc 0xc9bc9190 nfsd: service 100148 S rpcsvc 0xc9660b90 nfsd: service 100149 S rpcsvc 0xc9660a90 nfsd: service 100150 S rpcsvc 0xc9bc9090 nfsd: service 100151 S rpcsvc 0xc9660990 nfsd: service 100152 S rpcsvc 0xc9bc8e90 nfsd: service 100153 S rpcsvc 0xc9bc8d90 nfsd: service 100154 S rpcsvc 0xc9bc8c90 nfsd: service 556 1 556 0 Ss select 0xc969d2a4 nfsd 550 1 550 0 Ss select 0xc96da724 mountd 543 539 539 0 S select 0xc969d2e4 nfsuserd 542 539 539 0 S select 0xc96b4224 nfsuserd 541 539 539 0 S select 0xc969d324 nfsuserd 540 539 539 0 S select 0xc96b4264 nfsuserd 539 1 539 0 SWs pause 0xc97e23ac nfsuserd 497 1 497 0 Ss wait 0xc9fc4348 watchdogd 413 1 413 0 Ss select 0xc969d364 rpcbind 405 1 405 0 Ss select 0xc96b42a4 syslogd 370 1 370 0 Ss select 0xc96b42e4 rtsold 328 1 328 0 Rs devd 22 0 0 0 DL vlruwt 0xc9397348 [vnlru] 21 0 0 0 DL syncer 0xc1b078f8 [syncer] 20 0 0 0 DL (threaded) [bufdaemon] 100083 D psleep 0xc1b06604 [bufdaemon] 100101 D sdflush 0xc9a8b284 [/home worker] 100103 D sdflush 0xc9a8ae84 [/usr worker] 100104 D sdflush 0xc9a8ac84 [/var worker] 100178 D sdflush 0xca715c84 [/tmp worker] 19 0 0 0 DL - 0xc1b07248 [bufspacedaemon] 18 0 0 0 DL psleep 0xc1b0cda4 [vmdaemon] 17 0 0 0 DL (threaded) [pagedaemon] 100080 D psleep 0xc1a8bf0d [pagedaemon] 100090 D umarcl 0xc1b0c9a0 [uma] 16 0 0 0 DL - 0xc1b06054 [soaiod4] 15 0 0 0 DL - 0xc1b06054 [soaiod3] 9 0 0 0 DL - 0xc1b06054 [soaiod2] 8 0 0 0 DL - 0xc1b06054 [soaiod1] 7 0 0 0 DL - 0xc196557c [rand_harvestq] 6 0 0 0 DL waiting 0xc1b667d8 [sctp_iterator] 5 0 0 0 DL - 0xc905de3c [fdc0] 14 0 0 0 DL (threaded) [usb] 100033 D - 0xc9045acc [usbus0] 100034 D - 0xc9045afc [usbus0] 100035 D - 0xc9045b2c [usbus0] 100036 D - 0xc9045b5c [usbus0] 100037 D - 0xc9045b8c [usbus0] 100039 D - 0xc90b4acc [usbus1] 100040 D - 0xc90b4afc [usbus1] 100041 D - 0xc90b4b2c [usbus1] 100042 D - 0xc90b4b5c [usbus1] 100043 D - 0xc90b4b8c [usbus1] 100045 D - 0xc90bdacc [usbus2] 100046 D - 0xc90bdafc [usbus2] 100047 D - 0xc90bdb2c [usbus2] 100048 D - 0xc90bdb5c [usbus2] 100049 D - 0xc90bdb8c [usbus2] 100050 D - 0xc90c3acc [usbus3] 100051 D - 0xc90c3afc [usbus3] 100052 D - 0xc90c3b2c [usbus3] 100053 D - 0xc90c3b5c [usbus3] 100054 D - 0xc90c3b8c [usbus3] 100055 D - 0xc90d3acc [usbus4] 100056 D - 0xc90d3afc [usbus4] 100057 D - 0xc90d3b2c [usbus4] 100058 D - 0xc90d3b5c [usbus4] 100059 D - 0xc90d3b8c [usbus4] 100061 D - 0xc9063ca4 [usbus5] 100062 D - 0xc9063cd4 [usbus5] 100063 D - 0xc9063d04 [usbus5] 100064 D - 0xc9063d34 [usbus5] 100065 D - 0xc9063d64 [usbus5] 4 0 0 0 DL (threaded) [cam] 100028 D - 0xc18b1600 [doneq0] 100075 D - 0xc18b14ac [scanner] 3 0 0 0 DL crypto_ 0xc1b0bcf0 [crypto returns] 2 0 0 0 DL crypto_ 0xc1b0bc38 [crypto] 13 0 0 0 DL (threaded) [geom] 100019 D - 0xc1b61944 [g_event] 100020 D - 0xc1b61948 [g_up] 100021 D - 0xc1b6194c [g_down] 12 0 0 0 RL (threaded) [intr] 100007 I [swi3: vm] 100008 I [swi4: clock (0)] 100009 I [swi4: clock (1)] 100010 I [swi4: clock (2)] 100011 I [swi4: clock (3)] 100012 I [swi1: netisr 0] 100014 I [swi5: fast taskq] 100016 I [swi6: task queue] 100017 D devdrn 0xe4b53bac [swi6: Giant taskq] 100029 I [irq256: hdac0] 100030 Run CPU 1 [irq257: re0] 100031 I [irq22: ahci0] 100032 I [irq16: hdac1 ohci0] 100038 I [irq17: ohci1 ohci3] 100044 I [irq18: ohci2 ohci4] 100060 I [irq19: ehci0] 100066 I [irq14: ata0] 100067 I [swi0: uart] 100069 I [irq1: atkbd0] 100070 I [irq12: psm0] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 1 0 1 0 SLs wait 0xc8e3d9d8 [init] 10 0 0 0 DL audit_w 0xc1b696c8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1b61964 [swapper] 100013 D - 0xc8f23000 [aiod_kick taskq] 100015 D - 0xc8f22e80 [kqueue_ctx taskq] 100018 D - 0xc8f22d00 [thread taskq] 100022 D - 0xc8f22c80 [firmware taskq] 100025 D - 0xc8f22c00 [acpi_task_0] 100026 D - 0xc8f22c00 [acpi_task_1] 100027 D - 0xc8f22c00 [acpi_task_2] 100071 D - 0xc8f22980 [mca taskq] 100074 D - 0xc8f22b80 [CAM taskq] 100086 D - 0xc8f22500 [if_io_tqg_0] 100087 D - 0xc8f22480 [if_io_tqg_1] 100088 D - 0xc8f22400 [if_io_tqg_2] 100089 D - 0xc8f22380 [if_io_tqg_3] 100091 D - 0xc95df100 [if_config_tqg_0] 25432 25418 25349 1004 Z+ link 25433 25418 25349 1004 Z+ lockf 25439 25418 25349 1004 Z+ mkfifo 25438 25418 25349 1004 Z+ syscall 25436 25418 25349 1004 Z+ rename 25431 25418 25349 1004 Z+ fts 25217 25200 22315 1004 Z+ mkdir 25311 25307 22315 1004 Z+ creat 25221 25200 22315 1004 Z+ mkfifo 25220 25200 22315 1004 Z+ syscall 25222 25200 22315 1004 Z+ pty 25218 25200 22315 1004 Z+ rename 25223 25200 22315 1004 Z+ thr1 db:0:ps> allt Tracing command sh pid 25714 tid 100353 td 0xcd12a9f0 sched_switch(cd12a9f0,0,104,196,c84c2990,...) at sched_switch+0x4e1/frame 0xc84c2958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84c2990 sleepq_switch(cd12a9f0,0,c15cc34d,28b,cd12a9f0,...) at sleepq_switch+0xf0/frame 0xc84c29c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84c29e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc84c2a44 vm_waitpfault(c9fef280,215,0,c84c2afc,c84c2aec,...) at vm_waitpfault+0x99/frame 0xc84c2a70 vm_fault_hold(c9c6eb10,28615000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc84c2b30 vm_fault(c9c6eb10,28615000,2,0,7d,...) at vm_fault+0x88/frame 0xc84c2b58 trap_pfault(28615440,c84c2ce8,c84c2c40,c0cb415a,0,...) at trap_pfault+0x116/frame 0xc84c2ba0 trap(c84c2ce8) at trap+0x3ec/frame 0xc84c2cdc calltrap() at calltrap+0x6/frame 0xc84c2cdc --- trap 0xc, eip = 0x2820a06f, esp = 0xbfbfe4f4, ebp = 0xbfbfe51c --- Tracing command sh pid 25713 tid 100351 td 0xcd00d6a0 sched_switch(cd00d6a0,0,104,196,c84bc990,...) at sched_switch+0x4e1/frame 0xc84bc958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84bc990 sleepq_switch(cd00d6a0,0,c15cc34d,28b,cd00d6a0,...) at sleepq_switch+0xf0/frame 0xc84bc9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84bc9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc84bca44 vm_waitpfault(c9fee1e0,1f,0,c84bcafc,c84bcaec,...) at vm_waitpfault+0x99/frame 0xc84bca70 vm_fault_hold(c9c6edd4,bfbfe000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc84bcb30 vm_fault(c9c6edd4,bfbfe000,2,0,7d,...) at vm_fault+0x88/frame 0xc84bcb58 trap_pfault(bfbfe618,c84bcce8,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc84bcba0 trap(c84bcce8) at trap+0x3ec/frame 0xc84bccdc calltrap() at calltrap+0x6/frame 0xc84bccdc --- trap 0xc, eip = 0x8055cc3, esp = 0xbfbfe608, ebp = 0xbfbfe628 --- Tracing command grep pid 25712 tid 100340 td 0xccfd36a0 sched_switch(ccfd36a0,0,104,196,c849b990,...) at sched_switch+0x4e1/frame 0xc849b958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc849b990 sleepq_switch(ccfd36a0,0,c15cc34d,28b,ccfd36a0,...) at sleepq_switch+0xf0/frame 0xc849b9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc849b9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc849ba44 vm_waitpfault(cc326780,3ef,0,c849bafc,c849baec,...) at vm_waitpfault+0x99/frame 0xc849ba70 vm_fault_hold(c97130ec,28615000,1,0,0,...) at vm_fault_hold+0xd86/frame 0xc849bb30 vm_fault(c97130ec,28615000,1,0,c849bbd4,...) at vm_fault+0x88/frame 0xc849bb58 trap_pfault(28615000,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc849bba0 trap(c849bce8) at trap+0x3ec/frame 0xc849bcdc calltrap() at calltrap+0x6/frame 0xc849bcdc --- trap 0xc, eip = 0x2816f140, esp = 0xbfbfe364, ebp = 0xbfbfe39c --- Tracing command ls pid 25701 tid 100352 td 0xcd00d9f0 sched_switch(cd00d9f0,0,104,196,c84bf2bc,...) at sched_switch+0x4e1/frame 0xc84bf284 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84bf2bc sleepq_switch(cd00d9f0,0,c15cc34d,1c2,c84bf35c,...) at sleepq_switch+0xf0/frame 0xc84bf2f0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,228,...) at sleepq_catch_signals+0x443/frame 0xc84bf334 sleepq_timedwait_sig(c975b800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84bf35c _sleep(c975b800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84bf3b8 clnt_vc_call(c96a30c0,c84bf578,3,c9fe7c00,c84bf648,...) at clnt_vc_call+0x715/frame 0xc84bf490 clnt_reconnect_call(c96a30e0,c84bf578,3,c9fe7c00,c84bf648,...) at clnt_reconnect_call+0xcc/frame 0xc84bf4f8 newnfs_request(c84bf648,c905d400,0,c905d510,cc6c8ca8,cd00d9f0,c964fe00,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84bf5c0 nfscl_request(c84bf648,cc6c8ca8,cd00d9f0,c964fe00,0,...) at nfscl_request+0x8c/frame 0xc84bf608 nfsrpc_lookup(cc6c8ca8,cb500000,c,c964fe00,cd00d9f0,...) at nfsrpc_lookup+0x211/frame 0xc84bf700 nfs_lookup(c84bf990,c17be989,c160688d,c15d772f,c18aba14,...) at nfs_lookup+0x56f/frame 0xc84bf920 VOP_LOOKUP_APV(c185ccbc,c84bf990,c84bfb3c,20a,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84bf950 lookup(c84bfae0,c15d772f,124,eb,c84bf9f8,...) at lookup+0x589/frame 0xc84bf9b8 namei(c84bfae0,0,4000104,0,28684578,...) at namei+0x58c/frame 0xc84bfa40 kern_statat(cd00d9f0,200,ffffff9c,28684578,0,...) at kern_statat+0xae/frame 0xc84bfb78 sys_fstatat(cd00d9f0,c84bfca8,c15bd083,4,c84bfc3c,...) at sys_fstatat+0x49/frame 0xc84bfc18 syscall(c84bfce8) at syscall+0x3bf/frame 0xc84bfcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84bfcdc --- syscall (493, FreeBSD ELF32, sys_fstatat), eip = 0x28171ab7, esp = 0xbfbfe66c, ebp = 0xbfbfe704 --- Tracing command sh pid 25697 tid 100362 td 0xc9390000 sched_switch(c9390000,0,104,196,c84dd994,...) at sched_switch+0x4e1/frame 0xc84dd95c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84dd994 sleepq_switch(c9390000,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xc84dd9c8 sleepq_catch_signals(c15cc34d,170,cd12c0b8,240,c9390000,...) at sleepq_catch_signals+0x443/frame 0xc84dda0c sleepq_wait_sig(cd12c000,6c,c15d0099,100,0,...) at sleepq_wait_sig+0x14/frame 0xc84dda30 _sleep(cd12c000,cd12c0a8,16c,c15d0099,0,...) at _sleep+0x33f/frame 0xc84dda8c kern_wait6(c9390000,7,0,0,c84ddb24,...) at kern_wait6+0x47d/frame 0xc84ddaf8 sys_wait4(c9390000,c84ddca8,c15bd083,4,c84ddc6c,...) at sys_wait4+0x8b/frame 0xc84ddc18 syscall(c84ddce8) at syscall+0x3bf/frame 0xc84ddcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84ddcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2819a5d3, esp = 0xbfbfeae0, ebp = 0xbfbfeaf8 --- Tracing command newnfs 19 pid 25696 tid 100526 td 0xca172000 sched_switch(ca172000,0,104,196,c854f67c,...) at sched_switch+0x4e1/frame 0xc854f644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc854f67c sleepq_switch(ca172000,0,c15cc34d,1c2,c854f71c,...) at sleepq_switch+0xf0/frame 0xc854f6b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2ca,...) at sleepq_catch_signals+0x443/frame 0xc854f6f4 sleepq_timedwait_sig(c9c2ee00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc854f71c _sleep(c9c2ee00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc854f778 clnt_vc_call(c96a30c0,c854f938,7,ca910100,c854fa68,...) at clnt_vc_call+0x715/frame 0xc854f850 clnt_reconnect_call(c96a30e0,c854f938,7,ca910100,c854fa68,...) at clnt_reconnect_call+0xcc/frame 0xc854f8b8 newnfs_request(c854fa68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc854f980 nfscl_request(c854fa68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc854f9c8 nfsrpc_write(cb8f29d8,c854fc30,c854fc58,c854fc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc854fb20 ncl_writerpc(cb8f29d8,c854fc30,ca10e600,c854fc58,c854fc54,...) at ncl_writerpc+0xdb/frame 0xc854fbf8 ncl_doio(cb8f29d8,e4ac8fa0,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc854fc70 nfssvc_iod(c1a82984,c854fce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc854fcac fork_exit(c0b65190,c1a82984,c854fce8) at fork_exit+0x7e/frame 0xc854fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc854fcd4 --- trap 0, eip = 0, esp = 0xc854fd20, ebp = 0 --- Tracing command newnfs 18 pid 25695 tid 100492 td 0xcc0bb6a0 sched_switch(cc0bb6a0,0,104,196,c84e667c,...) at sched_switch+0x4e1/frame 0xc84e6644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84e667c sleepq_switch(cc0bb6a0,0,c15cc34d,1c2,c84e671c,...) at sleepq_switch+0xf0/frame 0xc84e66b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,8a,...) at sleepq_catch_signals+0x443/frame 0xc84e66f4 sleepq_timedwait_sig(cc1e2e00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84e671c _sleep(cc1e2e00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84e6778 clnt_vc_call(c96a30c0,c84e6938,7,cbb9d600,c84e6a68,...) at clnt_vc_call+0x715/frame 0xc84e6850 clnt_reconnect_call(c96a30e0,c84e6938,7,cbb9d600,c84e6a68,...) at clnt_reconnect_call+0xcc/frame 0xc84e68b8 newnfs_request(c84e6a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84e6980 nfscl_request(c84e6a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84e69c8 nfsrpc_write(cb8f29d8,c84e6c30,c84e6c58,c84e6c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc84e6b20 ncl_writerpc(cb8f29d8,c84e6c30,ca10e600,c84e6c58,c84e6c54,...) at ncl_writerpc+0xdb/frame 0xc84e6bf8 ncl_doio(cb8f29d8,e4ae4b60,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc84e6c70 nfssvc_iod(c1a82980,c84e6ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc84e6cac fork_exit(c0b65190,c1a82980,c84e6ce8) at fork_exit+0x7e/frame 0xc84e6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc84e6cd4 --- trap 0, eip = 0, esp = 0xc84e6d20, ebp = 0 --- Tracing command newnfs 17 pid 25694 tid 100513 td 0xcaf45000 sched_switch(caf45000,0,104,196,c852b67c,...) at sched_switch+0x4e1/frame 0xc852b644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc852b67c sleepq_switch(caf45000,0,c15cc34d,1c2,c852b71c,...) at sleepq_switch+0xf0/frame 0xc852b6b0 sleepq_catch_signals(3,c00402e5,12,cc1fe810,264,...) at sleepq_catch_signals+0x443/frame 0xc852b6f4 sleepq_timedwait_sig(ccd3cc00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc852b71c _sleep(ccd3cc00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc852b778 clnt_vc_call(c96a30c0,c852b938,7,ca4e9c00,c852ba68,...) at clnt_vc_call+0x715/frame 0xc852b850 clnt_reconnect_call(c96a30e0,c852b938,7,ca4e9c00,c852ba68,...) at clnt_reconnect_call+0xcc/frame 0xc852b8b8 newnfs_request(c852ba68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc852b980 nfscl_request(c852ba68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc852b9c8 nfsrpc_write(cb8f29d8,c852bc30,c852bc58,c852bc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc852bb20 ncl_writerpc(cb8f29d8,c852bc30,ca10e600,c852bc58,c852bc54,...) at ncl_writerpc+0xdb/frame 0xc852bbf8 ncl_doio(cb8f29d8,e4aef290,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc852bc70 nfssvc_iod(c1a8297c,c852bce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc852bcac fork_exit(c0b65190,c1a8297c,c852bce8) at fork_exit+0x7e/frame 0xc852bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc852bcd4 --- trap 0, eip = 0, esp = 0xc852bd20, ebp = 0 --- Tracing command badcode pid 25693 tid 100488 td 0xca1b09f0 sched_switch(ca1b09f0,0,602,192,ca1b09f0,...) at sched_switch+0x4e1/frame 0xc85cac6c mi_switch(602,0,c15c5e90,d3,ca1b09f0,...) at mi_switch+0x18c/frame 0xc85caca4 critical_exit(ca1b09f0,0,3) at critical_exit+0xa2/frame 0xc85cacc0 ipi_bitmap_handler(3b,3b,3b,57da6679,0,...) at ipi_bitmap_handler+0x6b/frame 0xc85cace0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xc85cace0 --- interrupt, eip = 0x80492fc, esp = 0xbfbfe4ec, ebp = 0xbfbfe4f8 --- Tracing command swap pid 25658 tid 100571 td 0xca1b26a0 sched_switch(ca1b26a0,0,104,196,c85d3990,...) at sched_switch+0x4e1/frame 0xc85d3958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85d3990 sleepq_switch(ca1b26a0,0,c15cc34d,28b,ca1b26a0,...) at sleepq_switch+0xf0/frame 0xc85d39c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85d39e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85d3a44 vm_waitpfault(ca5cac80,1047,0,c85d3afc,c85d3aec,...) at vm_waitpfault+0x99/frame 0xc85d3a70 vm_fault_hold(c9c6ea24,29847000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85d3b30 vm_fault(c9c6ea24,29847000,2,0,7d,...) at vm_fault+0x88/frame 0xc85d3b58 trap_pfault(29847000,c85d3ce8,325,2,1401c0,...) at trap_pfault+0x116/frame 0xc85d3ba0 trap(c85d3ce8) at trap+0x3ec/frame 0xc85d3cdc calltrap() at calltrap+0x6/frame 0xc85d3cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25657 tid 100570 td 0xca1b2350 sched_switch(ca1b2350,0,104,196,c85d0990,...) at sched_switch+0x4e1/frame 0xc85d0958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85d0990 sleepq_switch(ca1b2350,0,c15cc34d,28b,ca1b2350,...) at sleepq_switch+0xf0/frame 0xc85d09c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85d09e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85d0a44 vm_waitpfault(cab84320,44f,0,c85d0afc,c85d0aec,...) at vm_waitpfault+0x99/frame 0xc85d0a70 vm_fault_hold(c9c6e938,28c4f000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85d0b30 vm_fault(c9c6e938,28c4f000,2,0,7d,...) at vm_fault+0x88/frame 0xc85d0b58 trap_pfault(28c4f000,c85d0ce8,c0cb3a95,246,1,...) at trap_pfault+0x116/frame 0xc85d0ba0 trap(c85d0ce8) at trap+0x3ec/frame 0xc85d0cdc calltrap() at calltrap+0x6/frame 0xc85d0cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25656 tid 100569 td 0xca1b2000 sched_switch(ca1b2000,0,104,196,c85c7990,...) at sched_switch+0x4e1/frame 0xc85c7958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85c7990 sleepq_switch(ca1b2000,0,c15cc34d,28b,ca1b2000,...) at sleepq_switch+0xf0/frame 0xc85c79c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85c79e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85c7a44 vm_waitpfault(cab7ac80,48f,0,c85c7afc,c85c7aec,...) at vm_waitpfault+0x99/frame 0xc85c7a70 vm_fault_hold(c9c6e84c,28c8f000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85c7b30 vm_fault(c9c6e84c,28c8f000,2,0,7d,...) at vm_fault+0x88/frame 0xc85c7b58 trap_pfault(28c8f000,c85c7ce8,c0cb3a95,2,413126,...) at trap_pfault+0x116/frame 0xc85c7ba0 trap(c85c7ce8) at trap+0x3ec/frame 0xc85c7cdc calltrap() at calltrap+0x6/frame 0xc85c7cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25655 tid 100568 td 0xc9fa39f0 sched_switch(c9fa39f0,0,104,196,c85c4990,...) at sched_switch+0x4e1/frame 0xc85c4958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85c4990 sleepq_switch(c9fa39f0,0,c15cc34d,28b,c9fa39f0,...) at sleepq_switch+0xf0/frame 0xc85c49c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85c49e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85c4a44 vm_waitpfault(ca61baa0,65a,0,c85c4afc,c85c4aec,...) at vm_waitpfault+0x99/frame 0xc85c4a70 vm_fault_hold(c9c6e760,28e5a000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85c4b30 vm_fault(c9c6e760,28e5a000,2,0,7d,...) at vm_fault+0x88/frame 0xc85c4b58 trap_pfault(28e5a000,c85c4ce8,200,c9fa39f0,1,...) at trap_pfault+0x116/frame 0xc85c4ba0 trap(c85c4ce8) at trap+0x3ec/frame 0xc85c4cdc calltrap() at calltrap+0x6/frame 0xc85c4cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25654 tid 100567 td 0xc9fa36a0 sched_switch(c9fa36a0,0,104,196,c85c1990,...) at sched_switch+0x4e1/frame 0xc85c1958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85c1990 sleepq_switch(c9fa36a0,0,c15cc34d,28b,c9fa36a0,...) at sleepq_switch+0xf0/frame 0xc85c19c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85c19e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85c1a44 vm_waitpfault(cab7e780,415,0,c85c1afc,c85c1aec,...) at vm_waitpfault+0x99/frame 0xc85c1a70 vm_fault_hold(c9c6e674,28c15000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85c1b30 vm_fault(c9c6e674,28c15000,2,0,7d,...) at vm_fault+0x88/frame 0xc85c1b58 trap_pfault(28c15000,c85c1ce8,c0cb3a95,2,41321f,...) at trap_pfault+0x116/frame 0xc85c1ba0 trap(c85c1ce8) at trap+0x3ec/frame 0xc85c1cdc calltrap() at calltrap+0x6/frame 0xc85c1cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25653 tid 100566 td 0xc9fa3350 sched_switch(c9fa3350,0,104,196,c85be990,...) at sched_switch+0x4e1/frame 0xc85be958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85be990 sleepq_switch(c9fa3350,0,c15cc34d,28b,c9fa3350,...) at sleepq_switch+0xf0/frame 0xc85be9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85be9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85bea44 vm_waitpfault(ca61bb40,520,0,c85beafc,c85beaec,...) at vm_waitpfault+0x99/frame 0xc85bea70 vm_fault_hold(c9c6e588,28d20000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85beb30 vm_fault(c9c6e588,28d20000,2,0,7d,...) at vm_fault+0x88/frame 0xc85beb58 trap_pfault(28d20000,c85bece8,c0cb3a95,3,412e86,...) at trap_pfault+0x116/frame 0xc85beba0 trap(c85bece8) at trap+0x3ec/frame 0xc85becdc calltrap() at calltrap+0x6/frame 0xc85becdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25652 tid 100565 td 0xc9fa3000 sched_switch(c9fa3000,0,104,196,c85bb990,...) at sched_switch+0x4e1/frame 0xc85bb958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85bb990 sleepq_switch(c9fa3000,0,c15cc34d,28b,c9fa3000,...) at sleepq_switch+0xf0/frame 0xc85bb9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85bb9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85bba44 vm_waitpfault(ca664500,17a4,0,c85bbafc,c85bbaec,...) at vm_waitpfault+0x99/frame 0xc85bba70 vm_fault_hold(c9c6e2c4,29fa4000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85bbb30 vm_fault(c9c6e2c4,29fa4000,2,0,7d,...) at vm_fault+0x88/frame 0xc85bbb58 trap_pfault(29fa4000,c85bbce8,325,0,30eb0,...) at trap_pfault+0x116/frame 0xc85bbba0 trap(c85bbce8) at trap+0x3ec/frame 0xc85bbcdc calltrap() at calltrap+0x6/frame 0xc85bbcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25651 tid 100564 td 0xcab079f0 sched_switch(cab079f0,0,104,196,c85b8990,...) at sched_switch+0x4e1/frame 0xc85b8958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85b8990 sleepq_switch(cab079f0,0,c15cc34d,28b,cab079f0,...) at sleepq_switch+0xf0/frame 0xc85b89c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85b89e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85b8a44 vm_waitpfault(ca5b8320,e30,0,c85b8afc,c85b8aec,...) at vm_waitpfault+0x99/frame 0xc85b8a70 vm_fault_hold(c9c6e0ec,29630000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85b8b30 vm_fault(c9c6e0ec,29630000,2,0,7d,...) at vm_fault+0x88/frame 0xc85b8b58 trap_pfault(29630000,c85b8ce8,c0cb3a95,246,41315a,...) at trap_pfault+0x116/frame 0xc85b8ba0 trap(c85b8ce8) at trap+0x3ec/frame 0xc85b8cdc calltrap() at calltrap+0x6/frame 0xc85b8cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25650 tid 100563 td 0xcab076a0 sched_switch(cab076a0,0,104,196,c85b5990,...) at sched_switch+0x4e1/frame 0xc85b5958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85b5990 sleepq_switch(cab076a0,0,c15cc34d,28b,cab076a0,...) at sleepq_switch+0xf0/frame 0xc85b59c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85b59e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85b5a44 vm_waitpfault(cb321780,422,0,c85b5afc,c85b5aec,...) at vm_waitpfault+0x99/frame 0xc85b5a70 vm_fault_hold(c9c6e000,28c22000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85b5b30 vm_fault(c9c6e000,28c22000,2,0,7d,...) at vm_fault+0x88/frame 0xc85b5b58 trap_pfault(28c22000,c85b5ce8,325,2,ab28a,...) at trap_pfault+0x116/frame 0xc85b5ba0 trap(c85b5ce8) at trap+0x3ec/frame 0xc85b5cdc calltrap() at calltrap+0x6/frame 0xc85b5cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25649 tid 100562 td 0xcab07350 sched_switch(cab07350,0,104,196,c85b2990,...) at sched_switch+0x4e1/frame 0xc85b2958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85b2990 sleepq_switch(cab07350,0,c15cc34d,28b,cab07350,...) at sleepq_switch+0xf0/frame 0xc85b29c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85b29e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85b2a44 vm_waitpfault(ca5cbbe0,15b3,0,c85b2afc,c85b2aec,...) at vm_waitpfault+0x99/frame 0xc85b2a70 vm_fault_hold(c9c6cdd4,29db3000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85b2b30 vm_fault(c9c6cdd4,29db3000,2,0,7d,...) at vm_fault+0x88/frame 0xc85b2b58 trap_pfault(29db3000,c85b2ce8,c0cb3a95,2,4107ba,...) at trap_pfault+0x116/frame 0xc85b2ba0 trap(c85b2ce8) at trap+0x3ec/frame 0xc85b2cdc calltrap() at calltrap+0x6/frame 0xc85b2cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25648 tid 100165 td 0xc97e46a0 sched_switch(c97e46a0,0,104,196,f3922990,...) at sched_switch+0x4e1/frame 0xf3922958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3922990 sleepq_switch(c97e46a0,0,c15cc34d,28b,c97e46a0,...) at sleepq_switch+0xf0/frame 0xf39229c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf39229e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3922a44 vm_waitpfault(cb29fa00,a86,0,f3922afc,f3922aec,...) at vm_waitpfault+0x99/frame 0xf3922a70 vm_fault_hold(c9c6cce8,29286000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3922b30 vm_fault(c9c6cce8,29286000,2,0,7d,...) at vm_fault+0x88/frame 0xf3922b58 trap_pfault(29286000,f3922ce8,c0cb3a95,246,27bfbf,...) at trap_pfault+0x116/frame 0xf3922ba0 trap(f3922ce8) at trap+0x3ec/frame 0xf3922cdc calltrap() at calltrap+0x6/frame 0xf3922cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25647 tid 100561 td 0xcab07000 sched_switch(cab07000,0,104,196,c85af990,...) at sched_switch+0x4e1/frame 0xc85af958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85af990 sleepq_switch(cab07000,0,c15cc34d,28b,cab07000,...) at sleepq_switch+0xf0/frame 0xc85af9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85af9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85afa44 vm_waitpfault(ca23abe0,954,0,c85afafc,c85afaec,...) at vm_waitpfault+0x99/frame 0xc85afa70 vm_fault_hold(c9c6cbfc,29154000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85afb30 vm_fault(c9c6cbfc,29154000,2,0,7d,...) at vm_fault+0x88/frame 0xc85afb58 trap_pfault(29154000,c85afce8,c0cb3a95,246,4131d7,...) at trap_pfault+0x116/frame 0xc85afba0 trap(c85afce8) at trap+0x3ec/frame 0xc85afcdc calltrap() at calltrap+0x6/frame 0xc85afcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25646 tid 100560 td 0xc961b9f0 sched_switch(c961b9f0,0,104,196,c85ac990,...) at sched_switch+0x4e1/frame 0xc85ac958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85ac990 sleepq_switch(c961b9f0,0,c15cc34d,28b,c961b9f0,...) at sleepq_switch+0xf0/frame 0xc85ac9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85ac9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85aca44 vm_waitpfault(cb321460,4f6,0,c85acafc,c85acaec,...) at vm_waitpfault+0x99/frame 0xc85aca70 vm_fault_hold(c9c6c938,28cf6000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85acb30 vm_fault(c9c6c938,28cf6000,2,0,7d,...) at vm_fault+0x88/frame 0xc85acb58 trap_pfault(28cf6000,c85acce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xc85acba0 trap(c85acce8) at trap+0x3ec/frame 0xc85accdc calltrap() at calltrap+0x6/frame 0xc85accdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25645 tid 100559 td 0xc961b6a0 sched_switch(c961b6a0,0,104,196,c85a9990,...) at sched_switch+0x4e1/frame 0xc85a9958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85a9990 sleepq_switch(c961b6a0,0,c15cc34d,28b,c961b6a0,...) at sleepq_switch+0xf0/frame 0xc85a99c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85a99e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85a9a44 vm_waitpfault(ca61bc80,b13,0,c85a9afc,c85a9aec,...) at vm_waitpfault+0x99/frame 0xc85a9a70 vm_fault_hold(c9c6c84c,29313000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85a9b30 vm_fault(c9c6c84c,29313000,2,0,7d,...) at vm_fault+0x88/frame 0xc85a9b58 trap_pfault(29313000,c85a9ce8,c0cb3a95,246,1,...) at trap_pfault+0x116/frame 0xc85a9ba0 trap(c85a9ce8) at trap+0x3ec/frame 0xc85a9cdc calltrap() at calltrap+0x6/frame 0xc85a9cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25644 tid 100410 td 0xc9fd3000 sched_switch(c9fd3000,0,104,196,c8525990,...) at sched_switch+0x4e1/frame 0xc8525958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8525990 sleepq_switch(c9fd3000,0,c15cc34d,28b,c9fd3000,...) at sleepq_switch+0xf0/frame 0xc85259c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85259e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8525a44 vm_waitpfault(ca4660a0,184c,0,c8525afc,c8525aec,...) at vm_waitpfault+0x99/frame 0xc8525a70 vm_fault_hold(c9712588,2a04c000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8525b30 vm_fault(c9712588,2a04c000,2,0,7d,...) at vm_fault+0x88/frame 0xc8525b58 trap_pfault(2a04c000,c8525ce8,c0cb3a95,246,1,...) at trap_pfault+0x116/frame 0xc8525ba0 trap(c8525ce8) at trap+0x3ec/frame 0xc8525cdc calltrap() at calltrap+0x6/frame 0xc8525cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25643 tid 100363 td 0xc9390350 sched_switch(c9390350,0,104,196,c84e0990,...) at sched_switch+0x4e1/frame 0xc84e0958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84e0990 sleepq_switch(c9390350,0,c15cc34d,28b,c9390350,...) at sleepq_switch+0xf0/frame 0xc84e09c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84e09e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc84e0a44 vm_waitpfault(ca4643c0,c8a,0,c84e0afc,c84e0aec,...) at vm_waitpfault+0x99/frame 0xc84e0a70 vm_fault_hold(cc082760,2948a000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc84e0b30 vm_fault(cc082760,2948a000,2,0,7d,...) at vm_fault+0x88/frame 0xc84e0b58 trap_pfault(2948a000,c84e0ce8,c0cb3a95,2,412f50,...) at trap_pfault+0x116/frame 0xc84e0ba0 trap(c84e0ce8) at trap+0x3ec/frame 0xc84e0cdc calltrap() at calltrap+0x6/frame 0xc84e0cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25642 tid 100491 td 0xcc0bb000 sched_switch(cc0bb000,0,104,196,c84e3990,...) at sched_switch+0x4e1/frame 0xc84e3958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84e3990 sleepq_switch(cc0bb000,0,c15cc34d,28b,cc0bb000,...) at sleepq_switch+0xf0/frame 0xc84e39c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84e39e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc84e3a44 vm_waitpfault(cb63f0a0,cbd,0,c84e3afc,c84e3aec,...) at vm_waitpfault+0x99/frame 0xc84e3a70 vm_fault_hold(c9c6d0ec,294bd000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc84e3b30 vm_fault(c9c6d0ec,294bd000,2,0,7d,...) at vm_fault+0x88/frame 0xc84e3b58 trap_pfault(294bd000,c84e3ce8,c0cb3a95,246,416058,...) at trap_pfault+0x116/frame 0xc84e3ba0 trap(c84e3ce8) at trap+0x3ec/frame 0xc84e3cdc calltrap() at calltrap+0x6/frame 0xc84e3cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25639 tid 100555 td 0xc961b350 sched_switch(c961b350,0,104,196,c85a6990,...) at sched_switch+0x4e1/frame 0xc85a6958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85a6990 sleepq_switch(c961b350,0,c15cc34d,28b,c961b350,...) at sleepq_switch+0xf0/frame 0xc85a69c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85a69e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85a6a44 vm_waitpfault(cb3231e0,9a9,0,c85a6afc,c85a6aec,...) at vm_waitpfault+0x99/frame 0xc85a6a70 vm_fault_hold(ca79084c,291a9000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85a6b30 vm_fault(ca79084c,291a9000,2,0,7d,...) at vm_fault+0x88/frame 0xc85a6b58 trap_pfault(291a9000,c85a6ce8,c0c2fe30,3,413999,...) at trap_pfault+0x116/frame 0xc85a6ba0 trap(c85a6ce8) at trap+0x3ec/frame 0xc85a6cdc calltrap() at calltrap+0x6/frame 0xc85a6cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25634 tid 100553 td 0xca09a9f0 sched_switch(ca09a9f0,0,104,196,c85a0990,...) at sched_switch+0x4e1/frame 0xc85a0958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85a0990 sleepq_switch(ca09a9f0,0,c15cc34d,28b,ca09a9f0,...) at sleepq_switch+0xf0/frame 0xc85a09c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85a09e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85a0a44 vm_waitpfault(ca61ba00,8c1,0,c85a0afc,c85a0aec,...) at vm_waitpfault+0x99/frame 0xc85a0a70 vm_fault_hold(c9c6c760,290c1000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85a0b30 vm_fault(c9c6c760,290c1000,2,0,28,...) at vm_fault+0x88/frame 0xc85a0b58 trap_pfault(290c1000,c85a0ce8,c0cb3a95,246,8,...) at trap_pfault+0x116/frame 0xc85a0ba0 trap(c85a0ce8) at trap+0x3ec/frame 0xc85a0cdc calltrap() at calltrap+0x6/frame 0xc85a0cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command rw pid 25633 tid 100554 td 0xc961b000 sched_switch(c961b000,0,104,196,c85a35f0,...) at sched_switch+0x4e1/frame 0xc85a35b8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85a35f0 sleepq_switch(c961b000,0,c15cc34d,28b,c961b000,...) at sleepq_switch+0xf0/frame 0xc85a3624 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc85a3648 _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc85a36a4 vm_wait(ca61b830,c1611f9f,d8d,11222,a8f,...) at vm_wait+0xfd/frame 0xc85a36d0 vm_page_grab(ca61b820,aeb4,0,11222,c961b000,...) at vm_page_grab+0x1d4/frame 0xc85a3708 allocbuf(e4aee610,5000,c15ad2bc,407,802b6c16,...) at allocbuf+0x37e/frame 0xc85a3750 ncl_write(c85a39a0,c17beda9,c85a38c4,246,0,...) at ncl_write+0xf7f/frame 0xc85a38a8 VOP_WRITE_APV(c185ccbc,c85a39a0,caed5ca8,362,0,...) at VOP_WRITE_APV+0x199/frame 0xc85a3970 vn_write(c9778c78,c85a3be8,ca10e600,1,c961b000,...) at vn_write+0x283/frame 0xc85a39d0 vn_io_fault_doio(c961b000,246,0,0,0,...) at vn_io_fault_doio+0x83/frame 0xc85a3a18 vn_io_fault1(c961b000,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x18f/frame 0xc85a3af0 vn_io_fault(c9778c78,c85a3be8,ca10e600,0,c961b000,...) at vn_io_fault+0x207/frame 0xc85a3b4c dofilewrite(c9778c78,c85a3be8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xc85a3b80 kern_writev(c961b000,4,c85a3be8,ffffffff,bfbfd5a8,...) at kern_writev+0x93/frame 0xc85a3bc8 sys_write(c961b000,c85a3ca8,c15bd083,4,cbd2ca80,...) at sys_write+0x59/frame 0xc85a3c18 syscall(c85a3ce8) at syscall+0x3bf/frame 0xc85a3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc85a3cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281d5ad3, esp = 0xbfbfd4f4, ebp = 0xbfbfd508 --- Tracing command rw pid 25631 tid 100552 td 0xca09a6a0 sched_switch(ca09a6a0,0,104,196,c859d5f0,...) at sched_switch+0x4e1/frame 0xc859d5b8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc859d5f0 sleepq_switch(ca09a6a0,0,c15cc34d,28b,ca09a6a0,...) at sleepq_switch+0xf0/frame 0xc859d624 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc859d648 _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc859d6a4 vm_wait(cc1200b0,c1611f9f,d8d,11222,a8f,...) at vm_wait+0xfd/frame 0xc859d6d0 vm_page_grab(cc1200a0,9f14,0,11222,ca09a6a0,...) at vm_page_grab+0x1d4/frame 0xc859d708 allocbuf(e4aeaf60,5000,c15ad2bc,407,c859d774,...) at allocbuf+0x37e/frame 0xc859d750 ncl_write(c859d9a0,c17beda9,c859d8c4,246,0,...) at ncl_write+0xf7f/frame 0xc859d8a8 VOP_WRITE_APV(c185ccbc,c859d9a0,cb8f29d8,362,0,...) at VOP_WRITE_APV+0x199/frame 0xc859d970 vn_write(c9778a80,c859dbe8,ca10e600,1,ca09a6a0,...) at vn_write+0x283/frame 0xc859d9d0 vn_io_fault_doio(ca09a6a0,246,0,0,0,...) at vn_io_fault_doio+0x83/frame 0xc859da18 vn_io_fault1(ca09a6a0,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x18f/frame 0xc859daf0 vn_io_fault(c9778a80,c859dbe8,ca10e600,0,ca09a6a0,...) at vn_io_fault+0x207/frame 0xc859db4c dofilewrite(c9778a80,c859dbe8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xc859db80 kern_writev(ca09a6a0,4,c859dbe8,ffffffff,bfbfd5a8,...) at kern_writev+0x93/frame 0xc859dbc8 sys_write(ca09a6a0,c859dca8,c15bd083,4,cbd2c3f0,...) at sys_write+0x59/frame 0xc859dc18 syscall(c859dce8) at syscall+0x3bf/frame 0xc859dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc859dcdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281d5ad3, esp = 0xbfbfd4f4, ebp = 0xbfbfd508 --- Tracing command rw pid 25628 tid 100551 td 0xca09a350 sched_switch(ca09a350,0,104,196,c859a5f0,...) at sched_switch+0x4e1/frame 0xc859a5b8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc859a5f0 sleepq_switch(ca09a350,0,c15cc34d,28b,ca09a350,...) at sleepq_switch+0xf0/frame 0xc859a624 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc859a648 _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc859a6a4 vm_wait(cb3226f0,c1611f9f,d8d,11222,a8f,...) at vm_wait+0xfd/frame 0xc859a6d0 vm_page_grab(cb3226e0,42e5,0,11222,ca09a350,...) at vm_page_grab+0x1d4/frame 0xc859a708 allocbuf(e4aad570,6000,c15ad2bc,407,c859a7d0,...) at allocbuf+0x37e/frame 0xc859a750 ncl_write(c859a9a0,c17beda9,c859a8c4,246,0,...) at ncl_write+0xf7f/frame 0xc859a8a8 VOP_WRITE_APV(c185ccbc,c859a9a0,cb9842d0,362,0,...) at VOP_WRITE_APV+0x199/frame 0xc859a970 vn_write(c9778540,c859abe8,ca10e600,1,ca09a350,...) at vn_write+0x283/frame 0xc859a9d0 vn_io_fault_doio(ca09a350,246,0,0,0,...) at vn_io_fault_doio+0x83/frame 0xc859aa18 vn_io_fault1(ca09a350,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x18f/frame 0xc859aaf0 vn_io_fault(c9778540,c859abe8,ca10e600,0,ca09a350,...) at vn_io_fault+0x207/frame 0xc859ab4c dofilewrite(c9778540,c859abe8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xc859ab80 kern_writev(ca09a350,4,c859abe8,ffffffff,bfbfd5a8,...) at kern_writev+0x93/frame 0xc859abc8 sys_write(ca09a350,c859aca8,c15bd083,4,cbd2c0a8,...) at sys_write+0x59/frame 0xc859ac18 syscall(c859ace8) at syscall+0x3bf/frame 0xc859acdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc859acdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281d5ad3, esp = 0xbfbfd4f4, ebp = 0xbfbfd508 --- Tracing command rw pid 25627 tid 100550 td 0xca09a000 sched_switch(ca09a000,0,104,196,c85975f0,...) at sched_switch+0x4e1/frame 0xc85975b8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85975f0 sleepq_switch(ca09a000,0,c15cc34d,28b,ca09a000,...) at sleepq_switch+0xf0/frame 0xc8597624 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc8597648 _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc85976a4 vm_wait(ca61b150,c1611f9f,d8d,11222,a8f,...) at vm_wait+0xfd/frame 0xc85976d0 vm_page_grab(ca61b140,b7cf,0,11222,ca09a000,...) at vm_page_grab+0x1d4/frame 0xc8597708 allocbuf(e49eed00,10000,c15ad2bc,407,412c43,...) at allocbuf+0x37e/frame 0xc8597750 ncl_write(c85979a0,c17beda9,c85978c4,246,0,...) at ncl_write+0xf7f/frame 0xc85978a8 VOP_WRITE_APV(c185ccbc,c85979a0,caed8e10,362,0,...) at VOP_WRITE_APV+0x199/frame 0xc8597970 vn_write(c97277a8,c8597be8,ca10e600,1,ca09a000,...) at vn_write+0x283/frame 0xc85979d0 vn_io_fault_doio(ca09a000,246,0,0,0,...) at vn_io_fault_doio+0x83/frame 0xc8597a18 vn_io_fault1(ca09a000,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x18f/frame 0xc8597af0 vn_io_fault(c97277a8,c8597be8,ca10e600,0,ca09a000,...) at vn_io_fault+0x207/frame 0xc8597b4c dofilewrite(c97277a8,c8597be8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xc8597b80 kern_writev(ca09a000,4,c8597be8,ffffffff,bfbfd5a8,...) at kern_writev+0x93/frame 0xc8597bc8 sys_write(ca09a000,c8597ca8,c15bd083,4,cbd0ea80,...) at sys_write+0x59/frame 0xc8597c18 syscall(c8597ce8) at syscall+0x3bf/frame 0xc8597cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8597cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281d5ad3, esp = 0xbfbfd4f4, ebp = 0xbfbfd508 --- Tracing command rw pid 25626 tid 100549 td 0xccf9b9f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ccf9b9f0,ffffffff,641a,188c5,ccf9b9f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command swap pid 25615 tid 100546 td 0xccf9b000 sched_switch(ccf9b000,0,104,196,c858b990,...) at sched_switch+0x4e1/frame 0xc858b958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc858b990 sleepq_switch(ccf9b000,0,c15cc34d,28b,ccf9b000,...) at sleepq_switch+0xf0/frame 0xc858b9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc858b9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc858ba44 vm_waitpfault(c9df3320,7d2,0,c858bafc,c858baec,...) at vm_waitpfault+0x99/frame 0xc858ba70 vm_fault_hold(ca790dd4,28fd2000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc858bb30 vm_fault(ca790dd4,28fd2000,2,0,7d,...) at vm_fault+0x88/frame 0xc858bb58 trap_pfault(28fd2000,c858bce8,c0cb3a95,246,4159f4,...) at trap_pfault+0x116/frame 0xc858bba0 trap(c858bce8) at trap+0x3ec/frame 0xc858bcdc calltrap() at calltrap+0x6/frame 0xc858bcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25614 tid 100545 td 0xca1e59f0 sched_switch(ca1e59f0,0,104,196,c8588990,...) at sched_switch+0x4e1/frame 0xc8588958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8588990 sleepq_switch(ca1e59f0,0,c15cc34d,28b,ca1e59f0,...) at sleepq_switch+0xf0/frame 0xc85889c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85889e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8588a44 vm_waitpfault(ca666140,131c,0,c8588afc,c8588aec,...) at vm_waitpfault+0x99/frame 0xc8588a70 vm_fault_hold(c97120ec,29b1c000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8588b30 vm_fault(c97120ec,29b1c000,2,0,7d,...) at vm_fault+0x88/frame 0xc8588b58 trap_pfault(29b1c000,c8588ce8,c0cb3a95,246,1,...) at trap_pfault+0x116/frame 0xc8588ba0 trap(c8588ce8) at trap+0x3ec/frame 0xc8588cdc calltrap() at calltrap+0x6/frame 0xc8588cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25612 tid 100544 td 0xca1e56a0 sched_switch(ca1e56a0,0,104,196,c8585990,...) at sched_switch+0x4e1/frame 0xc8585958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8585990 sleepq_switch(ca1e56a0,0,c15cc34d,28b,ca1e56a0,...) at sleepq_switch+0xf0/frame 0xc85859c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85859e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8585a44 vm_waitpfault(ca47c960,1773,0,c8585afc,c8585aec,...) at vm_waitpfault+0x99/frame 0xc8585a70 vm_fault_hold(ca790a24,29f73000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8585b30 vm_fault(ca790a24,29f73000,2,0,7d,...) at vm_fault+0x88/frame 0xc8585b58 trap_pfault(29f73000,c8585ce8,c0cb3a95,246,4148e9,...) at trap_pfault+0x116/frame 0xc8585ba0 trap(c8585ce8) at trap+0x3ec/frame 0xc8585cdc calltrap() at calltrap+0x6/frame 0xc8585cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25610 tid 100543 td 0xca1e5350 sched_switch(ca1e5350,0,104,196,c8582990,...) at sched_switch+0x4e1/frame 0xc8582958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8582990 sleepq_switch(ca1e5350,0,c15cc34d,28b,ca1e5350,...) at sleepq_switch+0xf0/frame 0xc85829c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85829e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8582a44 vm_waitpfault(ca47cd20,a60,0,c8582afc,c8582aec,...) at vm_waitpfault+0x99/frame 0xc8582a70 vm_fault_hold(ca790760,29260000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8582b30 vm_fault(ca790760,29260000,2,0,7d,...) at vm_fault+0x88/frame 0xc8582b58 trap_pfault(29260000,c8582ce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xc8582ba0 trap(c8582ce8) at trap+0x3ec/frame 0xc8582cdc calltrap() at calltrap+0x6/frame 0xc8582cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25609 tid 100542 td 0xca1e5000 sched_switch(ca1e5000,0,104,196,c857f990,...) at sched_switch+0x4e1/frame 0xc857f958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc857f990 sleepq_switch(ca1e5000,0,c15cc34d,28b,ca1e5000,...) at sleepq_switch+0xf0/frame 0xc857f9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc857f9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc857fa44 vm_waitpfault(ca61bd20,ae3,0,c857fafc,c857faec,...) at vm_waitpfault+0x99/frame 0xc857fa70 vm_fault_hold(ca790674,292e3000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc857fb30 vm_fault(ca790674,292e3000,2,0,7d,...) at vm_fault+0x88/frame 0xc857fb58 trap_pfault(292e3000,c857fce8,c0c2fe30,2,414cc8,...) at trap_pfault+0x116/frame 0xc857fba0 trap(c857fce8) at trap+0x3ec/frame 0xc857fcdc calltrap() at calltrap+0x6/frame 0xc857fcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25608 tid 100541 td 0xca1d09f0 sched_switch(ca1d09f0,0,104,196,c857c990,...) at sched_switch+0x4e1/frame 0xc857c958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc857c990 sleepq_switch(ca1d09f0,0,c15cc34d,28b,ca1d09f0,...) at sleepq_switch+0xf0/frame 0xc857c9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc857c9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc857ca44 vm_waitpfault(cab7e6e0,6be,0,c857cafc,c857caec,...) at vm_waitpfault+0x99/frame 0xc857ca70 vm_fault_hold(ca7913b0,28ebe000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc857cb30 vm_fault(ca7913b0,28ebe000,2,0,7d,...) at vm_fault+0x88/frame 0xc857cb58 trap_pfault(28ebe000,c857cce8,325,2,1f05c9,...) at trap_pfault+0x116/frame 0xc857cba0 trap(c857cce8) at trap+0x3ec/frame 0xc857ccdc calltrap() at calltrap+0x6/frame 0xc857ccdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25607 tid 100540 td 0xca1d06a0 sched_switch(ca1d06a0,0,104,196,c8579990,...) at sched_switch+0x4e1/frame 0xc8579958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8579990 sleepq_switch(ca1d06a0,0,c15cc34d,28b,ca1d06a0,...) at sleepq_switch+0xf0/frame 0xc85799c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85799e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8579a44 vm_waitpfault(ca47ce60,10d7,0,c8579afc,c8579aec,...) at vm_waitpfault+0x99/frame 0xc8579a70 vm_fault_hold(ca790588,298d7000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8579b30 vm_fault(ca790588,298d7000,2,0,7d,...) at vm_fault+0x88/frame 0xc8579b58 trap_pfault(298d7000,c8579ce8,c0cb3a95,246,405e4a,...) at trap_pfault+0x116/frame 0xc8579ba0 trap(c8579ce8) at trap+0x3ec/frame 0xc8579cdc calltrap() at calltrap+0x6/frame 0xc8579cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25606 tid 100489 td 0xcc8f6000 sched_switch(cc8f6000,0,104,196,c85cd990,...) at sched_switch+0x4e1/frame 0xc85cd958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc85cd990 sleepq_switch(cc8f6000,0,c15cc34d,28b,cc8f6000,...) at sleepq_switch+0xf0/frame 0xc85cd9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85cd9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc85cda44 vm_waitpfault(c9669000,11db,0,c85cdafc,c85cdaec,...) at vm_waitpfault+0x99/frame 0xc85cda70 vm_fault_hold(ca7901d8,299db000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc85cdb30 vm_fault(ca7901d8,299db000,2,0,7d,...) at vm_fault+0x88/frame 0xc85cdb58 trap_pfault(299db000,c85cdce8,c0cb3a95,246,3,...) at trap_pfault+0x116/frame 0xc85cdba0 trap(c85cdce8) at trap+0x3ec/frame 0xc85cdcdc calltrap() at calltrap+0x6/frame 0xc85cdcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25604 tid 100539 td 0xca1d0350 sched_switch(ca1d0350,0,104,196,c8576990,...) at sched_switch+0x4e1/frame 0xc8576958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8576990 sleepq_switch(ca1d0350,0,c15cc34d,28b,ca1d0350,...) at sleepq_switch+0xf0/frame 0xc85769c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85769e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8576a44 vm_waitpfault(ca666280,14cc,0,c8576afc,c8576aec,...) at vm_waitpfault+0x99/frame 0xc8576a70 vm_fault_hold(ca79049c,29ccc000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8576b30 vm_fault(ca79049c,29ccc000,2,0,7d,...) at vm_fault+0x88/frame 0xc8576b58 trap_pfault(29ccc000,c8576ce8,c0cb3a95,246,85e67782,...) at trap_pfault+0x116/frame 0xc8576ba0 trap(c8576ce8) at trap+0x3ec/frame 0xc8576cdc calltrap() at calltrap+0x6/frame 0xc8576cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25603 tid 100538 td 0xca1d0000 sched_switch(ca1d0000,0,104,196,c8573990,...) at sched_switch+0x4e1/frame 0xc8573958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8573990 sleepq_switch(ca1d0000,0,c15cc34d,28b,ca1d0000,...) at sleepq_switch+0xf0/frame 0xc85739c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85739e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8573a44 vm_waitpfault(ca666320,159e,0,c8573afc,c8573aec,...) at vm_waitpfault+0x99/frame 0xc8573a70 vm_fault_hold(ca7903b0,29d9e000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8573b30 vm_fault(ca7903b0,29d9e000,2,0,7d,...) at vm_fault+0x88/frame 0xc8573b58 trap_pfault(29d9e000,c8573ce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xc8573ba0 trap(c8573ce8) at trap+0x3ec/frame 0xc8573cdc calltrap() at calltrap+0x6/frame 0xc8573cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25602 tid 100537 td 0xca0e49f0 sched_switch(ca0e49f0,0,104,196,c8570990,...) at sched_switch+0x4e1/frame 0xc8570958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8570990 sleepq_switch(ca0e49f0,0,c15cc34d,28b,ca0e49f0,...) at sleepq_switch+0xf0/frame 0xc85709c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85709e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8570a44 vm_waitpfault(cab7ec80,580,0,c8570afc,c8570aec,...) at vm_waitpfault+0x99/frame 0xc8570a70 vm_fault_hold(ca7902c4,28d80000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8570b30 vm_fault(ca7902c4,28d80000,2,0,7d,...) at vm_fault+0x88/frame 0xc8570b58 trap_pfault(28d80000,c8570ce8,c0cb3a95,1,40826b,...) at trap_pfault+0x116/frame 0xc8570ba0 trap(c8570ce8) at trap+0x3ec/frame 0xc8570cdc calltrap() at calltrap+0x6/frame 0xc8570cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25599 tid 100536 td 0xca0e46a0 sched_switch(ca0e46a0,0,104,196,c856d990,...) at sched_switch+0x4e1/frame 0xc856d958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc856d990 sleepq_switch(ca0e46a0,0,c15cc34d,28b,ca0e46a0,...) at sleepq_switch+0xf0/frame 0xc856d9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc856d9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc856da44 vm_waitpfault(cba9b000,a13,0,c856dafc,c856daec,...) at vm_waitpfault+0x99/frame 0xc856da70 vm_fault_hold(ca7900ec,29213000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc856db30 vm_fault(ca7900ec,29213000,2,0,7d,...) at vm_fault+0x88/frame 0xc856db58 trap_pfault(29213000,c856dce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xc856dba0 trap(c856dce8) at trap+0x3ec/frame 0xc856dcdc calltrap() at calltrap+0x6/frame 0xc856dcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25598 tid 100535 td 0xca0e4350 sched_switch(ca0e4350,0,104,196,c856a990,...) at sched_switch+0x4e1/frame 0xc856a958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc856a990 sleepq_switch(ca0e4350,0,c15cc34d,28b,ca0e4350,...) at sleepq_switch+0xf0/frame 0xc856a9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc856a9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc856aa44 vm_waitpfault(cb512f00,5fc,0,c856aafc,c856aaec,...) at vm_waitpfault+0x99/frame 0xc856aa70 vm_fault_hold(ca790000,28dfc000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc856ab30 vm_fault(ca790000,28dfc000,2,0,7d,...) at vm_fault+0x88/frame 0xc856ab58 trap_pfault(28dfc000,c856ace8,c0cb3a95,246,a593878f,...) at trap_pfault+0x116/frame 0xc856aba0 trap(c856ace8) at trap+0x3ec/frame 0xc856acdc calltrap() at calltrap+0x6/frame 0xc856acdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25597 tid 100534 td 0xca0e4000 sched_switch(ca0e4000,0,104,196,c8567990,...) at sched_switch+0x4e1/frame 0xc8567958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8567990 sleepq_switch(ca0e4000,0,c15cc34d,28b,ca0e4000,...) at sleepq_switch+0xf0/frame 0xc85679c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85679e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8567a44 vm_waitpfault(cab7caa0,6bb,0,c8567afc,c8567aec,...) at vm_waitpfault+0x99/frame 0xc8567a70 vm_fault_hold(c8e51ce8,28ebb000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8567b30 vm_fault(c8e51ce8,28ebb000,2,0,7d,...) at vm_fault+0x88/frame 0xc8567b58 trap_pfault(28ebb000,c8567ce8,c0cb3a95,3,414d95,...) at trap_pfault+0x116/frame 0xc8567ba0 trap(c8567ce8) at trap+0x3ec/frame 0xc8567cdc calltrap() at calltrap+0x6/frame 0xc8567cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25596 tid 100533 td 0xc9fb29f0 sched_switch(c9fb29f0,0,104,196,c8564990,...) at sched_switch+0x4e1/frame 0xc8564958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8564990 sleepq_switch(c9fb29f0,0,c15cc34d,28b,c9fb29f0,...) at sleepq_switch+0xf0/frame 0xc85649c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85649e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8564a44 vm_waitpfault(cab7e000,9c6,0,c8564afc,c8564aec,...) at vm_waitpfault+0x99/frame 0xc8564a70 vm_fault_hold(c8e51b10,291c6000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8564b30 vm_fault(c8e51b10,291c6000,2,0,7d,...) at vm_fault+0x88/frame 0xc8564b58 trap_pfault(291c6000,c8564ce8,200,c9fb29f0,3,...) at trap_pfault+0x116/frame 0xc8564ba0 trap(c8564ce8) at trap+0x3ec/frame 0xc8564cdc calltrap() at calltrap+0x6/frame 0xc8564cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25595 tid 100532 td 0xc9fb26a0 sched_switch(c9fb26a0,0,104,196,c8561990,...) at sched_switch+0x4e1/frame 0xc8561958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8561990 sleepq_switch(c9fb26a0,0,c15cc34d,28b,c9fb26a0,...) at sleepq_switch+0xf0/frame 0xc85619c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85619e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8561a44 vm_waitpfault(cbaccaa0,e85,0,c8561afc,c8561aec,...) at vm_waitpfault+0x99/frame 0xc8561a70 vm_fault_hold(c8e51a24,29685000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8561b30 vm_fault(c8e51a24,29685000,2,0,7d,...) at vm_fault+0x88/frame 0xc8561b58 trap_pfault(29685000,c8561ce8,c0cb3a95,246,410c10,...) at trap_pfault+0x116/frame 0xc8561ba0 trap(c8561ce8) at trap+0x3ec/frame 0xc8561cdc calltrap() at calltrap+0x6/frame 0xc8561cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25594 tid 100531 td 0xc9fb2350 sched_switch(c9fb2350,0,104,196,c855e990,...) at sched_switch+0x4e1/frame 0xc855e958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc855e990 sleepq_switch(c9fb2350,0,c15cc34d,28b,c9fb2350,...) at sleepq_switch+0xf0/frame 0xc855e9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc855e9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc855ea44 vm_waitpfault(cb512a00,aa5,0,c855eafc,c855eaec,...) at vm_waitpfault+0x99/frame 0xc855ea70 vm_fault_hold(c8e512c4,292a5000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc855eb30 vm_fault(c8e512c4,292a5000,2,0,7d,...) at vm_fault+0x88/frame 0xc855eb58 trap_pfault(292a5000,c855ece8,c0cb3a95,246,415df3,...) at trap_pfault+0x116/frame 0xc855eba0 trap(c855ece8) at trap+0x3ec/frame 0xc855ecdc calltrap() at calltrap+0x6/frame 0xc855ecdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25593 tid 100530 td 0xc9fb2000 sched_switch(c9fb2000,0,104,196,c855b990,...) at sched_switch+0x4e1/frame 0xc855b958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc855b990 sleepq_switch(c9fb2000,0,c15cc34d,28b,c9fb2000,...) at sleepq_switch+0xf0/frame 0xc855b9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc855b9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc855ba44 vm_waitpfault(cab843c0,65f,0,c855bafc,c855baec,...) at vm_waitpfault+0x99/frame 0xc855ba70 vm_fault_hold(c97133b0,28e5f000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc855bb30 vm_fault(c97133b0,28e5f000,2,0,7d,...) at vm_fault+0x88/frame 0xc855bb58 trap_pfault(28e5f000,c855bce8,c0cb3a95,1,4140cd,...) at trap_pfault+0x116/frame 0xc855bba0 trap(c855bce8) at trap+0x3ec/frame 0xc855bcdc calltrap() at calltrap+0x6/frame 0xc855bcdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25592 tid 100529 td 0xca1729f0 sched_switch(ca1729f0,0,104,196,c8558990,...) at sched_switch+0x4e1/frame 0xc8558958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8558990 sleepq_switch(ca1729f0,0,c15cc34d,28b,ca1729f0,...) at sleepq_switch+0xf0/frame 0xc85589c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85589e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8558a44 vm_waitpfault(ca662e60,111f,0,c8558afc,c8558aec,...) at vm_waitpfault+0x99/frame 0xc8558a70 vm_fault_hold(c97131d8,2991f000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8558b30 vm_fault(c97131d8,2991f000,2,0,7d,...) at vm_fault+0x88/frame 0xc8558b58 trap_pfault(2991f000,c8558ce8,c0cb3a95,246,41340f,...) at trap_pfault+0x116/frame 0xc8558ba0 trap(c8558ce8) at trap+0x3ec/frame 0xc8558cdc calltrap() at calltrap+0x6/frame 0xc8558cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25591 tid 100528 td 0xca1726a0 sched_switch(ca1726a0,0,104,196,c8555990,...) at sched_switch+0x4e1/frame 0xc8555958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8555990 sleepq_switch(ca1726a0,0,c15cc34d,28b,ca1726a0,...) at sleepq_switch+0xf0/frame 0xc85559c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85559e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8555a44 vm_waitpfault(ca61b3c0,c2b,0,c8555afc,c8555aec,...) at vm_waitpfault+0x99/frame 0xc8555a70 vm_fault_hold(c9712bfc,2942b000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8555b30 vm_fault(c9712bfc,2942b000,2,0,7d,...) at vm_fault+0x88/frame 0xc8555b58 trap_pfault(2942b000,c8555ce8,c0cb3a95,3,414a08,...) at trap_pfault+0x116/frame 0xc8555ba0 trap(c8555ce8) at trap+0x3ec/frame 0xc8555cdc calltrap() at calltrap+0x6/frame 0xc8555cdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command mkdir pid 25587 tid 100525 td 0xcab149f0 sched_switch(cab149f0,0,104,196,c854c584,...) at sched_switch+0x4e1/frame 0xc854c54c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc854c584 sleepq_switch(cab149f0,0,c15cc34d,1c2,c854c624,...) at sleepq_switch+0xf0/frame 0xc854c5b8 sleepq_catch_signals(0,c00402e5,12,cc1fe810,60,...) at sleepq_catch_signals+0x443/frame 0xc854c5fc sleepq_timedwait_sig(cc1e2000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc854c624 _sleep(cc1e2000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc854c680 clnt_vc_call(c96a30c0,c854c840,4,cb268500,c854c908,...) at clnt_vc_call+0x715/frame 0xc854c758 clnt_reconnect_call(c96a30e0,c854c840,4,cb268500,c854c908,...) at clnt_reconnect_call+0xcc/frame 0xc854c7c0 newnfs_request(c854c908,c905d400,0,c905d510,c9db8708,cab149f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc854c888 nfscl_request(c854c908,c9db8708,cab149f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc854c8d0 nfsrpc_accessrpc(c9db8708,3f,ca10e600,cab149f0,c854c9f0,...) at nfsrpc_accessrpc+0xec/frame 0xc854c9c0 nfs34_access_otw(cab149f0,ca10e600,c854cae8,1a3,8,...) at nfs34_access_otw+0x5d/frame 0xc854ca98 nfs_access(c854cbe0,c17bebc2,c1606799,c0d108dc,c18aba14,...) at nfs_access+0x3a7/frame 0xc854cb00 VOP_ACCESS_APV(c185ccbc,c854cbe0,4000144,0,bfbe876f,...) at VOP_ACCESS_APV+0xf9/frame 0xc854cb30 kern_chdir(cab149f0,bfbe876f,0) at kern_chdir+0x115/frame 0xc854cc04 sys_chdir(cab149f0,c854cca8,c15bd083,4,ca2f2738,...) at sys_chdir+0x22/frame 0xc854cc18 syscall(c854cce8) at syscall+0x3bf/frame 0xc854ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc854ccdc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280f47d3, esp = 0xbfbe8328, ebp = 0xbfbe8750 --- Tracing command mkdir pid 25586 tid 100524 td 0xcab146a0 sched_switch(cab146a0,0,104,196,c85493ac,...) at sched_switch+0x4e1/frame 0xc8549374 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc85493ac sleepq_switch(cab146a0,0,c15cc34d,1c2,c854944c,...) at sleepq_switch+0xf0/frame 0xc85493e0 sleepq_catch_signals(1,c00402e5,12,cc1fe810,264,...) at sleepq_catch_signals+0x443/frame 0xc8549424 sleepq_timedwait_sig(c97fcc00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc854944c _sleep(c97fcc00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc85494a8 clnt_vc_call(c96a30c0,c8549668,3,cd08bb00,c8549738,...) at clnt_vc_call+0x715/frame 0xc8549580 clnt_reconnect_call(c96a30e0,c8549668,3,cd08bb00,c8549738,...) at clnt_reconnect_call+0xcc/frame 0xc85495e8 newnfs_request(c8549738,c905d400,0,c905d510,c9763870,cab146a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc85496b0 nfscl_request(c8549738,c9763870,cab146a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc85496f8 nfsrpc_lookup(c9763870,c9562800,4,ca10e600,cab146a0,...) at nfsrpc_lookup+0x211/frame 0xc85497f0 nfs_lookup(c8549a80,c17be989,c160688d,c15d772f,c18aba14,...) at nfs_lookup+0x56f/frame 0xc8549a10 VOP_LOOKUP_APV(c185ccbc,c8549a80,c8549bbc,20a,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc8549a40 lookup(c8549b60,c15d772f,124,eb,bfbe44af,...) at lookup+0x589/frame 0xc8549aa8 namei(c8549b60,0,4000144,0,bfbe44af,...) at namei+0x58c/frame 0xc8549b30 kern_chdir(cab146a0,bfbe44af,0) at kern_chdir+0x60/frame 0xc8549c04 sys_chdir(cab146a0,c8549ca8,c15bd083,4,ca2f23f0,...) at sys_chdir+0x22/frame 0xc8549c18 syscall(c8549ce8) at syscall+0x3bf/frame 0xc8549cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8549cdc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280f47d3, esp = 0xbfbe4068, ebp = 0xbfbe4490 --- Tracing command mkdir pid 25585 tid 100523 td 0xcab14350 sched_switch(cab14350,0,104,196,c8546434,...) at sched_switch+0x4e1/frame 0xc85463fc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc8546434 sleepq_switch(cab14350,0,c15cc34d,1c2,c85464d4,...) at sleepq_switch+0xf0/frame 0xc8546468 sleepq_catch_signals(0,c00402e5,12,cc1fe810,150,...) at sleepq_catch_signals+0x443/frame 0xc85464ac sleepq_timedwait_sig(c9f77000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc85464d4 _sleep(c9f77000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8546530 clnt_vc_call(c96a30c0,c85466f0,9,cb82ab00,c85467b8,...) at clnt_vc_call+0x715/frame 0xc8546608 clnt_reconnect_call(c96a30e0,c85466f0,9,cb82ab00,c85467b8,...) at clnt_reconnect_call+0xcc/frame 0xc8546670 newnfs_request(c85467b8,c905d400,0,c905d510,ca6b4438,cab14350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8546738 nfscl_request(c85467b8,ca6b4438,cab14350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc8546780 nfsrpc_mkdir(ca6b4438,cb121800,3,c8546b68,ca10e600,...) at nfsrpc_mkdir+0x1b0/frame 0xc8546870 nfs_mkdir(c8546bd8,c17bf051,c16067c6,ca6b4438,c8546bd4,...) at nfs_mkdir+0xf4/frame 0xc8546a78 VOP_MKDIR_APV(c185ccbc,c8546bd8,c8546b44,c8546b68,bfbf0497,...) at VOP_MKDIR_APV+0xf9/frame 0xc8546aa8 kern_mkdirat(cab14350,ffffff9c,bfbf0497,0,1f8) at kern_mkdirat+0x22c/frame 0xc8546bfc sys_mkdir(cab14350,c8546ca8,c15bd083,4,c8546c3c,...) at sys_mkdir+0x31/frame 0xc8546c18 syscall(c8546ce8) at syscall+0x3bf/frame 0xc8546cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8546cdc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x281cebcb, esp = 0xbfbf0050, ebp = 0xbfbf0478 --- Tracing command mkdir pid 25584 tid 100522 td 0xcab14000 sched_switch(cab14000,0,104,196,c8543584,...) at sched_switch+0x4e1/frame 0xc854354c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc8543584 sleepq_switch(cab14000,0,c15cc34d,1c2,c8543624,...) at sleepq_switch+0xf0/frame 0xc85435b8 sleepq_catch_signals(0,c00402e5,12,cc1fe810,2be,...) at sleepq_catch_signals+0x443/frame 0xc85435fc sleepq_timedwait_sig(c978ea00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc8543624 _sleep(c978ea00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8543680 clnt_vc_call(c96a30c0,c8543840,4,cceaf700,c8543908,...) at clnt_vc_call+0x715/frame 0xc8543758 clnt_reconnect_call(c96a30e0,c8543840,4,cceaf700,c8543908,...) at clnt_reconnect_call+0xcc/frame 0xc85437c0 newnfs_request(c8543908,c905d400,0,c905d510,caba6168,cab14000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8543888 nfscl_request(c8543908,caba6168,cab14000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc85438d0 nfsrpc_accessrpc(caba6168,3f,ca10e600,cab14000,c85439f0,...) at nfsrpc_accessrpc+0xec/frame 0xc85439c0 nfs34_access_otw(cab14000,ca10e600,c8543ae8,1a3,8,...) at nfs34_access_otw+0x5d/frame 0xc8543a98 nfs_access(c8543be0,c17bebc2,c1606799,c0d108dc,c18aba14,...) at nfs_access+0x3a7/frame 0xc8543b00 VOP_ACCESS_APV(c185ccbc,c8543be0,4000144,0,bfbeb553,...) at VOP_ACCESS_APV+0xf9/frame 0xc8543b30 kern_chdir(cab14000,bfbeb553,0) at kern_chdir+0x115/frame 0xc8543c04 sys_chdir(cab14000,c8543ca8,c15bd083,4,14,...) at sys_chdir+0x22/frame 0xc8543c18 syscall(c8543ce8) at syscall+0x3bf/frame 0xc8543cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8543cdc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280f47d3, esp = 0xbfbeb10c, ebp = 0xbfbeb534 --- Tracing command mkdir pid 25583 tid 100521 td 0xcab269f0 sched_switch(cab269f0,0,104,196,c8540990,...) at sched_switch+0x4e1/frame 0xc8540958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8540990 sleepq_switch(cab269f0,0,c15cc34d,28b,cab269f0,...) at sleepq_switch+0xf0/frame 0xc85409c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85409e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8540a44 vm_waitpfault(cb9f0500,a,0,c8540ad0,c8540ad4,...) at vm_waitpfault+0x99/frame 0xc8540a70 vm_fault_hold(c8e5149c,bfbe9000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8540b30 vm_fault(c8e5149c,bfbe9000,2,0,c8540bd4,...) at vm_fault+0x88/frame 0xc8540b58 trap_pfault(bfbe9f14,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc8540ba0 trap(c8540ce8) at trap+0x3ec/frame 0xc8540cdc calltrap() at calltrap+0x6/frame 0xc8540cdc --- trap 0xc, eip = 0x281bbf7f, esp = 0xbfbe9f18, ebp = 0xbfbea034 --- Tracing command mkdir pid 25582 tid 100520 td 0xcab266a0 sched_switch(cab266a0,0,104,196,c853d990,...) at sched_switch+0x4e1/frame 0xc853d958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc853d990 sleepq_switch(cab266a0,0,c15cc34d,28b,cab266a0,...) at sleepq_switch+0xf0/frame 0xc853d9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc853d9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc853da44 vm_waitpfault(cb9f0500,d,0,2e8,c853dad4,...) at vm_waitpfault+0x99/frame 0xc853da70 vm_fault_hold(c8e513b0,bfbec000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc853db30 vm_fault(c8e513b0,bfbec000,2,0,c853dbd4,...) at vm_fault+0x88/frame 0xc853db58 trap_pfault(bfbeced4,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc853dba0 trap(c853dce8) at trap+0x3ec/frame 0xc853dcdc calltrap() at calltrap+0x6/frame 0xc853dcdc --- trap 0xc, eip = 0x2816c5bf, esp = 0xbfbeced8, ebp = 0xbfbed120 --- Tracing command mkdir pid 25579 tid 100519 td 0xcc0bb9f0 sched_switch(cc0bb9f0,0,104,196,c84e93ac,...) at sched_switch+0x4e1/frame 0xc84e9374 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84e93ac sleepq_switch(cc0bb9f0,0,c15cc34d,1c2,c84e944c,...) at sleepq_switch+0xf0/frame 0xc84e93e0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,6c,...) at sleepq_catch_signals+0x443/frame 0xc84e9424 sleepq_timedwait_sig(cc1e2400,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84e944c _sleep(cc1e2400,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84e94a8 clnt_vc_call(c96a30c0,c84e9668,3,cb5af700,c84e9738,...) at clnt_vc_call+0x715/frame 0xc84e9580 clnt_reconnect_call(c96a30e0,c84e9668,3,cb5af700,c84e9738,...) at clnt_reconnect_call+0xcc/frame 0xc84e95e8 newnfs_request(c84e9738,c905d400,0,c905d510,cccec870,cc0bb9f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84e96b0 nfscl_request(c84e9738,cccec870,cc0bb9f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84e96f8 nfsrpc_lookup(cccec870,ca947000,3,ca10e600,cc0bb9f0,...) at nfsrpc_lookup+0x211/frame 0xc84e97f0 nfs_lookup(c84e9a80,c17be989,c160688d,c15d772f,c18aba14,...) at nfs_lookup+0x56f/frame 0xc84e9a10 VOP_LOOKUP_APV(c185ccbc,c84e9a80,c84e9bbc,20a,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84e9a40 lookup(c84e9b60,c15d772f,124,eb,bfbee763,...) at lookup+0x589/frame 0xc84e9aa8 namei(c84e9b60,0,4000144,0,bfbee763,...) at namei+0x58c/frame 0xc84e9b30 kern_chdir(cc0bb9f0,bfbee763,0) at kern_chdir+0x60/frame 0xc84e9c04 sys_chdir(cc0bb9f0,c84e9ca8,c15bd083,4,cb1a50a8,...) at sys_chdir+0x22/frame 0xc84e9c18 syscall(c84e9ce8) at syscall+0x3bf/frame 0xc84e9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84e9cdc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280f47d3, esp = 0xbfbee31c, ebp = 0xbfbee744 --- Tracing command mkdir pid 25577 tid 100517 td 0xcab26000 sched_switch(cab26000,0,104,196,c8537990,...) at sched_switch+0x4e1/frame 0xc8537958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8537990 sleepq_switch(cab26000,0,c15cc34d,28b,cab26000,...) at sleepq_switch+0xf0/frame 0xc85379c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85379e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8537a44 vm_waitpfault(cb9f0500,9,0,c8537ad0,c8537ad4,...) at vm_waitpfault+0x99/frame 0xc8537a70 vm_fault_hold(c9713000,bfbe8000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8537b30 vm_fault(c9713000,bfbe8000,2,0,c8537bd4,...) at vm_fault+0x88/frame 0xc8537b58 trap_pfault(bfbe8ffc,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc8537ba0 trap(c8537ce8) at trap+0x3ec/frame 0xc8537cdc calltrap() at calltrap+0x6/frame 0xc8537cdc --- trap 0xc, eip = 0x281d254c, esp = 0xbfbe9000, ebp = 0xbfbe9038 --- Tracing command mmap pid 25576 tid 100516 td 0xcaf459f0 sched_switch(caf459f0,0,104,196,c85344b4,...) at sched_switch+0x4e1/frame 0xc853447c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc85344b4 sleepq_switch(caf459f0,0,c15cc34d,28b,caf459f0,...) at sleepq_switch+0xf0/frame 0xc85344e8 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc853450c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc8534568 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xc8534594 kmem_back(c1b69a78,ca00d000,1000,102,ca00d000,...) at kmem_back+0xe5/frame 0xc85345d4 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xc85345fc page_alloc(c91943c0,1000,c853463b,102,102,...) at page_alloc+0x28/frame 0xc8534610 keg_alloc_slab(102,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xc853464c keg_fetch_slab(102,0,c160f53b,943,c91943c0,...) at keg_fetch_slab+0x1af/frame 0xc8534694 zone_fetch_slab(c91943c0,0,102,ffffffff,2,...) at zone_fetch_slab+0x5d/frame 0xc85346b8 zone_import(c91943c0,c8534718,1,102,0,...) at zone_import+0x37/frame 0xc8534700 zone_alloc_item(102,0,c160f552,c15ac6ed,1,...) at zone_alloc_item+0x39/frame 0xc8534730 uma_zalloc_arg(c91943c0,0,102,caf459f0,c85347a0,...) at uma_zalloc_arg+0x687/frame 0xc8534764 nfscl_nget(c9ad4bb0,c91199d8,c9ffa9a0,c8534ba4,caf459f0,...) at nfscl_nget+0x378/frame 0xc85347b0 nfs_create(c8534ab0,c17bea3f,c16067c6,c91199d8,c8534aac,...) at nfs_create+0x3b5/frame 0xc85349d8 VOP_CREATE_APV(c185ccbc,c8534ab0,c8534ba4,c8534a40,c8534a44,...) at VOP_CREATE_APV+0xf9/frame 0xc8534a08 vn_open_cred(c8534b48,c8534bcc,180,0,ca10e600,c9807af0) at vn_open_cred+0x2a5/frame 0xc8534ad8 vn_open(c8534b48,c8534bcc,180,c9807af0,bfbfe520,...) at vn_open+0x3d/frame 0xc8534b00 kern_openat(caf459f0,ffffff9c,bfbfe520,0,602,180) at kern_openat+0x345/frame 0xc8534bf0 sys_openat(caf459f0,c8534ca8,c15bd083,4,14,...) at sys_openat+0x53/frame 0xc8534c18 syscall(c8534ce8) at syscall+0x3bf/frame 0xc8534cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8534cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe464, ebp = 0xbfbfe488 --- Tracing command mkdir pid 25573 tid 100515 td 0xcaf456a0 sched_switch(caf456a0,0,104,196,c8531990,...) at sched_switch+0x4e1/frame 0xc8531958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8531990 sleepq_switch(caf456a0,0,c15cc34d,28b,caf456a0,...) at sleepq_switch+0xf0/frame 0xc85319c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85319e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8531a44 vm_waitpfault(cb9f0500,9,0,c8531ad0,c8531ad4,...) at vm_waitpfault+0x99/frame 0xc8531a70 vm_fault_hold(cc082dd4,bfbe8000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8531b30 vm_fault(cc082dd4,bfbe8000,2,0,c8531bd4,...) at vm_fault+0x88/frame 0xc8531b58 trap_pfault(bfbe8ffc,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc8531ba0 trap(c8531ce8) at trap+0x3ec/frame 0xc8531cdc calltrap() at calltrap+0x6/frame 0xc8531cdc --- trap 0xc, eip = 0x281d254c, esp = 0xbfbe9000, ebp = 0xbfbe9038 --- Tracing command swap pid 25572 tid 100514 td 0xcaf45350 sched_switch(caf45350,0,104,196,c852e990,...) at sched_switch+0x4e1/frame 0xc852e958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc852e990 sleepq_switch(caf45350,0,c15cc34d,28b,caf45350,...) at sleepq_switch+0xf0/frame 0xc852e9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc852e9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc852ea44 vm_waitpfault(ca47cdc0,155d,0,c852eafc,c852eaec,...) at vm_waitpfault+0x99/frame 0xc852ea70 vm_fault_hold(cc082ce8,29d5d000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc852eb30 vm_fault(cc082ce8,29d5d000,2,0,7d,...) at vm_fault+0x88/frame 0xc852eb58 trap_pfault(29d5d000,c852ece8,c0cb3a95,246,41368d,...) at trap_pfault+0x116/frame 0xc852eba0 trap(c852ece8) at trap+0x3ec/frame 0xc852ecdc calltrap() at calltrap+0x6/frame 0xc852ecdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command mmap pid 25570 tid 100413 td 0xcc0bb350 sched_switch(cc0bb350,0,104,196,c8522540,...) at sched_switch+0x4e1/frame 0xc8522508 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8522540 sleepq_switch(cc0bb350,0,c15cc34d,28b,cc0bb350,...) at sleepq_switch+0xf0/frame 0xc8522574 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc8522598 _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc85225f4 vm_wait(c9feea10,c1611f9f,d8d,51222,a8f,...) at vm_wait+0xfd/frame 0xc8522620 vm_page_grab(c9feea00,0,0,51222,cc0bb350,...) at vm_page_grab+0x1d4/frame 0xc8522658 allocbuf(e4aede40,4ac4,e69,c0b285a3,cd12ca90,...) at allocbuf+0x37e/frame 0xc85226a0 getblk(c9d6c5a0,0,0,4ac4,100,...) at getblk+0x78d/frame 0xc85226f8 nfs_getcacheblk(0,4ac4,cc0bb350,41d,c9feea00,...) at nfs_getcacheblk+0xa5/frame 0xc8522750 ncl_write(c85229a0,c17beda9,c85228c4,246,0,...) at ncl_write+0x1030/frame 0xc85228a8 VOP_WRITE_APV(c185ccbc,c85229a0,c9d6c5a0,362,0,...) at VOP_WRITE_APV+0x199/frame 0xc8522970 vn_write(c9807888,c8522be8,ca10e600,1,cc0bb350,...) at vn_write+0x283/frame 0xc85229d0 vn_io_fault_doio(cc0bb350,246,0,0,0,...) at vn_io_fault_doio+0x83/frame 0xc8522a18 vn_io_fault1(cc0bb350,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x18f/frame 0xc8522af0 vn_io_fault(c9807888,c8522be8,ca10e600,0,cc0bb350,...) at vn_io_fault+0x207/frame 0xc8522b4c dofilewrite(c9807888,c8522be8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xc8522b80 kern_writev(cc0bb350,4,c8522be8,ffffffff,804bb53,...) at kern_writev+0x93/frame 0xc8522bc8 sys_write(cc0bb350,c8522ca8,c15bd083,4,cd12ca80,...) at sys_write+0x59/frame 0xc8522c18 syscall(c8522ce8) at syscall+0x3bf/frame 0xc8522cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8522cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281d5ad3, esp = 0xbfbfe474, ebp = 0xbfbfe488 --- Tracing command swap pid 25568 tid 100512 td 0xcb2219f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cb2219f0,ffffffff,63e0,188a0,cb2219f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command mkdir pid 25566 tid 100511 td 0xcb2216a0 sched_switch(cb2216a0,0,104,196,c851f990,...) at sched_switch+0x4e1/frame 0xc851f958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc851f990 sleepq_switch(cb2216a0,0,c15cc34d,28b,cb2216a0,...) at sleepq_switch+0xf0/frame 0xc851f9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc851f9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc851fa44 vm_waitpfault(c92426e0,f,0,c851fafc,c851faec,...) at vm_waitpfault+0x99/frame 0xc851fa70 vm_fault_hold(cc082674,bfbee000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc851fb30 vm_fault(cc082674,bfbee000,2,0,c851fbd4,...) at vm_fault+0x88/frame 0xc851fb58 trap_pfault(bfbeeff8,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc851fba0 trap(c851fce8) at trap+0x3ec/frame 0xc851fcdc calltrap() at calltrap+0x6/frame 0xc851fcdc --- trap 0xc, eip = 0x281d20a9, esp = 0xbfbeeffc, ebp = 0xbfbef030 --- Tracing command mkdir pid 25565 tid 100510 td 0xcb221350 sched_switch(cb221350,0,104,196,c851c990,...) at sched_switch+0x4e1/frame 0xc851c958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc851c990 sleepq_switch(cb221350,0,c15cc34d,28b,cb221350,...) at sleepq_switch+0xf0/frame 0xc851c9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc851c9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc851ca44 vm_waitpfault(cb9f0500,7,0,c851cad0,c851cad4,...) at vm_waitpfault+0x99/frame 0xc851ca70 vm_fault_hold(cc082588,bfbe6000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc851cb30 vm_fault(cc082588,bfbe6000,2,0,c851cbd4,...) at vm_fault+0x88/frame 0xc851cb58 trap_pfault(bfbe6edc,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc851cba0 trap(c851cce8) at trap+0x3ec/frame 0xc851ccdc calltrap() at calltrap+0x6/frame 0xc851ccdc --- trap 0xc, eip = 0x2816c5bf, esp = 0xbfbe6ee0, ebp = 0xbfbe7128 --- Tracing command mkdir pid 25564 tid 100509 td 0xcb221000 sched_switch(cb221000,0,104,196,c8519434,...) at sched_switch+0x4e1/frame 0xc85193fc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc8519434 sleepq_switch(cb221000,0,c15cc34d,1c2,c85194d4,...) at sleepq_switch+0xf0/frame 0xc8519468 sleepq_catch_signals(0,c00402e5,12,cc1fe810,15c,...) at sleepq_catch_signals+0x443/frame 0xc85194ac sleepq_timedwait_sig(c9f77400,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc85194d4 _sleep(c9f77400,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8519530 clnt_vc_call(c96a30c0,c85196f0,9,c9f5b100,c85197b8,...) at clnt_vc_call+0x715/frame 0xc8519608 clnt_reconnect_call(c96a30e0,c85196f0,9,c9f5b100,c85197b8,...) at clnt_reconnect_call+0xcc/frame 0xc8519670 newnfs_request(c85197b8,c905d400,0,c905d510,ca6312d0,cb221000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8519738 nfscl_request(c85197b8,ca6312d0,cb221000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc8519780 nfsrpc_mkdir(ca6312d0,cb6a2400,3,c8519b68,ca10e600,...) at nfsrpc_mkdir+0x1b0/frame 0xc8519870 nfs_mkdir(c8519bd8,c17bf051,c16067c6,ca6312d0,c8519bd4,...) at nfs_mkdir+0xf4/frame 0xc8519a78 VOP_MKDIR_APV(c185ccbc,c8519bd8,c8519b44,c8519b68,bfbe660f,...) at VOP_MKDIR_APV+0xf9/frame 0xc8519aa8 kern_mkdirat(cb221000,ffffff9c,bfbe660f,0,1f8) at kern_mkdirat+0x22c/frame 0xc8519bfc sys_mkdir(cb221000,c8519ca8,c15bd083,4,c9f81a80,...) at sys_mkdir+0x31/frame 0xc8519c18 syscall(c8519ce8) at syscall+0x3bf/frame 0xc8519cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8519cdc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x281cebcb, esp = 0xbfbe61c8, ebp = 0xbfbe65f0 --- Tracing command mkdir pid 25563 tid 100508 td 0xccf929f0 sched_switch(ccf929f0,0,104,196,c8516990,...) at sched_switch+0x4e1/frame 0xc8516958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8516990 sleepq_switch(ccf929f0,0,c15cc34d,28b,ccf929f0,...) at sleepq_switch+0xf0/frame 0xc85169c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85169e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8516a44 vm_waitpfault(cb9f0500,f,0,c8516ad0,c8516ad4,...) at vm_waitpfault+0x99/frame 0xc8516a70 vm_fault_hold(cc0822c4,bfbee000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8516b30 vm_fault(cc0822c4,bfbee000,2,0,c8516bd4,...) at vm_fault+0x88/frame 0xc8516b58 trap_pfault(bfbeeff8,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc8516ba0 trap(c8516ce8) at trap+0x3ec/frame 0xc8516cdc calltrap() at calltrap+0x6/frame 0xc8516cdc --- trap 0xc, eip = 0x281d20a9, esp = 0xbfbeeffc, ebp = 0xbfbef030 --- Tracing command mkdir pid 25562 tid 100507 td 0xccf926a0 sched_switch(ccf926a0,0,104,196,c8513584,...) at sched_switch+0x4e1/frame 0xc851354c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc8513584 sleepq_switch(ccf926a0,0,c15cc34d,1c2,c8513624,...) at sleepq_switch+0xf0/frame 0xc85135b8 sleepq_catch_signals(3,c00402e5,12,cc1fe810,26a,...) at sleepq_catch_signals+0x443/frame 0xc85135fc sleepq_timedwait_sig(ccd3ce00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc8513624 _sleep(ccd3ce00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8513680 clnt_vc_call(c96a30c0,c8513840,4,ca642500,c8513908,...) at clnt_vc_call+0x715/frame 0xc8513758 clnt_reconnect_call(c96a30e0,c8513840,4,ca642500,c8513908,...) at clnt_reconnect_call+0xcc/frame 0xc85137c0 newnfs_request(c8513908,c905d400,0,c905d510,caba6000,ccf926a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8513888 nfscl_request(c8513908,caba6000,ccf926a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc85138d0 nfsrpc_accessrpc(caba6000,3f,ca10e600,ccf926a0,c85139f0,...) at nfsrpc_accessrpc+0xec/frame 0xc85139c0 nfs34_access_otw(ccf926a0,ca10e600,c8513ae8,1a3,8,...) at nfs34_access_otw+0x5d/frame 0xc8513a98 nfs_access(c8513be0,c17bebc2,c1606799,c0d108dc,c18aba14,...) at nfs_access+0x3a7/frame 0xc8513b00 VOP_ACCESS_APV(c185ccbc,c8513be0,4000144,0,bfbec603,...) at VOP_ACCESS_APV+0xf9/frame 0xc8513b30 kern_chdir(ccf926a0,bfbec603,0) at kern_chdir+0x115/frame 0xc8513c04 sys_chdir(ccf926a0,c8513ca8,c15bd083,4,c9f813f0,...) at sys_chdir+0x22/frame 0xc8513c18 syscall(c8513ce8) at syscall+0x3bf/frame 0xc8513cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8513cdc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280f47d3, esp = 0xbfbec1bc, ebp = 0xbfbec5e4 --- Tracing command mkdir pid 25561 tid 100505 td 0xccf92000 sched_switch(ccf92000,0,104,196,c850d990,...) at sched_switch+0x4e1/frame 0xc850d958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc850d990 sleepq_switch(ccf92000,0,c15cc34d,28b,ccf92000,...) at sleepq_switch+0xf0/frame 0xc850d9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc850d9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc850da44 vm_waitpfault(cb9f0500,d,0,c850dad0,c850dad4,...) at vm_waitpfault+0x99/frame 0xc850da70 vm_fault_hold(c971284c,bfbec000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc850db30 vm_fault(c971284c,bfbec000,2,0,c850dbd4,...) at vm_fault+0x88/frame 0xc850db58 trap_pfault(bfbeced4,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc850dba0 trap(c850dce8) at trap+0x3ec/frame 0xc850dcdc calltrap() at calltrap+0x6/frame 0xc850dcdc --- trap 0xc, eip = 0x2816c5bf, esp = 0xbfbeced8, ebp = 0xbfbed120 --- Tracing command mkdir pid 25560 tid 100504 td 0xcc8f69f0 sched_switch(cc8f69f0,0,104,196,c850a990,...) at sched_switch+0x4e1/frame 0xc850a958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc850a990 sleepq_switch(cc8f69f0,0,c15cc34d,28b,cc8f69f0,...) at sleepq_switch+0xf0/frame 0xc850a9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc850a9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc850aa44 vm_waitpfault(cb9f0500,b,0,2e8,c850aad4,...) at vm_waitpfault+0x99/frame 0xc850aa70 vm_fault_hold(cc082000,bfbea000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc850ab30 vm_fault(cc082000,bfbea000,2,0,c850abd4,...) at vm_fault+0x88/frame 0xc850ab58 trap_pfault(bfbeafc4,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc850aba0 trap(c850ace8) at trap+0x3ec/frame 0xc850acdc calltrap() at calltrap+0x6/frame 0xc850acdc --- trap 0xc, eip = 0x281bbf7f, esp = 0xbfbeafc8, ebp = 0xbfbeb0e4 --- Tracing command mkdir pid 25558 tid 100503 td 0xcc8f66a0 sched_switch(cc8f66a0,0,104,196,c8507990,...) at sched_switch+0x4e1/frame 0xc8507958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8507990 sleepq_switch(cc8f66a0,0,c15cc34d,28b,cc8f66a0,...) at sleepq_switch+0xf0/frame 0xc85079c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc85079e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8507a44 vm_waitpfault(cb9f0500,11,0,c8507ad0,c8507ad4,...) at vm_waitpfault+0x99/frame 0xc8507a70 vm_fault_hold(c9713dd4,bfbf0000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8507b30 vm_fault(c9713dd4,bfbf0000,2,0,c8507bd4,...) at vm_fault+0x88/frame 0xc8507b58 trap_pfault(bfbf0fb4,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc8507ba0 trap(c8507ce8) at trap+0x3ec/frame 0xc8507cdc calltrap() at calltrap+0x6/frame 0xc8507cdc --- trap 0xc, eip = 0x281bbf7f, esp = 0xbfbf0fb8, ebp = 0xbfbf10d8 --- Tracing command mkdir pid 25557 tid 100502 td 0xcc8f6350 sched_switch(cc8f6350,0,104,196,c85043ac,...) at sched_switch+0x4e1/frame 0xc8504374 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc85043ac sleepq_switch(cc8f6350,0,c15cc34d,1c2,c850444c,...) at sleepq_switch+0xf0/frame 0xc85043e0 sleepq_catch_signals(1,c00402e5,12,cc1fe810,2a0,...) at sleepq_catch_signals+0x443/frame 0xc8504424 sleepq_timedwait_sig(c978e000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc850444c _sleep(c978e000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc85044a8 clnt_vc_call(c96a30c0,c8504668,3,ca90dc00,c8504738,...) at clnt_vc_call+0x715/frame 0xc8504580 clnt_reconnect_call(c96a30e0,c8504668,3,ca90dc00,c8504738,...) at clnt_reconnect_call+0xcc/frame 0xc85045e8 newnfs_request(c8504738,c905d400,0,c905d510,c9f0eca8,cc8f6350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc85046b0 nfscl_request(c8504738,c9f0eca8,cc8f6350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc85046f8 nfsrpc_lookup(c9f0eca8,cb6a2800,3,ca10e600,cc8f6350,...) at nfsrpc_lookup+0x211/frame 0xc85047f0 nfs_lookup(c8504a80,c17be989,c160688d,c15d772f,c18aba14,...) at nfs_lookup+0x56f/frame 0xc8504a10 VOP_LOOKUP_APV(c185ccbc,c8504a80,c8504bbc,20a,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc8504a40 lookup(c8504b60,c15d772f,124,eb,bfbe876f,...) at lookup+0x589/frame 0xc8504aa8 namei(c8504b60,0,4000144,0,bfbe876f,...) at namei+0x58c/frame 0xc8504b30 kern_chdir(cc8f6350,bfbe876f,0) at kern_chdir+0x60/frame 0xc8504c04 sys_chdir(cc8f6350,c8504ca8,c15bd083,4,c97f50a8,...) at sys_chdir+0x22/frame 0xc8504c18 syscall(c8504ce8) at syscall+0x3bf/frame 0xc8504cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8504cdc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280f47d3, esp = 0xbfbe8328, ebp = 0xbfbe8750 --- Tracing command mmap pid 25554 tid 100500 td 0xca1b0350 sched_switch(ca1b0350,0,104,196,c84fe4ac,...) at sched_switch+0x4e1/frame 0xc84fe474 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84fe4ac sleepq_switch(ca1b0350,0,c15cc34d,1c2,c84fe54c,...) at sleepq_switch+0xf0/frame 0xc84fe4e0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,174,...) at sleepq_catch_signals+0x443/frame 0xc84fe524 sleepq_timedwait_sig(c9f77c00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84fe54c _sleep(c9f77c00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84fe5a8 clnt_vc_call(c96a30c0,c84fe768,1,ca117000,c84fe830,...) at clnt_vc_call+0x715/frame 0xc84fe680 clnt_reconnect_call(c96a30e0,c84fe768,1,ca117000,c84fe830,...) at clnt_reconnect_call+0xcc/frame 0xc84fe6e8 newnfs_request(c84fe830,c905d400,0,c905d510,c9db8870,ca1b0350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84fe7b0 nfscl_request(c84fe830,c9db8870,ca1b0350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84fe7f8 nfsrpc_getattr(c9db8870,ca10e600,ca1b0350,c84fe978,0,...) at nfsrpc_getattr+0xb6/frame 0xc84fe8e8 nfs_getattr(c84feaf0,c17bec67,c18afd34,c9db8870,1,...) at nfs_getattr+0x22d/frame 0xc84fea18 VOP_GETATTR_APV(c185ccbc,c84feaf0,5000,c84feac0,c0f6f390,...) at VOP_GETATTR_APV+0xf9/frame 0xc84fea48 vm_mmap_vnode(ca1b0350,5000,3,c84feb63,c84feb78,...) at vm_mmap_vnode+0x156/frame 0xc84feb18 vn_mmap(c977aab8,c9713bfc,c84febfc,5000,3,...) at vn_mmap+0xe2/frame 0xc84feb90 sys_mmap(ca1b0350,c84feca8,c15bd083,4,ca13a738,...) at sys_mmap+0x4ab/frame 0xc84fec18 syscall(c84fece8) at syscall+0x3bf/frame 0xc84fecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84fecdc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x281c19a3, esp = 0xbfbfe48c, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25553 tid 100499 td 0xca1b0000 sched_switch(ca1b0000,0,104,196,c84fb4ac,...) at sched_switch+0x4e1/frame 0xc84fb474 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84fb4ac sleepq_switch(ca1b0000,0,c15cc34d,1c2,c84fb54c,...) at sleepq_switch+0xf0/frame 0xc84fb4e0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,168,...) at sleepq_catch_signals+0x443/frame 0xc84fb524 sleepq_timedwait_sig(c9f77800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84fb54c _sleep(c9f77800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84fb5a8 clnt_vc_call(c96a30c0,c84fb768,1,ca7aea00,c84fb830,...) at clnt_vc_call+0x715/frame 0xc84fb680 clnt_reconnect_call(c96a30e0,c84fb768,1,ca7aea00,c84fb830,...) at clnt_reconnect_call+0xcc/frame 0xc84fb6e8 newnfs_request(c84fb830,c905d400,0,c905d510,cc0b6168,ca1b0000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84fb7b0 nfscl_request(c84fb830,cc0b6168,ca1b0000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84fb7f8 nfsrpc_getattr(cc0b6168,ca10e600,ca1b0000,c84fb978,0,...) at nfsrpc_getattr+0xb6/frame 0xc84fb8e8 nfs_getattr(c84fbaf0,c17bec67,c18afd34,cc0b6168,1,...) at nfs_getattr+0x22d/frame 0xc84fba18 VOP_GETATTR_APV(c185ccbc,c84fbaf0,5000,c84fbac0,c0f6f390,...) at VOP_GETATTR_APV+0xf9/frame 0xc84fba48 vm_mmap_vnode(ca1b0000,5000,3,c84fbb63,c84fbb78,...) at vm_mmap_vnode+0x156/frame 0xc84fbb18 vn_mmap(c977a380,c9713b10,c84fbbfc,5000,3,...) at vn_mmap+0xe2/frame 0xc84fbb90 sys_mmap(ca1b0000,c84fbca8,c15bd083,4,14,...) at sys_mmap+0x4ab/frame 0xc84fbc18 syscall(c84fbce8) at syscall+0x3bf/frame 0xc84fbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84fbcdc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x281c19a3, esp = 0xbfbfe48c, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25552 tid 100498 td 0xc9fd39f0 sched_switch(c9fd39f0,0,104,196,c84f8284,...) at sched_switch+0x4e1/frame 0xc84f824c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84f8284 sleepq_switch(c9fd39f0,0,c15cc34d,1c2,c84f8324,...) at sleepq_switch+0xf0/frame 0xc84f82b8 sleepq_catch_signals(1,c00402e5,12,cc1fe810,1e0,...) at sleepq_catch_signals+0x443/frame 0xc84f82fc sleepq_timedwait_sig(c975a000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84f8324 _sleep(c975a000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84f8380 clnt_vc_call(c96a30c0,c84f8540,3,ca910200,c84f8610,...) at clnt_vc_call+0x715/frame 0xc84f8458 clnt_reconnect_call(c96a30e0,c84f8540,3,ca910200,c84f8610,...) at clnt_reconnect_call+0xcc/frame 0xc84f84c0 newnfs_request(c84f8610,c905d400,0,c905d510,caac2000,c9fd39f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84f8588 nfscl_request(c84f8610,caac2000,c9fd39f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84f85d0 nfsrpc_lookup(caac2000,cb898800,c,ca10e600,c9fd39f0,...) at nfsrpc_lookup+0x211/frame 0xc84f86c8 nfs_lookup(c84f8958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xc84f88e8 VOP_LOOKUP_APV(c185ccbc,c84f8958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84f8918 lookup(c84f8b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xc84f8980 namei(c84f8b48,c239ad20,c9807fa8,c9807fa8,c84f8a44,...) at namei+0x58c/frame 0xc84f8a08 vn_open_cred(c84f8b48,c84f8bcc,180,0,ca10e600,c9807310) at vn_open_cred+0xbc/frame 0xc84f8ad8 vn_open(c84f8b48,c84f8bcc,180,c9807310,bfbfe520,...) at vn_open+0x3d/frame 0xc84f8b00 kern_openat(c9fd39f0,ffffff9c,bfbfe520,0,602,180) at kern_openat+0x345/frame 0xc84f8bf0 sys_openat(c9fd39f0,c84f8ca8,c15bd083,4,db,...) at sys_openat+0x53/frame 0xc84f8c18 syscall(c84f8ce8) at syscall+0x3bf/frame 0xc84f8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84f8cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe464, ebp = 0xbfbfe488 --- Tracing command mmap pid 25551 tid 100497 td 0xc9fd36a0 sched_switch(c9fd36a0,0,104,196,c84f532c,...) at sched_switch+0x4e1/frame 0xc84f52f4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84f532c sleepq_switch(c9fd36a0,0,c15cc34d,1c2,c84f53cc,...) at sleepq_switch+0xf0/frame 0xc84f5360 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2a6,...) at sleepq_catch_signals+0x443/frame 0xc84f53a4 sleepq_timedwait_sig(c9c2e200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84f53cc _sleep(c9c2e200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84f5428 clnt_vc_call(c96a30c0,c84f55e8,3,ca910400,c84f56b8,...) at clnt_vc_call+0x715/frame 0xc84f5500 clnt_reconnect_call(c96a30e0,c84f55e8,3,ca910400,c84f56b8,...) at clnt_reconnect_call+0xcc/frame 0xc84f5568 newnfs_request(c84f56b8,c905d400,0,c905d510,caacf000,c9fd36a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84f5630 nfscl_request(c84f56b8,caacf000,c9fd36a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84f5678 nfsrpc_lookup(caacf000,cc312000,c,ca10e600,c9fd36a0,...) at nfsrpc_lookup+0x211/frame 0xc84f5770 nfs_lookup(c84f5a00,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xc84f5990 VOP_LOOKUP_APV(c185ccbc,c84f5a00,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84f59c0 lookup(c84f5b50,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xc84f5a28 namei(c84f5b50,2,400000c,0,bfbfe520,...) at namei+0x58c/frame 0xc84f5ab0 kern_unlinkat(c9fd36a0,ffffff9c,bfbfe520,0,0) at kern_unlinkat+0xa7/frame 0xc84f5bfc sys_unlink(c9fd36a0,c84f5ca8,c15bd083,4,ca7a0a80,...) at sys_unlink+0x32/frame 0xc84f5c18 syscall(c84f5ce8) at syscall+0x3bf/frame 0xc84f5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84f5cdc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281cbbeb, esp = 0xbfbfe48c, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25550 tid 100496 td 0xc9fd3350 sched_switch(c9fd3350,0,104,196,c84f222c,...) at sched_switch+0x4e1/frame 0xc84f21f4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84f222c sleepq_switch(c9fd3350,0,c15cc34d,1c2,c84f22cc,...) at sleepq_switch+0xf0/frame 0xc84f2260 sleepq_catch_signals(0,c00402e5,12,cc1fe810,17a,...) at sleepq_catch_signals+0x443/frame 0xc84f22a4 sleepq_timedwait_sig(c9f77e00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84f22cc _sleep(c9f77e00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84f2328 clnt_vc_call(c96a30c0,c84f24e8,7,ca7ae400,c84f2618,...) at clnt_vc_call+0x715/frame 0xc84f2400 clnt_reconnect_call(c96a30e0,c84f24e8,7,ca7ae400,c84f2618,...) at clnt_reconnect_call+0xcc/frame 0xc84f2468 newnfs_request(c84f2618,c905d400,0,c905d510,c9dd4168,c9fd3350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84f2530 nfscl_request(c84f2618,c9dd4168,c9fd3350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84f2578 nfsrpc_write(c9dd4168,c84f2808,c84f27fc,c84f27f8,ca10e600,...) at nfsrpc_write+0x489/frame 0xc84f26d0 ncl_writerpc(c9dd4168,c84f2808,ca10e600,c84f27fc,c84f27f8,...) at ncl_writerpc+0xdb/frame 0xc84f27a8 ncl_putpages(c84f2888,c17bf707,8,c1614913,475,...) at ncl_putpages+0x303/frame 0xc84f2840 VOP_PUTPAGES_APV(c185ccbc,c84f2888,475,c9dd4168,c18ae684,...) at VOP_PUTPAGES_APV+0xff/frame 0xc84f2870 vnode_pager_putpages(c9feda00,c84f291c,1,8,c84f28d0,...) at vnode_pager_putpages+0x89/frame 0xc84f28b4 vm_pageout_flush(c84f291c,1,8,0,c84f2970,c84f29cc) at vm_pageout_flush+0xf5/frame 0xc84f28fc vm_object_page_collect_flush(8,4,c84f29d0,c84f29cc,c15d8362,...) at vm_object_page_collect_flush+0x19d/frame 0xc84f2984 vm_object_page_clean(c9feda00,0,0,0,0,...) at vm_object_page_clean+0x1ed/frame 0xc84f29e0 vinactive(c9dd4168,c9fd3350,c15d8362,a43,c9dd4218,...) at vinactive+0xd3/frame 0xc84f2a28 vputx(c9dd4168,c84f2a90,c15d9f18,1ba,c0cb3b27,...) at vputx+0x364/frame 0xc84f2a70 vn_close(c9dd4168,3,ca10e600,c9fd3350,246,...) at vn_close+0xfc/frame 0xc84f2ab8 vn_closefile(c9807818,c9fd3350,c967a718,0,c9807818,...) at vn_closefile+0x4f/frame 0xc84f2b1c _fdrop(c9807818,c9fd3350,246,c9fd3350,c1870774,...) at _fdrop+0x21/frame 0xc84f2b38 closef(c9807818,c9fd3350,4a6,48b,c967a6f0,...) at closef+0x21e/frame 0xc84f2ba0 closefp(c9807818,c9fd3350,1,cf,c967a7e8,...) at closefp+0xac/frame 0xc84f2bd4 kern_close(c9fd3350,4) at kern_close+0x120/frame 0xc84f2c08 sys_close(c9fd3350,c84f2ca8,c15bd083,4,db,...) at sys_close+0x1a/frame 0xc84f2c18 syscall(c84f2ce8) at syscall+0x3bf/frame 0xc84f2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84f2cdc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x281d5b03, esp = 0xbfbfe47c, ebp = 0xbfbfe488 --- Tracing command mmap pid 25549 tid 100495 td 0xc93909f0 sched_switch(c93909f0,0,104,196,c84ef4ac,...) at sched_switch+0x4e1/frame 0xc84ef474 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84ef4ac sleepq_switch(c93909f0,0,c15cc34d,1c2,c84ef54c,...) at sleepq_switch+0xf0/frame 0xc84ef4e0 sleepq_catch_signals(1,c00402e5,12,cc1fe810,246,...) at sleepq_catch_signals+0x443/frame 0xc84ef524 sleepq_timedwait_sig(c97fc200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84ef54c _sleep(c97fc200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84ef5a8 clnt_vc_call(c96a30c0,c84ef768,1,ca4f4800,c84ef830,...) at clnt_vc_call+0x715/frame 0xc84ef680 clnt_reconnect_call(c96a30e0,c84ef768,1,ca4f4800,c84ef830,...) at clnt_reconnect_call+0xcc/frame 0xc84ef6e8 newnfs_request(c84ef830,c905d400,0,c905d510,cbaf4ca8,c93909f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84ef7b0 nfscl_request(c84ef830,cbaf4ca8,c93909f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84ef7f8 nfsrpc_getattr(cbaf4ca8,ca10e600,c93909f0,c84ef978,0,...) at nfsrpc_getattr+0xb6/frame 0xc84ef8e8 nfs_getattr(c84efaf0,c17bec67,c18afd34,cbaf4ca8,1,...) at nfs_getattr+0x22d/frame 0xc84efa18 VOP_GETATTR_APV(c185ccbc,c84efaf0,5000,c84efac0,c0f6f390,...) at VOP_GETATTR_APV+0xf9/frame 0xc84efa48 vm_mmap_vnode(c93909f0,5000,3,c84efb63,c84efb78,...) at vm_mmap_vnode+0x156/frame 0xc84efb18 vn_mmap(c977a7e0,c9713588,c84efbfc,5000,3,...) at vn_mmap+0xe2/frame 0xc84efb90 sys_mmap(c93909f0,c84efca8,c15bd083,4,db,...) at sys_mmap+0x4ab/frame 0xc84efc18 syscall(c84efce8) at syscall+0x3bf/frame 0xc84efcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84efcdc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x281c19a3, esp = 0xbfbfe48c, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25548 tid 100494 td 0xc93906a0 sched_switch(c93906a0,0,104,196,c84ec4ac,...) at sched_switch+0x4e1/frame 0xc84ec474 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84ec4ac sleepq_switch(c93906a0,0,c15cc34d,1c2,c84ec54c,...) at sleepq_switch+0xf0/frame 0xc84ec4e0 sleepq_catch_signals(3,c00402e5,12,cc1fe810,240,...) at sleepq_catch_signals+0x443/frame 0xc84ec524 sleepq_timedwait_sig(ccd3c000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84ec54c _sleep(ccd3c000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84ec5a8 clnt_vc_call(c96a30c0,c84ec768,1,ca64ac00,c84ec830,...) at clnt_vc_call+0x715/frame 0xc84ec680 clnt_reconnect_call(c96a30e0,c84ec768,1,ca64ac00,c84ec830,...) at clnt_reconnect_call+0xcc/frame 0xc84ec6e8 newnfs_request(c84ec830,c905d400,0,c905d510,cc0b6e10,c93906a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84ec7b0 nfscl_request(c84ec830,cc0b6e10,c93906a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84ec7f8 nfsrpc_getattr(cc0b6e10,ca10e600,c93906a0,c84ec978,0,...) at nfsrpc_getattr+0xb6/frame 0xc84ec8e8 nfs_getattr(c84ecaf0,c17bec67,c18afd34,cc0b6e10,1,...) at nfs_getattr+0x22d/frame 0xc84eca18 VOP_GETATTR_APV(c185ccbc,c84ecaf0,5000,c84ecac0,c0f6f390,...) at VOP_GETATTR_APV+0xf9/frame 0xc84eca48 vm_mmap_vnode(c93906a0,5000,3,c84ecb63,c84ecb78,...) at vm_mmap_vnode+0x156/frame 0xc84ecb18 vn_mmap(c977a1f8,c971349c,c84ecbfc,5000,3,...) at vn_mmap+0xe2/frame 0xc84ecb90 sys_mmap(c93906a0,c84ecca8,c15bd083,4,14,...) at sys_mmap+0x4ab/frame 0xc84ecc18 syscall(c84ecce8) at syscall+0x3bf/frame 0xc84eccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84eccdc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x281c19a3, esp = 0xbfbfe48c, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25500 tid 100350 td 0xcd1296a0 sched_switch(cd1296a0,0,104,196,c84b91ac,...) at sched_switch+0x4e1/frame 0xc84b9174 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84b91ac sleepq_switch(cd1296a0,0,c15cc34d,1c2,c84b924c,...) at sleepq_switch+0xf0/frame 0xc84b91e0 sleepq_catch_signals(3,c00402e5,12,cc1fe810,246,...) at sleepq_catch_signals+0x443/frame 0xc84b9224 sleepq_timedwait_sig(ccd3c200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84b924c _sleep(ccd3c200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84b92a8 clnt_vc_call(c96a30c0,c84b9468,7,ca4f4c00,c84b9598,...) at clnt_vc_call+0x715/frame 0xc84b9380 clnt_reconnect_call(c96a30e0,c84b9468,7,ca4f4c00,c84b9598,...) at clnt_reconnect_call+0xcc/frame 0xc84b93e8 newnfs_request(c84b9598,c905d400,0,c905d510,c970dca8,cd1296a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84b94b0 nfscl_request(c84b9598,c970dca8,cd1296a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84b94f8 nfsrpc_write(c970dca8,c84b9788,c84b977c,c84b9778,ca10e600,...) at nfsrpc_write+0x489/frame 0xc84b9650 ncl_writerpc(c970dca8,c84b9788,ca10e600,c84b977c,c84b9778,...) at ncl_writerpc+0xdb/frame 0xc84b9728 ncl_putpages(c84b9808,c17bf707,8,c1614913,475,...) at ncl_putpages+0x303/frame 0xc84b97c0 VOP_PUTPAGES_APV(c185ccbc,c84b9808,475,c970dca8,c18ae684,...) at VOP_PUTPAGES_APV+0xff/frame 0xc84b97f0 vnode_pager_putpages(c9feee60,c84b98ac,5,8,c84b9850,...) at vnode_pager_putpages+0x89/frame 0xc84b9834 vm_pageout_flush(c84b98ac,5,8,0,c84b9900,c84b995c) at vm_pageout_flush+0xf5/frame 0xc84b988c vm_object_page_collect_flush(8,0,c84b9960,c84b995c,c15ac2fb,...) at vm_object_page_collect_flush+0x19d/frame 0xc84b9914 vm_object_page_clean(c9feee60,0,0,0,0,...) at vm_object_page_clean+0x1ed/frame 0xc84b9970 nfs_close(c84b9a90,c17beb74,80400,c15d9f18,1ba,...) at nfs_close+0xcb/frame 0xc84b9a40 VOP_CLOSE_APV(c185ccbc,c84b9a90,c15d9f18,1ba,c0cb3b27,...) at VOP_CLOSE_APV+0xf9/frame 0xc84b9a70 vn_close(c970dca8,3,ca10e600,cd1296a0,246,...) at vn_close+0xf2/frame 0xc84b9ab8 vn_closefile(c977a348,cd1296a0,c979c3a0,0,c977a348,...) at vn_closefile+0x4f/frame 0xc84b9b1c _fdrop(c977a348,cd1296a0,246,cd1296a0,c1870774,...) at _fdrop+0x21/frame 0xc84b9b38 closef(c977a348,cd1296a0,4a6,48b,c979c378,...) at closef+0x21e/frame 0xc84b9ba0 closefp(c977a348,cd1296a0,1,cf,c979c470,...) at closefp+0xac/frame 0xc84b9bd4 kern_close(cd1296a0,4) at kern_close+0x120/frame 0xc84b9c08 sys_close(cd1296a0,c84b9ca8,c15bd083,4,cd0610a8,...) at sys_close+0x1a/frame 0xc84b9c18 syscall(c84b9ce8) at syscall+0x3bf/frame 0xc84b9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84b9cdc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x281d5b03, esp = 0xbfbfe47c, ebp = 0xbfbfe488 --- Tracing command mmap pid 25499 tid 100349 td 0xcd129350 sched_switch(cd129350,0,104,196,c84b6284,...) at sched_switch+0x4e1/frame 0xc84b624c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84b6284 sleepq_switch(cd129350,0,c15cc34d,1c2,c84b6324,...) at sleepq_switch+0xf0/frame 0xc84b62b8 sleepq_catch_signals(2,c00402e5,12,cc1fe810,26a,...) at sleepq_catch_signals+0x443/frame 0xc84b62fc sleepq_timedwait_sig(c97fce00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84b6324 _sleep(c97fce00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84b6380 clnt_vc_call(c96a30c0,c84b6540,3,cce10a00,c84b6610,...) at clnt_vc_call+0x715/frame 0xc84b6458 clnt_reconnect_call(c96a30e0,c84b6540,3,cce10a00,c84b6610,...) at clnt_reconnect_call+0xcc/frame 0xc84b64c0 newnfs_request(c84b6610,c905d400,0,c905d510,cad48000,cd129350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84b6588 nfscl_request(c84b6610,cad48000,cd129350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84b65d0 nfsrpc_lookup(cad48000,cb500c00,c,ca10e600,cd129350,...) at nfsrpc_lookup+0x211/frame 0xc84b66c8 nfs_lookup(c84b6958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xc84b68e8 VOP_LOOKUP_APV(c185ccbc,c84b6958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84b6918 lookup(c84b6b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xc84b6980 namei(c84b6b48,c239ad20,c9807fa8,c9807fa8,c84b6a44,...) at namei+0x58c/frame 0xc84b6a08 vn_open_cred(c84b6b48,c84b6bcc,180,0,ca10e600,c9807460) at vn_open_cred+0xbc/frame 0xc84b6ad8 vn_open(c84b6b48,c84b6bcc,180,c9807460,bfbfe520,...) at vn_open+0x3d/frame 0xc84b6b00 kern_openat(cd129350,ffffff9c,bfbfe520,0,602,180) at kern_openat+0x345/frame 0xc84b6bf0 sys_openat(cd129350,c84b6ca8,c15bd083,4,c84b6c3c,...) at sys_openat+0x53/frame 0xc84b6c18 syscall(c84b6ce8) at syscall+0x3bf/frame 0xc84b6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84b6cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe464, ebp = 0xbfbfe488 --- Tracing command mmap pid 25498 tid 100348 td 0xcd129000 sched_switch(cd129000,0,104,196,c84b3284,...) at sched_switch+0x4e1/frame 0xc84b324c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84b3284 sleepq_switch(cd129000,0,c15cc34d,1c2,c84b3324,...) at sleepq_switch+0xf0/frame 0xc84b32b8 sleepq_catch_signals(0,c00402e5,12,cc1fe810,78,...) at sleepq_catch_signals+0x443/frame 0xc84b32fc sleepq_timedwait_sig(cc1e2800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84b3324 _sleep(cc1e2800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84b3380 clnt_vc_call(c96a30c0,c84b3540,3,ca2b7300,c84b3610,...) at clnt_vc_call+0x715/frame 0xc84b3458 clnt_reconnect_call(c96a30e0,c84b3540,3,ca2b7300,c84b3610,...) at clnt_reconnect_call+0xcc/frame 0xc84b34c0 newnfs_request(c84b3610,c905d400,0,c905d510,cc0b9000,cd129000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84b3588 nfscl_request(c84b3610,cc0b9000,cd129000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84b35d0 nfsrpc_lookup(cc0b9000,cb6a2c00,c,ca10e600,cd129000,...) at nfsrpc_lookup+0x211/frame 0xc84b36c8 nfs_lookup(c84b3958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xc84b38e8 VOP_LOOKUP_APV(c185ccbc,c84b3958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84b3918 lookup(c84b3b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xc84b3980 namei(c84b3b48,c239ad20,c9807fa8,c9807fa8,c84b3a44,...) at namei+0x58c/frame 0xc84b3a08 vn_open_cred(c84b3b48,c84b3bcc,180,0,ca10e600,c9807348) at vn_open_cred+0xbc/frame 0xc84b3ad8 vn_open(c84b3b48,c84b3bcc,180,c9807348,bfbfe520,...) at vn_open+0x3d/frame 0xc84b3b00 kern_openat(cd129000,ffffff9c,bfbfe520,0,602,180) at kern_openat+0x345/frame 0xc84b3bf0 sys_openat(cd129000,c84b3ca8,c15bd083,4,c84b3c3c,...) at sys_openat+0x53/frame 0xc84b3c18 syscall(c84b3ce8) at syscall+0x3bf/frame 0xc84b3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84b3cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe464, ebp = 0xbfbfe488 --- Tracing command mmap pid 25497 tid 100347 td 0xcc1ea9f0 sched_switch(cc1ea9f0,0,104,196,c84b0764,...) at sched_switch+0x4e1/frame 0xc84b072c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84b0764 sleepq_switch(cc1ea9f0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xc84b0798 sleepq_catch_signals(c15cc34d,170,cac300d0,27,cc1ea9f0,...) at sleepq_catch_signals+0x443/frame 0xc84b07dc sleepq_wait_sig(cac3010c,5d,c15d566f,100,0,...) at sleepq_wait_sig+0x14/frame 0xc84b0800 _sleep(cac3010c,cac300c0,15d,c15d566f,0,...) at _sleep+0x33f/frame 0xc84b085c bufobj_wwait(cac300c0,100,0,0,0,...) at bufobj_wwait+0xb0/frame 0xc84b089c ncl_flush(cac30000,1,c15ac2fb,cc1ea9f0,0,...) at ncl_flush+0xa33/frame 0xc84b0970 nfs_close(c84b0a90,c17beb74,80400,c15d9f18,1ba,...) at nfs_close+0x1c3/frame 0xc84b0a40 VOP_CLOSE_APV(c185ccbc,c84b0a90,c15d9f18,1ba,c0cb3b27,...) at VOP_CLOSE_APV+0xf9/frame 0xc84b0a70 vn_close(cac30000,3,ca10e600,cc1ea9f0,246,...) at vn_close+0xf2/frame 0xc84b0ab8 vn_closefile(c9807508,cc1ea9f0,cc213718,0,c9807508,...) at vn_closefile+0x4f/frame 0xc84b0b1c _fdrop(c9807508,cc1ea9f0,246,cc1ea9f0,c1870774,...) at _fdrop+0x21/frame 0xc84b0b38 closef(c9807508,cc1ea9f0,4a6,48b,cc2136f0,...) at closef+0x21e/frame 0xc84b0ba0 closefp(c9807508,cc1ea9f0,1,cf,cc2137e8,...) at closefp+0xac/frame 0xc84b0bd4 kern_close(cc1ea9f0,4) at kern_close+0x120/frame 0xc84b0c08 sys_close(cc1ea9f0,c84b0ca8,c15bd083,4,db,...) at sys_close+0x1a/frame 0xc84b0c18 syscall(c84b0ce8) at syscall+0x3bf/frame 0xc84b0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84b0cdc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x281d5b03, esp = 0xbfbfe47c, ebp = 0xbfbfe488 --- Tracing command mmap pid 25496 tid 100346 td 0xcc1ea6a0 sched_switch(cc1ea6a0,0,104,196,c84ad4ac,...) at sched_switch+0x4e1/frame 0xc84ad474 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84ad4ac sleepq_switch(cc1ea6a0,0,c15cc34d,1c2,c84ad54c,...) at sleepq_switch+0xf0/frame 0xc84ad4e0 sleepq_catch_signals(1,c00402e5,12,cc1fe810,234,...) at sleepq_catch_signals+0x443/frame 0xc84ad524 sleepq_timedwait_sig(c975bc00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84ad54c _sleep(c975bc00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84ad5a8 clnt_vc_call(c96a30c0,c84ad768,1,cb532800,c84ad830,...) at clnt_vc_call+0x715/frame 0xc84ad680 clnt_reconnect_call(c96a30e0,c84ad768,1,cb532800,c84ad830,...) at clnt_reconnect_call+0xcc/frame 0xc84ad6e8 newnfs_request(c84ad830,c905d400,0,c905d510,cbaf45a0,cc1ea6a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84ad7b0 nfscl_request(c84ad830,cbaf45a0,cc1ea6a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84ad7f8 nfsrpc_getattr(cbaf45a0,ca10e600,cc1ea6a0,c84ad978,0,...) at nfsrpc_getattr+0xb6/frame 0xc84ad8e8 nfs_getattr(c84adaf0,c17bec67,c18afd34,cbaf45a0,1,...) at nfs_getattr+0x22d/frame 0xc84ada18 VOP_GETATTR_APV(c185ccbc,c84adaf0,5000,c84adac0,c0f6f390,...) at VOP_GETATTR_APV+0xf9/frame 0xc84ada48 vm_mmap_vnode(cc1ea6a0,5000,3,c84adb63,c84adb78,...) at vm_mmap_vnode+0x156/frame 0xc84adb18 vn_mmap(c977a000,c9799938,c84adbfc,5000,3,...) at vn_mmap+0xe2/frame 0xc84adb90 sys_mmap(cc1ea6a0,c84adca8,c15bd083,4,cd0660a8,...) at sys_mmap+0x4ab/frame 0xc84adc18 syscall(c84adce8) at syscall+0x3bf/frame 0xc84adcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84adcdc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x281c19a3, esp = 0xbfbfe48c, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25495 tid 100220 td 0xcc0806a0 sched_switch(cc0806a0,0,104,196,f3ab1284,...) at sched_switch+0x4e1/frame 0xf3ab124c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3ab1284 sleepq_switch(cc0806a0,0,c15cc34d,1c2,f3ab1324,...) at sleepq_switch+0xf0/frame 0xf3ab12b8 sleepq_catch_signals(1,c00402e5,12,cc1fe810,162,...) at sleepq_catch_signals+0x443/frame 0xf3ab12fc sleepq_timedwait_sig(c9f77600,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3ab1324 _sleep(c9f77600,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3ab1380 clnt_vc_call(c96a30c0,f3ab1540,3,ca90e100,f3ab1610,...) at clnt_vc_call+0x715/frame 0xf3ab1458 clnt_reconnect_call(c96a30e0,f3ab1540,3,ca90e100,f3ab1610,...) at clnt_reconnect_call+0xcc/frame 0xf3ab14c0 newnfs_request(f3ab1610,c905d400,0,c905d510,ca0f09d8,cc0806a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3ab1588 nfscl_request(f3ab1610,ca0f09d8,cc0806a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3ab15d0 nfsrpc_lookup(ca0f09d8,c9f04400,c,ca10e600,cc0806a0,...) at nfsrpc_lookup+0x211/frame 0xf3ab16c8 nfs_lookup(f3ab1958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xf3ab18e8 VOP_LOOKUP_APV(c185ccbc,f3ab1958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3ab1918 lookup(f3ab1b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xf3ab1980 namei(f3ab1b48,c239ad20,c9807fa8,c9807fa8,f3ab1a44,...) at namei+0x58c/frame 0xf3ab1a08 vn_open_cred(f3ab1b48,f3ab1bcc,180,0,ca10e600,c98073f0) at vn_open_cred+0xbc/frame 0xf3ab1ad8 vn_open(f3ab1b48,f3ab1bcc,180,c98073f0,bfbfe520,...) at vn_open+0x3d/frame 0xf3ab1b00 kern_openat(cc0806a0,ffffff9c,bfbfe520,0,602,180) at kern_openat+0x345/frame 0xf3ab1bf0 sys_openat(cc0806a0,f3ab1ca8,c15bd083,4,f3ab1c3c,...) at sys_openat+0x53/frame 0xf3ab1c18 syscall(f3ab1ce8) at syscall+0x3bf/frame 0xf3ab1cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ab1cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe464, ebp = 0xbfbfe488 --- Tracing command thr1 pid 25494 tid 100221 td 0xcc080350 sched_switch(cc080350,0,104,196,f3ab47a0,...) at sched_switch+0x4e1/frame 0xf3ab4768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3ab47a0 sleepq_switch(cc080350,0,c15cc34d,28b,cc080350,...) at sleepq_switch+0xf0/frame 0xf3ab47d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3ab47f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3ab4854 vm_waitpfault(c9e4f8c0,1f,0,f3ab490c,f3ab48fc,...) at vm_waitpfault+0x99/frame 0xf3ab4880 vm_fault_hold(c979984c,b94d6000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3ab4940 vm_fault(c979984c,b94d6000,2,0,101,...) at vm_fault+0x88/frame 0xf3ab4968 trap_pfault(b94d6ff0,101,c1ad563c,c1ad5640,ffffffff,...) at trap_pfault+0x116/frame 0xf3ab49b0 trap(f3ab4afc) at trap+0x2d5/frame 0xf3ab4af0 calltrap() at calltrap+0x6/frame 0xf3ab4af0 --- trap 0xc, eip = 0xc11debcd, esp = 0xf3ab4b3c, ebp = 0xf3ab4b58 --- suword32(ccf41350,28093e00,2863f800,f3ab4b70,b93d7000,...) at suword32+0x21/frame 0xf3ab4b58 thr_new_initthr(ccf41350,f3ab4bd0,2c,cc0ca738,cc080350,...) at thr_new_initthr+0x7e/frame 0xf3ab4b8c thread_create(cc080350,0,c0c60e30,f3ab4bd0,28093e00,...) at thread_create+0x19a/frame 0xf3ab4bb8 sys_thr_new(cc080350,f3ab4ca8,c15bd083,4,14,...) at sys_thr_new+0x8d/frame 0xf3ab4c18 syscall(f3ab4ce8) at syscall+0x3bf/frame 0xf3ab4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ab4cdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command thr1 pid 25493 tid 100234 td 0xcc080000 sched_switch(cc080000,0,104,196,f3adb7a0,...) at sched_switch+0x4e1/frame 0xf3adb768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3adb7a0 sleepq_switch(cc080000,0,c15cc34d,28b,cc080000,...) at sleepq_switch+0xf0/frame 0xf3adb7d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3adb7f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3adb854 vm_waitpfault(cc3920a0,1f,0,f3adb90c,f3adb8fc,...) at vm_waitpfault+0x99/frame 0xf3adb880 vm_fault_hold(c9799760,b5a9c000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3adb940 vm_fault(c9799760,b5a9c000,2,0,101,...) at vm_fault+0x88/frame 0xf3adb968 trap_pfault(b5a9cff0,101,c1ad542c,c1ad5430,ffffffff,...) at trap_pfault+0x116/frame 0xf3adb9b0 trap(f3adbafc) at trap+0x2d5/frame 0xf3adbaf0 calltrap() at calltrap+0x6/frame 0xf3adbaf0 --- trap 0xc, eip = 0xc11debcd, esp = 0xf3adbb3c, ebp = 0xf3adbb58 --- suword32(ccf41000,28093e00,2864a600,f3adbb70,b599d000,...) at suword32+0x21/frame 0xf3adbb58 thr_new_initthr(ccf41000,f3adbbd0,2c,82b,cc080000,...) at thr_new_initthr+0x7e/frame 0xf3adbb8c thread_create(cc080000,0,c0c60e30,f3adbbd0,28093e00,...) at thread_create+0x19a/frame 0xf3adbbb8 sys_thr_new(cc080000,f3adbca8,c15bd083,4,f3adbc3c,...) at sys_thr_new+0x8d/frame 0xf3adbc18 syscall(f3adbce8) at syscall+0x3bf/frame 0xf3adbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3adbcdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command thr1 pid 25492 tid 100235 td 0xcc07f9f0 sched_switch(cc07f9f0,0,104,196,f3ade7a0,...) at sched_switch+0x4e1/frame 0xf3ade768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3ade7a0 sleepq_switch(cc07f9f0,0,c15cc34d,28b,cc07f9f0,...) at sleepq_switch+0xf0/frame 0xf3ade7d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3ade7f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3ade854 vm_waitpfault(c9fec140,1f,0,f3ade90c,f3ade8fc,...) at vm_waitpfault+0x99/frame 0xf3ade880 vm_fault_hold(c9799588,adb1d000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3ade940 vm_fault(c9799588,adb1d000,2,0,101,...) at vm_fault+0x88/frame 0xf3ade968 trap_pfault(adb1dff0,101,c1ad7214,c1ad7218,ffffffff,...) at trap_pfault+0x116/frame 0xf3ade9b0 trap(f3adeafc) at trap+0x2d5/frame 0xf3adeaf0 calltrap() at calltrap+0x6/frame 0xf3adeaf0 --- trap 0xc, eip = 0xc11debcd, esp = 0xf3adeb3c, ebp = 0xf3adeb58 --- suword32(ccf419f0,28093e00,28664300,f3adeb70,ada1e000,...) at suword32+0x21/frame 0xf3adeb58 thr_new_initthr(ccf419f0,f3adebd0,2c,82b,cc07f9f0,...) at thr_new_initthr+0x7e/frame 0xf3adeb8c thread_create(cc07f9f0,0,c0c60e30,f3adebd0,28093e00,...) at thread_create+0x19a/frame 0xf3adebb8 sys_thr_new(cc07f9f0,f3adeca8,c15bd083,4,cc0ca0a8,...) at sys_thr_new+0x8d/frame 0xf3adec18 syscall(f3adece8) at syscall+0x3bf/frame 0xf3adecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3adecdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command thr1 pid 25491 tid 100336 td 0xcd12a350 sched_switch(cd12a350,0,104,196,c848f990,...) at sched_switch+0x4e1/frame 0xc848f958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc848f990 sleepq_switch(cd12a350,0,c15cc34d,28b,cd12a350,...) at sleepq_switch+0xf0/frame 0xc848f9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc848f9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc848fa44 vm_waitpfault(cb1b36e0,441,0,c848fad0,c848fad4,...) at vm_waitpfault+0x99/frame 0xc848fa70 vm_fault_hold(c97993b0,28654000,1,0,0,...) at vm_fault_hold+0xd86/frame 0xc848fb30 vm_fault(c97993b0,28654000,1,0,7d,...) at vm_fault+0x88/frame 0xc848fb58 trap_pfault(28654000,c848fce8,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc848fba0 trap(c848fce8) at trap+0x3ec/frame 0xc848fcdc calltrap() at calltrap+0x6/frame 0xc848fcdc --- trap 0xc, eip = 0x2815c140, esp = 0xbfbfdefc, ebp = 0xbfbfdf34 --- Tracing command thr1 pid 25490 tid 100337 td 0xcd12a000 sched_switch(cd12a000,0,104,196,c8492990,...) at sched_switch+0x4e1/frame 0xc8492958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc8492990 sleepq_switch(cd12a000,0,c15cc34d,28b,cd12a000,...) at sleepq_switch+0xf0/frame 0xc84929c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84929e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8492a44 vm_waitpfault(cb1b36e0,431,0,c8492ad0,c8492ad4,...) at vm_waitpfault+0x99/frame 0xc8492a70 vm_fault_hold(c97992c4,28644000,1,0,0,...) at vm_fault_hold+0xd86/frame 0xc8492b30 vm_fault(c97992c4,28644000,1,0,c1a9b780,...) at vm_fault+0x88/frame 0xc8492b58 trap_pfault(28644000,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xc8492ba0 trap(c8492ce8) at trap+0x3ec/frame 0xc8492cdc calltrap() at calltrap+0x6/frame 0xc8492cdc --- trap 0xc, eip = 0x2815c140, esp = 0xbfbfdefc, ebp = 0xbfbfdf34 --- Tracing command thr1 pid 25489 tid 100338 td 0xcd1299f0 sched_switch(cd1299f0,0,104,196,c84957a0,...) at sched_switch+0x4e1/frame 0xc8495768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84957a0 sleepq_switch(cd1299f0,0,c15cc34d,28b,cd1299f0,...) at sleepq_switch+0xf0/frame 0xc84957d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84957f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc8495854 vm_waitpfault(c9fec780,1f,0,c849590c,c84958fc,...) at vm_waitpfault+0x99/frame 0xc8495880 vm_fault_hold(c97991d8,b89cb000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc8495940 vm_fault(c97991d8,b89cb000,2,0,101,...) at vm_fault+0x88/frame 0xc8495968 trap_pfault(b89cbff0,101,c1ad5484,c1ad5488,ffffffff,...) at trap_pfault+0x116/frame 0xc84959b0 trap(c8495afc) at trap+0x2d5/frame 0xc8495af0 calltrap() at calltrap+0x6/frame 0xc8495af0 --- trap 0xc, eip = 0xc11debcd, esp = 0xc8495b3c, ebp = 0xc8495b58 --- suword32(ca7d16a0,28093e00,28641900,c8495b70,b88cc000,...) at suword32+0x21/frame 0xc8495b58 thr_new_initthr(ca7d16a0,c8495bd0,2c,82b,cd1299f0,...) at thr_new_initthr+0x7e/frame 0xc8495b8c thread_create(cd1299f0,0,c0c60e30,c8495bd0,28093e00,...) at thread_create+0x19a/frame 0xc8495bb8 sys_thr_new(cd1299f0,c8495ca8,c15bd083,4,12a,...) at sys_thr_new+0x8d/frame 0xc8495c18 syscall(c8495ce8) at syscall+0x3bf/frame 0xc8495cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8495cdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command thr1 pid 25488 tid 100345 td 0xcce88350 sched_switch(cce88350,0,104,196,c84aa7a0,...) at sched_switch+0x4e1/frame 0xc84aa768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84aa7a0 sleepq_switch(cce88350,0,c15cc34d,28b,cce88350,...) at sleepq_switch+0xf0/frame 0xc84aa7d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84aa7f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc84aa854 vm_waitpfault(cc329000,1f,0,c84aa90c,c84aa8fc,...) at vm_waitpfault+0x99/frame 0xc84aa880 vm_fault_hold(cc084ce8,b4587000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc84aa940 vm_fault(cc084ce8,b4587000,2,0,101,...) at vm_fault+0x88/frame 0xc84aa968 trap_pfault(b4587ff0,101,c1ad71bc,c1ad71c0,ffffffff,...) at trap_pfault+0x116/frame 0xc84aa9b0 trap(c84aaafc) at trap+0x2d5/frame 0xc84aaaf0 calltrap() at calltrap+0x6/frame 0xc84aaaf0 --- trap 0xc, eip = 0xc11debcd, esp = 0xc84aab3c, ebp = 0xc84aab58 --- suword32(ca7d1000,28093e00,2864f500,c84aab70,b4488000,...) at suword32+0x21/frame 0xc84aab58 thr_new_initthr(ca7d1000,c84aabd0,2c,cd12d0a8,cce88350,...) at thr_new_initthr+0x7e/frame 0xc84aab8c thread_create(cce88350,0,c0c60e30,c84aabd0,28093e00,...) at thread_create+0x19a/frame 0xc84aabb8 sys_thr_new(cce88350,c84aaca8,c15bd083,4,cd12d0a8,...) at sys_thr_new+0x8d/frame 0xc84aac18 syscall(c84aace8) at syscall+0x3bf/frame 0xc84aacdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84aacdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command thr1 pid 25487 tid 100344 td 0xcce88000 sched_switch(cce88000,0,104,196,c84a77a0,...) at sched_switch+0x4e1/frame 0xc84a7768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84a77a0 sleepq_switch(cce88000,0,c15cc34d,28b,cce88000,...) at sleepq_switch+0xf0/frame 0xc84a77d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc84a77f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc84a7854 vm_waitpfault(cbae9a00,1f,0,c84a790c,c84a78fc,...) at vm_waitpfault+0x99/frame 0xc84a7880 vm_fault_hold(cc084bfc,b3b7d000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc84a7940 vm_fault(cc084bfc,b3b7d000,2,0,101,...) at vm_fault+0x88/frame 0xc84a7968 trap_pfault(b3b7dff0,101,e2426fa8,c23b7e00,1,...) at trap_pfault+0x116/frame 0xc84a79b0 trap(c84a7afc) at trap+0x2d5/frame 0xc84a7af0 calltrap() at calltrap+0x6/frame 0xc84a7af0 --- trap 0xc, eip = 0xc11debcd, esp = 0xc84a7b3c, ebp = 0xc84a7b58 --- suword32(ccf416a0,28093e00,28651300,c84a7b70,b3a7e000,...) at suword32+0x21/frame 0xc84a7b58 thr_new_initthr(ccf416a0,c84a7bd0,2c,82b,cce88000,...) at thr_new_initthr+0x7e/frame 0xc84a7b8c thread_create(cce88000,0,c0c60e30,c84a7bd0,28093e00,...) at thread_create+0x19a/frame 0xc84a7bb8 sys_thr_new(cce88000,c84a7ca8,c15bd083,4,c84a7c3c,...) at sys_thr_new+0x8d/frame 0xc84a7c18 syscall(c84a7ce8) at syscall+0x3bf/frame 0xc84a7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84a7cdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command thr1 pid 25486 tid 100325 td 0xcce89000 sched_switch(cce89000,0,104,196,c846e7a0,...) at sched_switch+0x4e1/frame 0xc846e768 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc846e7a0 sleepq_switch(cce89000,0,c15cc34d,28b,cce89000,...) at sleepq_switch+0xf0/frame 0xc846e7d4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xc846e7f8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xc846e854 vm_waitpfault(c9fec640,1f,0,c846e90c,c846e8fc,...) at vm_waitpfault+0x99/frame 0xc846e880 vm_fault_hold(cc084b10,b0547000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xc846e940 vm_fault(cc084b10,b0547000,2,0,101,...) at vm_fault+0x88/frame 0xc846e968 trap_pfault(b0547ff0,101,c1ad54dc,c1ad54e0,ffffffff,...) at trap_pfault+0x116/frame 0xc846e9b0 trap(c846eafc) at trap+0x2d5/frame 0xc846eaf0 calltrap() at calltrap+0x6/frame 0xc846eaf0 --- trap 0xc, eip = 0xc11debcd, esp = 0xc846eb3c, ebp = 0xc846eb58 --- suword32(ca7d1350,28093e00,2865b500,c846eb70,b0448000,...) at suword32+0x21/frame 0xc846eb58 thr_new_initthr(ca7d1350,c846ebd0,2c,82b,cce89000,...) at thr_new_initthr+0x7e/frame 0xc846eb8c thread_create(cce89000,0,c0c60e30,c846ebd0,28093e00,...) at thread_create+0x19a/frame 0xc846ebb8 sys_thr_new(cce89000,c846eca8,c15bd083,4,14,...) at sys_thr_new+0x8d/frame 0xc846ec18 syscall(c846ece8) at syscall+0x3bf/frame 0xc846ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc846ecdc --- syscall (455, FreeBSD ELF32, sys_thr_new), eip = 0x280e6d2f, esp = 0xbfbfe0ec, ebp = 0xbfbfe194 --- Tracing command pty pid 25485 tid 100326 td 0xcce889f0 sched_switch(cce889f0,0,104,196,c84717b0,...) at sched_switch+0x4e1/frame 0xc8471778 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84717b0 sleepq_switch(cce889f0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xc84717e4 sleepq_wait(c96411d4,0,c15a9be9,3,0,...) at sleepq_wait+0x48/frame 0xc8471808 _sx_xlock_hard(c96411d4,cce889f0,0,c15a9c18,1be,...) at _sx_xlock_hard+0x4c4/frame 0xc8471890 _sx_xlock(c96411d4,0,c15a9c18,1be,80500,...) at _sx_xlock+0xe2/frame 0xc84718c0 devfs_allocv(c9654300,c96485d8,80000,c847190c,c96f8b40,...) at devfs_allocv+0x10e/frame 0xc84718f4 devfs_root(c96485d8,202000,c8471954,20a,c1870774,...) at devfs_root+0x52/frame 0xc8471918 lookup(c8471b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xc8471980 namei(c8471b48,c239ad20,c977afa8,c977afa8,c8471a44,...) at namei+0x58c/frame 0xc8471a08 vn_open_cred(c8471b48,c8471bcc,0,0,ca10e600,c977a888) at vn_open_cred+0x1fd/frame 0xc8471ad8 vn_open(c8471b48,c8471bcc,0,c977a888,281ec4ec,...) at vn_open+0x3d/frame 0xc8471b00 kern_openat(cce889f0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xc8471bf0 sys_openat(cce889f0,c8471ca8,c15bd083,4,cd10a3f0,...) at sys_openat+0x53/frame 0xc8471c18 syscall(c8471ce8) at syscall+0x3bf/frame 0xc8471cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8471cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25484 tid 100327 td 0xcce886a0 sched_switch(cce886a0,0,104,196,c84746d0,...) at sched_switch+0x4e1/frame 0xc8474698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc84746d0 sleepq_switch(cce886a0,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xc8474704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xc8474728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xc8474770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xc84747e8 vop_stdlock(c8474860,8ebbed4b,5c0,384,0,...) at vop_stdlock+0x53/frame 0xc8474818 VOP_LOCK1_APV(c185b66c,c8474860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xc8474848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xc8474888 vget(c96572d0,80500,cce886a0,1bb,80500,...) at vget+0x8e/frame 0xc84748c0 devfs_allocv(c9654300,c96485d8,80000,c847490c,c96f8b40,...) at devfs_allocv+0xee/frame 0xc84748f4 devfs_root(c96485d8,202000,c8474954,20a,c1870774,...) at devfs_root+0x52/frame 0xc8474918 lookup(c8474b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xc8474980 namei(c8474b48,c239ad20,c9807fa8,c9807fa8,c8474a44,...) at namei+0x58c/frame 0xc8474a08 vn_open_cred(c8474b48,c8474bcc,0,0,ca10e600,c98070e0) at vn_open_cred+0x1fd/frame 0xc8474ad8 vn_open(c8474b48,c8474bcc,0,c98070e0,281ec4ec,...) at vn_open+0x3d/frame 0xc8474b00 kern_openat(cce886a0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xc8474bf0 sys_openat(cce886a0,c8474ca8,c15bd083,4,cd10a0a8,...) at sys_openat+0x53/frame 0xc8474c18 syscall(c8474ce8) at syscall+0x3bf/frame 0xc8474cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8474cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25483 tid 100262 td 0xcce8a000 sched_switch(cce8a000,0,104,196,f3b526d0,...) at sched_switch+0x4e1/frame 0xf3b52698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3b526d0 sleepq_switch(cce8a000,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf3b52704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf3b52728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf3b52770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xf3b527e8 vop_stdlock(f3b52860,935d47d3,5c0,3e8,0,...) at vop_stdlock+0x53/frame 0xf3b52818 VOP_LOCK1_APV(c185b66c,f3b52860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf3b52848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xf3b52888 vget(c96572d0,80500,cce8a000,1bb,80500,...) at vget+0x8e/frame 0xf3b528c0 devfs_allocv(c9654300,c96485d8,80000,f3b5290c,c96f8b40,...) at devfs_allocv+0xee/frame 0xf3b528f4 devfs_root(c96485d8,202000,f3b52954,20a,c1870774,...) at devfs_root+0x52/frame 0xf3b52918 lookup(f3b52b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3b52980 namei(f3b52b48,c239ad20,c9807fa8,c9807fa8,f3b52a44,...) at namei+0x58c/frame 0xf3b52a08 vn_open_cred(f3b52b48,f3b52bcc,0,0,ca10e600,c98071c0) at vn_open_cred+0x1fd/frame 0xf3b52ad8 vn_open(f3b52b48,f3b52bcc,0,c98071c0,281ec4ec,...) at vn_open+0x3d/frame 0xf3b52b00 kern_openat(cce8a000,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3b52bf0 sys_openat(cce8a000,f3b52ca8,c15bd083,4,cc9a4738,...) at sys_openat+0x53/frame 0xf3b52c18 syscall(f3b52ce8) at syscall+0x3bf/frame 0xf3b52cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b52cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25482 tid 100263 td 0xcce899f0 sched_switch(cce899f0,0,104,196,f3b556d0,...) at sched_switch+0x4e1/frame 0xf3b55698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3b556d0 sleepq_switch(cce899f0,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf3b55704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf3b55728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf3b55770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xf3b557e8 vop_stdlock(f3b55860,9321f32b,5c0,3e8,0,...) at vop_stdlock+0x53/frame 0xf3b55818 VOP_LOCK1_APV(c185b66c,f3b55860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf3b55848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xf3b55888 vget(c96572d0,80500,cce899f0,1bb,80500,...) at vget+0x8e/frame 0xf3b558c0 devfs_allocv(c9654300,c96485d8,80000,f3b5590c,c96f8b40,...) at devfs_allocv+0xee/frame 0xf3b558f4 devfs_root(c96485d8,202000,f3b55954,20a,c1870774,...) at devfs_root+0x52/frame 0xf3b55918 lookup(f3b55b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3b55980 namei(f3b55b48,c239ad20,c977afa8,c977afa8,f3b55a44,...) at namei+0x58c/frame 0xf3b55a08 vn_open_cred(f3b55b48,f3b55bcc,0,0,ca10e600,c977a5b0) at vn_open_cred+0x1fd/frame 0xf3b55ad8 vn_open(f3b55b48,f3b55bcc,0,c977a5b0,281ec4ec,...) at vn_open+0x3d/frame 0xf3b55b00 kern_openat(cce899f0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3b55bf0 sys_openat(cce899f0,f3b55ca8,c15bd083,4,cc9a43f0,...) at sys_openat+0x53/frame 0xf3b55c18 syscall(f3b55ce8) at syscall+0x3bf/frame 0xf3b55cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b55cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25481 tid 100264 td 0xcce896a0 sched_switch(cce896a0,0,104,196,f3b58514,...) at sched_switch+0x4e1/frame 0xf3b584dc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3b58514 sleepq_switch(cce896a0,0,c15cc34d,28b,cce896a0,...) at sleepq_switch+0xf0/frame 0xf3b58548 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xf3b5856c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xf3b585c8 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xf3b585f4 kmem_back(c1b69a78,ca014000,1000,102,ca014000,...) at kmem_back+0xe5/frame 0xf3b58634 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xf3b5865c page_alloc(c900d1e0,1000,f3b5869b,102,102,...) at page_alloc+0x28/frame 0xf3b58670 keg_alloc_slab(2,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xf3b586ac keg_fetch_slab(2,0,c160f53b,943,c900d1e0,...) at keg_fetch_slab+0x1af/frame 0xf3b586f4 zone_fetch_slab(c900d1e0,0,2,246,246,...) at zone_fetch_slab+0x5d/frame 0xf3b58718 zone_import(c900d1e0,f3b58778,1,2,0,...) at zone_import+0x37/frame 0xf3b58760 zone_alloc_item(2,0,c160f552,c15d8f98,1,...) at zone_alloc_item+0x39/frame 0xf3b58790 uma_zalloc_arg(c900d1e0,0,2,561,cce896a0,...) at uma_zalloc_arg+0x687/frame 0xf3b587c4 getnewvnode(c15be3a8,c96485d8,c185b66c,f3b58810,c0b135ed,...) at getnewvnode+0x195/frame 0xf3b587ec devfs_allocv(cb267780,c96485d8,80000,f3b58b90,0,...) at devfs_allocv+0x271/frame 0xf3b58820 devfs_lookup(f3b58958,c17be989,c160688d,c15d772f,c18aba14,...) at devfs_lookup+0x6f3/frame 0xf3b588e8 VOP_LOOKUP_APV(c185b66c,f3b58958,f3b58ba4,325,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3b58918 lookup(f3b58b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xf3b58980 namei(f3b58b48,c239ad20,c977afa8,c977afa8,f3b58a44,...) at namei+0x58c/frame 0xf3b58a08 vn_open_cred(f3b58b48,f3b58bcc,0,0,ca10e600,c977a3b8) at vn_open_cred+0x1fd/frame 0xf3b58ad8 vn_open(f3b58b48,f3b58bcc,0,c977a3b8,281ec4ec,...) at vn_open+0x3d/frame 0xf3b58b00 kern_openat(cce896a0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3b58bf0 sys_openat(cce896a0,f3b58ca8,c15bd083,4,cc9a40a8,...) at sys_openat+0x53/frame 0xf3b58c18 syscall(f3b58ce8) at syscall+0x3bf/frame 0xf3b58cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b58cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25480 tid 100194 td 0xca144000 sched_switch(ca144000,0,104,196,f39b16d0,...) at sched_switch+0x4e1/frame 0xf39b1698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf39b16d0 sleepq_switch(ca144000,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf39b1704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf39b1728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf39b1770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xf39b17e8 vop_stdlock(f39b1860,9321fcd4,5c0,3e8,0,...) at vop_stdlock+0x53/frame 0xf39b1818 VOP_LOCK1_APV(c185b66c,f39b1860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf39b1848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xf39b1888 vget(c96572d0,80500,ca144000,1bb,80500,...) at vget+0x8e/frame 0xf39b18c0 devfs_allocv(c9654300,c96485d8,80000,f39b190c,c96f8b40,...) at devfs_allocv+0xee/frame 0xf39b18f4 devfs_root(c96485d8,202000,f39b1954,20a,c1870774,...) at devfs_root+0x52/frame 0xf39b1918 lookup(f39b1b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf39b1980 namei(f39b1b48,c239ad20,c977afa8,c977afa8,f39b1a44,...) at namei+0x58c/frame 0xf39b1a08 vn_open_cred(f39b1b48,f39b1bcc,0,0,ca10e600,c977a5e8) at vn_open_cred+0x1fd/frame 0xf39b1ad8 vn_open(f39b1b48,f39b1bcc,0,c977a5e8,281ec4ec,...) at vn_open+0x3d/frame 0xf39b1b00 kern_openat(ca144000,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf39b1bf0 sys_openat(ca144000,f39b1ca8,c15bd083,4,f39b1c3c,...) at sys_openat+0x53/frame 0xf39b1c18 syscall(f39b1ce8) at syscall+0x3bf/frame 0xf39b1cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf39b1cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25479 tid 100210 td 0xc9be7000 sched_switch(c9be7000,0,104,196,f3a93628,...) at sched_switch+0x4e1/frame 0xf3a935f0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a93628 sleepq_switch(c9be7000,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf3a9365c sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf3a93680 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf3a936c8 __lockmgr_args(c9657304,80400,c9657370,0,0,0,c15a9c18,f4) at __lockmgr_args+0x736/frame 0xf3a93740 vop_stdlock(f3a937b8,f3a937c0,0,0,246,...) at vop_stdlock+0x53/frame 0xf3a93770 VOP_LOCK1_APV(c185b66c,f3a937b8,c9be7000,f3a937e0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf3a937a0 _vn_lock(c96572d0,80400,c15a9c18,f4,21b,...) at _vn_lock+0xba/frame 0xf3a937e0 devfs_populate_vp(c0d09d48,c91938a4,f3a93860,c12106f1,0,...) at devfs_populate_vp+0xdc/frame 0xf3a93820 devfs_lookup(f3a93958,c17be989,c160688d,c15d772f,c18aba14,...) at devfs_lookup+0x26/frame 0xf3a938e8 VOP_LOOKUP_APV(c185b66c,f3a93958,f3a93ba4,325,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3a93918 lookup(f3a93b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xf3a93980 namei(f3a93b48,c239ad20,c977afa8,c977afa8,f3a93a44,...) at namei+0x58c/frame 0xf3a93a08 vn_open_cred(f3a93b48,f3a93bcc,0,0,ca10e600,c977a1c0) at vn_open_cred+0x1fd/frame 0xf3a93ad8 vn_open(f3a93b48,f3a93bcc,0,c977a1c0,281ec4ec,...) at vn_open+0x3d/frame 0xf3a93b00 kern_openat(c9be7000,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3a93bf0 sys_openat(c9be7000,f3a93ca8,c15bd083,4,c9fc23f0,...) at sys_openat+0x53/frame 0xf3a93c18 syscall(f3a93ce8) at syscall+0x3bf/frame 0xf3a93cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a93cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25478 tid 100211 td 0xc97ee9f0 sched_switch(c97ee9f0,0,104,196,f3a967e8,...) at sched_switch+0x4e1/frame 0xf3a967b0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a967e8 sleepq_switch(c97ee9f0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xf3a9681c sleepq_wait(c96411d4,0,c15a9be9,3,0,...) at sleepq_wait+0x48/frame 0xf3a96840 _sx_xlock_hard(c96411d4,c97ee9f0,0,c15a9bc8,d7,...) at _sx_xlock_hard+0x4c4/frame 0xf3a968c4 _sx_xlock(c96411d4,0,c15a9bc8,d7,c96f8b40,...) at _sx_xlock+0xe2/frame 0xf3a968f4 devfs_root(c96485d8,202000,f3a96954,20a,c1870774,...) at devfs_root+0x34/frame 0xf3a96918 lookup(f3a96b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3a96980 namei(f3a96b48,c239ad20,c9807fa8,c9807fa8,f3a96a44,...) at namei+0x58c/frame 0xf3a96a08 vn_open_cred(f3a96b48,f3a96bcc,0,0,ca10e600,c9807188) at vn_open_cred+0x1fd/frame 0xf3a96ad8 vn_open(f3a96b48,f3a96bcc,0,c9807188,281ec4ec,...) at vn_open+0x3d/frame 0xf3a96b00 kern_openat(c97ee9f0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3a96bf0 sys_openat(c97ee9f0,f3a96ca8,c15bd083,4,c9fc20a8,...) at sys_openat+0x53/frame 0xf3a96c18 syscall(f3a96ce8) at syscall+0x3bf/frame 0xf3a96cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a96cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25477 tid 100212 td 0xc97ee6a0 sched_switch(c97ee6a0,0,104,196,f3a996d0,...) at sched_switch+0x4e1/frame 0xf3a99698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a996d0 sleepq_switch(c97ee6a0,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf3a99704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf3a99728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf3a99770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xf3a997e8 vop_stdlock(f3a99860,f3a99830,c0d09d48,c96f8cdc,f3a99860,...) at vop_stdlock+0x53/frame 0xf3a99818 VOP_LOCK1_APV(c185b66c,f3a99860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf3a99848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xf3a99888 vget(c96572d0,80500,c97ee6a0,1bb,80500,...) at vget+0x8e/frame 0xf3a998c0 devfs_allocv(c9654300,c96485d8,80000,f3a9990c,c96f8b40,...) at devfs_allocv+0xee/frame 0xf3a998f4 devfs_root(c96485d8,202000,f3a99954,20a,c1870774,...) at devfs_root+0x52/frame 0xf3a99918 lookup(f3a99b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3a99980 namei(f3a99b48,c239ad20,c9807fa8,c9807fa8,f3a99a44,...) at namei+0x58c/frame 0xf3a99a08 vn_open_cred(f3a99b48,f3a99bcc,0,0,ca10e600,c9807380) at vn_open_cred+0x1fd/frame 0xf3a99ad8 vn_open(f3a99b48,f3a99bcc,0,c9807380,281ec4ec,...) at vn_open+0x3d/frame 0xf3a99b00 kern_openat(c97ee6a0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3a99bf0 sys_openat(c97ee6a0,f3a99ca8,c15bd083,4,c97e3a80,...) at sys_openat+0x53/frame 0xf3a99c18 syscall(f3a99ce8) at syscall+0x3bf/frame 0xf3a99cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a99cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25476 tid 100213 td 0xcc0c46a0 sched_switch(cc0c46a0,0,104,196,f3a9c6d0,...) at sched_switch+0x4e1/frame 0xf3a9c698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a9c6d0 sleepq_switch(cc0c46a0,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf3a9c704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf3a9c728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf3a9c770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xf3a9c7e8 vop_stdlock(f3a9c860,935127ff,5c0,3e8,0,...) at vop_stdlock+0x53/frame 0xf3a9c818 VOP_LOCK1_APV(c185b66c,f3a9c860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf3a9c848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xf3a9c888 vget(c96572d0,80500,cc0c46a0,1bb,80500,...) at vget+0x8e/frame 0xf3a9c8c0 devfs_allocv(c9654300,c96485d8,80000,f3a9c90c,c96f8b40,...) at devfs_allocv+0xee/frame 0xf3a9c8f4 devfs_root(c96485d8,202000,f3a9c954,20a,c1870774,...) at devfs_root+0x52/frame 0xf3a9c918 lookup(f3a9cb48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3a9c980 namei(f3a9cb48,c239ad20,c977afa8,c977afa8,f3a9ca44,...) at namei+0x58c/frame 0xf3a9ca08 vn_open_cred(f3a9cb48,f3a9cbcc,0,0,ca10e600,c977ac08) at vn_open_cred+0x1fd/frame 0xf3a9cad8 vn_open(f3a9cb48,f3a9cbcc,0,c977ac08,281ec4ec,...) at vn_open+0x3d/frame 0xf3a9cb00 kern_openat(cc0c46a0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3a9cbf0 sys_openat(cc0c46a0,f3a9cca8,c15bd083,4,c97e3738,...) at sys_openat+0x53/frame 0xf3a9cc18 syscall(f3a9cce8) at syscall+0x3bf/frame 0xf3a9ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a9ccdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25475 tid 100214 td 0xcc0c4350 sched_switch(cc0c4350,0,104,196,f3a9f7e8,...) at sched_switch+0x4e1/frame 0xf3a9f7b0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a9f7e8 sleepq_switch(cc0c4350,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xf3a9f81c sleepq_wait(c96411d4,0,c15a9be9,3,0,...) at sleepq_wait+0x48/frame 0xf3a9f840 _sx_xlock_hard(c96411d4,cc0c4350,0,c15a9bc8,d7,...) at _sx_xlock_hard+0x4c4/frame 0xf3a9f8c4 _sx_xlock(c96411d4,0,c15a9bc8,d7,c96f8b40,...) at _sx_xlock+0xe2/frame 0xf3a9f8f4 devfs_root(c96485d8,202000,f3a9f954,20a,c1870774,...) at devfs_root+0x34/frame 0xf3a9f918 lookup(f3a9fb48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3a9f980 namei(f3a9fb48,c239ad20,c9807fa8,c9807fa8,f3a9fa44,...) at namei+0x58c/frame 0xf3a9fa08 vn_open_cred(f3a9fb48,f3a9fbcc,0,0,ca10e600,c9807230) at vn_open_cred+0x1fd/frame 0xf3a9fad8 vn_open(f3a9fb48,f3a9fbcc,0,c9807230,281ec4ec,...) at vn_open+0x3d/frame 0xf3a9fb00 kern_openat(cc0c4350,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3a9fbf0 sys_openat(cc0c4350,f3a9fca8,c15bd083,4,c97e33f0,...) at sys_openat+0x53/frame 0xf3a9fc18 syscall(f3a9fce8) at syscall+0x3bf/frame 0xf3a9fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a9fcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25474 tid 100274 td 0xcc0be000 sched_switch(cc0be000,0,104,196,f3b76628,...) at sched_switch+0x4e1/frame 0xf3b765f0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3b76628 sleepq_switch(cc0be000,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf3b7665c sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf3b76680 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf3b766c8 __lockmgr_args(c9657304,80400,c9657370,0,0,0,c15a9c18,f4) at __lockmgr_args+0x736/frame 0xf3b76740 vop_stdlock(f3b767b8,c0ca024d,c1aa9f84,0,c15cc34d,...) at vop_stdlock+0x53/frame 0xf3b76770 VOP_LOCK1_APV(c185b66c,f3b767b8,f3,f3b767e0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf3b767a0 _vn_lock(c96572d0,80400,c15a9c18,f4,21b,...) at _vn_lock+0xba/frame 0xf3b767e0 devfs_populate_vp(c0d09d48,c91938a4,f3b76860,c12106f1,0,...) at devfs_populate_vp+0xdc/frame 0xf3b76820 devfs_lookup(f3b76958,c17be989,c160688d,c15d772f,c18aba14,...) at devfs_lookup+0x26/frame 0xf3b768e8 VOP_LOOKUP_APV(c185b66c,f3b76958,f3b76ba4,325,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3b76918 lookup(f3b76b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xf3b76980 namei(f3b76b48,c239ad20,c9807fa8,c9807fa8,f3b76a44,...) at namei+0x58c/frame 0xf3b76a08 vn_open_cred(f3b76b48,f3b76bcc,0,0,ca10e600,c9807000) at vn_open_cred+0x1fd/frame 0xf3b76ad8 vn_open(f3b76b48,f3b76bcc,0,c9807000,281ec4ec,...) at vn_open+0x3d/frame 0xf3b76b00 kern_openat(cc0be000,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3b76bf0 sys_openat(cc0be000,f3b76ca8,c15bd083,4,ccf85a80,...) at sys_openat+0x53/frame 0xf3b76c18 syscall(f3b76ce8) at syscall+0x3bf/frame 0xf3b76cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b76cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25473 tid 100276 td 0xcc0819f0 sched_switch(cc0819f0,0,104,196,f3b7c7e8,...) at sched_switch+0x4e1/frame 0xf3b7c7b0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3b7c7e8 sleepq_switch(cc0819f0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xf3b7c81c sleepq_wait(c96411d4,0,c15a9be9,3,0,...) at sleepq_wait+0x48/frame 0xf3b7c840 _sx_xlock_hard(c96411d4,cc0819f0,0,c15a9bc8,d7,...) at _sx_xlock_hard+0x4c4/frame 0xf3b7c8c4 _sx_xlock(c96411d4,0,c15a9bc8,d7,c96f8b40,...) at _sx_xlock+0xe2/frame 0xf3b7c8f4 devfs_root(c96485d8,202000,f3b7c954,20a,c1870774,...) at devfs_root+0x34/frame 0xf3b7c918 lookup(f3b7cb48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3b7c980 namei(f3b7cb48,c239ad20,c977afa8,c977afa8,f3b7ca44,...) at namei+0x58c/frame 0xf3b7ca08 vn_open_cred(f3b7cb48,f3b7cbcc,0,0,ca10e600,c977ab60) at vn_open_cred+0x1fd/frame 0xf3b7cad8 vn_open(f3b7cb48,f3b7cbcc,0,c977ab60,281ec4ec,...) at vn_open+0x3d/frame 0xf3b7cb00 kern_openat(cc0819f0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3b7cbf0 sys_openat(cc0819f0,f3b7cca8,c15bd083,4,ccf85738,...) at sys_openat+0x53/frame 0xf3b7cc18 syscall(f3b7cce8) at syscall+0x3bf/frame 0xf3b7ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b7ccdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25472 tid 100307 td 0xcc0816a0 sched_switch(cc0816a0,0,104,196,f3bd97e8,...) at sched_switch+0x4e1/frame 0xf3bd97b0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bd97e8 sleepq_switch(cc0816a0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xf3bd981c sleepq_wait(c96411d4,0,c15a9be9,3,0,...) at sleepq_wait+0x48/frame 0xf3bd9840 _sx_xlock_hard(c96411d4,cc0816a0,0,c15a9bc8,d7,...) at _sx_xlock_hard+0x4c4/frame 0xf3bd98c4 _sx_xlock(c96411d4,0,c15a9bc8,d7,c96f8b40,...) at _sx_xlock+0xe2/frame 0xf3bd98f4 devfs_root(c96485d8,202000,f3bd9954,20a,c1870774,...) at devfs_root+0x34/frame 0xf3bd9918 lookup(f3bd9b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3bd9980 namei(f3bd9b48,c239ad20,c977afa8,c977afa8,f3bd9a44,...) at namei+0x58c/frame 0xf3bd9a08 vn_open_cred(f3bd9b48,f3bd9bcc,0,0,ca10e600,c977aa10) at vn_open_cred+0x1fd/frame 0xf3bd9ad8 vn_open(f3bd9b48,f3bd9bcc,0,c977aa10,281ec4ec,...) at vn_open+0x3d/frame 0xf3bd9b00 kern_openat(cc0816a0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3bd9bf0 sys_openat(cc0816a0,f3bd9ca8,c15bd083,4,ccf853f0,...) at sys_openat+0x53/frame 0xf3bd9c18 syscall(f3bd9ce8) at syscall+0x3bf/frame 0xf3bd9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3bd9cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25471 tid 100215 td 0xca796350 sched_switch(ca796350,0,104,196,f3aa27e8,...) at sched_switch+0x4e1/frame 0xf3aa27b0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3aa27e8 sleepq_switch(ca796350,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xf3aa281c sleepq_wait(c96411d4,0,c15a9be9,3,0,...) at sleepq_wait+0x48/frame 0xf3aa2840 _sx_xlock_hard(c96411d4,ca796350,0,c15a9bc8,d7,...) at _sx_xlock_hard+0x4c4/frame 0xf3aa28c4 _sx_xlock(c96411d4,0,c15a9bc8,d7,c96f8b40,...) at _sx_xlock+0xe2/frame 0xf3aa28f4 devfs_root(c96485d8,202000,f3aa2954,20a,c1870774,...) at devfs_root+0x34/frame 0xf3aa2918 lookup(f3aa2b48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf3aa2980 namei(f3aa2b48,c239ad20,c977afa8,c977afa8,f3aa2a44,...) at namei+0x58c/frame 0xf3aa2a08 vn_open_cred(f3aa2b48,f3aa2bcc,0,0,ca10e600,c977a2d8) at vn_open_cred+0x1fd/frame 0xf3aa2ad8 vn_open(f3aa2b48,f3aa2bcc,0,c977a2d8,281ec4ec,...) at vn_open+0x3d/frame 0xf3aa2b00 kern_openat(ca796350,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf3aa2bf0 sys_openat(ca796350,f3aa2ca8,c15bd083,4,cc0a30a8,...) at sys_openat+0x53/frame 0xf3aa2c18 syscall(f3aa2ce8) at syscall+0x3bf/frame 0xf3aa2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3aa2cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command pty pid 25470 tid 100169 td 0xca1456a0 sched_switch(ca1456a0,0,104,196,f392b6d0,...) at sched_switch+0x4e1/frame 0xf392b698 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf392b6d0 sleepq_switch(ca1456a0,0,c15cc34d,28b,c9657304,...) at sleepq_switch+0xf0/frame 0xf392b704 sleepq_wait(c9657304,60,c15be3a8,4,0,...) at sleepq_wait+0x48/frame 0xf392b728 sleeplk(c9657370,c15be3a8,60,33,0,...) at sleeplk+0x194/frame 0xf392b770 __lockmgr_args(c9657304,80500,c9657370,0,0,0,c15d8362,9db) at __lockmgr_args+0x736/frame 0xf392b7e8 vop_stdlock(f392b860,f392b830,c0d09d48,c96f8cdc,f392b860,...) at vop_stdlock+0x53/frame 0xf392b818 VOP_LOCK1_APV(c185b66c,f392b860,c9657370,0,c18ad91c,...) at VOP_LOCK1_APV+0xe0/frame 0xf392b848 _vn_lock(c96572d0,80500,c15d8362,9db,8,...) at _vn_lock+0xba/frame 0xf392b888 vget(c96572d0,80500,ca1456a0,1bb,80500,...) at vget+0x8e/frame 0xf392b8c0 devfs_allocv(c9654300,c96485d8,80000,f392b90c,c96f8b40,...) at devfs_allocv+0xee/frame 0xf392b8f4 devfs_root(c96485d8,202000,f392b954,20a,c1870774,...) at devfs_root+0x52/frame 0xf392b918 lookup(f392bb48,c15d772f,124,eb,0,...) at lookup+0x7f8/frame 0xf392b980 namei(f392bb48,c239ad20,c977afa8,c977afa8,f392ba44,...) at namei+0x58c/frame 0xf392ba08 vn_open_cred(f392bb48,f392bbcc,0,0,ca10e600,c977a578) at vn_open_cred+0x1fd/frame 0xf392bad8 vn_open(f392bb48,f392bbcc,0,c977a578,281ec4ec,...) at vn_open+0x3d/frame 0xf392bb00 kern_openat(ca1456a0,ffffff9c,281ec4ec,0,2,0) at kern_openat+0x345/frame 0xf392bbf0 sys_openat(ca1456a0,f392bca8,c15bd083,4,c9ae5738,...) at sys_openat+0x53/frame 0xf392bc18 syscall(f392bce8) at syscall+0x3bf/frame 0xf392bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf392bcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28164683, esp = 0xbfbfde00, ebp = 0xbfbfde24 --- Tracing command creat pid 25469 tid 100172 td 0xca145000 sched_switch(ca145000,0,104,196,f39344b4,...) at sched_switch+0x4e1/frame 0xf393447c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39344b4 sleepq_switch(ca145000,0,c15cc34d,28b,ca145000,...) at sleepq_switch+0xf0/frame 0xf39344e8 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xf393450c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xf3934568 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xf3934594 kmem_back(c1b69a78,ca010000,1000,102,ca010000,...) at kmem_back+0xe5/frame 0xf39345d4 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xf39345fc page_alloc(c91943c0,1000,f393463b,102,102,...) at page_alloc+0x28/frame 0xf3934610 keg_alloc_slab(102,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xf393464c keg_fetch_slab(102,0,c160f53b,943,c91943c0,...) at keg_fetch_slab+0x1af/frame 0xf3934694 zone_fetch_slab(c91943c0,0,102,ffffffff,2,...) at zone_fetch_slab+0x5d/frame 0xf39346b8 zone_import(c91943c0,f3934718,1,102,0,...) at zone_import+0x37/frame 0xf3934700 zone_alloc_item(102,0,c160f552,c15ac6ed,1,...) at zone_alloc_item+0x39/frame 0xf3934730 uma_zalloc_arg(c91943c0,0,102,ca145000,f39347a0,...) at uma_zalloc_arg+0x687/frame 0xf3934764 nfscl_nget(c9ad4bb0,cafbf9d8,c9ffaa00,f3934ba4,ca145000,...) at nfscl_nget+0x378/frame 0xf39347b0 nfs_create(f3934ab0,c17bea3f,c16067c6,cafbf9d8,f3934aac,...) at nfs_create+0x3b5/frame 0xf39349d8 VOP_CREATE_APV(c185ccbc,f3934ab0,f3934ba4,f3934a40,f3934a44,...) at VOP_CREATE_APV+0xf9/frame 0xf3934a08 vn_open_cred(f3934b48,f3934bcc,1b0,0,ca10e600,c9807a48) at vn_open_cred+0x2a5/frame 0xf3934ad8 vn_open(f3934b48,f3934bcc,1b0,c9807a48,bfbfe528,...) at vn_open+0x3d/frame 0xf3934b00 kern_openat(ca145000,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3934bf0 sys_openat(ca145000,f3934ca8,c15bd083,4,f3934c3c,...) at sys_openat+0x53/frame 0xf3934c18 syscall(f3934ce8) at syscall+0x3bf/frame 0xf3934cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3934cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25468 tid 100225 td 0xcb1ff000 sched_switch(cb1ff000,0,104,196,f3ac02e4,...) at sched_switch+0x4e1/frame 0xf3ac02ac mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3ac02e4 sleepq_switch(cb1ff000,0,c15cc34d,1c2,f3ac0384,...) at sleepq_switch+0xf0/frame 0xf3ac0318 sleepq_catch_signals(3,c00402e5,12,cc1fe810,2ac,...) at sleepq_catch_signals+0x443/frame 0xf3ac035c sleepq_timedwait_sig(c978e400,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3ac0384 _sleep(c978e400,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3ac03e0 clnt_vc_call(c96a30c0,f3ac05a0,8,cb579b00,f3ac06f8,...) at clnt_vc_call+0x715/frame 0xf3ac04b8 clnt_reconnect_call(c96a30e0,f3ac05a0,8,cb579b00,f3ac06f8,...) at clnt_reconnect_call+0xcc/frame 0xf3ac0520 newnfs_request(f3ac06f8,c905d400,0,c905d510,cc6c82d0,cb1ff000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3ac05e8 nfscl_request(f3ac06f8,cc6c82d0,cb1ff000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3ac0630 nfsrpc_create(cc6c82d0,ca947800,c,f3ac0a40,f0f111e3,...) at nfsrpc_create+0xff6/frame 0xf3ac07b0 nfs_create(f3ac0ab0,c17bea3f,c16067c6,cc6c82d0,f3ac0aac,...) at nfs_create+0x2cd/frame 0xf3ac09d8 VOP_CREATE_APV(c185ccbc,f3ac0ab0,f3ac0ba4,f3ac0a40,f3ac0a44,...) at VOP_CREATE_APV+0xf9/frame 0xf3ac0a08 vn_open_cred(f3ac0b48,f3ac0bcc,1b0,0,ca10e600,c977a118) at vn_open_cred+0x2a5/frame 0xf3ac0ad8 vn_open(f3ac0b48,f3ac0bcc,1b0,c977a118,bfbfe528,...) at vn_open+0x3d/frame 0xf3ac0b00 kern_openat(cb1ff000,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3ac0bf0 sys_openat(cb1ff000,f3ac0ca8,c15bd083,4,c11e909e,...) at sys_openat+0x53/frame 0xf3ac0c18 syscall(f3ac0ce8) at syscall+0x3bf/frame 0xf3ac0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ac0cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25467 tid 100226 td 0xcb1fe9f0 sched_switch(cb1fe9f0,0,104,196,f3ac3990,...) at sched_switch+0x4e1/frame 0xf3ac3958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3ac3990 sleepq_switch(cb1fe9f0,0,c15cc34d,28b,cb1fe9f0,...) at sleepq_switch+0xf0/frame 0xf3ac39c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3ac39e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3ac3a44 vm_waitpfault(cb9c6320,12,0,f3ac3afc,f3ac3aec,...) at vm_waitpfault+0x99/frame 0xf3ac3a70 vm_fault_hold(cc089000,28202000,1,0,0,...) at vm_fault_hold+0xd86/frame 0xf3ac3b30 vm_fault(cc089000,28202000,1,0,f3ac3bd4,...) at vm_fault+0x88/frame 0xf3ac3b58 trap_pfault(28202660,0,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xf3ac3ba0 trap(f3ac3ce8) at trap+0x3ec/frame 0xf3ac3cdc calltrap() at calltrap+0x6/frame 0xf3ac3cdc --- trap 0xc, eip = 0x281d0ac4, esp = 0xbfbfe538, ebp = 0xbfbfe56c --- Tracing command creat pid 25466 tid 100227 td 0xcb1fe6a0 sched_switch(cb1fe6a0,0,104,196,f3ac632c,...) at sched_switch+0x4e1/frame 0xf3ac62f4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3ac632c sleepq_switch(cb1fe6a0,0,c15cc34d,1c2,f3ac63cc,...) at sleepq_switch+0xf0/frame 0xf3ac6360 sleepq_catch_signals(2,c00402e5,12,cc1fe810,72,...) at sleepq_catch_signals+0x443/frame 0xf3ac63a4 sleepq_timedwait_sig(cc1e2600,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3ac63cc _sleep(cc1e2600,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3ac6428 clnt_vc_call(c96a30c0,f3ac65e8,3,c9fe8c00,f3ac66b8,...) at clnt_vc_call+0x715/frame 0xf3ac6500 clnt_reconnect_call(c96a30e0,f3ac65e8,3,c9fe8c00,f3ac66b8,...) at clnt_reconnect_call+0xcc/frame 0xf3ac6568 newnfs_request(f3ac66b8,c905d400,0,c905d510,ca2b29d8,cb1fe6a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3ac6630 nfscl_request(f3ac66b8,ca2b29d8,cb1fe6a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3ac6678 nfsrpc_lookup(ca2b29d8,cb121400,c,ca10e600,cb1fe6a0,...) at nfsrpc_lookup+0x211/frame 0xf3ac6770 nfs_lookup(f3ac6a00,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xf3ac6990 VOP_LOOKUP_APV(c185ccbc,f3ac6a00,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3ac69c0 lookup(f3ac6b50,c15d772f,124,eb,f3ac6a68,...) at lookup+0x589/frame 0xf3ac6a28 namei(f3ac6b50,2,400000c,0,bfbfe528,...) at namei+0x58c/frame 0xf3ac6ab0 kern_unlinkat(cb1fe6a0,ffffff9c,bfbfe528,0,0) at kern_unlinkat+0xa7/frame 0xf3ac6bfc sys_unlink(cb1fe6a0,f3ac6ca8,c15bd083,4,14,...) at sys_unlink+0x32/frame 0xf3ac6c18 syscall(f3ac6ce8) at syscall+0x3bf/frame 0xf3ac6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ac6cdc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281cbbeb, esp = 0xbfbfe514, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25465 tid 100253 td 0xcc1ab350 sched_switch(cc1ab350,0,104,196,f3ab7284,...) at sched_switch+0x4e1/frame 0xf3ab724c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3ab7284 sleepq_switch(cc1ab350,0,c15cc34d,1c2,f3ab7324,...) at sleepq_switch+0xf0/frame 0xf3ab72b8 sleepq_catch_signals(1,c00402e5,12,cc1fe810,2b8,...) at sleepq_catch_signals+0x443/frame 0xf3ab72fc sleepq_timedwait_sig(c9c2e800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3ab7324 _sleep(c9c2e800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3ab7380 clnt_vc_call(c96a30c0,f3ab7540,3,c9681a00,f3ab7610,...) at clnt_vc_call+0x715/frame 0xf3ab7458 clnt_reconnect_call(c96a30e0,f3ab7540,3,c9681a00,f3ab7610,...) at clnt_reconnect_call+0xcc/frame 0xf3ab74c0 newnfs_request(f3ab7610,c905d400,0,c905d510,ca8ed438,cc1ab350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3ab7588 nfscl_request(f3ab7610,ca8ed438,cc1ab350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3ab75d0 nfsrpc_lookup(ca8ed438,cac05400,c,ca10e600,cc1ab350,...) at nfsrpc_lookup+0x211/frame 0xf3ab76c8 nfs_lookup(f3ab7958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xf3ab78e8 VOP_LOOKUP_APV(c185ccbc,f3ab7958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3ab7918 lookup(f3ab7b48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xf3ab7980 namei(f3ab7b48,c239ad20,c977afa8,c977afa8,f3ab7a44,...) at namei+0x58c/frame 0xf3ab7a08 vn_open_cred(f3ab7b48,f3ab7bcc,1b0,0,ca10e600,c977a0e0) at vn_open_cred+0xbc/frame 0xf3ab7ad8 vn_open(f3ab7b48,f3ab7bcc,1b0,c977a0e0,bfbfe528,...) at vn_open+0x3d/frame 0xf3ab7b00 kern_openat(cc1ab350,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3ab7bf0 sys_openat(cc1ab350,f3ab7ca8,c15bd083,4,f3ab7c3c,...) at sys_openat+0x53/frame 0xf3ab7c18 syscall(f3ab7ce8) at syscall+0x3bf/frame 0xf3ab7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ab7cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25464 tid 100254 td 0xcc1ab000 sched_switch(cc1ab000,0,104,196,f3aba2e4,...) at sched_switch+0x4e1/frame 0xf3aba2ac mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3aba2e4 sleepq_switch(cc1ab000,0,c15cc34d,1c2,f3aba384,...) at sleepq_switch+0xf0/frame 0xf3aba318 sleepq_catch_signals(0,c00402e5,12,cc1fe810,66,...) at sleepq_catch_signals+0x443/frame 0xf3aba35c sleepq_timedwait_sig(cc1e2200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3aba384 _sleep(cc1e2200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3aba3e0 clnt_vc_call(c96a30c0,f3aba5a0,8,cb269300,f3aba6f8,...) at clnt_vc_call+0x715/frame 0xf3aba4b8 clnt_reconnect_call(c96a30e0,f3aba5a0,8,cb269300,f3aba6f8,...) at clnt_reconnect_call+0xcc/frame 0xf3aba520 newnfs_request(f3aba6f8,c905d400,0,c905d510,cbaa1870,cc1ab000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3aba5e8 nfscl_request(f3aba6f8,cbaa1870,cc1ab000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3aba630 nfsrpc_create(cbaa1870,cc370c00,c,f3abaa40,f0f111e2,...) at nfsrpc_create+0xff6/frame 0xf3aba7b0 nfs_create(f3abaab0,c17bea3f,c16067c6,cbaa1870,f3abaaac,...) at nfs_create+0x2cd/frame 0xf3aba9d8 VOP_CREATE_APV(c185ccbc,f3abaab0,f3ababa4,f3abaa40,f3abaa44,...) at VOP_CREATE_APV+0xf9/frame 0xf3abaa08 vn_open_cred(f3abab48,f3ababcc,1b0,0,ca10e600,c977aa48) at vn_open_cred+0x2a5/frame 0xf3abaad8 vn_open(f3abab48,f3ababcc,1b0,c977aa48,bfbfe528,...) at vn_open+0x3d/frame 0xf3abab00 kern_openat(cc1ab000,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3ababf0 sys_openat(cc1ab000,f3abaca8,c15bd083,4,f3abac3c,...) at sys_openat+0x53/frame 0xf3abac18 syscall(f3abace8) at syscall+0x3bf/frame 0xf3abacdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3abacdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25463 tid 100255 td 0xcc1aa9f0 sched_switch(cc1aa9f0,0,104,196,f3abd284,...) at sched_switch+0x4e1/frame 0xf3abd24c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3abd284 sleepq_switch(cc1aa9f0,0,c15cc34d,1c2,f3abd324,...) at sleepq_switch+0xf0/frame 0xf3abd2b8 sleepq_catch_signals(0,c00402e5,12,cc1fe810,258,...) at sleepq_catch_signals+0x443/frame 0xf3abd2fc sleepq_timedwait_sig(c97fc800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3abd324 _sleep(c97fc800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3abd380 clnt_vc_call(c96a30c0,f3abd540,3,ca90a800,f3abd610,...) at clnt_vc_call+0x715/frame 0xf3abd458 clnt_reconnect_call(c96a30e0,f3abd540,3,ca90a800,f3abd610,...) at clnt_reconnect_call+0xcc/frame 0xf3abd4c0 newnfs_request(f3abd610,c905d400,0,c905d510,cbaa1708,cc1aa9f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3abd588 nfscl_request(f3abd610,cbaa1708,cc1aa9f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3abd5d0 nfsrpc_lookup(cbaa1708,ca947c00,c,ca10e600,cc1aa9f0,...) at nfsrpc_lookup+0x211/frame 0xf3abd6c8 nfs_lookup(f3abd958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xf3abd8e8 VOP_LOOKUP_APV(c185ccbc,f3abd958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf3abd918 lookup(f3abdb48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xf3abd980 namei(f3abdb48,c239ad20,c977afa8,c977afa8,f3abda44,...) at namei+0x58c/frame 0xf3abda08 vn_open_cred(f3abdb48,f3abdbcc,1b0,0,ca10e600,c977a070) at vn_open_cred+0xbc/frame 0xf3abdad8 vn_open(f3abdb48,f3abdbcc,1b0,c977a070,bfbfe528,...) at vn_open+0x3d/frame 0xf3abdb00 kern_openat(cc1aa9f0,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3abdbf0 sys_openat(cc1aa9f0,f3abdca8,c15bd083,4,db,...) at sys_openat+0x53/frame 0xf3abdc18 syscall(f3abdce8) at syscall+0x3bf/frame 0xf3abdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3abdcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25462 tid 100196 td 0xcb200000 sched_switch(cb200000,0,104,196,f39b732c,...) at sched_switch+0x4e1/frame 0xf39b72f4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39b732c sleepq_switch(cb200000,0,c15cc34d,1c2,f39b73cc,...) at sleepq_switch+0xf0/frame 0xf39b7360 sleepq_catch_signals(0,c00402e5,12,cc1fe810,16e,...) at sleepq_catch_signals+0x443/frame 0xf39b73a4 sleepq_timedwait_sig(c9f77a00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39b73cc _sleep(c9f77a00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf39b7428 clnt_vc_call(c96a30c0,f39b75e8,3,ca117d00,f39b76b8,...) at clnt_vc_call+0x715/frame 0xf39b7500 clnt_reconnect_call(c96a30e0,f39b75e8,3,ca117d00,f39b76b8,...) at clnt_reconnect_call+0xcc/frame 0xf39b7568 newnfs_request(f39b76b8,c905d400,0,c905d510,ca3d2708,cb200000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf39b7630 nfscl_request(f39b76b8,ca3d2708,cb200000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf39b7678 nfsrpc_lookup(ca3d2708,cb121000,c,ca10e600,cb200000,...) at nfsrpc_lookup+0x211/frame 0xf39b7770 nfs_lookup(f39b7a00,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xf39b7990 VOP_LOOKUP_APV(c185ccbc,f39b7a00,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf39b79c0 lookup(f39b7b50,c15d772f,124,eb,f39b7a68,...) at lookup+0x589/frame 0xf39b7a28 namei(f39b7b50,2,400000c,0,bfbfe528,...) at namei+0x58c/frame 0xf39b7ab0 kern_unlinkat(cb200000,ffffff9c,bfbfe528,0,0) at kern_unlinkat+0xa7/frame 0xf39b7bfc sys_unlink(cb200000,f39b7ca8,c15bd083,4,c9ae3738,...) at sys_unlink+0x32/frame 0xf39b7c18 syscall(f39b7ce8) at syscall+0x3bf/frame 0xf39b7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf39b7cdc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281cbbeb, esp = 0xbfbfe514, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25461 tid 100198 td 0xcb1ff9f0 sched_switch(cb1ff9f0,0,104,196,f39bd32c,...) at sched_switch+0x4e1/frame 0xf39bd2f4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39bd32c sleepq_switch(cb1ff9f0,0,c15cc34d,1c2,f39bd3cc,...) at sleepq_switch+0xf0/frame 0xf39bd360 sleepq_catch_signals(0,c00402e5,12,cc1fe810,1e6,...) at sleepq_catch_signals+0x443/frame 0xf39bd3a4 sleepq_timedwait_sig(c975a200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39bd3cc _sleep(c975a200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf39bd428 clnt_vc_call(c96a30c0,f39bd5e8,3,c9f23d00,f39bd6b8,...) at clnt_vc_call+0x715/frame 0xf39bd500 clnt_reconnect_call(c96a30e0,f39bd5e8,3,c9f23d00,f39bd6b8,...) at clnt_reconnect_call+0xcc/frame 0xf39bd568 newnfs_request(f39bd6b8,c905d400,0,c905d510,cbaa1ca8,cb1ff9f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf39bd630 nfscl_request(f39bd6b8,cbaa1ca8,cb1ff9f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf39bd678 nfsrpc_lookup(cbaa1ca8,cc370400,c,ca10e600,cb1ff9f0,...) at nfsrpc_lookup+0x211/frame 0xf39bd770 nfs_lookup(f39bda00,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xf39bd990 VOP_LOOKUP_APV(c185ccbc,f39bda00,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xf39bd9c0 lookup(f39bdb50,c15d772f,124,eb,f39bda68,...) at lookup+0x589/frame 0xf39bda28 namei(f39bdb50,2,400000c,0,bfbfe528,...) at namei+0x58c/frame 0xf39bdab0 kern_unlinkat(cb1ff9f0,ffffff9c,bfbfe528,0,0) at kern_unlinkat+0xa7/frame 0xf39bdbfc sys_unlink(cb1ff9f0,f39bdca8,c15bd083,4,db,...) at sys_unlink+0x32/frame 0xf39bdc18 syscall(f39bdce8) at syscall+0x3bf/frame 0xf39bdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf39bdcdc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281cbbeb, esp = 0xbfbfe514, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25460 tid 100100 td 0xc97ee000 sched_switch(c97ee000,0,104,196,edf4f284,...) at sched_switch+0x4e1/frame 0xedf4f24c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf4f284 sleepq_switch(c97ee000,0,c15cc34d,1c2,edf4f324,...) at sleepq_switch+0xf0/frame 0xedf4f2b8 sleepq_catch_signals(1,c00402e5,12,cc1fe810,252,...) at sleepq_catch_signals+0x443/frame 0xedf4f2fc sleepq_timedwait_sig(ccd3c600,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xedf4f324 _sleep(ccd3c600,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xedf4f380 clnt_vc_call(c96a30c0,edf4f540,3,c9fe8700,edf4f610,...) at clnt_vc_call+0x715/frame 0xedf4f458 clnt_reconnect_call(c96a30e0,edf4f540,3,c9fe8700,edf4f610,...) at clnt_reconnect_call+0xcc/frame 0xedf4f4c0 newnfs_request(edf4f610,c905d400,0,c905d510,cc6cd708,c97ee000,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xedf4f588 nfscl_request(edf4f610,cc6cd708,c97ee000,ca10e600,0,...) at nfscl_request+0x8c/frame 0xedf4f5d0 nfsrpc_lookup(cc6cd708,c9562c00,c,ca10e600,c97ee000,...) at nfsrpc_lookup+0x211/frame 0xedf4f6c8 nfs_lookup(edf4f958,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xedf4f8e8 VOP_LOOKUP_APV(c185ccbc,edf4f958,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xedf4f918 lookup(edf4fb48,c15d772f,124,eb,0,...) at lookup+0x589/frame 0xedf4f980 namei(edf4fb48,c239ad20,c977afa8,c977afa8,edf4fa44,...) at namei+0x58c/frame 0xedf4fa08 vn_open_cred(edf4fb48,edf4fbcc,1b0,0,ca10e600,c977ae00) at vn_open_cred+0xbc/frame 0xedf4fad8 vn_open(edf4fb48,edf4fbcc,1b0,c977ae00,bfbfe528,...) at vn_open+0x3d/frame 0xedf4fb00 kern_openat(c97ee000,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xedf4fbf0 sys_openat(c97ee000,edf4fca8,c15bd083,4,edf4fc3c,...) at sys_openat+0x53/frame 0xedf4fc18 syscall(edf4fce8) at syscall+0x3bf/frame 0xedf4fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf4fcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25459 tid 100251 td 0xcb200350 sched_switch(cb200350,0,104,196,f3b0f4b4,...) at sched_switch+0x4e1/frame 0xf3b0f47c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3b0f4b4 sleepq_switch(cb200350,0,c15cc34d,28b,cb200350,...) at sleepq_switch+0xf0/frame 0xf3b0f4e8 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xf3b0f50c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xf3b0f568 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xf3b0f594 kmem_back(c1b69a78,ca00e000,1000,102,ca00e000,...) at kmem_back+0xe5/frame 0xf3b0f5d4 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xf3b0f5fc page_alloc(c91943c0,1000,f3b0f63b,102,102,...) at page_alloc+0x28/frame 0xf3b0f610 keg_alloc_slab(102,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xf3b0f64c keg_fetch_slab(102,0,c160f53b,943,c91943c0,...) at keg_fetch_slab+0x1af/frame 0xf3b0f694 zone_fetch_slab(c91943c0,0,102,ffffffff,2,...) at zone_fetch_slab+0x5d/frame 0xf3b0f6b8 zone_import(c91943c0,f3b0f718,1,102,0,...) at zone_import+0x37/frame 0xf3b0f700 zone_alloc_item(102,0,c160f552,c15ac6ed,1,...) at zone_alloc_item+0x39/frame 0xf3b0f730 uma_zalloc_arg(c91943c0,0,102,cb200350,f3b0f7a0,...) at uma_zalloc_arg+0x687/frame 0xf3b0f764 nfscl_nget(c9ad4bb0,cbaa19d8,c9ffa9c0,f3b0fba4,cb200350,...) at nfscl_nget+0x378/frame 0xf3b0f7b0 nfs_create(f3b0fab0,c17bea3f,c16067c6,cbaa19d8,f3b0faac,...) at nfs_create+0x3b5/frame 0xf3b0f9d8 VOP_CREATE_APV(c185ccbc,f3b0fab0,f3b0fba4,f3b0fa40,f3b0fa44,...) at VOP_CREATE_APV+0xf9/frame 0xf3b0fa08 vn_open_cred(f3b0fb48,f3b0fbcc,1b0,0,ca10e600,c9807498) at vn_open_cred+0x2a5/frame 0xf3b0fad8 vn_open(f3b0fb48,f3b0fbcc,1b0,c9807498,bfbfe528,...) at vn_open+0x3d/frame 0xf3b0fb00 kern_openat(cb200350,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3b0fbf0 sys_openat(cb200350,f3b0fca8,c15bd083,4,14,...) at sys_openat+0x53/frame 0xf3b0fc18 syscall(f3b0fce8) at syscall+0x3bf/frame 0xf3b0fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b0fcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25458 tid 100252 td 0xcc1ea350 sched_switch(cc1ea350,0,104,196,f3b124b4,...) at sched_switch+0x4e1/frame 0xf3b1247c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3b124b4 sleepq_switch(cc1ea350,0,c15cc34d,28b,cc1ea350,...) at sleepq_switch+0xf0/frame 0xf3b124e8 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xf3b1250c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xf3b12568 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xf3b12594 kmem_back(c1b69a78,ca00c000,1000,102,ca00c000,...) at kmem_back+0xe5/frame 0xf3b125d4 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xf3b125fc page_alloc(c91943c0,1000,f3b1263b,102,102,...) at page_alloc+0x28/frame 0xf3b12610 keg_alloc_slab(102,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xf3b1264c keg_fetch_slab(102,0,c160f53b,943,c91943c0,...) at keg_fetch_slab+0x1af/frame 0xf3b12694 zone_fetch_slab(c91943c0,0,102,ffffffff,2,...) at zone_fetch_slab+0x5d/frame 0xf3b126b8 zone_import(c91943c0,f3b12718,1,102,0,...) at zone_import+0x37/frame 0xf3b12700 zone_alloc_item(102,0,c160f552,c15ac6ed,1,...) at zone_alloc_item+0x39/frame 0xf3b12730 uma_zalloc_arg(c91943c0,0,102,cc1ea350,f3b127a0,...) at uma_zalloc_arg+0x687/frame 0xf3b12764 nfscl_nget(c9ad4bb0,cc8af438,c9ffa980,f3b12ba4,cc1ea350,...) at nfscl_nget+0x378/frame 0xf3b127b0 nfs_create(f3b12ab0,c17bea3f,c16067c6,cc8af438,f3b12aac,...) at nfs_create+0x3b5/frame 0xf3b129d8 VOP_CREATE_APV(c185ccbc,f3b12ab0,f3b12ba4,f3b12a40,f3b12a44,...) at VOP_CREATE_APV+0xf9/frame 0xf3b12a08 vn_open_cred(f3b12b48,f3b12bcc,1b0,0,ca10e600,c9807070) at vn_open_cred+0x2a5/frame 0xf3b12ad8 vn_open(f3b12b48,f3b12bcc,1b0,c9807070,bfbfe528,...) at vn_open+0x3d/frame 0xf3b12b00 kern_openat(cc1ea350,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3b12bf0 sys_openat(cc1ea350,f3b12ca8,c15bd083,4,14,...) at sys_openat+0x53/frame 0xf3b12c18 syscall(f3b12ce8) at syscall+0x3bf/frame 0xf3b12cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b12cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25457 tid 100247 td 0xcc1d76a0 sched_switch(cc1d76a0,0,104,196,f3b032e4,...) at sched_switch+0x4e1/frame 0xf3b032ac mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3b032e4 sleepq_switch(cc1d76a0,0,c15cc34d,1c2,f3b03384,...) at sleepq_switch+0xf0/frame 0xf3b03318 sleepq_catch_signals(2,c00402e5,12,cc1fe810,25e,...) at sleepq_catch_signals+0x443/frame 0xf3b0335c sleepq_timedwait_sig(c97fca00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3b03384 _sleep(c97fca00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3b033e0 clnt_vc_call(c96a30c0,f3b035a0,8,cb268a00,f3b036f8,...) at clnt_vc_call+0x715/frame 0xf3b034b8 clnt_reconnect_call(c96a30e0,f3b035a0,8,cb268a00,f3b036f8,...) at clnt_reconnect_call+0xcc/frame 0xf3b03520 newnfs_request(f3b036f8,c905d400,0,c905d510,caad65a0,cc1d76a0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3b035e8 nfscl_request(f3b036f8,caad65a0,cc1d76a0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3b03630 nfsrpc_create(caad65a0,cc370800,c,f3b03a40,f0f111e4,...) at nfsrpc_create+0xff6/frame 0xf3b037b0 nfs_create(f3b03ab0,c17bea3f,c16067c6,caad65a0,f3b03aac,...) at nfs_create+0x2cd/frame 0xf3b039d8 VOP_CREATE_APV(c185ccbc,f3b03ab0,f3b03ba4,f3b03a40,f3b03a44,...) at VOP_CREATE_APV+0xf9/frame 0xf3b03a08 vn_open_cred(f3b03b48,f3b03bcc,1b0,0,ca10e600,c977a3f0) at vn_open_cred+0x2a5/frame 0xf3b03ad8 vn_open(f3b03b48,f3b03bcc,1b0,c977a3f0,bfbfe528,...) at vn_open+0x3d/frame 0xf3b03b00 kern_openat(cc1d76a0,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3b03bf0 sys_openat(cc1d76a0,f3b03ca8,c15bd083,4,cc0cba80,...) at sys_openat+0x53/frame 0xf3b03c18 syscall(f3b03ce8) at syscall+0x3bf/frame 0xf3b03cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b03cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25456 tid 100218 td 0xcc0809f0 sched_switch(cc0809f0,0,104,196,f3aab2e4,...) at sched_switch+0x4e1/frame 0xf3aab2ac mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3aab2e4 sleepq_switch(cc0809f0,0,c15cc34d,1c2,f3aab384,...) at sleepq_switch+0xf0/frame 0xf3aab318 sleepq_catch_signals(1,c00402e5,12,cc1fe810,24c,...) at sleepq_catch_signals+0x443/frame 0xf3aab35c sleepq_timedwait_sig(ccd3c400,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3aab384 _sleep(ccd3c400,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3aab3e0 clnt_vc_call(c96a30c0,f3aab5a0,8,cb78e100,f3aab6f8,...) at clnt_vc_call+0x715/frame 0xf3aab4b8 clnt_reconnect_call(c96a30e0,f3aab5a0,8,cb78e100,f3aab6f8,...) at clnt_reconnect_call+0xcc/frame 0xf3aab520 newnfs_request(f3aab6f8,c905d400,0,c905d510,caad5438,cc0809f0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3aab5e8 nfscl_request(f3aab6f8,caad5438,cc0809f0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3aab630 nfsrpc_create(caad5438,cc370000,c,f3aaba40,f0f111e5,...) at nfsrpc_create+0xff6/frame 0xf3aab7b0 nfs_create(f3aabab0,c17bea3f,c16067c6,caad5438,f3aabaac,...) at nfs_create+0x2cd/frame 0xf3aab9d8 VOP_CREATE_APV(c185ccbc,f3aabab0,f3aabba4,f3aaba40,f3aaba44,...) at VOP_CREATE_APV+0xf9/frame 0xf3aaba08 vn_open_cred(f3aabb48,f3aabbcc,1b0,0,ca10e600,c977a268) at vn_open_cred+0x2a5/frame 0xf3aabad8 vn_open(f3aabb48,f3aabbcc,1b0,c977a268,bfbfe528,...) at vn_open+0x3d/frame 0xf3aabb00 kern_openat(cc0809f0,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3aabbf0 sys_openat(cc0809f0,f3aabca8,c15bd083,4,f3aabc3c,...) at sys_openat+0x53/frame 0xf3aabc18 syscall(f3aabce8) at syscall+0x3bf/frame 0xf3aabcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3aabcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25455 tid 100343 td 0xcc1d86a0 sched_switch(cc1d86a0,0,104,196,c84a44b4,...) at sched_switch+0x4e1/frame 0xc84a447c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84a44b4 sleepq_switch(cc1d86a0,0,c15cc34d,28b,cc1d86a0,...) at sleepq_switch+0xf0/frame 0xc84a44e8 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xc84a450c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xc84a4568 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xc84a4594 kmem_back(c1b69a78,ca00f000,1000,102,ca00f000,...) at kmem_back+0xe5/frame 0xc84a45d4 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xc84a45fc page_alloc(c91943c0,1000,c84a463b,102,102,...) at page_alloc+0x28/frame 0xc84a4610 keg_alloc_slab(102,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xc84a464c keg_fetch_slab(102,0,c160f53b,943,c91943c0,...) at keg_fetch_slab+0x1af/frame 0xc84a4694 zone_fetch_slab(c91943c0,0,102,ffffffff,2,...) at zone_fetch_slab+0x5d/frame 0xc84a46b8 zone_import(c91943c0,c84a4718,1,102,0,...) at zone_import+0x37/frame 0xc84a4700 zone_alloc_item(102,0,c160f552,c15ac6ed,1,...) at zone_alloc_item+0x39/frame 0xc84a4730 uma_zalloc_arg(c91943c0,0,102,cc1d86a0,c84a47a0,...) at uma_zalloc_arg+0x687/frame 0xc84a4764 nfscl_nget(c9ad4bb0,c8f5e168,c9ffa9e0,c84a4ba4,cc1d86a0,...) at nfscl_nget+0x378/frame 0xc84a47b0 nfs_create(c84a4ab0,c17bea3f,c16067c6,c8f5e168,c84a4aac,...) at nfs_create+0x3b5/frame 0xc84a49d8 VOP_CREATE_APV(c185ccbc,c84a4ab0,c84a4ba4,c84a4a40,c84a4a44,...) at VOP_CREATE_APV+0xf9/frame 0xc84a4a08 vn_open_cred(c84a4b48,c84a4bcc,1b0,0,ca10e600,c9807d90) at vn_open_cred+0x2a5/frame 0xc84a4ad8 vn_open(c84a4b48,c84a4bcc,1b0,c9807d90,bfbfe528,...) at vn_open+0x3d/frame 0xc84a4b00 kern_openat(cc1d86a0,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xc84a4bf0 sys_openat(cc1d86a0,c84a4ca8,c15bd083,4,c84a4c3c,...) at sys_openat+0x53/frame 0xc84a4c18 syscall(c84a4ce8) at syscall+0x3bf/frame 0xc84a4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84a4cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25454 tid 100342 td 0xcc1d8350 sched_switch(cc1d8350,0,104,196,c84a132c,...) at sched_switch+0x4e1/frame 0xc84a12f4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc84a132c sleepq_switch(cc1d8350,0,c15cc34d,1c2,c84a13cc,...) at sleepq_switch+0xf0/frame 0xc84a1360 sleepq_catch_signals(3,c00402e5,12,cc1fe810,23a,...) at sleepq_catch_signals+0x443/frame 0xc84a13a4 sleepq_timedwait_sig(c975be00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc84a13cc _sleep(c975be00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc84a1428 clnt_vc_call(c96a30c0,c84a15e8,3,cd08b400,c84a16b8,...) at clnt_vc_call+0x715/frame 0xc84a1500 clnt_reconnect_call(c96a30e0,c84a15e8,3,cd08b400,c84a16b8,...) at clnt_reconnect_call+0xcc/frame 0xc84a1568 newnfs_request(c84a16b8,c905d400,0,c905d510,cc6cdca8,cc1d8350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc84a1630 nfscl_request(c84a16b8,cc6cdca8,cc1d8350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84a1678 nfsrpc_lookup(cc6cdca8,cb898000,c,ca10e600,cc1d8350,...) at nfsrpc_lookup+0x211/frame 0xc84a1770 nfs_lookup(c84a1a00,c17be989,400400,c15d772f,2c0,...) at nfs_lookup+0x56f/frame 0xc84a1990 VOP_LOOKUP_APV(c185ccbc,c84a1a00,c15d772f,2c0,c1870774,...) at VOP_LOOKUP_APV+0xf9/frame 0xc84a19c0 lookup(c84a1b50,c15d772f,124,eb,c84a1a68,...) at lookup+0x589/frame 0xc84a1a28 namei(c84a1b50,2,400000c,0,bfbfe528,...) at namei+0x58c/frame 0xc84a1ab0 kern_unlinkat(cc1d8350,ffffff9c,bfbfe528,0,0) at kern_unlinkat+0xa7/frame 0xc84a1bfc sys_unlink(cc1d8350,c84a1ca8,c15bd083,4,cd0ae738,...) at sys_unlink+0x32/frame 0xc84a1c18 syscall(c84a1ce8) at syscall+0x3bf/frame 0xc84a1cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc84a1cdc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281cbbeb, esp = 0xbfbfe514, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25453 tid 100240 td 0xcb1fd350 sched_switch(cb1fd350,0,104,196,f3aed2e4,...) at sched_switch+0x4e1/frame 0xf3aed2ac mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3aed2e4 sleepq_switch(cb1fd350,0,c15cc34d,1c2,f3aed384,...) at sleepq_switch+0xf0/frame 0xf3aed318 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2b2,...) at sleepq_catch_signals+0x443/frame 0xf3aed35c sleepq_timedwait_sig(c978e600,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3aed384 _sleep(c978e600,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3aed3e0 clnt_vc_call(c96a30c0,f3aed5a0,8,cd093000,f3aed6f8,...) at clnt_vc_call+0x715/frame 0xf3aed4b8 clnt_reconnect_call(c96a30e0,f3aed5a0,8,cd093000,f3aed6f8,...) at clnt_reconnect_call+0xcc/frame 0xf3aed520 newnfs_request(f3aed6f8,c905d400,0,c905d510,cc6cd9d8,cb1fd350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3aed5e8 nfscl_request(f3aed6f8,cc6cd9d8,cb1fd350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3aed630 nfsrpc_create(cc6cd9d8,cac05c00,c,f3aeda40,f0f111e1,...) at nfsrpc_create+0xff6/frame 0xf3aed7b0 nfs_create(f3aedab0,c17bea3f,c16067c6,cc6cd9d8,f3aedaac,...) at nfs_create+0x2cd/frame 0xf3aed9d8 VOP_CREATE_APV(c185ccbc,f3aedab0,f3aedba4,f3aeda40,f3aeda44,...) at VOP_CREATE_APV+0xf9/frame 0xf3aeda08 vn_open_cred(f3aedb48,f3aedbcc,1b0,0,ca10e600,c98072a0) at vn_open_cred+0x2a5/frame 0xf3aedad8 vn_open(f3aedb48,f3aedbcc,1b0,c98072a0,bfbfe528,...) at vn_open+0x3d/frame 0xf3aedb00 kern_openat(cb1fd350,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf3aedbf0 sys_openat(cb1fd350,f3aedca8,c15bd083,4,db,...) at sys_openat+0x53/frame 0xf3aedc18 syscall(f3aedce8) at syscall+0x3bf/frame 0xf3aedcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3aedcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25452 tid 100231 td 0xcc1ac350 sched_switch(cc1ac350,0,104,196,f3ad24b4,...) at sched_switch+0x4e1/frame 0xf3ad247c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3ad24b4 sleepq_switch(cc1ac350,0,c15cc34d,1c2,f3ad2554,...) at sleepq_switch+0xf0/frame 0xf3ad24e8 sleepq_catch_signals(3,c00402e5,12,cc1fe810,2ca,...) at sleepq_catch_signals+0x443/frame 0xf3ad252c sleepq_timedwait_sig(c978ee00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3ad2554 _sleep(c978ee00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3ad25b0 clnt_vc_call(c96a30c0,f3ad2770,c,cc391300,f3ad2840,...) at clnt_vc_call+0x715/frame 0xf3ad2688 clnt_reconnect_call(c96a30e0,f3ad2770,c,cc391300,f3ad2840,...) at clnt_reconnect_call+0xcc/frame 0xf3ad26f0 newnfs_request(f3ad2840,c905d400,0,c905d510,ca3d2e10,cc1ac350,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3ad27b8 nfscl_request(f3ad2840,ca3d2e10,cc1ac350,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3ad2800 nfsrpc_remove(ca3d2e10,cb898400,c,cb813ca8,ca10e600,...) at nfsrpc_remove+0x201/frame 0xf3ad28f8 nfs_removerpc(cb898400,c,ca10e600,cc1ac350,ca3d2e10,...) at nfs_removerpc+0xad/frame 0xf3ad29d0 nfs_remove(f3ad2bd8,c17bef7a,c15d8362,c5d,f3ad2bd4,...) at nfs_remove+0x112/frame 0xf3ad2a80 VOP_REMOVE_APV(c185ccbc,f3ad2bd8,cb813ca8,f3ad2bac,bfbfe528,...) at VOP_REMOVE_APV+0x122/frame 0xf3ad2ab0 kern_unlinkat(cc1ac350,ffffff9c,bfbfe528,0,0) at kern_unlinkat+0x266/frame 0xf3ad2bfc sys_unlink(cc1ac350,f3ad2ca8,c15bd083,4,14,...) at sys_unlink+0x32/frame 0xf3ad2c18 syscall(f3ad2ce8) at syscall+0x3bf/frame 0xf3ad2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ad2cdc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281cbbeb, esp = 0xbfbfe514, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25451 tid 100164 td 0xca4b3000 sched_switch(ca4b3000,0,104,196,f391f4b4,...) at sched_switch+0x4e1/frame 0xf391f47c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf391f4b4 sleepq_switch(ca4b3000,0,c15cc34d,28b,ca4b3000,...) at sleepq_switch+0xf0/frame 0xf391f4e8 sleepq_wait(c1b69970,54,c1612528,0,0,...) at sleepq_wait+0x48/frame 0xf391f50c _sleep(c1b69970,c1b6ae00,254,c1612528,0,0,0,0,100) at _sleep+0x352/frame 0xf391f568 vm_wait(c1b69a88,c16103bc,162,262,0,...) at vm_wait+0xfd/frame 0xf391f594 kmem_back(c1b69a78,ca013000,1000,102,ca013000,...) at kmem_back+0xe5/frame 0xf391f5d4 kmem_malloc(c1aabd00,1000,102) at kmem_malloc+0x6b/frame 0xf391f5fc page_alloc(c91943c0,1000,f391f63b,102,102,...) at page_alloc+0x28/frame 0xf391f610 keg_alloc_slab(102,4,c160f53b,8f7,c0c2f032,...) at keg_alloc_slab+0xda/frame 0xf391f64c keg_fetch_slab(102,0,c160f53b,943,c91943c0,...) at keg_fetch_slab+0x1af/frame 0xf391f694 zone_fetch_slab(c91943c0,0,102,ffffffff,2,...) at zone_fetch_slab+0x5d/frame 0xf391f6b8 zone_import(c91943c0,f391f718,1,102,0,...) at zone_import+0x37/frame 0xf391f700 zone_alloc_item(102,0,c160f552,c15ac6ed,1,...) at zone_alloc_item+0x39/frame 0xf391f730 uma_zalloc_arg(c91943c0,0,102,ca4b3000,f391f7a0,...) at uma_zalloc_arg+0x687/frame 0xf391f764 nfscl_nget(c9ad4bb0,cc8af2d0,c9fface0,f391fba4,ca4b3000,...) at nfscl_nget+0x378/frame 0xf391f7b0 nfs_create(f391fab0,c17bea3f,c16067c6,cc8af2d0,f391faac,...) at nfs_create+0x3b5/frame 0xf391f9d8 VOP_CREATE_APV(c185ccbc,f391fab0,f391fba4,f391fa40,f391fa44,...) at VOP_CREATE_APV+0xf9/frame 0xf391fa08 vn_open_cred(f391fb48,f391fbcc,1b0,0,ca10e600,c9807118) at vn_open_cred+0x2a5/frame 0xf391fad8 vn_open(f391fb48,f391fbcc,1b0,c9807118,bfbfe528,...) at vn_open+0x3d/frame 0xf391fb00 kern_openat(ca4b3000,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x345/frame 0xf391fbf0 sys_openat(ca4b3000,f391fca8,c15bd083,4,c97cd738,...) at sys_openat+0x53/frame 0xf391fc18 syscall(f391fce8) at syscall+0x3bf/frame 0xf391fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf391fcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command thr1 pid 25450 tid 100116 td 0xc9be89f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c9be89f0,ffffffff,636a,18714,c9be89f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command creat pid 25449 tid 100245 td 0xcc1d8000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cc1d8000,ffffffff,6369,18795,cc1d8000,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command mkdir pid 25448 tid 100258 td 0xcc1aa000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cc1aa000,ffffffff,6368,187a2,cc1aa000,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command mmap pid 25447 tid 100260 td 0xcce8a6a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cce8a6a0,ffffffff,6367,187a4,cce8a6a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command pty pid 25446 tid 100341 td 0xccfd39f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ccfd39f0,ffffffff,6366,187f5,ccfd39f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command thr1 pid 25441 tid 100243 td 0xcc07f350 sched_switch(cc07f350,0,104,196,f3af6a7c,...) at sched_switch+0x4e1/frame 0xf3af6a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3af6a7c sleepq_switch(cc07f350,0,c15cc34d,1c2,f3af6b1c,...) at sleepq_switch+0xf0/frame 0xf3af6ab0 sleepq_catch_signals(3,10000000,0,c89924d8,c9606260,...) at sleepq_catch_signals+0x443/frame 0xf3af6af4 sleepq_timedwait_sig(c1a8d023,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3af6b1c _sleep(c1a8d023,0,16c,c15c70f2,369bec4,...) at _sleep+0x30f/frame 0xf3af6b78 kern_nanosleep(bfbfe580,f3af6bf0,f3af6bf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3af6bd8 sys_nanosleep(cc07f350,f3af6ca8,c15bd083,4,f3af6c3c,...) at sys_nanosleep+0x68/frame 0xf3af6c18 syscall(f3af6ce8) at syscall+0x3bf/frame 0xf3af6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3af6cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28188693, esp = 0xbfbfe558, ebp = 0xbfbfe570 --- Tracing command pty pid 25440 tid 100244 td 0xcc07f000 sched_switch(cc07f000,0,104,196,f3af9a7c,...) at sched_switch+0x4e1/frame 0xf3af9a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3af9a7c sleepq_switch(cc07f000,0,c15cc34d,1c2,f3af9b1c,...) at sleepq_switch+0xf0/frame 0xf3af9ab0 sleepq_catch_signals(3,10000000,0,c97e7818,c9606260,...) at sleepq_catch_signals+0x443/frame 0xf3af9af4 sleepq_timedwait_sig(c1a8d023,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3af9b1c _sleep(c1a8d023,0,16c,c15c70f2,1ab594f0,...) at _sleep+0x30f/frame 0xf3af9b78 kern_nanosleep(bfbfe580,f3af9bf0,f3af9bf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3af9bd8 sys_nanosleep(cc07f000,f3af9ca8,c15bd083,4,0,...) at sys_nanosleep+0x68/frame 0xf3af9c18 syscall(f3af9ce8) at syscall+0x3bf/frame 0xf3af9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3af9cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25437 tid 100203 td 0xc9629350 sched_switch(c9629350,0,104,196,f39cca7c,...) at sched_switch+0x4e1/frame 0xf39cca44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39cca7c sleepq_switch(c9629350,0,c15cc34d,1c2,f39ccb1c,...) at sleepq_switch+0xf0/frame 0xf39ccab0 sleepq_catch_signals(0,10000000,0,c97e7818,c95b87e0,...) at sleepq_catch_signals+0x443/frame 0xf39ccaf4 sleepq_timedwait_sig(c1a8d020,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39ccb1c _sleep(c1a8d020,0,16c,c15c70f2,22220d5a,...) at _sleep+0x30f/frame 0xf39ccb78 kern_nanosleep(bfbfe580,f39ccbf0,f39ccbf8,0,1,...) at kern_nanosleep+0x137/frame 0xf39ccbd8 sys_nanosleep(c9629350,f39ccca8,c15bd083,4,14,...) at sys_nanosleep+0x68/frame 0xf39ccc18 syscall(f39ccce8) at syscall+0x3bf/frame 0xf39cccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf39cccdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command mkdir pid 25435 tid 100219 td 0xca4b39f0 sched_switch(ca4b39f0,0,104,196,f3aaea7c,...) at sched_switch+0x4e1/frame 0xf3aaea44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3aaea7c sleepq_switch(ca4b39f0,0,c15cc34d,1c2,f3aaeb1c,...) at sleepq_switch+0xf0/frame 0xf3aaeab0 sleepq_catch_signals(0,10000000,0,c95b7bd8,c95b87e0,...) at sleepq_catch_signals+0x443/frame 0xf3aaeaf4 sleepq_timedwait_sig(c1a8d020,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3aaeb1c _sleep(c1a8d020,0,16c,c15c70f2,37e481bf,...) at _sleep+0x30f/frame 0xf3aaeb78 kern_nanosleep(bfbfe580,f3aaebf0,f3aaebf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3aaebd8 sys_nanosleep(ca4b39f0,f3aaeca8,c15bd083,4,f3aaec3c,...) at sys_nanosleep+0x68/frame 0xf3aaec18 syscall(f3aaece8) at syscall+0x3bf/frame 0xf3aaecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3aaecdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25434 tid 100229 td 0xcc1ac9f0 sched_switch(cc1ac9f0,0,104,196,f3acca7c,...) at sched_switch+0x4e1/frame 0xf3acca44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3acca7c sleepq_switch(cc1ac9f0,0,c15cc34d,1c2,f3accb1c,...) at sleepq_switch+0xf0/frame 0xf3accab0 sleepq_catch_signals(2,10000000,0,c0ca017d,2d6,...) at sleepq_catch_signals+0x443/frame 0xf3accaf4 sleepq_timedwait_sig(c1a8d022,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3accb1c _sleep(c1a8d022,0,16c,c15c70f2,18a947af,...) at _sleep+0x30f/frame 0xf3accb78 kern_nanosleep(bfbfe580,f3accbf0,f3accbf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3accbd8 sys_nanosleep(cc1ac9f0,f3accca8,c15bd083,4,0,...) at sys_nanosleep+0x68/frame 0xf3accc18 syscall(f3accce8) at syscall+0x3bf/frame 0xf3acccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3acccdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command mmap pid 25430 tid 100239 td 0xcb1fd6a0 sched_switch(cb1fd6a0,0,104,196,f3aeaa7c,...) at sched_switch+0x4e1/frame 0xf3aeaa44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3aeaa7c sleepq_switch(cb1fd6a0,0,c15cc34d,1c2,f3aeab1c,...) at sleepq_switch+0xf0/frame 0xf3aeaab0 sleepq_catch_signals(3,10000000,0,c89924d8,c9606260,...) at sleepq_catch_signals+0x443/frame 0xf3aeaaf4 sleepq_timedwait_sig(c1a8d023,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3aeab1c _sleep(c1a8d023,0,16c,c15c70f2,a94d1d9,...) at _sleep+0x30f/frame 0xf3aeab78 kern_nanosleep(bfbfe580,f3aeabf0,f3aeabf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3aeabd8 sys_nanosleep(cb1fd6a0,f3aeaca8,c15bd083,4,f3aeac3c,...) at sys_nanosleep+0x68/frame 0xf3aeac18 syscall(f3aeace8) at syscall+0x3bf/frame 0xf3aeacdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3aeacdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command rw pid 25429 tid 100328 td 0xcd00b350 sched_switch(cd00b350,0,104,196,c8477a7c,...) at sched_switch+0x4e1/frame 0xc8477a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc8477a7c sleepq_switch(cd00b350,0,c15cc34d,1c2,c8477b1c,...) at sleepq_switch+0xf0/frame 0xc8477ab0 sleepq_catch_signals(0,10000000,0,c0ca017d,2d0,...) at sleepq_catch_signals+0x443/frame 0xc8477af4 sleepq_timedwait_sig(c1a8d020,6c,d81,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xc8477b1c _sleep(c1a8d020,0,16c,c15c70f2,8740c4e8,...) at _sleep+0x30f/frame 0xc8477b78 kern_nanosleep(bfbfe580,c8477bf0,c8477bf8,0,1,...) at kern_nanosleep+0x137/frame 0xc8477bd8 sys_nanosleep(cd00b350,c8477ca8,c15bd083,4,db,...) at sys_nanosleep+0x68/frame 0xc8477c18 syscall(c8477ce8) at syscall+0x3bf/frame 0xc8477cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8477cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command run pid 25418 tid 100236 td 0xcc1ac000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cc1ac000,ffffffff,634a,1878c,cc1ac000,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command run pid 25417 tid 100238 td 0xcc1ab6a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cc1ab6a0,ffffffff,6349,1878e,cc1ab6a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command run pid 25416 tid 100331 td 0xccfd0000 sched_switch(ccfd0000,0,104,196,c8480a7c,...) at sched_switch+0x4e1/frame 0xc8480a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc8480a7c sleepq_switch(ccfd0000,0,c15cc34d,1c2,c8480b1c,...) at sleepq_switch+0xf0/frame 0xc8480ab0 sleepq_catch_signals(1,10000000,0,c95b8998,c9604760,...) at sleepq_catch_signals+0x443/frame 0xc8480af4 sleepq_timedwait_sig(c1a8d021,6c,d81,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xc8480b1c _sleep(c1a8d021,0,16c,c15c70f2,a46fdbe4,...) at _sleep+0x30f/frame 0xc8480b78 kern_nanosleep(bfbfe330,c8480bf0,c8480bf8,0,1,...) at kern_nanosleep+0x137/frame 0xc8480bd8 sys_nanosleep(ccfd0000,c8480ca8,c15bd083,4,db,...) at sys_nanosleep+0x68/frame 0xc8480c18 syscall(c8480ce8) at syscall+0x3bf/frame 0xc8480cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc8480cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164693, esp = 0xbfbfe324, ebp = 0xbfbfe368 --- Tracing command sh pid 25368 tid 100335 td 0xcd12a6a0 sched_switch(cd12a6a0,0,104,196,c848ca10,...) at sched_switch+0x4e1/frame 0xc848c9d8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xc848ca10 sleepq_switch(cd12a6a0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xc848ca44 sleepq_catch_signals(c15cc34d,170,cc092198,60,cd12a6a0,...) at sleepq_catch_signals+0x443/frame 0xc848ca88 sleepq_wait_sig(cc092000,5c,c15cf8cd,100,0,...) at sleepq_wait_sig+0x14/frame 0xc848caac _sleep(cc092000,cc092188,15c,c15cf8cd,0,...) at _sleep+0x33f/frame 0xc848cb08 pipe_read(c98077a8,c848cbe8,c964e800,0,cd12a6a0,...) at pipe_read+0x2ca/frame 0xc848cb4c dofileread(c98077a8,c848cbe8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xc848cb80 kern_readv(cd12a6a0,3,c848cbe8,ffffffff,bfbfe798,...) at kern_readv+0x93/frame 0xc848cbc8 sys_read(cd12a6a0,c848cca8,c15bd083,4,ccfb3a80,...) at sys_read+0x59/frame 0xc848cc18 syscall(c848cce8) at syscall+0x3bf/frame 0xc848ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc848ccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2820aaf3, esp = 0xbfbfe6fc, ebp = 0xbfbfe710 --- Tracing command sh pid 25349 tid 100330 td 0xcc1e8350 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cc1e8350,ffffffff,6305,187ea,cc1e8350,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command su pid 25347 tid 100199 td 0xc96299f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c96299f0,ffffffff,6303,18767,c96299f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command newnfs 16 pid 25331 tid 100324 td 0xcc1e86a0 sched_switch(cc1e86a0,0,104,196,c846b67c,...) at sched_switch+0x4e1/frame 0xc846b644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc846b67c sleepq_switch(cc1e86a0,0,c15cc34d,1c2,c846b71c,...) at sleepq_switch+0xf0/frame 0xc846b6b0 sleepq_catch_signals(1,c00402e5,12,cc1fe810,2c4,...) at sleepq_catch_signals+0x443/frame 0xc846b6f4 sleepq_timedwait_sig(c978ec00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc846b71c _sleep(c978ec00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc846b778 clnt_vc_call(c96a30c0,c846b938,7,cb14de00,c846ba68,...) at clnt_vc_call+0x715/frame 0xc846b850 clnt_reconnect_call(c96a30e0,c846b938,7,cb14de00,c846ba68,...) at clnt_reconnect_call+0xcc/frame 0xc846b8b8 newnfs_request(c846ba68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc846b980 nfscl_request(c846ba68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc846b9c8 nfsrpc_write(cb8f29d8,c846bc30,c846bc58,c846bc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc846bb20 ncl_writerpc(cb8f29d8,c846bc30,ca10e600,c846bc58,c846bc54,...) at ncl_writerpc+0xdb/frame 0xc846bbf8 ncl_doio(cb8f29d8,e4ae78b0,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc846bc70 nfssvc_iod(c1a82978,c846bce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc846bcac fork_exit(c0b65190,c1a82978,c846bce8) at fork_exit+0x7e/frame 0xc846bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc846bcd4 --- trap 0, eip = 0, esp = 0xc846bd20, ebp = 0 --- Tracing command newnfs 15 pid 25330 tid 100323 td 0xcc1e89f0 sched_switch(cc1e89f0,0,104,196,c846867c,...) at sched_switch+0x4e1/frame 0xc8468644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc846867c sleepq_switch(cc1e89f0,0,c15cc34d,1c2,c846871c,...) at sleepq_switch+0xf0/frame 0xc84686b0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,240,...) at sleepq_catch_signals+0x443/frame 0xc84686f4 sleepq_timedwait_sig(c97fc000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc846871c _sleep(c97fc000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8468778 clnt_vc_call(c96a30c0,c8468938,7,ca4f3500,c8468a68,...) at clnt_vc_call+0x715/frame 0xc8468850 clnt_reconnect_call(c96a30e0,c8468938,7,ca4f3500,c8468a68,...) at clnt_reconnect_call+0xcc/frame 0xc84688b8 newnfs_request(c8468a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8468980 nfscl_request(c8468a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84689c8 nfsrpc_write(cb8f29d8,c8468c30,c8468c58,c8468c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc8468b20 ncl_writerpc(cb8f29d8,c8468c30,ca10e600,c8468c58,c8468c54,...) at ncl_writerpc+0xdb/frame 0xc8468bf8 ncl_doio(cb8f29d8,e49d0d50,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc8468c70 nfssvc_iod(c1a82974,c8468ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc8468cac fork_exit(c0b65190,c1a82974,c8468ce8) at fork_exit+0x7e/frame 0xc8468cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc8468cd4 --- trap 0, eip = 0, esp = 0xc8468d20, ebp = 0 --- Tracing command newnfs 14 pid 25329 tid 100322 td 0xcc1e9000 sched_switch(cc1e9000,0,104,196,c846567c,...) at sched_switch+0x4e1/frame 0xc8465644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc846567c sleepq_switch(cc1e9000,0,c15cc34d,1c2,c846571c,...) at sleepq_switch+0xf0/frame 0xc84656b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2a6,...) at sleepq_catch_signals+0x443/frame 0xc84656f4 sleepq_timedwait_sig(c978e200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc846571c _sleep(c978e200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8465778 clnt_vc_call(c96a30c0,c8465938,7,ca4f3b00,c8465a68,...) at clnt_vc_call+0x715/frame 0xc8465850 clnt_reconnect_call(c96a30e0,c8465938,7,ca4f3b00,c8465a68,...) at clnt_reconnect_call+0xcc/frame 0xc84658b8 newnfs_request(c8465a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8465980 nfscl_request(c8465a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84659c8 nfsrpc_write(cb8f29d8,c8465c30,c8465c58,c8465c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc8465b20 ncl_writerpc(cb8f29d8,c8465c30,ca10e600,c8465c58,c8465c54,...) at ncl_writerpc+0xdb/frame 0xc8465bf8 ncl_doio(cb8f29d8,e4ae8d00,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc8465c70 nfssvc_iod(c1a82970,c8465ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc8465cac fork_exit(c0b65190,c1a82970,c8465ce8) at fork_exit+0x7e/frame 0xc8465cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc8465cd4 --- trap 0, eip = 0, esp = 0xc8465d20, ebp = 0 --- Tracing command newnfs 13 pid 25328 tid 100321 td 0xcc1e9350 sched_switch(cc1e9350,0,104,196,c846267c,...) at sched_switch+0x4e1/frame 0xc8462644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc846267c sleepq_switch(cc1e9350,0,c15cc34d,1c2,c846271c,...) at sleepq_switch+0xf0/frame 0xc84626b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2a0,...) at sleepq_catch_signals+0x443/frame 0xc84626f4 sleepq_timedwait_sig(c9c2e000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc846271c _sleep(c9c2e000,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc8462778 clnt_vc_call(c96a30c0,c8462938,7,c9cce100,c8462a68,...) at clnt_vc_call+0x715/frame 0xc8462850 clnt_reconnect_call(c96a30e0,c8462938,7,c9cce100,c8462a68,...) at clnt_reconnect_call+0xcc/frame 0xc84628b8 newnfs_request(c8462a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc8462980 nfscl_request(c8462a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc84629c8 nfsrpc_write(cb8f29d8,c8462c30,c8462c58,c8462c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc8462b20 ncl_writerpc(cb8f29d8,c8462c30,ca10e600,c8462c58,c8462c54,...) at ncl_writerpc+0xdb/frame 0xc8462bf8 ncl_doio(cb8f29d8,e4a1aa90,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc8462c70 nfssvc_iod(c1a8296c,c8462ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc8462cac fork_exit(c0b65190,c1a8296c,c8462ce8) at fork_exit+0x7e/frame 0xc8462cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc8462cd4 --- trap 0, eip = 0, esp = 0xc8462d20, ebp = 0 --- Tracing command newnfs 12 pid 25327 tid 100320 td 0xcc1e96a0 sched_switch(cc1e96a0,0,104,196,c845f67c,...) at sched_switch+0x4e1/frame 0xc845f644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc845f67c sleepq_switch(cc1e96a0,0,c15cc34d,1c2,c845f71c,...) at sleepq_switch+0xf0/frame 0xc845f6b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2be,...) at sleepq_catch_signals+0x443/frame 0xc845f6f4 sleepq_timedwait_sig(c9c2ea00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xc845f71c _sleep(c9c2ea00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xc845f778 clnt_vc_call(c96a30c0,c845f938,7,cc393600,c845fa68,...) at clnt_vc_call+0x715/frame 0xc845f850 clnt_reconnect_call(c96a30e0,c845f938,7,cc393600,c845fa68,...) at clnt_reconnect_call+0xcc/frame 0xc845f8b8 newnfs_request(c845fa68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xc845f980 nfscl_request(c845fa68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xc845f9c8 nfsrpc_write(cb8f29d8,c845fc30,c845fc58,c845fc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xc845fb20 ncl_writerpc(cb8f29d8,c845fc30,ca10e600,c845fc58,c845fc54,...) at ncl_writerpc+0xdb/frame 0xc845fbf8 ncl_doio(cb8f29d8,e4ae4840,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xc845fc70 nfssvc_iod(c1a82968,c845fce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xc845fcac fork_exit(c0b65190,c1a82968,c845fce8) at fork_exit+0x7e/frame 0xc845fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc845fcd4 --- trap 0, eip = 0, esp = 0xc845fd20, ebp = 0 --- Tracing command newnfs 11 pid 25326 tid 100319 td 0xcc1e99f0 (CPU 0) cpustop_handler(0,13,f3bfd510,c11e0497,c89a5d00,...) at cpustop_handler+0x25/frame 0xf3bfd3c0 ipi_nmi_handler(c89a5d00,c89a5618,c9049140,0,c156deb4,...) at ipi_nmi_handler+0x36/frame 0xf3bfd3d0 trap(f3bfd51c) at trap+0x37/frame 0xf3bfd510 calltrap() at calltrap+0x6/frame 0xf3bfd510 --- trap 0x13, eip = 0xc11eb8ed, esp = 0xf3bfd55c, ebp = 0xf3bfd5c0 --- __qdivrem(93b9fba7,5c0,3e8,0,f3bfd5e0,...) at __qdivrem+0x43d/frame 0xf3bfd5c0 __umoddi3(93b9fba7,5c0,3e8,0,ca154cd8,...) at __umoddi3+0x33/frame 0xf3bfd5f4 lock_delay(f3bfd670,c160f53b,8,c8e04400,cc1e99f0,...) at lock_delay+0x43/frame 0xf3bfd618 __rw_wlock_hard(ca154cd8,cc1e99f0,c15f7027,36a,0,...) at __rw_wlock_hard+0xf8/frame 0xf3bfd68c _rw_wlock_cookie(ca154cd8,c15f7027,36a,cc1e99f0,f3bfd704,...) at _rw_wlock_cookie+0xeb/frame 0xf3bfd6c0 tcp_usr_send(ca48b830,0,cd08b900,0,0,...) at tcp_usr_send+0x5f/frame 0xf3bfd704 sosend_generic(ca48b830,0,0,cd08b900,0,...) at sosend_generic+0x425/frame 0xf3bfd778 clnt_vc_call(c96a30c0,f3bfd938,7,ca1bb600,f3bfda68,...) at clnt_vc_call+0x492/frame 0xf3bfd850 clnt_reconnect_call(c96a30e0,f3bfd938,7,ca1bb600,f3bfda68,...) at clnt_reconnect_call+0xcc/frame 0xf3bfd8b8 newnfs_request(f3bfda68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bfd980 nfscl_request(f3bfda68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bfd9c8 nfsrpc_write(cb8f29d8,f3bfdc30,f3bfdc58,f3bfdc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bfdb20 ncl_writerpc(cb8f29d8,f3bfdc30,ca10e600,f3bfdc58,f3bfdc54,...) at ncl_writerpc+0xdb/frame 0xf3bfdbf8 ncl_doio(cb8f29d8,e4aecd10,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bfdc70 nfssvc_iod(c1a82964,f3bfdce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bfdcac fork_exit(c0b65190,c1a82964,f3bfdce8) at fork_exit+0x7e/frame 0xf3bfdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bfdcd4 --- trap 0, eip = 0, esp = 0xf3bfdd20, ebp = 0 --- Tracing command newnfs 10 pid 25325 tid 100318 td 0xcc1ea000 sched_switch(cc1ea000,0,104,196,f3bfa67c,...) at sched_switch+0x4e1/frame 0xf3bfa644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3bfa67c sleepq_switch(cc1ea000,0,c15cc34d,1c2,f3bfa71c,...) at sleepq_switch+0xf0/frame 0xf3bfa6b0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,222,...) at sleepq_catch_signals+0x443/frame 0xf3bfa6f4 sleepq_timedwait_sig(c975b600,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3bfa71c _sleep(c975b600,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3bfa778 clnt_vc_call(c96a30c0,f3bfa938,7,cbd9a300,f3bfaa68,...) at clnt_vc_call+0x715/frame 0xf3bfa850 clnt_reconnect_call(c96a30e0,f3bfa938,7,cbd9a300,f3bfaa68,...) at clnt_reconnect_call+0xcc/frame 0xf3bfa8b8 newnfs_request(f3bfaa68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bfa980 nfscl_request(f3bfaa68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bfa9c8 nfsrpc_write(cb8f29d8,f3bfac30,f3bfac58,f3bfac54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bfab20 ncl_writerpc(cb8f29d8,f3bfac30,ca10e600,f3bfac58,f3bfac54,...) at ncl_writerpc+0xdb/frame 0xf3bfabf8 ncl_doio(cb8f29d8,e49379c0,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bfac70 nfssvc_iod(c1a82960,f3bface8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bfacac fork_exit(c0b65190,c1a82960,f3bface8) at fork_exit+0x7e/frame 0xf3bfacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bfacd4 --- trap 0, eip = 0, esp = 0xf3bfad20, ebp = 0 --- Tracing command newnfs 9 pid 25324 tid 100317 td 0xcd00b6a0 sched_switch(cd00b6a0,0,104,196,f3bf767c,...) at sched_switch+0x4e1/frame 0xf3bf7644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3bf767c sleepq_switch(cd00b6a0,0,c15cc34d,1c2,f3bf771c,...) at sleepq_switch+0xf0/frame 0xf3bf76b0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,2ac,...) at sleepq_catch_signals+0x443/frame 0xf3bf76f4 sleepq_timedwait_sig(c9c2e400,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3bf771c _sleep(c9c2e400,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3bf7778 clnt_vc_call(c96a30c0,f3bf7938,7,cb533400,f3bf7a68,...) at clnt_vc_call+0x715/frame 0xf3bf7850 clnt_reconnect_call(c96a30e0,f3bf7938,7,cb533400,f3bf7a68,...) at clnt_reconnect_call+0xcc/frame 0xf3bf78b8 newnfs_request(f3bf7a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bf7980 nfscl_request(f3bf7a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bf79c8 nfsrpc_write(cb8f29d8,f3bf7c30,f3bf7c58,f3bf7c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bf7b20 ncl_writerpc(cb8f29d8,f3bf7c30,ca10e600,f3bf7c58,f3bf7c54,...) at ncl_writerpc+0xdb/frame 0xf3bf7bf8 ncl_doio(cb8f29d8,e49edef0,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bf7c70 nfssvc_iod(c1a8295c,f3bf7ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bf7cac fork_exit(c0b65190,c1a8295c,f3bf7ce8) at fork_exit+0x7e/frame 0xf3bf7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bf7cd4 --- trap 0, eip = 0, esp = 0xf3bf7d20, ebp = 0 --- Tracing command newnfs 8 pid 25323 tid 100316 td 0xcd00b9f0 sched_switch(cd00b9f0,0,104,196,f3bf467c,...) at sched_switch+0x4e1/frame 0xf3bf4644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3bf467c sleepq_switch(cd00b9f0,0,c15cc34d,1c2,f3bf471c,...) at sleepq_switch+0xf0/frame 0xf3bf46b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,156,...) at sleepq_catch_signals+0x443/frame 0xf3bf46f4 sleepq_timedwait_sig(c9f77200,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3bf471c _sleep(c9f77200,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3bf4778 clnt_vc_call(c96a30c0,f3bf4938,7,cc0f8200,f3bf4a68,...) at clnt_vc_call+0x715/frame 0xf3bf4850 clnt_reconnect_call(c96a30e0,f3bf4938,7,cc0f8200,f3bf4a68,...) at clnt_reconnect_call+0xcc/frame 0xf3bf48b8 newnfs_request(f3bf4a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bf4980 nfscl_request(f3bf4a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bf49c8 nfsrpc_write(cb8f29d8,f3bf4c30,f3bf4c58,f3bf4c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bf4b20 ncl_writerpc(cb8f29d8,f3bf4c30,ca10e600,f3bf4c58,f3bf4c54,...) at ncl_writerpc+0xdb/frame 0xf3bf4bf8 ncl_doio(cb8f29d8,e4ae1e10,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bf4c70 nfssvc_iod(c1a82958,f3bf4ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bf4cac fork_exit(c0b65190,c1a82958,f3bf4ce8) at fork_exit+0x7e/frame 0xf3bf4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bf4cd4 --- trap 0, eip = 0, esp = 0xf3bf4d20, ebp = 0 --- Tracing command newnfs 7 pid 25322 tid 100315 td 0xcd00c000 sched_switch(cd00c000,0,104,196,f3bf167c,...) at sched_switch+0x4e1/frame 0xf3bf1644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3bf167c sleepq_switch(cd00c000,0,c15cc34d,1c2,f3bf171c,...) at sleepq_switch+0xf0/frame 0xf3bf16b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,258,...) at sleepq_catch_signals+0x443/frame 0xf3bf16f4 sleepq_timedwait_sig(ccd3c800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3bf171c _sleep(ccd3c800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3bf1778 clnt_vc_call(c96a30c0,f3bf1938,7,c9f5b500,f3bf1a68,...) at clnt_vc_call+0x715/frame 0xf3bf1850 clnt_reconnect_call(c96a30e0,f3bf1938,7,c9f5b500,f3bf1a68,...) at clnt_reconnect_call+0xcc/frame 0xf3bf18b8 newnfs_request(f3bf1a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bf1980 nfscl_request(f3bf1a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bf19c8 nfsrpc_write(cb8f29d8,f3bf1c30,f3bf1c58,f3bf1c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bf1b20 ncl_writerpc(cb8f29d8,f3bf1c30,ca10e600,f3bf1c58,f3bf1c54,...) at ncl_writerpc+0xdb/frame 0xf3bf1bf8 ncl_doio(cb8f29d8,e4ae2f40,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bf1c70 nfssvc_iod(c1a82954,f3bf1ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bf1cac fork_exit(c0b65190,c1a82954,f3bf1ce8) at fork_exit+0x7e/frame 0xf3bf1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bf1cd4 --- trap 0, eip = 0, esp = 0xf3bf1d20, ebp = 0 --- Tracing command newnfs 6 pid 25321 tid 100314 td 0xcd00c350 sched_switch(cd00c350,0,104,196,f3bee67c,...) at sched_switch+0x4e1/frame 0xf3bee644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3bee67c sleepq_switch(cd00c350,0,c15cc34d,1c2,f3bee71c,...) at sleepq_switch+0xf0/frame 0xf3bee6b0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,2b8,...) at sleepq_catch_signals+0x443/frame 0xf3bee6f4 sleepq_timedwait_sig(c978e800,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3bee71c _sleep(c978e800,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3bee778 clnt_vc_call(c96a30c0,f3bee938,7,cbdb3700,f3beea68,...) at clnt_vc_call+0x715/frame 0xf3bee850 clnt_reconnect_call(c96a30e0,f3bee938,7,cbdb3700,f3beea68,...) at clnt_reconnect_call+0xcc/frame 0xf3bee8b8 newnfs_request(f3beea68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bee980 nfscl_request(f3beea68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bee9c8 nfsrpc_write(cb8f29d8,f3beec30,f3beec58,f3beec54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3beeb20 ncl_writerpc(cb8f29d8,f3beec30,ca10e600,f3beec58,f3beec54,...) at ncl_writerpc+0xdb/frame 0xf3beebf8 ncl_doio(cb8f29d8,e4ae09c0,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3beec70 nfssvc_iod(c1a82950,f3beece8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3beecac fork_exit(c0b65190,c1a82950,f3beece8) at fork_exit+0x7e/frame 0xf3beecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3beecd4 --- trap 0, eip = 0, esp = 0xf3beed20, ebp = 0 --- Tracing command newnfs 5 pid 25320 tid 100313 td 0xcd00c6a0 sched_switch(cd00c6a0,0,104,196,f3beb67c,...) at sched_switch+0x4e1/frame 0xf3beb644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3beb67c sleepq_switch(cd00c6a0,0,c15cc34d,1c2,f3beb71c,...) at sleepq_switch+0xf0/frame 0xf3beb6b0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,7e,...) at sleepq_catch_signals+0x443/frame 0xf3beb6f4 sleepq_timedwait_sig(cc1e2a00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3beb71c _sleep(cc1e2a00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3beb778 clnt_vc_call(c96a30c0,f3beb938,7,ca643800,f3beba68,...) at clnt_vc_call+0x715/frame 0xf3beb850 clnt_reconnect_call(c96a30e0,f3beb938,7,ca643800,f3beba68,...) at clnt_reconnect_call+0xcc/frame 0xf3beb8b8 newnfs_request(f3beba68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3beb980 nfscl_request(f3beba68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3beb9c8 nfsrpc_write(cb8f29d8,f3bebc30,f3bebc58,f3bebc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bebb20 ncl_writerpc(cb8f29d8,f3bebc30,ca10e600,f3bebc58,f3bebc54,...) at ncl_writerpc+0xdb/frame 0xf3bebbf8 ncl_doio(cb8f29d8,e4ae4070,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bebc70 nfssvc_iod(c1a8294c,f3bebce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bebcac fork_exit(c0b65190,c1a8294c,f3bebce8) at fork_exit+0x7e/frame 0xf3bebcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bebcd4 --- trap 0, eip = 0, esp = 0xf3bebd20, ebp = 0 --- Tracing command newnfs 4 pid 25319 tid 100312 td 0xcd00c9f0 sched_switch(cd00c9f0,0,104,196,f3be867c,...) at sched_switch+0x4e1/frame 0xf3be8644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3be867c sleepq_switch(cd00c9f0,0,c15cc34d,1c2,f3be871c,...) at sleepq_switch+0xf0/frame 0xf3be86b0 sleepq_catch_signals(3,c00402e5,12,cc1fe810,25e,...) at sleepq_catch_signals+0x443/frame 0xf3be86f4 sleepq_timedwait_sig(ccd3ca00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3be871c _sleep(ccd3ca00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3be8778 clnt_vc_call(c96a30c0,f3be8938,7,cb537900,f3be8a68,...) at clnt_vc_call+0x715/frame 0xf3be8850 clnt_reconnect_call(c96a30e0,f3be8938,7,cb537900,f3be8a68,...) at clnt_reconnect_call+0xcc/frame 0xf3be88b8 newnfs_request(f3be8a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3be8980 nfscl_request(f3be8a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3be89c8 nfsrpc_write(cb8f29d8,f3be8c30,f3be8c58,f3be8c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3be8b20 ncl_writerpc(cb8f29d8,f3be8c30,ca10e600,f3be8c58,f3be8c54,...) at ncl_writerpc+0xdb/frame 0xf3be8bf8 ncl_doio(cb8f29d8,e4ae0b50,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3be8c70 nfssvc_iod(c1a82948,f3be8ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3be8cac fork_exit(c0b65190,c1a82948,f3be8ce8) at fork_exit+0x7e/frame 0xf3be8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3be8cd4 --- trap 0, eip = 0, esp = 0xf3be8d20, ebp = 0 --- Tracing command newnfs 3 pid 25318 tid 100311 td 0xcd00d000 sched_switch(cd00d000,0,104,196,f3be567c,...) at sched_switch+0x4e1/frame 0xf3be5644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3be567c sleepq_switch(cd00d000,0,c15cc34d,1c2,f3be571c,...) at sleepq_switch+0xf0/frame 0xf3be56b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2c4,...) at sleepq_catch_signals+0x443/frame 0xf3be56f4 sleepq_timedwait_sig(c9c2ec00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3be571c _sleep(c9c2ec00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3be5778 clnt_vc_call(c96a30c0,f3be5938,7,cb78e000,f3be5a68,...) at clnt_vc_call+0x715/frame 0xf3be5850 clnt_reconnect_call(c96a30e0,f3be5938,7,cb78e000,f3be5a68,...) at clnt_reconnect_call+0xcc/frame 0xf3be58b8 newnfs_request(f3be5a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3be5980 nfscl_request(f3be5a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3be59c8 nfsrpc_write(cb8f29d8,f3be5c30,f3be5c58,f3be5c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3be5b20 ncl_writerpc(cb8f29d8,f3be5c30,ca10e600,f3be5c58,f3be5c54,...) at ncl_writerpc+0xdb/frame 0xf3be5bf8 ncl_doio(cb8f29d8,e49c5680,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3be5c70 nfssvc_iod(c1a82944,f3be5ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3be5cac fork_exit(c0b65190,c1a82944,f3be5ce8) at fork_exit+0x7e/frame 0xf3be5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3be5cd4 --- trap 0, eip = 0, esp = 0xf3be5d20, ebp = 0 --- Tracing command newnfs 2 pid 25317 tid 100310 td 0xcd00d350 sched_switch(cd00d350,0,104,196,f3be267c,...) at sched_switch+0x4e1/frame 0xf3be2644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3be267c sleepq_switch(cd00d350,0,c15cc34d,1c2,f3be271c,...) at sleepq_switch+0xf0/frame 0xf3be26b0 sleepq_catch_signals(0,c00402e5,12,cc1fe810,84,...) at sleepq_catch_signals+0x443/frame 0xf3be26f4 sleepq_timedwait_sig(cc1e2c00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3be271c _sleep(cc1e2c00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3be2778 clnt_vc_call(c96a30c0,f3be2938,7,ca4f5c00,f3be2a68,...) at clnt_vc_call+0x715/frame 0xf3be2850 clnt_reconnect_call(c96a30e0,f3be2938,7,ca4f5c00,f3be2a68,...) at clnt_reconnect_call+0xcc/frame 0xf3be28b8 newnfs_request(f3be2a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3be2980 nfscl_request(f3be2a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3be29c8 nfsrpc_write(cb8f29d8,f3be2c30,f3be2c58,f3be2c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3be2b20 ncl_writerpc(cb8f29d8,f3be2c30,ca10e600,f3be2c58,f3be2c54,...) at ncl_writerpc+0xdb/frame 0xf3be2bf8 ncl_doio(cb8f29d8,e49d2010,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3be2c70 nfssvc_iod(c1a82940,f3be2ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3be2cac fork_exit(c0b65190,c1a82940,f3be2ce8) at fork_exit+0x7e/frame 0xf3be2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3be2cd4 --- trap 0, eip = 0, esp = 0xf3be2d20, ebp = 0 --- Tracing command newnfs 1 pid 25316 tid 100309 td 0xccfd06a0 sched_switch(ccfd06a0,0,104,196,f3bdf67c,...) at sched_switch+0x4e1/frame 0xf3bdf644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3bdf67c sleepq_switch(ccfd06a0,0,c15cc34d,1c2,f3bdf71c,...) at sleepq_switch+0xf0/frame 0xf3bdf6b0 sleepq_catch_signals(2,c00402e5,12,cc1fe810,2b2,...) at sleepq_catch_signals+0x443/frame 0xf3bdf6f4 sleepq_timedwait_sig(c9c2e600,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3bdf71c _sleep(c9c2e600,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3bdf778 clnt_vc_call(c96a30c0,f3bdf938,7,cb533e00,f3bdfa68,...) at clnt_vc_call+0x715/frame 0xf3bdf850 clnt_reconnect_call(c96a30e0,f3bdf938,7,cb533e00,f3bdfa68,...) at clnt_reconnect_call+0xcc/frame 0xf3bdf8b8 newnfs_request(f3bdfa68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3bdf980 nfscl_request(f3bdfa68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf3bdf9c8 nfsrpc_write(cb8f29d8,f3bdfc30,f3bdfc58,f3bdfc54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3bdfb20 ncl_writerpc(cb8f29d8,f3bdfc30,ca10e600,f3bdfc58,f3bdfc54,...) at ncl_writerpc+0xdb/frame 0xf3bdfbf8 ncl_doio(cb8f29d8,e4aea2e0,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3bdfc70 nfssvc_iod(c1a8293c,f3bdfce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3bdfcac fork_exit(c0b65190,c1a8293c,f3bdfce8) at fork_exit+0x7e/frame 0xf3bdfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3bdfcd4 --- trap 0, eip = 0, esp = 0xf3bdfd20, ebp = 0 --- Tracing command creat pid 25309 tid 100228 td 0xcb1fe350 sched_switch(cb1fe350,0,602,192,cb1fe350,...) at sched_switch+0x4e1/frame 0xf3ac9a2c mi_switch(602,0,c15c5e90,d3,cb1fe350,...) at mi_switch+0x18c/frame 0xf3ac9a64 critical_exit(cb1fe350,0,0) at critical_exit+0xa2/frame 0xf3ac9a80 ipi_bitmap_handler(8,28,28,f3ac9bc8,196fd,...) at ipi_bitmap_handler+0x6b/frame 0xf3ac9aa0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3ac9aa0 --- interrupt, eip = 0xc0bfab44, esp = 0xf3ac9ae8, ebp = 0xf3ac9b00 --- falloc_noinstall(cb1fe350,f3ac9bc8,2000000,0,0,...) at falloc_noinstall+0x54/frame 0xf3ac9b00 kern_openat(cb1fe350,ffffff9c,bfbfe528,0,601,1b0) at kern_openat+0x2a6/frame 0xf3ac9bf0 sys_openat(cb1fe350,f3ac9ca8,c15bd083,4,cc1a8a80,...) at sys_openat+0x53/frame 0xf3ac9c18 syscall(f3ac9ce8) at syscall+0x3bf/frame 0xf3ac9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3ac9cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28165683, esp = 0xbfbfe4f8, ebp = 0xbfbfe510 --- Tracing command creat pid 25307 tid 100308 td 0xccfd09f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ccfd09f0,ffffffff,62db,187d4,ccfd09f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command swap pid 25305 tid 100306 td 0xccfd1000 sched_switch(ccfd1000,0,602,192,ccfd1000,...) at sched_switch+0x4e1/frame 0xf3bd6c6c mi_switch(602,0,c15c5e90,d3,ccfd1000,...) at mi_switch+0x18c/frame 0xf3bd6ca4 critical_exit(ccfd1000,0,3) at critical_exit+0xa2/frame 0xf3bd6cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3bd6ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3bd6ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25304 tid 100305 td 0xccfd1350 sched_switch(ccfd1350,0,602,192,ccfd1350,...) at sched_switch+0x4e1/frame 0xf3bd3c6c mi_switch(602,0,c15c5e90,d3,ccfd1350,...) at mi_switch+0x18c/frame 0xf3bd3ca4 critical_exit(ccfd1350,0,2) at critical_exit+0xa2/frame 0xf3bd3cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3bd3ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3bd3ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25303 tid 100304 td 0xccfd16a0 sched_switch(ccfd16a0,0,104,196,f3bd0990,...) at sched_switch+0x4e1/frame 0xf3bd0958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bd0990 sleepq_switch(ccfd16a0,0,c15cc34d,28b,ccfd16a0,...) at sleepq_switch+0xf0/frame 0xf3bd09c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3bd09e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3bd0a44 vm_waitpfault(cb7793c0,450,0,f3bd0afc,f3bd0aec,...) at vm_waitpfault+0x99/frame 0xf3bd0a70 vm_fault_hold(c9c6cb10,28c50000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3bd0b30 vm_fault(c9c6cb10,28c50000,2,0,7d,...) at vm_fault+0x88/frame 0xf3bd0b58 trap_pfault(28c50000,f3bd0ce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xf3bd0ba0 trap(f3bd0ce8) at trap+0x3ec/frame 0xf3bd0cdc calltrap() at calltrap+0x6/frame 0xf3bd0cdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25302 tid 100303 td 0xccfd19f0 sched_switch(ccfd19f0,0,602,192,c186d654,...) at sched_switch+0x4e1/frame 0xf3bcdc18 mi_switch(602,0,c15c5e90,d3,c8e9b000,...) at mi_switch+0x18c/frame 0xf3bcdc50 critical_exit(c9038b80,c1a9a980,8,c15c5e90,0,...) at critical_exit+0xa2/frame 0xf3bcdc6c intr_event_handle(c8e9b000,f3bcdce8,c0c57cd7,1,3,...) at intr_event_handle+0x11f/frame 0xf3bcdc98 intr_execute_handlers(c9038b80,f3bcdce8,1) at intr_execute_handlers+0x42/frame 0xf3bcdcb8 lapic_handle_intr(33,f3bcdce8) at lapic_handle_intr+0x5d/frame 0xf3bcdcd8 Xapic_isr1() at Xapic_isr1+0x55/frame 0xf3bcdcd8 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25301 tid 100302 td 0xccfd2000 sched_switch(ccfd2000,0,104,196,f3bca990,...) at sched_switch+0x4e1/frame 0xf3bca958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bca990 sleepq_switch(ccfd2000,0,c15cc34d,28b,ccfd2000,...) at sleepq_switch+0xf0/frame 0xf3bca9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3bca9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3bcaa44 vm_waitpfault(ccf44500,2c0,0,f3bcaafc,f3bcaaec,...) at vm_waitpfault+0x99/frame 0xf3bcaa70 vm_fault_hold(cc084a24,28ac0000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3bcab30 vm_fault(cc084a24,28ac0000,2,0,7d,...) at vm_fault+0x88/frame 0xf3bcab58 trap_pfault(28ac0000,f3bcace8,c0cb3a95,246,41020f,...) at trap_pfault+0x116/frame 0xf3bcaba0 trap(f3bcace8) at trap+0x3ec/frame 0xf3bcacdc calltrap() at calltrap+0x6/frame 0xf3bcacdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25300 tid 100301 td 0xccfd2350 (CPU 2) cpustop_handler(2,13,f3bc7cdc,c11e0497,f3bc7bd4,...) at cpustop_handler+0x25/frame 0xf3bc7b90 ipi_nmi_handler(f3bc7bd4,0,0,c15ccf3d,0,...) at ipi_nmi_handler+0x36/frame 0xf3bc7ba0 trap(f3bc7ce8) at trap+0x37/frame 0xf3bc7cdc calltrap() at calltrap+0x6/frame 0xf3bc7cdc --- trap 0x13, eip = 0x80495b0, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25299 tid 100300 td 0xccfd26a0 sched_switch(ccfd26a0,0,104,196,f3bc4990,...) at sched_switch+0x4e1/frame 0xf3bc4958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bc4990 sleepq_switch(ccfd26a0,0,c15cc34d,28b,ccfd26a0,...) at sleepq_switch+0xf0/frame 0xf3bc49c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3bc49e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3bc4a44 vm_waitpfault(ccf45500,490,0,f3bc4afc,f3bc4aec,...) at vm_waitpfault+0x99/frame 0xf3bc4a70 vm_fault_hold(c9c6b1d8,28c90000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3bc4b30 vm_fault(c9c6b1d8,28c90000,2,0,7d,...) at vm_fault+0x88/frame 0xf3bc4b58 trap_pfault(28c90000,f3bc4ce8,c0cb3a95,246,414610,...) at trap_pfault+0x116/frame 0xf3bc4ba0 trap(f3bc4ce8) at trap+0x3ec/frame 0xf3bc4cdc calltrap() at calltrap+0x6/frame 0xf3bc4cdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25298 tid 100299 td 0xccfd29f0 sched_switch(ccfd29f0,0,104,196,f3bc1990,...) at sched_switch+0x4e1/frame 0xf3bc1958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bc1990 sleepq_switch(ccfd29f0,0,c15cc34d,28b,ccfd29f0,...) at sleepq_switch+0xf0/frame 0xf3bc19c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3bc19e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3bc1a44 vm_waitpfault(ccf66000,490,0,f3bc1afc,f3bc1aec,...) at vm_waitpfault+0x99/frame 0xf3bc1a70 vm_fault_hold(ca7931d8,28c90000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3bc1b30 vm_fault(ca7931d8,28c90000,2,0,7d,...) at vm_fault+0x88/frame 0xf3bc1b58 trap_pfault(28c90000,f3bc1ce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xf3bc1ba0 trap(f3bc1ce8) at trap+0x3ec/frame 0xf3bc1cdc calltrap() at calltrap+0x6/frame 0xf3bc1cdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25297 tid 100298 td 0xccfd3000 sched_switch(ccfd3000,0,104,196,f3bbe990,...) at sched_switch+0x4e1/frame 0xf3bbe958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bbe990 sleepq_switch(ccfd3000,0,c15cc34d,28b,ccfd3000,...) at sleepq_switch+0xf0/frame 0xf3bbe9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3bbe9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3bbea44 vm_waitpfault(ccf455a0,4e20,0,f3bbeafc,f3bbeaec,...) at vm_waitpfault+0x99/frame 0xf3bbea70 vm_fault_hold(c9713ce8,2d620000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3bbeb30 vm_fault(c9713ce8,2d620000,2,0,7d,...) at vm_fault+0x88/frame 0xf3bbeb58 trap_pfault(2d620000,f3bbece8,c0cb3a95,3,4149e0,...) at trap_pfault+0x116/frame 0xf3bbeba0 trap(f3bbece8) at trap+0x3ec/frame 0xf3bbecdc calltrap() at calltrap+0x6/frame 0xf3bbecdc --- trap 0xc, eip = 0x281d506f, esp = 0xbfbfe428, ebp = 0xbfbfe47c --- Tracing command swap pid 25296 tid 100297 td 0xcce8a9f0 sched_switch(cce8a9f0,0,602,192,c186d654,...) at sched_switch+0x4e1/frame 0xf3bbbc18 mi_switch(602,0,c15c5e90,d3,c8e9b000,...) at mi_switch+0x18c/frame 0xf3bbbc50 critical_exit(c9038b80,c1a9a980,8,c15c5e90,0,...) at critical_exit+0xa2/frame 0xf3bbbc6c intr_event_handle(c8e9b000,f3bbbce8,d,1,3,...) at intr_event_handle+0x11f/frame 0xf3bbbc98 intr_execute_handlers(c9038b80,f3bbbce8,1) at intr_execute_handlers+0x42/frame 0xf3bbbcb8 lapic_handle_intr(33,f3bbbce8) at lapic_handle_intr+0x5d/frame 0xf3bbbcd8 Xapic_isr1() at Xapic_isr1+0x55/frame 0xf3bbbcd8 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25295 tid 100296 td 0xccfad000 sched_switch(ccfad000,0,602,192,ccfad000,...) at sched_switch+0x4e1/frame 0xf3bb8c6c mi_switch(602,0,c15c5e90,d3,ccfad000,...) at mi_switch+0x18c/frame 0xf3bb8ca4 critical_exit(ccfad000,0,2) at critical_exit+0xa2/frame 0xf3bb8cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3bb8ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3bb8ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25294 tid 100295 td 0xccfad350 sched_switch(ccfad350,0,602,192,ccfad350,...) at sched_switch+0x4e1/frame 0xf3bb5c6c mi_switch(602,0,c15c5e90,d3,ccfad350,...) at mi_switch+0x18c/frame 0xf3bb5ca4 critical_exit(ccfad350,0,2) at critical_exit+0xa2/frame 0xf3bb5cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3bb5ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3bb5ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25293 tid 100294 td 0xccfad6a0 sched_switch(ccfad6a0,0,602,192,ccfad6a0,...) at sched_switch+0x4e1/frame 0xf3bb2c6c mi_switch(602,0,c15c5e90,d3,ccfad6a0,...) at mi_switch+0x18c/frame 0xf3bb2ca4 critical_exit(ccfad6a0,0,1) at critical_exit+0xa2/frame 0xf3bb2cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3bb2ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3bb2ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25292 tid 100293 td 0xccfad9f0 sched_switch(ccfad9f0,0,602,192,ccfad9f0,...) at sched_switch+0x4e1/frame 0xf3bafc6c mi_switch(602,0,c15c5e90,d3,ccfad9f0,...) at mi_switch+0x18c/frame 0xf3bafca4 critical_exit(ccfad9f0,0,0) at critical_exit+0xa2/frame 0xf3bafcc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3bafce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3bafce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25291 tid 100292 td 0xccfae000 sched_switch(ccfae000,0,104,196,f3bac990,...) at sched_switch+0x4e1/frame 0xf3bac958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3bac990 sleepq_switch(ccfae000,0,c15cc34d,28b,ccfae000,...) at sleepq_switch+0xf0/frame 0xf3bac9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3bac9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3baca44 vm_waitpfault(ccf65820,470,0,f3bacafc,f3bacaec,...) at vm_waitpfault+0x99/frame 0xf3baca70 vm_fault_hold(cc0890ec,28c70000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3bacb30 vm_fault(cc0890ec,28c70000,2,0,7d,...) at vm_fault+0x88/frame 0xf3bacb58 trap_pfault(28c70000,f3bacce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xf3bacba0 trap(f3bacce8) at trap+0x3ec/frame 0xf3baccdc calltrap() at calltrap+0x6/frame 0xf3baccdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25290 tid 100291 td 0xccfae350 sched_switch(ccfae350,0,602,192,ccfae350,...) at sched_switch+0x4e1/frame 0xf3ba9c6c mi_switch(602,0,c15c5e90,d3,ccfae350,...) at mi_switch+0x18c/frame 0xf3ba9ca4 critical_exit(ccfae350,0,1) at critical_exit+0xa2/frame 0xf3ba9cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3ba9ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3ba9ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25289 tid 100290 td 0xccfae6a0 sched_switch(ccfae6a0,0,602,192,ccfae6a0,...) at sched_switch+0x4e1/frame 0xf3ba6c6c mi_switch(602,0,c15c5e90,d3,ccfae6a0,...) at mi_switch+0x18c/frame 0xf3ba6ca4 critical_exit(ccfae6a0,0,2) at critical_exit+0xa2/frame 0xf3ba6cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3ba6ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3ba6ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25288 tid 100289 td 0xccfae9f0 sched_switch(ccfae9f0,0,602,192,ccfae9f0,...) at sched_switch+0x4e1/frame 0xf3ba3c6c mi_switch(602,0,c15c5e90,d3,ccfae9f0,...) at mi_switch+0x18c/frame 0xf3ba3ca4 critical_exit(ccfae9f0,0,2) at critical_exit+0xa2/frame 0xf3ba3cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3ba3ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3ba3ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25287 tid 100288 td 0xccfaf000 sched_switch(ccfaf000,0,104,196,f3ba0990,...) at sched_switch+0x4e1/frame 0xf3ba0958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3ba0990 sleepq_switch(ccfaf000,0,c15cc34d,28b,ccfaf000,...) at sleepq_switch+0xf0/frame 0xf3ba09c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3ba09e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3ba0a44 vm_waitpfault(ccf658c0,407,0,f3ba0afc,f3ba0aec,...) at vm_waitpfault+0x99/frame 0xf3ba0a70 vm_fault_hold(ca79284c,28c07000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3ba0b30 vm_fault(ca79284c,28c07000,2,0,7d,...) at vm_fault+0x88/frame 0xf3ba0b58 trap_pfault(28c07000,f3ba0ce8,c0cb3a95,246,410bfe,...) at trap_pfault+0x116/frame 0xf3ba0ba0 trap(f3ba0ce8) at trap+0x3ec/frame 0xf3ba0cdc calltrap() at calltrap+0x6/frame 0xf3ba0cdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25286 tid 100287 td 0xccfaf350 sched_switch(ccfaf350,0,602,192,ccfaf350,...) at sched_switch+0x4e1/frame 0xf3b9dc6c mi_switch(602,0,c15c5e90,d3,ccfaf350,...) at mi_switch+0x18c/frame 0xf3b9dca4 critical_exit(ccfaf350,0,1) at critical_exit+0xa2/frame 0xf3b9dcc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b9dce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b9dce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25285 tid 100286 td 0xccfaf6a0 sched_switch(ccfaf6a0,0,602,192,ccfaf6a0,...) at sched_switch+0x4e1/frame 0xf3b9ac6c mi_switch(602,0,c15c5e90,d3,ccfaf6a0,...) at mi_switch+0x18c/frame 0xf3b9aca4 critical_exit(ccfaf6a0,0,2) at critical_exit+0xa2/frame 0xf3b9acc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b9ace0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b9ace0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25284 tid 100285 td 0xccfaf9f0 sched_switch(ccfaf9f0,0,602,192,ccfaf9f0,...) at sched_switch+0x4e1/frame 0xf3b97c6c mi_switch(602,0,c15c5e90,d3,ccfaf9f0,...) at mi_switch+0x18c/frame 0xf3b97ca4 critical_exit(ccfaf9f0,0,3) at critical_exit+0xa2/frame 0xf3b97cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b97ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b97ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25283 tid 100284 td 0xcc1d5000 sched_switch(cc1d5000,0,602,192,cc1d5000,...) at sched_switch+0x4e1/frame 0xf3b94c6c mi_switch(602,0,c15c5e90,d3,cc1d5000,...) at mi_switch+0x18c/frame 0xf3b94ca4 critical_exit(cc1d5000,0,3) at critical_exit+0xa2/frame 0xf3b94cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b94ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b94ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25282 tid 100283 td 0xcc1d5350 sched_switch(cc1d5350,0,602,192,cc1d5350,...) at sched_switch+0x4e1/frame 0xf3b91c6c mi_switch(602,0,c15c5e90,d3,cc1d5350,...) at mi_switch+0x18c/frame 0xf3b91ca4 critical_exit(cc1d5350,0,0) at critical_exit+0xa2/frame 0xf3b91cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b91ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b91ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25281 tid 100282 td 0xcc1d56a0 sched_switch(cc1d56a0,0,602,192,cc1d56a0,...) at sched_switch+0x4e1/frame 0xf3b8ec6c mi_switch(602,0,c15c5e90,d3,cc1d56a0,...) at mi_switch+0x18c/frame 0xf3b8eca4 critical_exit(cc1d56a0,0,2) at critical_exit+0xa2/frame 0xf3b8ecc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b8ece0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b8ece0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25280 tid 100281 td 0xcc1d59f0 sched_switch(cc1d59f0,0,602,192,cc1d59f0,...) at sched_switch+0x4e1/frame 0xf3b8bc6c mi_switch(602,0,c15c5e90,d3,cc1d59f0,...) at mi_switch+0x18c/frame 0xf3b8bca4 critical_exit(cc1d59f0,0,3) at critical_exit+0xa2/frame 0xf3b8bcc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b8bce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b8bce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25279 tid 100280 td 0xcc1d6000 sched_switch(cc1d6000,0,602,192,cc1d6000,...) at sched_switch+0x4e1/frame 0xf3b88c6c mi_switch(602,0,c15c5e90,d3,cc1d6000,...) at mi_switch+0x18c/frame 0xf3b88ca4 critical_exit(cc1d6000,0,1) at critical_exit+0xa2/frame 0xf3b88cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b88ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b88ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25278 tid 100279 td 0xcc1d6350 (CPU 3) cpustop_handler(3,13,f3b85cdc,c11e0497,f3b85bd4,...) at cpustop_handler+0x25/frame 0xf3b85b90 ipi_nmi_handler(f3b85bd4,0,0,3,41056a,...) at ipi_nmi_handler+0x36/frame 0xf3b85ba0 trap(f3b85ce8) at trap+0x37/frame 0xf3b85cdc calltrap() at calltrap+0x6/frame 0xf3b85cdc --- trap 0x13, eip = 0x80495b7, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25277 tid 100278 td 0xcc1d66a0 sched_switch(cc1d66a0,0,602,192,cc1d66a0,...) at sched_switch+0x4e1/frame 0xf3b82c6c mi_switch(602,0,c15c5e90,d3,cc1d66a0,...) at mi_switch+0x18c/frame 0xf3b82ca4 critical_exit(cc1d66a0,0,3) at critical_exit+0xa2/frame 0xf3b82cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b82ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b82ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25276 tid 100277 td 0xcc1d69f0 sched_switch(cc1d69f0,0,602,192,cc1d69f0,...) at sched_switch+0x4e1/frame 0xf3b7fc6c mi_switch(602,0,c15c5e90,d3,cc1d69f0,...) at mi_switch+0x18c/frame 0xf3b7fca4 critical_exit(cc1d69f0,0,0) at critical_exit+0xa2/frame 0xf3b7fcc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b7fce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b7fce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25274 tid 100275 td 0xcc1d7000 sched_switch(cc1d7000,0,602,192,c186d654,...) at sched_switch+0x4e1/frame 0xf3b79c18 mi_switch(602,0,c15c5e90,d3,c8e9b000,...) at mi_switch+0x18c/frame 0xf3b79c50 critical_exit(c9038b80,765b3dc9,e4b14cac,f3b79cbc,0,...) at critical_exit+0xa2/frame 0xf3b79c6c intr_event_handle(c8e9b000,f3b79ce8,765b3dc9,1,3,...) at intr_event_handle+0x11f/frame 0xf3b79c98 intr_execute_handlers(c9038b80,f3b79ce8,1) at intr_execute_handlers+0x42/frame 0xf3b79cb8 lapic_handle_intr(33,f3b79ce8) at lapic_handle_intr+0x5d/frame 0xf3b79cd8 Xapic_isr1() at Xapic_isr1+0x55/frame 0xf3b79cd8 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25271 tid 100272 td 0xcc0c4000 sched_switch(cc0c4000,0,602,192,cc0c4000,...) at sched_switch+0x4e1/frame 0xf3b70c6c mi_switch(602,0,c15c5e90,d3,cc0c4000,...) at mi_switch+0x18c/frame 0xf3b70ca4 critical_exit(cc0c4000,0,0) at critical_exit+0xa2/frame 0xf3b70cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b70ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b70ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25269 tid 100270 td 0xcc0bf9f0 sched_switch(cc0bf9f0,0,602,192,cc0bf9f0,...) at sched_switch+0x4e1/frame 0xf3b6ac6c mi_switch(602,0,c15c5e90,d3,cc0bf9f0,...) at mi_switch+0x18c/frame 0xf3b6aca4 critical_exit(cc0bf9f0,0,3) at critical_exit+0xa2/frame 0xf3b6acc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b6ace0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b6ace0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25267 tid 100268 td 0xcc0bf6a0 sched_switch(cc0bf6a0,0,104,196,f3b64990,...) at sched_switch+0x4e1/frame 0xf3b64958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3b64990 sleepq_switch(cc0bf6a0,0,c15cc34d,28b,cc0bf6a0,...) at sleepq_switch+0xf0/frame 0xf3b649c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf3b649e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf3b64a44 vm_waitpfault(ccfe8640,1bf8,0,f3b64afc,f3b64aec,...) at vm_waitpfault+0x99/frame 0xf3b64a70 vm_fault_hold(c9c6d1d8,2a3f8000,2,0,0,...) at vm_fault_hold+0xd86/frame 0xf3b64b30 vm_fault(c9c6d1d8,2a3f8000,2,0,7d,...) at vm_fault+0x88/frame 0xf3b64b58 trap_pfault(2a3f8000,f3b64ce8,c0cb3a95,246,0,...) at trap_pfault+0x116/frame 0xf3b64ba0 trap(f3b64ce8) at trap+0x3ec/frame 0xf3b64cdc calltrap() at calltrap+0x6/frame 0xf3b64cdc --- trap 0xc, eip = 0x80495b9, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25265 tid 100256 td 0xcc1aa6a0 sched_switch(cc1aa6a0,0,602,192,cc1aa6a0,...) at sched_switch+0x4e1/frame 0xf3b40c6c mi_switch(602,0,c15c5e90,d3,cc1aa6a0,...) at mi_switch+0x18c/frame 0xf3b40ca4 critical_exit(cc1aa6a0,0,2) at critical_exit+0xa2/frame 0xf3b40cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b40ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b40ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25263 tid 100217 td 0xcc081000 sched_switch(cc081000,0,602,192,cc081000,...) at sched_switch+0x4e1/frame 0xf3aa8c6c mi_switch(602,0,c15c5e90,d3,cc081000,...) at mi_switch+0x18c/frame 0xf3aa8ca4 critical_exit(cc081000,0,2) at critical_exit+0xa2/frame 0xf3aa8cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3aa8ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3aa8ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25261 tid 100092 td 0xc96289f0 sched_switch(c96289f0,0,602,192,c96289f0,...) at sched_switch+0x4e1/frame 0xedf26c6c mi_switch(602,0,c15c5e90,d3,c96289f0,...) at mi_switch+0x18c/frame 0xedf26ca4 critical_exit(c96289f0,0,3) at critical_exit+0xa2/frame 0xedf26cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xedf26ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xedf26ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25259 tid 100233 td 0xcb1fd9f0 sched_switch(cb1fd9f0,0,602,192,cb1fd9f0,...) at sched_switch+0x4e1/frame 0xf3ad8c6c mi_switch(602,0,c15c5e90,d3,cb1fd9f0,...) at mi_switch+0x18c/frame 0xf3ad8ca4 critical_exit(cb1fd9f0,0,0) at critical_exit+0xa2/frame 0xf3ad8cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3ad8ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3ad8ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25257 tid 100237 td 0xcc1ab9f0 sched_switch(cc1ab9f0,0,602,192,c186d654,...) at sched_switch+0x4e1/frame 0xf3ae4c18 mi_switch(602,0,c15c5e90,d3,c8e9b000,...) at mi_switch+0x18c/frame 0xf3ae4c50 critical_exit(c9038b80,6369e151,e4b14cac,f3ae4cbc,0,...) at critical_exit+0xa2/frame 0xf3ae4c6c intr_event_handle(c8e9b000,f3ae4ce8,d,1,3,...) at intr_event_handle+0x11f/frame 0xf3ae4c98 intr_execute_handlers(c9038b80,f3ae4ce8,1) at intr_execute_handlers+0x42/frame 0xf3ae4cb8 lapic_handle_intr(33,f3ae4ce8) at lapic_handle_intr+0x5d/frame 0xf3ae4cd8 Xapic_isr1() at Xapic_isr1+0x55/frame 0xf3ae4cd8 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25255 tid 100248 td 0xcc1d7350 sched_switch(cc1d7350,0,602,192,cc1d7350,...) at sched_switch+0x4e1/frame 0xf3b06c6c mi_switch(602,0,c15c5e90,d3,cc1d7350,...) at mi_switch+0x18c/frame 0xf3b06ca4 critical_exit(cc1d7350,0,3) at critical_exit+0xa2/frame 0xf3b06cc0 ipi_bitmap_handler(3b,3b,3b,1000,28800000,...) at ipi_bitmap_handler+0x6b/frame 0xf3b06ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xf3b06ce0 --- interrupt, eip = 0x80495bd, esp = 0xbfbfe5a0, ebp = 0xbfbfe5b8 --- Tracing command swap pid 25253 tid 100259 td 0xcc0c49f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cc0c49f0,ffffffff,62a5,187a3,cc0c49f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command swap pid 25219 tid 100099 td 0xc9628000 sched_switch(c9628000,0,104,196,edf48a7c,...) at sched_switch+0x4e1/frame 0xedf48a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf48a7c sleepq_switch(c9628000,0,c15cc34d,1c2,edf48b1c,...) at sleepq_switch+0xf0/frame 0xedf48ab0 sleepq_catch_signals(0,10000000,0,c95b8998,c95b87e0,...) at sleepq_catch_signals+0x443/frame 0xedf48af4 sleepq_timedwait_sig(c1a8d020,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xedf48b1c _sleep(c1a8d020,0,16c,c15c70f2,6bdaf6b,...) at _sleep+0x30f/frame 0xedf48b78 kern_nanosleep(bfbfe580,edf48bf0,edf48bf8,0,1,...) at kern_nanosleep+0x137/frame 0xedf48bd8 sys_nanosleep(c9628000,edf48ca8,c15bd083,4,edf48c3c,...) at sys_nanosleep+0x68/frame 0xedf48c18 syscall(edf48ce8) at syscall+0x3bf/frame 0xedf48cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf48cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command creat pid 25216 tid 100257 td 0xcc1aa350 sched_switch(cc1aa350,0,104,196,f3b43a7c,...) at sched_switch+0x4e1/frame 0xf3b43a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3b43a7c sleepq_switch(cc1aa350,0,c15cc34d,1c2,f3b43b1c,...) at sleepq_switch+0xf0/frame 0xf3b43ab0 sleepq_catch_signals(0,10000000,0,c97e7818,c95b87e0,...) at sleepq_catch_signals+0x443/frame 0xf3b43af4 sleepq_timedwait_sig(c1a8d020,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3b43b1c _sleep(c1a8d020,0,16c,c15c70f2,22e6b286,...) at _sleep+0x30f/frame 0xf3b43b78 kern_nanosleep(bfbfe580,f3b43bf0,f3b43bf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3b43bd8 sys_nanosleep(cc1aa350,f3b43ca8,c15bd083,4,f3b43c3c,...) at sys_nanosleep+0x68/frame 0xf3b43c18 syscall(f3b43ce8) at syscall+0x3bf/frame 0xf3b43cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3b43cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28165693, esp = 0xbfbfe574, ebp = 0xbfbfe5b8 --- Tracing command run pid 25200 tid 100097 td 0xc91009f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c91009f0,ffffffff,6270,18701,c91009f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command run pid 25199 tid 100261 td 0xcce8a350 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cce8a350,ffffffff,626f,187a5,cce8a350,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command run pid 25198 tid 100242 td 0xcc07f6a0 sched_switch(cc07f6a0,0,104,196,f3af3a7c,...) at sched_switch+0x4e1/frame 0xf3af3a44 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3af3a7c sleepq_switch(cc07f6a0,0,c15cc34d,1c2,f3af3b1c,...) at sleepq_switch+0xf0/frame 0xf3af3ab0 sleepq_catch_signals(0,10000000,0,c95b7d98,c95b87e0,...) at sleepq_catch_signals+0x443/frame 0xf3af3af4 sleepq_timedwait_sig(c1a8d020,6c,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3af3b1c _sleep(c1a8d020,0,16c,c15c70f2,1619cd56,...) at _sleep+0x30f/frame 0xf3af3b78 kern_nanosleep(bfbfe330,f3af3bf0,f3af3bf8,0,1,...) at kern_nanosleep+0x137/frame 0xf3af3bd8 sys_nanosleep(cc07f6a0,f3af3ca8,c15bd083,4,f3af3c3c,...) at sys_nanosleep+0x68/frame 0xf3af3c18 syscall(f3af3ce8) at syscall+0x3bf/frame 0xf3af3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3af3cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164693, esp = 0xbfbfe324, ebp = 0xbfbfe368 --- Tracing command sh pid 22315 tid 100166 td 0xc9be8000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c9be8000,ffffffff,572b,18746,c9be8000,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command newnfs 0 pid 13046 tid 100177 td 0xc9be7350 sched_switch(c9be7350,0,104,196,f394467c,...) at sched_switch+0x4e1/frame 0xf3944644 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf394467c sleepq_switch(c9be7350,0,c15cc34d,1c2,f394471c,...) at sleepq_switch+0xf0/frame 0xf39446b0 sleepq_catch_signals(3,c00402e5,12,cc1fe810,22e,...) at sleepq_catch_signals+0x443/frame 0xf39446f4 sleepq_timedwait_sig(c975ba00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf394471c _sleep(c975ba00,cc1fe800,100,c15aa8d4,402e57,...) at _sleep+0x30f/frame 0xf3944778 clnt_vc_call(c96a30c0,f3944938,7,cb908200,f3944a68,...) at clnt_vc_call+0x715/frame 0xf3944850 clnt_reconnect_call(c96a30e0,f3944938,7,cb908200,f3944a68,...) at clnt_reconnect_call+0xcc/frame 0xf39448b8 newnfs_request(f3944a68,c905d400,0,c905d510,cb8f29d8,0,ca10e600,186a3,3,0,1,0,0) at newnfs_request+0x873/frame 0xf3944980 nfscl_request(f3944a68,cb8f29d8,0,ca10e600,0,...) at nfscl_request+0x8c/frame 0xf39449c8 nfsrpc_write(cb8f29d8,f3944c30,f3944c58,f3944c54,ca10e600,...) at nfsrpc_write+0x489/frame 0xf3944b20 ncl_writerpc(cb8f29d8,f3944c30,ca10e600,f3944c58,f3944c54,...) at ncl_writerpc+0xdb/frame 0xf3944bf8 ncl_doio(cb8f29d8,e4a90d30,ca10e600,0,0,...) at ncl_doio+0x4bf/frame 0xf3944c70 nfssvc_iod(c1a82938,f3944ce8,c15bd5d8,406,0,...) at nfssvc_iod+0x296/frame 0xf3944cac fork_exit(c0b65190,c1a82938,f3944ce8) at fork_exit+0x7e/frame 0xf3944cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3944cd4 --- trap 0, eip = 0, esp = 0xf3944d20, ebp = 0 --- Tracing command sh pid 12454 tid 100176 td 0xc9be76a0 sched_switch(c9be76a0,0,104,196,f3941994,...) at sched_switch+0x4e1/frame 0xf394195c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3941994 sleepq_switch(c9be76a0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xf39419c8 sleepq_catch_signals(c15cc34d,170,c9fc2a90,2d3,c9be76a0,...) at sleepq_catch_signals+0x443/frame 0xf3941a0c sleepq_wait_sig(c9fc29d8,6c,c15d0099,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3941a30 _sleep(c9fc29d8,c9fc2a80,16c,c15d0099,0,...) at _sleep+0x33f/frame 0xf3941a8c kern_wait6(c9be76a0,7,0,0,f3941b24,...) at kern_wait6+0x47d/frame 0xf3941af8 sys_wait4(c9be76a0,f3941ca8,c15bd083,4,0,...) at sys_wait4+0x8b/frame 0xf3941c18 syscall(f3941ce8) at syscall+0x3bf/frame 0xf3941cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3941cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2819a5d3, esp = 0xbfbfe518, ebp = 0xbfbfe530 --- Tracing command tee pid 12453 tid 100168 td 0xc96276a0 sched_switch(c96276a0,0,104,196,edf55a10,...) at sched_switch+0x4e1/frame 0xedf559d8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf55a10 sleepq_switch(c96276a0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xedf55a44 sleepq_catch_signals(c15cc34d,170,c981a338,3,c96276a0,...) at sleepq_catch_signals+0x443/frame 0xedf55a88 sleepq_wait_sig(c981a1a0,5c,c15cf8cd,100,0,...) at sleepq_wait_sig+0x14/frame 0xedf55aac _sleep(c981a1a0,c981a328,15c,c15cf8cd,0,...) at _sleep+0x33f/frame 0xedf55b08 pipe_read(cc0998c0,edf55be8,c9a6a000,0,c96276a0,...) at pipe_read+0x2ca/frame 0xedf55b4c dofileread(cc0998c0,edf55be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xedf55b80 kern_readv(c96276a0,0,edf55be8,ffffffff,28414000,...) at kern_readv+0x93/frame 0xedf55bc8 sys_read(c96276a0,edf55ca8,c15bd083,4,edf55c6c,...) at sys_read+0x59/frame 0xedf55c18 syscall(edf55ce8) at syscall+0x3bf/frame 0xedf55cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf55cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281bfaf3, esp = 0xbfbfe7b0, ebp = 0xbfbfe7c4 --- Tracing command sh pid 12452 tid 100250 td 0xcb2006a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(cb2006a0,ffffffff,30a4,1879a,cb2006a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command sh pid 2257 tid 100209 td 0xca7966a0 sched_switch(ca7966a0,0,104,196,f3a90a10,...) at sched_switch+0x4e1/frame 0xf3a909d8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a90a10 sleepq_switch(ca7966a0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xf3a90a44 sleepq_catch_signals(c15cc34d,170,c98189b8,1f8,ca7966a0,...) at sleepq_catch_signals+0x443/frame 0xf3a90a88 sleepq_wait_sig(c9818820,5c,c15cf8cd,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3a90aac _sleep(c9818820,c98189a8,15c,c15cf8cd,0,...) at _sleep+0x33f/frame 0xf3a90b08 pipe_read(c9808428,f3a90be8,c964e800,0,ca7966a0,...) at pipe_read+0x2ca/frame 0xf3a90b4c dofileread(c9808428,f3a90be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3a90b80 kern_readv(ca7966a0,0,f3a90be8,ffffffff,bfbfe99f,...) at kern_readv+0x93/frame 0xf3a90bc8 sys_read(ca7966a0,f3a90ca8,c15bd083,4,0,...) at sys_read+0x59/frame 0xf3a90c18 syscall(f3a90ce8) at syscall+0x3bf/frame 0xf3a90cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a90cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2820aaf3, esp = 0xbfbfe944, ebp = 0xbfbfe958 --- Tracing command awk pid 2255 tid 100208 td 0xca7969f0 sched_switch(ca7969f0,0,104,196,f3a8da10,...) at sched_switch+0x4e1/frame 0xf3a8d9d8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3a8da10 sleepq_switch(ca7969f0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xf3a8da44 sleepq_catch_signals(c15cc34d,170,c9818818,12,ca7969f0,...) at sleepq_catch_signals+0x443/frame 0xf3a8da88 sleepq_wait_sig(c9818680,5c,c15cf8cd,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3a8daac _sleep(c9818680,c9818808,15c,c15cf8cd,0,...) at _sleep+0x33f/frame 0xf3a8db08 pipe_read(cc099e00,f3a8dbe8,c964e800,0,ca7969f0,...) at pipe_read+0x2ca/frame 0xf3a8db4c dofileread(cc099e00,f3a8dbe8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3a8db80 kern_readv(ca7969f0,0,f3a8dbe8,ffffffff,28677000,...) at kern_readv+0x93/frame 0xf3a8dbc8 sys_read(ca7969f0,f3a8dca8,c15bd083,4,f3a8dc3c,...) at sys_read+0x59/frame 0xf3a8dc18 syscall(f3a8dce8) at syscall+0x3bf/frame 0xf3a8dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a8dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28213af3, esp = 0xbfbfe9cc, ebp = 0xbfbfe9e0 --- Tracing command sh pid 2254 tid 100207 td 0xca797000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca797000,ffffffff,8ce,1876f,ca797000,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command tail pid 2251 tid 100206 td 0xca797350 sched_switch(ca797350,0,104,196,f3a878ec,...) at sched_switch+0x4e1/frame 0xf3a878b4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3a878ec sleepq_switch(ca797350,0,c15cc34d,1c2,f3a8798c,...) at sleepq_switch+0xf0/frame 0xf3a87920 sleepq_catch_signals(3,10000000,0,c8cf1810,48,...) at sleepq_catch_signals+0x443/frame 0xf3a87964 sleepq_timedwait_sig(c8cf1800,68,d82,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3a8798c _sleep(c8cf1800,c8cf1800,168,c15bcbbd,678254b8,...) at _sleep+0x30f/frame 0xf3a879e8 kqueue_kevent(0,1,f3a87be8,f3a87bf8,0,...) at kqueue_kevent+0x35e/frame 0xf3a87b24 kern_kevent_fp(ca797350,c9727e70,0,1,f3a87be8,...) at kern_kevent_fp+0xa0/frame 0xf3a87b48 kern_kevent(ca797350,4,0,1,f3a87be8,...) at kern_kevent+0xe8/frame 0xf3a87b98 sys_kevent(ca797350,f3a87ca8,c15bd083,4,f3a87c3c,...) at sys_kevent+0x135/frame 0xf3a87c18 syscall(f3a87ce8) at syscall+0x3bf/frame 0xf3a87cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3a87cdc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x281a8e3b, esp = 0xbfbfeb90, ebp = 0xbfbfebb8 --- Tracing command sh pid 2250 tid 100205 td 0xca7976a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca7976a0,ffffffff,8ca,1876d,ca7976a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command top pid 2249 tid 100181 td 0xca4b19f0 sched_switch(ca4b19f0,0,104,196,f395c904,...) at sched_switch+0x4e1/frame 0xf395c8cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf395c904 sleepq_switch(ca4b19f0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xf395c938 sleepq_catch_signals(c186d3bc,f395c9a4,c0c2ee86,c969ce20,0,...) at sleepq_catch_signals+0x443/frame 0xf395c97c sleepq_timedwait_sig(c969ce24,0,f395c9e0,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf395c9a4 _cv_timedwait_sig_sbt(c969ce24,c969ce10,85b775df,d81,10000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf395c9f4 seltdwait(d81,10000000,0,ca4b19f0,0,...) at seltdwait+0x8d/frame 0xf395ca28 kern_select(ca4b19f0,2,bfbfec08,0,0,...) at kern_select+0x910/frame 0xf395cbd0 sys_select(ca4b19f0,f395cca8,c15bd083,4,ca760738,...) at sys_select+0x66/frame 0xf395cc18 syscall(f395cce8) at syscall+0x3bf/frame 0xf395ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf395ccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28253ae3, esp = 0xbfbfeb94, ebp = 0xbfbfebb8 --- Tracing command sshd pid 2248 tid 100190 td 0xca798000 sched_switch(ca798000,0,104,196,f397f90c,...) at sched_switch+0x4e1/frame 0xf397f8d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf397f90c sleepq_switch(ca798000,0,c15cc34d,1c2,c96da550,...) at sleepq_switch+0xf0/frame 0xf397f940 sleepq_catch_signals(f397f9a8,c0c2ee86,c96da560,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf397f984 sleepq_wait_sig(c96da564,0,f397f9e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf397f9a8 _cv_wait_sig(c96da564,c96da550,c15cf647,73c,c15cf6a2,...) at _cv_wait_sig+0x211/frame 0xf397f9f4 seltdwait(ffffffff,0,0,ca798000,0,...) at seltdwait+0xbf/frame 0xf397fa28 kern_select(ca798000,c,28a18088,28a180c0,0,...) at kern_select+0x910/frame 0xf397fbd0 sys_select(ca798000,f397fca8,c15bd083,4,ca75e3f0,...) at sys_select+0x66/frame 0xf397fc18 syscall(f397fce8) at syscall+0x3bf/frame 0xf397fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf397fcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516ae3, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 2247 tid 100170 td 0xca4b29f0 sched_switch(ca4b29f0,0,104,196,f392e90c,...) at sched_switch+0x4e1/frame 0xf392e8d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf392e90c sleepq_switch(ca4b29f0,0,c15cc34d,1c2,c969ced0,...) at sleepq_switch+0xf0/frame 0xf392e940 sleepq_catch_signals(f392e9a8,c0c2ee86,c969cee0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf392e984 sleepq_wait_sig(c969cee4,0,f392e9e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf392e9a8 _cv_wait_sig(c969cee4,c969ced0,c15cf647,73c,c15cf6a2,...) at _cv_wait_sig+0x211/frame 0xf392e9f4 seltdwait(ffffffff,0,0,ca4b29f0,0,...) at seltdwait+0xbf/frame 0xf392ea28 kern_select(ca4b29f0,c,28a18088,28a180c0,0,...) at kern_select+0x910/frame 0xf392ebd0 sys_select(ca4b29f0,f392eca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xf392ec18 syscall(f392ece8) at syscall+0x3bf/frame 0xf392ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf392ecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516ae3, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 2246 tid 100167 td 0xc97e4350 sched_switch(c97e4350,0,104,196,f392890c,...) at sched_switch+0x4e1/frame 0xf39288d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf392890c sleepq_switch(c97e4350,0,c15cc34d,1c2,c9086650,...) at sleepq_switch+0xf0/frame 0xf3928940 sleepq_catch_signals(f39289a8,c0c2ee86,c9086660,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3928984 sleepq_wait_sig(c9086664,0,f39289e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf39289a8 _cv_wait_sig(c9086664,c9086650,c15cf647,73c,c15d2494,...) at _cv_wait_sig+0x211/frame 0xf39289f4 seltdwait(ffffffff,0,0,c97e4350,0,...) at seltdwait+0xbf/frame 0xf3928a28 kern_select(c97e4350,a,28a18088,28a180c0,0,...) at kern_select+0x910/frame 0xf3928bd0 sys_select(c97e4350,f3928ca8,c15bd083,4,db,...) at sys_select+0x66/frame 0xf3928c18 syscall(f3928ce8) at syscall+0x3bf/frame 0xf3928cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3928cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516ae3, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 2242 tid 100094 td 0xc960a6a0 sched_switch(c960a6a0,0,104,196,edf31944,...) at sched_switch+0x4e1/frame 0xedf3190c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf31944 sleepq_switch(c960a6a0,0,c15cc34d,1c2,c969ce90,...) at sleepq_switch+0xf0/frame 0xedf31978 sleepq_catch_signals(edf319e0,c0c2ee86,c969cea0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedf319bc sleepq_wait_sig(c969cea4,0,edf31a18,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf319e0 _cv_wait_sig(c969cea4,c969ce90,c15cf647,73c,c15cf647,...) at _cv_wait_sig+0x211/frame 0xedf31a2c seltdwait(ffffffff,0,0,c960a6a0,0,...) at seltdwait+0xbf/frame 0xedf31a60 kern_poll(c960a6a0,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xedf31be0 sys_poll(c960a6a0,edf31ca8,c15bd083,4,edf31c3c,...) at sys_poll+0x71/frame 0xedf31c18 syscall(edf31ce8) at syscall+0x3bf/frame 0xedf31cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf31cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b88cb, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command sshd pid 2241 tid 100179 td 0xca1449f0 sched_switch(ca1449f0,0,104,196,f3955944,...) at sched_switch+0x4e1/frame 0xf395590c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3955944 sleepq_switch(ca1449f0,0,c15cc34d,1c2,c96b4090,...) at sleepq_switch+0xf0/frame 0xf3955978 sleepq_catch_signals(f39559e0,c0c2ee86,c96b40a0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf39559bc sleepq_wait_sig(c96b40a4,0,f3955a18,101,0,...) at sleepq_wait_sig+0x14/frame 0xf39559e0 _cv_wait_sig(c96b40a4,c96b4090,c15cf647,73c,c15cf647,...) at _cv_wait_sig+0x211/frame 0xf3955a2c seltdwait(ffffffff,0,0,ca1449f0,0,...) at seltdwait+0xbf/frame 0xf3955a60 kern_poll(ca1449f0,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xf3955be0 sys_poll(ca1449f0,f3955ca8,c15bd083,4,f3955c3c,...) at sys_poll+0x71/frame 0xf3955c18 syscall(f3955ce8) at syscall+0x3bf/frame 0xf3955cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3955cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b88cb, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command sshd pid 2240 tid 100191 td 0xca7979f0 sched_switch(ca7979f0,0,104,196,f3982944,...) at sched_switch+0x4e1/frame 0xf398290c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3982944 sleepq_switch(ca7979f0,0,c15cc34d,1c2,c969d150,...) at sleepq_switch+0xf0/frame 0xf3982978 sleepq_catch_signals(f39829e0,c0c2ee86,c969d160,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf39829bc sleepq_wait_sig(c969d164,0,f3982a18,101,0,...) at sleepq_wait_sig+0x14/frame 0xf39829e0 _cv_wait_sig(c969d164,c969d150,c15cf647,73c,c15cf647,...) at _cv_wait_sig+0x211/frame 0xf3982a2c seltdwait(ffffffff,0,0,ca7979f0,0,...) at seltdwait+0xbf/frame 0xf3982a60 kern_poll(ca7979f0,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xf3982be0 sys_poll(ca7979f0,f3982ca8,c15bd083,4,f3982c6c,...) at sys_poll+0x71/frame 0xf3982c18 syscall(f3982ce8) at syscall+0x3bf/frame 0xf3982cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3982cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b88cb, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command sh pid 1119 tid 100197 td 0xca1459f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca1459f0,ffffffff,45f,18765,ca1459f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command bash pid 1115 tid 100195 td 0xc9be99f0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c9be99f0,ffffffff,45b,18763,c9be99f0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command csh pid 1113 tid 100193 td 0xca144350 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca144350,ffffffff,459,18761,ca144350,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command su pid 1112 tid 100192 td 0xca1446a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca1446a0,ffffffff,458,18760,ca1446a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command getty pid 858 tid 100189 td 0xca798350 sched_switch(ca798350,0,104,196,f397a9a4,...) at sched_switch+0x4e1/frame 0xf397a96c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf397a9a4 sleepq_switch(ca798350,0,c15cc34d,1c2,c9111604,...) at sleepq_switch+0xf0/frame 0xf397a9d8 sleepq_catch_signals(f397aa40,c0c2ee86,c9111614,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf397aa1c sleepq_wait_sig(c9111670,0,f397aa78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf397aa40 _cv_wait_sig(c9111670,c9111604,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf397aa8c tty_wait(c9111600,c9111670,f397abe8,1,0,...) at tty_wait+0x4b/frame 0xf397aab0 ttydisc_read(c9111600,f397abe8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf397aaf4 ttydev_read(c9105400,f397abe8,0,0,ca798350,...) at ttydev_read+0x55/frame 0xf397ab14 devfs_read_f(c9789150,f397abe8,c8e18a00,0,ca798350,...) at devfs_read_f+0xc7/frame 0xf397ab4c dofileread(c9789150,f397abe8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf397ab80 kern_readv(ca798350,0,f397abe8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf397abc8 sys_read(ca798350,f397aca8,c15bd083,4,db,...) at sys_read+0x59/frame 0xf397ac18 syscall(f397ace8) at syscall+0x3bf/frame 0xf397acdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf397acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 857 tid 100188 td 0xca7986a0 sched_switch(ca7986a0,0,104,196,f39769a4,...) at sched_switch+0x4e1/frame 0xf397696c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39769a4 sleepq_switch(ca7986a0,0,c15cc34d,1c2,c9110604,...) at sleepq_switch+0xf0/frame 0xf39769d8 sleepq_catch_signals(f3976a40,c0c2ee86,c9110614,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3976a1c sleepq_wait_sig(c9110670,0,f3976a78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3976a40 _cv_wait_sig(c9110670,c9110604,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf3976a8c tty_wait(c9110600,c9110670,f3976be8,1,0,...) at tty_wait+0x4b/frame 0xf3976ab0 ttydisc_read(c9110600,f3976be8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf3976af4 ttydev_read(c9374500,f3976be8,0,0,ca7986a0,...) at ttydev_read+0x55/frame 0xf3976b14 devfs_read_f(c977b1c0,f3976be8,c964ee00,0,ca7986a0,...) at devfs_read_f+0xc7/frame 0xf3976b4c dofileread(c977b1c0,f3976be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3976b80 kern_readv(ca7986a0,0,f3976be8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf3976bc8 sys_read(ca7986a0,f3976ca8,c15bd083,4,f3976c3c,...) at sys_read+0x59/frame 0xf3976c18 syscall(f3976ce8) at syscall+0x3bf/frame 0xf3976cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3976cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 856 tid 100187 td 0xca7989f0 sched_switch(ca7989f0,0,104,196,f39729a4,...) at sched_switch+0x4e1/frame 0xf397296c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39729a4 sleepq_switch(ca7989f0,0,c15cc34d,1c2,c9110804,...) at sleepq_switch+0xf0/frame 0xf39729d8 sleepq_catch_signals(f3972a40,c0c2ee86,c9110814,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3972a1c sleepq_wait_sig(c9110870,0,f3972a78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3972a40 _cv_wait_sig(c9110870,c9110804,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf3972a8c tty_wait(c9110800,c9110870,f3972be8,1,0,...) at tty_wait+0x4b/frame 0xf3972ab0 ttydisc_read(c9110800,f3972be8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf3972af4 ttydev_read(c9374600,f3972be8,0,0,ca7989f0,...) at ttydev_read+0x55/frame 0xf3972b14 devfs_read_f(c9726d20,f3972be8,c964f300,0,ca7989f0,...) at devfs_read_f+0xc7/frame 0xf3972b4c dofileread(c9726d20,f3972be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3972b80 kern_readv(ca7989f0,0,f3972be8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf3972bc8 sys_read(ca7989f0,f3972ca8,c15bd083,4,0,...) at sys_read+0x59/frame 0xf3972c18 syscall(f3972ce8) at syscall+0x3bf/frame 0xf3972cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3972cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 855 tid 100186 td 0xca14e6a0 sched_switch(ca14e6a0,0,104,196,f396e9a4,...) at sched_switch+0x4e1/frame 0xf396e96c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf396e9a4 sleepq_switch(ca14e6a0,0,c15cc34d,1c2,c9110a04,...) at sleepq_switch+0xf0/frame 0xf396e9d8 sleepq_catch_signals(f396ea40,c0c2ee86,c9110a14,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf396ea1c sleepq_wait_sig(c9110a70,0,f396ea78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf396ea40 _cv_wait_sig(c9110a70,c9110a04,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf396ea8c tty_wait(c9110a00,c9110a70,f396ebe8,1,0,...) at tty_wait+0x4b/frame 0xf396eab0 ttydisc_read(c9110a00,f396ebe8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf396eaf4 ttydev_read(c9374700,f396ebe8,0,0,ca14e6a0,...) at ttydev_read+0x55/frame 0xf396eb14 devfs_read_f(c9727070,f396ebe8,c9a6ad00,0,ca14e6a0,...) at devfs_read_f+0xc7/frame 0xf396eb4c dofileread(c9727070,f396ebe8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf396eb80 kern_readv(ca14e6a0,0,f396ebe8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf396ebc8 sys_read(ca14e6a0,f396eca8,c15bd083,4,f396ec3c,...) at sys_read+0x59/frame 0xf396ec18 syscall(f396ece8) at syscall+0x3bf/frame 0xf396ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf396ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 854 tid 100185 td 0xca14e9f0 sched_switch(ca14e9f0,0,104,196,f396a9a4,...) at sched_switch+0x4e1/frame 0xf396a96c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf396a9a4 sleepq_switch(ca14e9f0,0,c15cc34d,1c2,c9110c04,...) at sleepq_switch+0xf0/frame 0xf396a9d8 sleepq_catch_signals(f396aa40,c0c2ee86,c9110c14,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf396aa1c sleepq_wait_sig(c9110c70,0,f396aa78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf396aa40 _cv_wait_sig(c9110c70,c9110c04,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf396aa8c tty_wait(c9110c00,c9110c70,f396abe8,1,0,...) at tty_wait+0x4b/frame 0xf396aab0 ttydisc_read(c9110c00,f396abe8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf396aaf4 ttydev_read(c9374800,f396abe8,0,0,ca14e9f0,...) at ttydev_read+0x55/frame 0xf396ab14 devfs_read_f(c9726b60,f396abe8,ca10fb00,0,ca14e9f0,...) at devfs_read_f+0xc7/frame 0xf396ab4c dofileread(c9726b60,f396abe8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf396ab80 kern_readv(ca14e9f0,0,f396abe8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf396abc8 sys_read(ca14e9f0,f396aca8,c15bd083,4,ca75f738,...) at sys_read+0x59/frame 0xf396ac18 syscall(f396ace8) at syscall+0x3bf/frame 0xf396acdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf396acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 853 tid 100184 td 0xca4b1000 sched_switch(ca4b1000,0,104,196,f39669a4,...) at sched_switch+0x4e1/frame 0xf396696c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39669a4 sleepq_switch(ca4b1000,0,c15cc34d,1c2,c9110e04,...) at sleepq_switch+0xf0/frame 0xf39669d8 sleepq_catch_signals(f3966a40,c0c2ee86,c9110e14,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3966a1c sleepq_wait_sig(c9110e70,0,f3966a78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3966a40 _cv_wait_sig(c9110e70,c9110e04,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf3966a8c tty_wait(c9110e00,c9110e70,f3966be8,1,0,...) at tty_wait+0x4b/frame 0xf3966ab0 ttydisc_read(c9110e00,f3966be8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf3966af4 ttydev_read(c9374900,f3966be8,0,0,ca4b1000,...) at ttydev_read+0x55/frame 0xf3966b14 devfs_read_f(c9788ea8,f3966be8,c964f100,0,ca4b1000,...) at devfs_read_f+0xc7/frame 0xf3966b4c dofileread(c9788ea8,f3966be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3966b80 kern_readv(ca4b1000,0,f3966be8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf3966bc8 sys_read(ca4b1000,f3966ca8,c15bd083,4,0,...) at sys_read+0x59/frame 0xf3966c18 syscall(f3966ce8) at syscall+0x3bf/frame 0xf3966cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3966cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 852 tid 100183 td 0xca4b1350 sched_switch(ca4b1350,0,104,196,f39639a4,...) at sched_switch+0x4e1/frame 0xf396396c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39639a4 sleepq_switch(ca4b1350,0,c15cc34d,1c2,c9111004,...) at sleepq_switch+0xf0/frame 0xf39639d8 sleepq_catch_signals(f3963a40,c0c2ee86,c9111014,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3963a1c sleepq_wait_sig(c9111070,0,f3963a78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3963a40 _cv_wait_sig(c9111070,c9111004,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf3963a8c tty_wait(c9111000,c9111070,f3963be8,1,0,...) at tty_wait+0x4b/frame 0xf3963ab0 ttydisc_read(c9111000,f3963be8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf3963af4 ttydev_read(c9374a00,f3963be8,0,0,ca4b1350,...) at ttydev_read+0x55/frame 0xf3963b14 devfs_read_f(c978a7a8,f3963be8,c8e19100,0,ca4b1350,...) at devfs_read_f+0xc7/frame 0xf3963b4c dofileread(c978a7a8,f3963be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3963b80 kern_readv(ca4b1350,0,f3963be8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf3963bc8 sys_read(ca4b1350,f3963ca8,c15bd083,4,f3963c3c,...) at sys_read+0x59/frame 0xf3963c18 syscall(f3963ce8) at syscall+0x3bf/frame 0xf3963cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3963cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 851 tid 100182 td 0xca4b16a0 sched_switch(ca4b16a0,0,104,196,f39609a4,...) at sched_switch+0x4e1/frame 0xf396096c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf39609a4 sleepq_switch(ca4b16a0,0,c15cc34d,1c2,c9111204,...) at sleepq_switch+0xf0/frame 0xf39609d8 sleepq_catch_signals(f3960a40,c0c2ee86,c9111214,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3960a1c sleepq_wait_sig(c9111270,0,f3960a78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3960a40 _cv_wait_sig(c9111270,c9111204,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf3960a8c tty_wait(c9111200,c9111270,f3960be8,1,0,...) at tty_wait+0x4b/frame 0xf3960ab0 ttydisc_read(c9111200,f3960be8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf3960af4 ttydev_read(c9374b00,f3960be8,0,0,ca4b16a0,...) at ttydev_read+0x55/frame 0xf3960b14 devfs_read_f(c9727118,f3960be8,c9a6b200,0,ca4b16a0,...) at devfs_read_f+0xc7/frame 0xf3960b4c dofileread(c9727118,f3960be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf3960b80 kern_readv(ca4b16a0,0,f3960be8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf3960bc8 sys_read(ca4b16a0,f3960ca8,c15bd083,4,f3960c3c,...) at sys_read+0x59/frame 0xf3960c18 syscall(f3960ce8) at syscall+0x3bf/frame 0xf3960cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3960cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 850 tid 100156 td 0xc97e49f0 sched_switch(c97e49f0,0,104,196,f38f59a4,...) at sched_switch+0x4e1/frame 0xf38f596c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf38f59a4 sleepq_switch(c97e49f0,0,c15cc34d,1c2,c9111404,...) at sleepq_switch+0xf0/frame 0xf38f59d8 sleepq_catch_signals(f38f5a40,c0c2ee86,c9111414,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38f5a1c sleepq_wait_sig(c9111470,0,f38f5a78,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38f5a40 _cv_wait_sig(c9111470,c9111404,c15d19e5,580,1,...) at _cv_wait_sig+0x211/frame 0xf38f5a8c tty_wait(c9111400,c9111470,f38f5be8,1,0,...) at tty_wait+0x4b/frame 0xf38f5ab0 ttydisc_read(c9111400,f38f5be8,0,ab,c18767a4,...) at ttydisc_read+0x3a7/frame 0xf38f5af4 ttydev_read(c9374c00,f38f5be8,0,0,c97e49f0,...) at ttydev_read+0x55/frame 0xf38f5b14 devfs_read_f(c9727508,f38f5be8,ca10f500,0,c97e49f0,...) at devfs_read_f+0xc7/frame 0xf38f5b4c dofileread(c9727508,f38f5be8,ffffffff,ffffffff,0,...) at dofileread+0xb6/frame 0xf38f5b80 kern_readv(c97e49f0,0,f38f5be8,ffffffff,bfbfede7,...) at kern_readv+0x93/frame 0xf38f5bc8 sys_read(c97e49f0,f38f5ca8,c15bd083,4,f38f5c3c,...) at sys_read+0x59/frame 0xf38f5c18 syscall(f38f5ce8) at syscall+0x3bf/frame 0xf38f5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf38f5cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d7af3, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command inetd pid 831 tid 100162 td 0xc9be8350 sched_switch(c9be8350,0,104,196,f391990c,...) at sched_switch+0x4e1/frame 0xf39198d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf391990c sleepq_switch(c9be8350,0,c15cc34d,1c2,c969d050,...) at sleepq_switch+0xf0/frame 0xf3919940 sleepq_catch_signals(f39199a8,c0c2ee86,c969d060,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3919984 sleepq_wait_sig(c969d064,0,f39199e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf39199a8 _cv_wait_sig(c969d064,c969d050,c15cf647,73c,c15cf6a2,...) at _cv_wait_sig+0x211/frame 0xf39199f4 seltdwait(ffffffff,0,0,c9be8350,0,...) at seltdwait+0xbf/frame 0xf3919a28 kern_select(c9be8350,6,bfbfe078,0,0,...) at kern_select+0x910/frame 0xf3919bd0 sys_select(c9be8350,f3919ca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xf3919c18 syscall(f3919ce8) at syscall+0x3bf/frame 0xf3919cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3919cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ebae3, esp = 0xbfbfe00c, ebp = 0xbfbfe030 --- Tracing command moused pid 801 tid 100120 td 0xc95e0000 sched_switch(c95e0000,0,104,196,edff590c,...) at sched_switch+0x4e1/frame 0xedff58d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedff590c sleepq_switch(c95e0000,0,c15cc34d,1c2,c969d1d0,...) at sleepq_switch+0xf0/frame 0xedff5940 sleepq_catch_signals(edff59a8,c0c2ee86,c969d1e0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedff5984 sleepq_wait_sig(c969d1e4,0,edff59e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xedff59a8 _cv_wait_sig(c969d1e4,c969d1d0,c15cf647,73c,1,...) at _cv_wait_sig+0x211/frame 0xedff59f4 seltdwait(ffffffff,0,0,c95e0000,0,...) at seltdwait+0xbf/frame 0xedff5a28 kern_select(c95e0000,400,bfbfebb8,0,0,...) at kern_select+0x910/frame 0xedff5bd0 sys_select(c95e0000,edff5ca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xedff5c18 syscall(edff5ce8) at syscall+0x3bf/frame 0xedff5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedff5cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28202ae3, esp = 0xbfbfea54, ebp = 0xbfbfea78 --- Tracing command bash pid 763 tid 100173 td 0xca4b26a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca4b26a0,ffffffff,2fb,1874d,ca4b26a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command sshd pid 762 tid 100171 td 0xca145350 sched_switch(ca145350,0,104,196,f393190c,...) at sched_switch+0x4e1/frame 0xf39318d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf393190c sleepq_switch(ca145350,0,c15cc34d,1c2,c96da610,...) at sleepq_switch+0xf0/frame 0xf3931940 sleepq_catch_signals(f39319a8,c0c2ee86,c96da620,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3931984 sleepq_wait_sig(c96da624,0,f39319e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf39319a8 _cv_wait_sig(c96da624,c96da610,c15cf647,73c,c15d2494,...) at _cv_wait_sig+0x211/frame 0xf39319f4 seltdwait(ffffffff,0,0,ca145350,0,...) at seltdwait+0xbf/frame 0xf3931a28 kern_select(ca145350,c,28a18088,28a180c0,0,...) at kern_select+0x910/frame 0xf3931bd0 sys_select(ca145350,f3931ca8,c15bd083,4,f3931c3c,...) at sys_select+0x66/frame 0xf3931c18 syscall(f3931ce8) at syscall+0x3bf/frame 0xf3931cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3931cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516ae3, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 758 tid 100175 td 0xc9be79f0 sched_switch(c9be79f0,0,104,196,f393e944,...) at sched_switch+0x4e1/frame 0xf393e90c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf393e944 sleepq_switch(c9be79f0,0,c15cc34d,1c2,c96da590,...) at sleepq_switch+0xf0/frame 0xf393e978 sleepq_catch_signals(f393e9e0,c0c2ee86,c96da5a0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf393e9bc sleepq_wait_sig(c96da5a4,0,f393ea18,101,0,...) at sleepq_wait_sig+0x14/frame 0xf393e9e0 _cv_wait_sig(c96da5a4,c96da590,c15cf647,73c,c15cf647,...) at _cv_wait_sig+0x211/frame 0xf393ea2c seltdwait(ffffffff,0,0,c9be79f0,0,...) at seltdwait+0xbf/frame 0xf393ea60 kern_poll(c9be79f0,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xf393ebe0 sys_poll(c9be79f0,f393eca8,c15bd083,4,f393ec3c,...) at sys_poll+0x71/frame 0xf393ec18 syscall(f393ece8) at syscall+0x3bf/frame 0xf393ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf393ecdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b88cb, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command cron pid 698 tid 100163 td 0xca4b3350 sched_switch(ca4b3350,0,104,196,f391c990,...) at sched_switch+0x4e1/frame 0xf391c958 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf391c990 sleepq_switch(ca4b3350,0,c15cc34d,28b,ca4b3350,...) at sleepq_switch+0xf0/frame 0xf391c9c4 sleepq_wait(c1b69970,78,c161252f,0,0,...) at sleepq_wait+0x48/frame 0xf391c9e8 _sleep(c1b69970,c1b6ae00,278,c161252f,0,0,0,0,100) at _sleep+0x352/frame 0xf391ca44 vm_waitpfault(cbe5d960,4,0,f391cafc,f391caec,...) at vm_waitpfault+0x99/frame 0xf391ca70 vm_fault_hold(c9c6da24,28203000,1,0,0,...) at vm_fault_hold+0xd86/frame 0xf391cb30 vm_fault(c9c6da24,28203000,1,0,7d,...) at vm_fault+0x88/frame 0xf391cb58 trap_pfault(28203e70,f391cce8,0,c15ccf3d,0,...) at trap_pfault+0x116/frame 0xf391cba0 trap(f391cce8) at trap+0x3ec/frame 0xf391ccdc calltrap() at calltrap+0x6/frame 0xf391ccdc --- trap 0xc, eip = 0x2814d944, esp = 0xbfbfebec, ebp = 0xbfbfec0c --- Tracing command sendmail pid 693 tid 100161 td 0xca4b36a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(ca4b36a0,ffffffff,2b5,18741,ca4b36a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command sendmail pid 690 tid 100160 td 0xc9be86a0 sched_switch(c9be86a0,0,104,196,f3913904,...) at sched_switch+0x4e1/frame 0xf39138cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3913904 sleepq_switch(c9be86a0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xf3913938 sleepq_catch_signals(c186d3bc,f39139a4,c0c2ee86,c969d1a0,0,...) at sleepq_catch_signals+0x443/frame 0xf391397c sleepq_timedwait_sig(c969d1a4,0,f39139e0,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39139a4 _cv_timedwait_sig_sbt(c969d1a4,c969d190,dece179b,d84,50000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf39139f4 seltdwait(d84,50000000,0,c9be86a0,0,...) at seltdwait+0x8d/frame 0xf3913a28 kern_select(c9be86a0,5,bfbfd140,0,0,...) at kern_select+0x910/frame 0xf3913bd0 sys_select(c9be86a0,f3913ca8,c15bd083,4,c9fc3a80,...) at sys_select+0x66/frame 0xf3913c18 syscall(f3913ce8) at syscall+0x3bf/frame 0xf3913cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3913cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2848bae3, esp = 0xbfbfcff4, ebp = 0xbfbfd018 --- Tracing command sshd pid 687 tid 100122 td 0xc97ed000 sched_switch(c97ed000,0,104,196,edffb90c,...) at sched_switch+0x4e1/frame 0xedffb8d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedffb90c sleepq_switch(c97ed000,0,c15cc34d,1c2,c969d250,...) at sleepq_switch+0xf0/frame 0xedffb940 sleepq_catch_signals(edffb9a8,c0c2ee86,c969d260,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedffb984 sleepq_wait_sig(c969d264,0,edffb9e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xedffb9a8 _cv_wait_sig(c969d264,c969d250,c15cf647,73c,c0cc2afd,...) at _cv_wait_sig+0x211/frame 0xedffb9f4 seltdwait(ffffffff,0,0,c97ed000,0,...) at seltdwait+0xbf/frame 0xedffba28 kern_select(c97ed000,9,28a18148,0,0,...) at kern_select+0x910/frame 0xedffbbd0 sys_select(c97ed000,edffbca8,c15bd083,4,edffbc3c,...) at sys_select+0x66/frame 0xedffbc18 syscall(edffbce8) at syscall+0x3bf/frame 0xedffbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedffbcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516ae3, esp = 0xbfbfe86c, ebp = 0xbfbfe890 --- Tracing command smartd pid 650 tid 100117 td 0xc96096a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c96096a0,ffffffff,28a,18715,c96096a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command powerd pid 620 tid 100158 td 0xca146000 sched_switch(ca146000,0,104,196,f3905904,...) at sched_switch+0x4e1/frame 0xf39058cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3905904 sleepq_switch(ca146000,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xf3905938 sleepq_catch_signals(c186d3bc,f39059a4,c0c2ee86,c9083360,0,...) at sleepq_catch_signals+0x443/frame 0xf390597c sleepq_timedwait_sig(c9083364,0,f39059e0,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39059a4 _cv_timedwait_sig_sbt(c9083364,c9083350,a88876a8,d81,3ffffff,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf39059f4 seltdwait(d81,3ffffff,0,0,c1a8bf5c,...) at seltdwait+0x8d/frame 0xf3905a28 kern_select(ca146000,0,bfbfeda0,0,bfbfeda0,...) at kern_select+0x910/frame 0xf3905bd0 sys_select(ca146000,f3905ca8,c15bd083,4,f3905c3c,...) at sys_select+0x66/frame 0xf3905c18 syscall(f3905ce8) at syscall+0x3bf/frame 0xf3905cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3905cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d4ae3, esp = 0xbfbfed14, ebp = 0xbfbfed38 --- Tracing command ntpd pid 617 tid 100112 td 0xc95e0350 sched_switch(c95e0350,0,104,196,edfc690c,...) at sched_switch+0x4e1/frame 0xedfc68d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedfc690c sleepq_switch(c95e0350,0,c15cc34d,1c2,c96b41d0,...) at sleepq_switch+0xf0/frame 0xedfc6940 sleepq_catch_signals(edfc69a8,c0c2ee86,c96b41e0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedfc6984 sleepq_wait_sig(c96b41e4,0,edfc69e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xedfc69a8 _cv_wait_sig(c96b41e4,c96b41d0,c15cf647,73c,c0cc2afd,...) at _cv_wait_sig+0x211/frame 0xedfc69f4 seltdwait(ffffffff,0,0,c95e0350,0,...) at seltdwait+0xbf/frame 0xedfc6a28 kern_select(c95e0350,1c,bfbfdee8,0,0,...) at kern_select+0x910/frame 0xedfc6bd0 sys_select(c95e0350,edfc6ca8,c15bd083,4,c971e0a8,...) at sys_select+0x66/frame 0xedfc6c18 syscall(edfc6ce8) at syscall+0x3bf/frame 0xedfc6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedfc6cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28468ae3, esp = 0xbfbfddfc, ebp = 0xbfbfde20 --- Tracing command rpc.lockd pid 563 tid 100157 td 0xca146350 sched_switch(ca146350,0,104,196,f38f8890,...) at sched_switch+0x4e1/frame 0xf38f8858 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38f8890 sleepq_switch(ca146350,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xf38f88c4 sleepq_catch_signals(c186d3bc,f38f8930,c0c2ee86,ca17c110,0,...) at sleepq_catch_signals+0x443/frame 0xf38f8908 sleepq_timedwait_sig(c9bc8b90,0,f38f896c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf38f8930 _cv_timedwait_sig_sbt(c9bc8b90,ca17c100,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf38f8980 svc_run_internal(ca146508,14,c16037b3,c16000b6,c9e19500,...) at svc_run_internal+0xc69/frame 0xf38f8a64 svc_run(ca17c000,0,4,c0ec8990,f38f8b10,...) at svc_run+0x210/frame 0xf38f8ab8 sys_nlm_syscall(ca146350,f38f8ca8,c15bd083,4,0,...) at sys_nlm_syscall+0x744/frame 0xf38f8c18 syscall(f38f8ce8) at syscall+0x3bf/frame 0xf38f8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf38f8cdc --- syscall (154, FreeBSD ELF32, sys_nlm_syscall), eip = 0x280c44ef, esp = 0xbfbfed3c, ebp = 0xbfbfee44 --- Tracing command rpc.statd pid 560 tid 100155 td 0xca1466a0 sched_switch(ca1466a0,0,104,196,f38f2904,...) at sched_switch+0x4e1/frame 0xf38f28cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf38f2904 sleepq_switch(ca1466a0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xf38f2938 sleepq_catch_signals(c186d3bc,f38f29a4,c0c2ee86,c96da6e0,0,...) at sleepq_catch_signals+0x443/frame 0xf38f297c sleepq_timedwait_sig(c96da6e4,0,f38f29e0,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf38f29a4 _cv_timedwait_sig_sbt(c96da6e4,c96da6d0,917e4eaf,d90,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf38f29f4 seltdwait(d90,e0000000,1,ca1466a0,0,...) at seltdwait+0x8d/frame 0xf38f2a28 kern_select(ca1466a0,8,bfbfecf0,0,0,...) at kern_select+0x910/frame 0xf38f2bd0 sys_select(ca1466a0,f38f2ca8,c15bd083,4,f38f2c6c,...) at sys_select+0x66/frame 0xf38f2c18 syscall(f38f2ce8) at syscall+0x3bf/frame 0xf38f2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf38f2cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ccae3, esp = 0xbfbfec3c, ebp = 0xbfbfed88 --- Tracing command nfsd pid 559 tid 100123 td 0xca1469f0 sched_switch(ca1469f0,0,104,196,edffe300,...) at sched_switch+0x4e1/frame 0xedffe2c8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedffe300 sleepq_switch(ca1469f0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xedffe334 sleepq_catch_signals(c186d3bc,edffe3a0,c0c2ee86,c920b110,0,...) at sleepq_catch_signals+0x443/frame 0xedffe378 sleepq_timedwait_sig(c9bd4490,0,edffe3dc,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xedffe3a0 _cv_timedwait_sig_sbt(c9bd4490,c920b100,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedffe3f0 svc_run_internal(c0ee0d60,c920b100,c9719690,edffe518,0,...) at svc_run_internal+0xc69/frame 0xedffe4d4 svc_run(c920b000,0,c15ae0e6,1f3,0,...) at svc_run+0x210/frame 0xedffe528 nfsrvd_nfsd(ca1469f0,edffe698,c,0,0,...) at nfsrvd_nfsd+0x20c/frame 0xedffe668 nfssvc_nfsd(ca1469f0,edffeca8,0,ca1469f0,edffecdc,...) at nfssvc_nfsd+0x1e3/frame 0xedffec00 sys_nfssvc(ca1469f0,edffeca8,c15bd083,4,0,...) at sys_nfssvc+0xc4/frame 0xedffec18 syscall(edffece8) at syscall+0x3bf/frame 0xedffecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedffecdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280b14df, esp = 0xbfbfe7e4, ebp = 0xbfbfea58 --- Tracing command nfsd pid 559 tid 100124 td 0xc95609f0 sched_switch(c95609f0,0,104,196,f3895ad8,...) at sched_switch+0x4e1/frame 0xf3895aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3895ad8 sleepq_switch(c95609f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf3895b0c sleepq_catch_signals(f3895b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3895b50 sleepq_wait_sig(c9bdca90,0,f3895bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3895b74 _cv_wait_sig(c9bdca90,c920b100,c1603775,411,0,...) at _cv_wait_sig+0x211/frame 0xf3895bc0 svc_run_internal(f3895cd4,c0c10f3e,c920b100,f3895ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf3895ca4 svc_thread_start(c920b100,f3895ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf3895cac fork_exit(c0ee0d60,c920b100,f3895ce8) at fork_exit+0x7e/frame 0xf3895cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3895cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100125 td 0xc95606a0 sched_switch(c95606a0,0,104,196,f3898ad8,...) at sched_switch+0x4e1/frame 0xf3898aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf3898ad8 sleepq_switch(c95606a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf3898b0c sleepq_catch_signals(f3898b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf3898b50 sleepq_wait_sig(c9bc9d90,0,f3898bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3898b74 _cv_wait_sig(c9bc9d90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf3898bc0 svc_run_internal(f3898cd4,c0c10f3e,c920b100,f3898ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf3898ca4 svc_thread_start(c920b100,f3898ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf3898cac fork_exit(c0ee0d60,c920b100,f3898ce8) at fork_exit+0x7e/frame 0xf3898cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3898cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100126 td 0xc9560350 sched_switch(c9560350,0,104,196,f389bad8,...) at sched_switch+0x4e1/frame 0xf389baa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf389bad8 sleepq_switch(c9560350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf389bb0c sleepq_catch_signals(f389bb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf389bb50 sleepq_wait_sig(c9661690,0,f389bbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf389bb74 _cv_wait_sig(c9661690,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf389bbc0 svc_run_internal(f389bcd4,c0c10f3e,c920b100,f389bce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf389bca4 svc_thread_start(c920b100,f389bce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf389bcac fork_exit(c0ee0d60,c920b100,f389bce8) at fork_exit+0x7e/frame 0xf389bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf389bcd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100127 td 0xc9560000 sched_switch(c9560000,0,104,196,f389ead8,...) at sched_switch+0x4e1/frame 0xf389eaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf389ead8 sleepq_switch(c9560000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf389eb0c sleepq_catch_signals(f389eb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf389eb50 sleepq_wait_sig(c9661590,0,f389ebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf389eb74 _cv_wait_sig(c9661590,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf389ebc0 svc_run_internal(f389ecd4,c0c10f3e,c920b100,f389ece8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf389eca4 svc_thread_start(c920b100,f389ece8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf389ecac fork_exit(c0ee0d60,c920b100,f389ece8) at fork_exit+0x7e/frame 0xf389ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf389ecd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100128 td 0xc939e9f0 sched_switch(c939e9f0,0,104,196,f38a1ad8,...) at sched_switch+0x4e1/frame 0xf38a1aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38a1ad8 sleepq_switch(c939e9f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38a1b0c sleepq_catch_signals(f38a1b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38a1b50 sleepq_wait_sig(c9bc9c90,0,f38a1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38a1b74 _cv_wait_sig(c9bc9c90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38a1bc0 svc_run_internal(f38a1cd4,c0c10f3e,c920b100,f38a1ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38a1ca4 svc_thread_start(c920b100,f38a1ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38a1cac fork_exit(c0ee0d60,c920b100,f38a1ce8) at fork_exit+0x7e/frame 0xf38a1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38a1cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100129 td 0xca14b000 sched_switch(ca14b000,0,104,196,f38a4ad8,...) at sched_switch+0x4e1/frame 0xf38a4aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38a4ad8 sleepq_switch(ca14b000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38a4b0c sleepq_catch_signals(f38a4b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38a4b50 sleepq_wait_sig(c9bc9b90,0,f38a4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38a4b74 _cv_wait_sig(c9bc9b90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38a4bc0 svc_run_internal(f38a4cd4,c0c10f3e,c920b100,f38a4ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38a4ca4 svc_thread_start(c920b100,f38a4ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38a4cac fork_exit(c0ee0d60,c920b100,f38a4ce8) at fork_exit+0x7e/frame 0xf38a4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38a4cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100130 td 0xca14a9f0 sched_switch(ca14a9f0,0,104,196,f38a7ad8,...) at sched_switch+0x4e1/frame 0xf38a7aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38a7ad8 sleepq_switch(ca14a9f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38a7b0c sleepq_catch_signals(f38a7b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38a7b50 sleepq_wait_sig(c9661490,0,f38a7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38a7b74 _cv_wait_sig(c9661490,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38a7bc0 svc_run_internal(f38a7cd4,c0c10f3e,c920b100,f38a7ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38a7ca4 svc_thread_start(c920b100,f38a7ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38a7cac fork_exit(c0ee0d60,c920b100,f38a7ce8) at fork_exit+0x7e/frame 0xf38a7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38a7cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100131 td 0xca14a6a0 sched_switch(ca14a6a0,0,104,196,f38aaad8,...) at sched_switch+0x4e1/frame 0xf38aaaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38aaad8 sleepq_switch(ca14a6a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38aab0c sleepq_catch_signals(f38aab74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38aab50 sleepq_wait_sig(c9bc9a90,0,f38aabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38aab74 _cv_wait_sig(c9bc9a90,c920b100,c1603775,459,280b5912,...) at _cv_wait_sig+0x211/frame 0xf38aabc0 svc_run_internal(f38aacd4,c0c10f3e,c920b100,f38aace8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38aaca4 svc_thread_start(c920b100,f38aace8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38aacac fork_exit(c0ee0d60,c920b100,f38aace8) at fork_exit+0x7e/frame 0xf38aacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38aacd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100132 td 0xca14a350 sched_switch(ca14a350,0,104,196,f38adad8,...) at sched_switch+0x4e1/frame 0xf38adaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38adad8 sleepq_switch(ca14a350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38adb0c sleepq_catch_signals(f38adb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38adb50 sleepq_wait_sig(c9bc9990,0,f38adbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38adb74 _cv_wait_sig(c9bc9990,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38adbc0 svc_run_internal(f38adcd4,c0c10f3e,c920b100,f38adce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38adca4 svc_thread_start(c920b100,f38adce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38adcac fork_exit(c0ee0d60,c920b100,f38adce8) at fork_exit+0x7e/frame 0xf38adcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38adcd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100133 td 0xca14a000 sched_switch(ca14a000,0,104,196,f38b0ad8,...) at sched_switch+0x4e1/frame 0xf38b0aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38b0ad8 sleepq_switch(ca14a000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38b0b0c sleepq_catch_signals(f38b0b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38b0b50 sleepq_wait_sig(c9661390,0,f38b0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b0b74 _cv_wait_sig(c9661390,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38b0bc0 svc_run_internal(f38b0cd4,c0c10f3e,c920b100,f38b0ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38b0ca4 svc_thread_start(c920b100,f38b0ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38b0cac fork_exit(c0ee0d60,c920b100,f38b0ce8) at fork_exit+0x7e/frame 0xf38b0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b0cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100134 td 0xca1499f0 sched_switch(ca1499f0,0,104,196,f38b3ad8,...) at sched_switch+0x4e1/frame 0xf38b3aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38b3ad8 sleepq_switch(ca1499f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38b3b0c sleepq_catch_signals(f38b3b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38b3b50 sleepq_wait_sig(c9bc9890,0,f38b3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b3b74 _cv_wait_sig(c9bc9890,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38b3bc0 svc_run_internal(f38b3cd4,c0c10f3e,c920b100,f38b3ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38b3ca4 svc_thread_start(c920b100,f38b3ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38b3cac fork_exit(c0ee0d60,c920b100,f38b3ce8) at fork_exit+0x7e/frame 0xf38b3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b3cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100135 td 0xca1496a0 sched_switch(ca1496a0,0,104,196,f38b6ad8,...) at sched_switch+0x4e1/frame 0xf38b6aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38b6ad8 sleepq_switch(ca1496a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38b6b0c sleepq_catch_signals(f38b6b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38b6b50 sleepq_wait_sig(c9bc9790,0,f38b6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b6b74 _cv_wait_sig(c9bc9790,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38b6bc0 svc_run_internal(f38b6cd4,c0c10f3e,c920b100,f38b6ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38b6ca4 svc_thread_start(c920b100,f38b6ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38b6cac fork_exit(c0ee0d60,c920b100,f38b6ce8) at fork_exit+0x7e/frame 0xf38b6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b6cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100136 td 0xca149350 sched_switch(ca149350,0,104,196,f38b9ad8,...) at sched_switch+0x4e1/frame 0xf38b9aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38b9ad8 sleepq_switch(ca149350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38b9b0c sleepq_catch_signals(f38b9b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38b9b50 sleepq_wait_sig(c9bc9690,0,f38b9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b9b74 _cv_wait_sig(c9bc9690,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38b9bc0 svc_run_internal(f38b9cd4,c0c10f3e,c920b100,f38b9ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38b9ca4 svc_thread_start(c920b100,f38b9ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38b9cac fork_exit(c0ee0d60,c920b100,f38b9ce8) at fork_exit+0x7e/frame 0xf38b9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b9cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100137 td 0xca149000 sched_switch(ca149000,0,104,196,f38bcad8,...) at sched_switch+0x4e1/frame 0xf38bcaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38bcad8 sleepq_switch(ca149000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38bcb0c sleepq_catch_signals(f38bcb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38bcb50 sleepq_wait_sig(c9bc9590,0,f38bcbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38bcb74 _cv_wait_sig(c9bc9590,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38bcbc0 svc_run_internal(f38bccd4,c0c10f3e,c920b100,f38bcce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38bcca4 svc_thread_start(c920b100,f38bcce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38bccac fork_exit(c0ee0d60,c920b100,f38bcce8) at fork_exit+0x7e/frame 0xf38bccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38bccd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100138 td 0xca1489f0 sched_switch(ca1489f0,0,104,196,f38bfad8,...) at sched_switch+0x4e1/frame 0xf38bfaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38bfad8 sleepq_switch(ca1489f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38bfb0c sleepq_catch_signals(f38bfb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38bfb50 sleepq_wait_sig(c9661290,0,f38bfbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38bfb74 _cv_wait_sig(c9661290,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38bfbc0 svc_run_internal(f38bfcd4,c0c10f3e,c920b100,f38bfce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38bfca4 svc_thread_start(c920b100,f38bfce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38bfcac fork_exit(c0ee0d60,c920b100,f38bfce8) at fork_exit+0x7e/frame 0xf38bfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38bfcd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100139 td 0xca1486a0 sched_switch(ca1486a0,0,104,196,f38c2ad8,...) at sched_switch+0x4e1/frame 0xf38c2aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38c2ad8 sleepq_switch(ca1486a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38c2b0c sleepq_catch_signals(f38c2b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38c2b50 sleepq_wait_sig(c9bc9490,0,f38c2bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38c2b74 _cv_wait_sig(c9bc9490,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38c2bc0 svc_run_internal(f38c2cd4,c0c10f3e,c920b100,f38c2ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38c2ca4 svc_thread_start(c920b100,f38c2ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38c2cac fork_exit(c0ee0d60,c920b100,f38c2ce8) at fork_exit+0x7e/frame 0xf38c2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38c2cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100140 td 0xca148350 sched_switch(ca148350,0,104,196,f38c5ad8,...) at sched_switch+0x4e1/frame 0xf38c5aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38c5ad8 sleepq_switch(ca148350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38c5b0c sleepq_catch_signals(f38c5b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38c5b50 sleepq_wait_sig(c9661190,0,f38c5bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38c5b74 _cv_wait_sig(c9661190,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38c5bc0 svc_run_internal(f38c5cd4,c0c10f3e,c920b100,f38c5ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38c5ca4 svc_thread_start(c920b100,f38c5ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38c5cac fork_exit(c0ee0d60,c920b100,f38c5ce8) at fork_exit+0x7e/frame 0xf38c5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38c5cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100141 td 0xca148000 sched_switch(ca148000,0,104,196,f38c8ad8,...) at sched_switch+0x4e1/frame 0xf38c8aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38c8ad8 sleepq_switch(ca148000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38c8b0c sleepq_catch_signals(f38c8b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38c8b50 sleepq_wait_sig(c9bc9390,0,f38c8bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38c8b74 _cv_wait_sig(c9bc9390,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38c8bc0 svc_run_internal(f38c8cd4,c0c10f3e,c920b100,f38c8ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38c8ca4 svc_thread_start(c920b100,f38c8ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38c8cac fork_exit(c0ee0d60,c920b100,f38c8ce8) at fork_exit+0x7e/frame 0xf38c8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38c8cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100142 td 0xca14e350 sched_switch(ca14e350,0,104,196,f38cbad8,...) at sched_switch+0x4e1/frame 0xf38cbaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38cbad8 sleepq_switch(ca14e350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38cbb0c sleepq_catch_signals(f38cbb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38cbb50 sleepq_wait_sig(c9661090,0,f38cbbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38cbb74 _cv_wait_sig(c9661090,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38cbbc0 svc_run_internal(f38cbcd4,c0c10f3e,c920b100,f38cbce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38cbca4 svc_thread_start(c920b100,f38cbce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38cbcac fork_exit(c0ee0d60,c920b100,f38cbce8) at fork_exit+0x7e/frame 0xf38cbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38cbcd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100143 td 0xca14e000 sched_switch(ca14e000,0,104,196,f38cead8,...) at sched_switch+0x4e1/frame 0xf38ceaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38cead8 sleepq_switch(ca14e000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38ceb0c sleepq_catch_signals(f38ceb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38ceb50 sleepq_wait_sig(c9660e90,0,f38cebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38ceb74 _cv_wait_sig(c9660e90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38cebc0 svc_run_internal(f38cecd4,c0c10f3e,c920b100,f38cece8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38ceca4 svc_thread_start(c920b100,f38cece8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38cecac fork_exit(c0ee0d60,c920b100,f38cece8) at fork_exit+0x7e/frame 0xf38cecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38cecd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100144 td 0xca14d9f0 sched_switch(ca14d9f0,0,104,196,f38d1ad8,...) at sched_switch+0x4e1/frame 0xf38d1aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38d1ad8 sleepq_switch(ca14d9f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38d1b0c sleepq_catch_signals(f38d1b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38d1b50 sleepq_wait_sig(c9bc9290,0,f38d1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38d1b74 _cv_wait_sig(c9bc9290,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38d1bc0 svc_run_internal(f38d1cd4,c0c10f3e,c920b100,f38d1ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38d1ca4 svc_thread_start(c920b100,f38d1ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38d1cac fork_exit(c0ee0d60,c920b100,f38d1ce8) at fork_exit+0x7e/frame 0xf38d1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38d1cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100145 td 0xca14d6a0 sched_switch(ca14d6a0,0,104,196,f38d4ad8,...) at sched_switch+0x4e1/frame 0xf38d4aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38d4ad8 sleepq_switch(ca14d6a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38d4b0c sleepq_catch_signals(f38d4b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38d4b50 sleepq_wait_sig(c9660d90,0,f38d4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38d4b74 _cv_wait_sig(c9660d90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38d4bc0 svc_run_internal(f38d4cd4,c0c10f3e,c920b100,f38d4ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38d4ca4 svc_thread_start(c920b100,f38d4ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38d4cac fork_exit(c0ee0d60,c920b100,f38d4ce8) at fork_exit+0x7e/frame 0xf38d4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38d4cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100146 td 0xca14d350 sched_switch(ca14d350,0,104,196,f38d7ad8,...) at sched_switch+0x4e1/frame 0xf38d7aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38d7ad8 sleepq_switch(ca14d350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38d7b0c sleepq_catch_signals(f38d7b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38d7b50 sleepq_wait_sig(c9660c90,0,f38d7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38d7b74 _cv_wait_sig(c9660c90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38d7bc0 svc_run_internal(f38d7cd4,c0c10f3e,c920b100,f38d7ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38d7ca4 svc_thread_start(c920b100,f38d7ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38d7cac fork_exit(c0ee0d60,c920b100,f38d7ce8) at fork_exit+0x7e/frame 0xf38d7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38d7cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100147 td 0xca14d000 sched_switch(ca14d000,0,104,196,f38daad8,...) at sched_switch+0x4e1/frame 0xf38daaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38daad8 sleepq_switch(ca14d000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38dab0c sleepq_catch_signals(f38dab74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38dab50 sleepq_wait_sig(c9bc9190,0,f38dabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38dab74 _cv_wait_sig(c9bc9190,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38dabc0 svc_run_internal(f38dacd4,c0c10f3e,c920b100,f38dace8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38daca4 svc_thread_start(c920b100,f38dace8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38dacac fork_exit(c0ee0d60,c920b100,f38dace8) at fork_exit+0x7e/frame 0xf38dacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38dacd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100148 td 0xca14c9f0 sched_switch(ca14c9f0,0,104,196,f38ddad8,...) at sched_switch+0x4e1/frame 0xf38ddaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38ddad8 sleepq_switch(ca14c9f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38ddb0c sleepq_catch_signals(f38ddb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38ddb50 sleepq_wait_sig(c9660b90,0,f38ddbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38ddb74 _cv_wait_sig(c9660b90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38ddbc0 svc_run_internal(f38ddcd4,c0c10f3e,c920b100,f38ddce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38ddca4 svc_thread_start(c920b100,f38ddce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38ddcac fork_exit(c0ee0d60,c920b100,f38ddce8) at fork_exit+0x7e/frame 0xf38ddcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38ddcd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100149 td 0xca14c6a0 sched_switch(ca14c6a0,0,104,196,f38e0ad8,...) at sched_switch+0x4e1/frame 0xf38e0aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38e0ad8 sleepq_switch(ca14c6a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38e0b0c sleepq_catch_signals(f38e0b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38e0b50 sleepq_wait_sig(c9660a90,0,f38e0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e0b74 _cv_wait_sig(c9660a90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38e0bc0 svc_run_internal(f38e0cd4,c0c10f3e,c920b100,f38e0ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38e0ca4 svc_thread_start(c920b100,f38e0ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38e0cac fork_exit(c0ee0d60,c920b100,f38e0ce8) at fork_exit+0x7e/frame 0xf38e0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e0cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100150 td 0xca14c350 sched_switch(ca14c350,0,104,196,f38e3ad8,...) at sched_switch+0x4e1/frame 0xf38e3aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38e3ad8 sleepq_switch(ca14c350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38e3b0c sleepq_catch_signals(f38e3b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38e3b50 sleepq_wait_sig(c9bc9090,0,f38e3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e3b74 _cv_wait_sig(c9bc9090,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38e3bc0 svc_run_internal(f38e3cd4,c0c10f3e,c920b100,f38e3ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38e3ca4 svc_thread_start(c920b100,f38e3ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38e3cac fork_exit(c0ee0d60,c920b100,f38e3ce8) at fork_exit+0x7e/frame 0xf38e3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e3cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100151 td 0xca14c000 sched_switch(ca14c000,0,104,196,f38e6ad8,...) at sched_switch+0x4e1/frame 0xf38e6aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38e6ad8 sleepq_switch(ca14c000,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38e6b0c sleepq_catch_signals(f38e6b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38e6b50 sleepq_wait_sig(c9660990,0,f38e6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e6b74 _cv_wait_sig(c9660990,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38e6bc0 svc_run_internal(f38e6cd4,c0c10f3e,c920b100,f38e6ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38e6ca4 svc_thread_start(c920b100,f38e6ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38e6cac fork_exit(c0ee0d60,c920b100,f38e6ce8) at fork_exit+0x7e/frame 0xf38e6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e6cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100152 td 0xca14b9f0 sched_switch(ca14b9f0,0,104,196,f38e9ad8,...) at sched_switch+0x4e1/frame 0xf38e9aa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38e9ad8 sleepq_switch(ca14b9f0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38e9b0c sleepq_catch_signals(f38e9b74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38e9b50 sleepq_wait_sig(c9bc8e90,0,f38e9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e9b74 _cv_wait_sig(c9bc8e90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38e9bc0 svc_run_internal(f38e9cd4,c0c10f3e,c920b100,f38e9ce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38e9ca4 svc_thread_start(c920b100,f38e9ce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38e9cac fork_exit(c0ee0d60,c920b100,f38e9ce8) at fork_exit+0x7e/frame 0xf38e9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e9cd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100153 td 0xca14b6a0 sched_switch(ca14b6a0,0,104,196,f38ecad8,...) at sched_switch+0x4e1/frame 0xf38ecaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38ecad8 sleepq_switch(ca14b6a0,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38ecb0c sleepq_catch_signals(f38ecb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38ecb50 sleepq_wait_sig(c9bc8d90,0,f38ecbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38ecb74 _cv_wait_sig(c9bc8d90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38ecbc0 svc_run_internal(f38eccd4,c0c10f3e,c920b100,f38ecce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38ecca4 svc_thread_start(c920b100,f38ecce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38eccac fork_exit(c0ee0d60,c920b100,f38ecce8) at fork_exit+0x7e/frame 0xf38eccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38eccd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 559 tid 100154 td 0xca14b350 sched_switch(ca14b350,0,104,196,f38efad8,...) at sched_switch+0x4e1/frame 0xf38efaa0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xf38efad8 sleepq_switch(ca14b350,0,c15cc34d,1c2,c920b100,...) at sleepq_switch+0xf0/frame 0xf38efb0c sleepq_catch_signals(f38efb74,c0c2ee86,c920b110,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xf38efb50 sleepq_wait_sig(c9bc8c90,0,f38efbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38efb74 _cv_wait_sig(c9bc8c90,c920b100,c1603775,459,0,...) at _cv_wait_sig+0x211/frame 0xf38efbc0 svc_run_internal(f38efcd4,c0c10f3e,c920b100,f38efce8,c15bd5d8,...) at svc_run_internal+0xc7b/frame 0xf38efca4 svc_thread_start(c920b100,f38efce8,c15bd5d8,406,0,...) at svc_thread_start+0xd/frame 0xf38efcac fork_exit(c0ee0d60,c920b100,f38efce8) at fork_exit+0x7e/frame 0xf38efcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38efcd4 --- trap 0x20, eip = 0, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 556 tid 100121 td 0xc9609000 sched_switch(c9609000,0,104,196,edff890c,...) at sched_switch+0x4e1/frame 0xedff88d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedff890c sleepq_switch(c9609000,0,c15cc34d,1c2,c969d290,...) at sleepq_switch+0xf0/frame 0xedff8940 sleepq_catch_signals(edff89a8,c0c2ee86,c969d2a0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedff8984 sleepq_wait_sig(c969d2a4,0,edff89e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xedff89a8 _cv_wait_sig(c969d2a4,c969d290,c15cf647,73c,c0cc2afd,...) at _cv_wait_sig+0x211/frame 0xedff89f4 seltdwait(ffffffff,0,0,c9609000,0,...) at seltdwait+0xbf/frame 0xedff8a28 kern_select(c9609000,7,bfbfec30,0,0,...) at kern_select+0x910/frame 0xedff8bd0 sys_select(c9609000,edff8ca8,c15bd083,4,edff8c3c,...) at sys_select+0x66/frame 0xedff8c18 syscall(edff8ce8) at syscall+0x3bf/frame 0xedff8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedff8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c2ae3, esp = 0xbfbfea34, ebp = 0xbfbfea58 --- Tracing command mountd pid 550 tid 100107 td 0xc95e09f0 sched_switch(c95e09f0,0,104,196,edf7d90c,...) at sched_switch+0x4e1/frame 0xedf7d8d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf7d90c sleepq_switch(c95e09f0,0,c15cc34d,1c2,c96da710,...) at sleepq_switch+0xf0/frame 0xedf7d940 sleepq_catch_signals(edf7d9a8,c0c2ee86,c96da720,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedf7d984 sleepq_wait_sig(c96da724,0,edf7d9e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf7d9a8 _cv_wait_sig(c96da724,c96da710,c15cf647,73c,c0cc2afd,...) at _cv_wait_sig+0x211/frame 0xedf7d9f4 seltdwait(ffffffff,0,0,c95e09f0,0,...) at seltdwait+0xbf/frame 0xedf7da28 kern_select(c95e09f0,9,bfbfe848,0,0,...) at kern_select+0x910/frame 0xedf7dbd0 sys_select(c95e09f0,edf7dca8,c15bd083,4,edf7dc3c,...) at sys_select+0x66/frame 0xedf7dc18 syscall(edf7dce8) at syscall+0x3bf/frame 0xedf7dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf7dcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281dbae3, esp = 0xbfbfe7d4, ebp = 0xbfbfe7f8 --- Tracing command nfsuserd pid 543 tid 100119 td 0xc97ed350 sched_switch(c97ed350,0,104,196,edff2904,...) at sched_switch+0x4e1/frame 0xedff28cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedff2904 sleepq_switch(c97ed350,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xedff2938 sleepq_catch_signals(c186d3bc,edff29a4,c0c2ee86,c969d2e0,0,...) at sleepq_catch_signals+0x443/frame 0xedff297c sleepq_timedwait_sig(c969d2e4,0,edff29e0,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedff29a4 _cv_timedwait_sig_sbt(c969d2e4,c969d2d0,43ece541,d8f,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedff29f4 seltdwait(d8f,e0000000,1,c97ed350,0,...) at seltdwait+0x8d/frame 0xedff2a28 kern_select(c97ed350,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedff2bd0 sys_select(c97ed350,edff2ca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xedff2c18 syscall(edff2ce8) at syscall+0x3bf/frame 0xedff2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedff2cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c1ae3, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 542 tid 100113 td 0xc97ed9f0 sched_switch(c97ed9f0,0,104,196,edfce904,...) at sched_switch+0x4e1/frame 0xedfce8cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedfce904 sleepq_switch(c97ed9f0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xedfce938 sleepq_catch_signals(c186d3bc,edfce9a4,c0c2ee86,c96b4220,0,...) at sleepq_catch_signals+0x443/frame 0xedfce97c sleepq_timedwait_sig(c96b4224,0,edfce9e0,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedfce9a4 _cv_timedwait_sig_sbt(c96b4224,c96b4210,1490cc10,d8f,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedfce9f4 seltdwait(d8f,e0000000,1,c97ed9f0,0,...) at seltdwait+0x8d/frame 0xedfcea28 kern_select(c97ed9f0,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedfcebd0 sys_select(c97ed9f0,edfceca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xedfcec18 syscall(edfcece8) at syscall+0x3bf/frame 0xedfcecdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedfcecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c1ae3, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 541 tid 100095 td 0xc97ee350 sched_switch(c97ee350,0,104,196,edf35904,...) at sched_switch+0x4e1/frame 0xedf358cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf35904 sleepq_switch(c97ee350,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xedf35938 sleepq_catch_signals(c186d3bc,edf359a4,c0c2ee86,c969d320,0,...) at sleepq_catch_signals+0x443/frame 0xedf3597c sleepq_timedwait_sig(c969d324,0,edf359e0,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedf359a4 _cv_timedwait_sig_sbt(c969d324,c969d310,c63ab8d3,d8d,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedf359f4 seltdwait(d8d,e0000000,1,c97ee350,0,...) at seltdwait+0x8d/frame 0xedf35a28 kern_select(c97ee350,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedf35bd0 sys_select(c97ee350,edf35ca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xedf35c18 syscall(edf35ce8) at syscall+0x3bf/frame 0xedf35cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf35cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c1ae3, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 540 tid 100111 td 0xc96099f0 sched_switch(c96099f0,0,104,196,edfc0904,...) at sched_switch+0x4e1/frame 0xedfc08cc mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedfc0904 sleepq_switch(c96099f0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xedfc0938 sleepq_catch_signals(c186d3bc,edfc09a4,c0c2ee86,c96b4260,0,...) at sleepq_catch_signals+0x443/frame 0xedfc097c sleepq_timedwait_sig(c96b4264,0,edfc09e0,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedfc09a4 _cv_timedwait_sig_sbt(c96b4264,c96b4250,928470ef,d8d,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedfc09f4 seltdwait(d8d,e0000000,1,c96099f0,0,...) at seltdwait+0x8d/frame 0xedfc0a28 kern_select(c96099f0,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedfc0bd0 sys_select(c96099f0,edfc0ca8,c15bd083,4,0,...) at sys_select+0x66/frame 0xedfc0c18 syscall(edfc0ce8) at syscall+0x3bf/frame 0xedfc0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedfc0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c1ae3, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 539 tid 100114 td 0xc97ed6a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ca648,fc,f12ae180,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xf12ae108 kdb_reenter(0,c1859078,0,50001e,c1859154,...) at kdb_reenter+0x76/frame 0xf12ae170 trap(f12ae2bc) at trap+0x4d/frame 0xf12ae2b0 calltrap() at calltrap+0x6/frame 0xf12ae2b0 --- trap 0xc, eip = 0xc11cba99, esp = 0xf12ae2fc, ebp = 0xf12ae318 --- db_trace_thread(c97ed6a0,ffffffff,21b,18712,c97ed6a0,...) at db_trace_thread+0x29/frame 0xf12ae318 _db_stack_trace_all(c0c9330a,0,ffffffff,f12ae3c8,0,...) at _db_stack_trace_all+0xea/frame 0xf12ae390 db_command(c18b4fe9,0,c1b57f70,c18b4fe8,0,...) at db_command+0x2d8/frame 0xf12ae450 db_script_exec(c07e14f7,0,f12ae504,f12ae4f4,1,...) at db_script_exec+0x168/frame 0xf12ae4bc db_command(c1239c3b,f12ae5e0,c056d3da,c15c5390,0,...) at db_command+0x2d8/frame 0xf12ae57c db_command_loop(c15c5390,0,f12ae5a7,f12ae5a6,c1859078,...) at db_command_loop+0x50/frame 0xf12ae588 db_trap(3,0,a,46,0,...) at db_trap+0x10a/frame 0xf12ae5e0 kdb_trap(3,0,f12ae764,0,0,...) at kdb_trap+0x117/frame 0xf12ae618 trap(f12ae764) at trap+0x5fc/frame 0xf12ae758 calltrap() at calltrap+0x6/frame 0xf12ae758 --- trap 0x3, eip = 0xc0c9330a, esp = 0xf12ae7a4, ebp = 0xf12ae7b0 --- kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command watchdogd pid 497 tid 100115 td 0xc9be9000 sched_switch(c9be9000,0,104,196,edfd4994,...) at sched_switch+0x4e1/frame 0xedfd495c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedfd4994 sleepq_switch(c9be9000,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xedfd49c8 sleepq_catch_signals(c15cc34d,170,c9fc4400,21,c9be9000,...) at sleepq_catch_signals+0x443/frame 0xedfd4a0c sleepq_wait_sig(c9fc4348,6c,c15d0099,100,0,...) at sleepq_wait_sig+0x14/frame 0xedfd4a30 _sleep(c9fc4348,c9fc43f0,16c,c15d0099,0,...) at _sleep+0x33f/frame 0xedfd4a8c kern_wait6(c9be9000,0,6461,0,edfd4b24,...) at kern_wait6+0x47d/frame 0xedfd4af8 sys_wait4(c9be9000,edfd4ca8,c15bd083,4,0,...) at sys_wait4+0x8b/frame 0xedfd4c18 syscall(edfd4ce8) at syscall+0x3bf/frame 0xedfd4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedfd4cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281645d3, esp = 0xbfbfec64, ebp = 0xbfbfed08 --- Tracing command rpcbind pid 413 tid 100105 td 0xc91006a0 sched_switch(c91006a0,0,104,196,edf6393c,...) at sched_switch+0x4e1/frame 0xedf63904 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf6393c sleepq_switch(c91006a0,0,c15cc34d,1c2,8,...) at sleepq_switch+0xf0/frame 0xedf63970 sleepq_catch_signals(c186d3bc,edf639dc,c0c2ee86,c969d360,0,...) at sleepq_catch_signals+0x443/frame 0xedf639b4 sleepq_timedwait_sig(c969d364,0,edf63a18,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedf639dc _cv_timedwait_sig_sbt(c969d364,c969d350,c8058916,d8f,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedf63a2c seltdwait(d8f,e0000000,1,c91006a0,0,...) at seltdwait+0x8d/frame 0xedf63a60 kern_poll(c91006a0,bfbfccc0,7,edf63c00,0,...) at kern_poll+0x4d0/frame 0xedf63be0 sys_poll(c91006a0,edf63ca8,c15bd083,4,edf63c3c,...) at sys_poll+0x71/frame 0xedf63c18 syscall(edf63ce8) at syscall+0x3bf/frame 0xedf63cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf63cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x281718cb, esp = 0xbfbfcbe4, ebp = 0xbfbfcbf8 --- Tracing command syslogd pid 405 tid 100110 td 0xc9be9350 sched_switch(c9be9350,0,104,196,edfb490c,...) at sched_switch+0x4e1/frame 0xedfb48d4 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedfb490c sleepq_switch(c9be9350,0,c15cc34d,1c2,c96b4290,...) at sleepq_switch+0xf0/frame 0xedfb4940 sleepq_catch_signals(edfb49a8,c0c2ee86,c96b42a0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedfb4984 sleepq_wait_sig(c96b42a4,0,edfb49e0,101,0,...) at sleepq_wait_sig+0x14/frame 0xedfb49a8 _cv_wait_sig(c96b42a4,c96b4290,c15cf647,73c,1,...) at _cv_wait_sig+0x211/frame 0xedfb49f4 seltdwait(ffffffff,0,0,c9be9350,0,...) at seltdwait+0xbf/frame 0xedfb4a28 kern_select(c9be9350,9,286230d8,0,0,...) at kern_select+0x910/frame 0xedfb4bd0 sys_select(c9be9350,edfb4ca8,c15bd083,4,edfb4c3c,...) at sys_select+0x66/frame 0xedfb4c18 syscall(edfb4ce8) at syscall+0x3bf/frame 0xedfb4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedfb4cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281daae3, esp = 0xbfbfdfc4, ebp = 0xbfbfdfe8 --- Tracing command rtsold pid 370 tid 100109 td 0xc960a000 sched_switch(c960a000,0,104,196,edf83944,...) at sched_switch+0x4e1/frame 0xedf8390c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf83944 sleepq_switch(c960a000,0,c15cc34d,1c2,c96b42d0,...) at sleepq_switch+0xf0/frame 0xedf83978 sleepq_catch_signals(edf839e0,c0c2ee86,c96b42e0,0,c186d3bc,...) at sleepq_catch_signals+0x443/frame 0xedf839bc sleepq_wait_sig(c96b42e4,0,edf83a18,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf839e0 _cv_wait_sig(c96b42e4,c96b42d0,c15cf647,73c,c15cf647,...) at _cv_wait_sig+0x211/frame 0xedf83a2c seltdwait(ffffffff,0,0,c960a000,0,...) at seltdwait+0xbf/frame 0xedf83a60 kern_poll(c960a000,bfbfee10,2,0,0,...) at kern_poll+0x4d0/frame 0xedf83be0 sys_poll(c960a000,edf83ca8,c15bd083,4,0,...) at sys_poll+0x71/frame 0xedf83c18 syscall(edf83ce8) at syscall+0x3bf/frame 0xedf83cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xedf83cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x281678cb, esp = 0xbfbfedac, ebp = 0xbfbfedc0 --- Tracing command devd pid 328 tid 100106 td 0xc9be96a0 sched_switch(c9be96a0,0,602,192,c9be96a0,...) at sched_switch+0x4e1/frame 0xedf67c6c mi_switch(602,0,c15c5e90,d3,c9be96a0,...) at mi_switch+0x18c/frame 0xedf67ca4 critical_exit(c9be96a0,0,1) at critical_exit+0xa2/frame 0xedf67cc0 ipi_bitmap_handler(3b,3b,3b,2872774d,ffffff7f,...) at ipi_bitmap_handler+0x6b/frame 0xedf67ce0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x32/frame 0xedf67ce0 --- interrupt, eip = 0x80b531f, esp = 0xbfbfcba8, ebp = 0xbfbfcce0 --- Tracing command vnlru pid 22 tid 100085 td 0xc939d000 sched_switch(c939d000,0,104,196,edf10b84,...) at sched_switch+0x4e1/frame 0xedf10b4c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf10b84 sleepq_switch(c939d000,0,c15cc34d,2ae,c939d000,...) at sleepq_switch+0xf0/frame 0xedf10bb8 sleepq_timedwait(c9397348,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf10bdc _sleep(c9397348,c1b078a4,260,c15d914a,fffffed8,...) at _sleep+0x326/frame 0xedf10c38 vnlru_proc(0,edf10ce8,c15bd5d8,406,0,...) at vnlru_proc+0xbf/frame 0xedf10cac fork_exit(c0d20550,0,edf10ce8) at fork_exit+0x7e/frame 0xedf10cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf10cd4 --- trap 0, eip = 0, esp = 0xedf10d20, ebp = 0 --- Tracing command syncer pid 21 tid 100084 td 0xc939d350 sched_switch(c939d350,0,104,196,edf0db90,...) at sched_switch+0x4e1/frame 0xedf0db58 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf0db90 sleepq_switch(c939d350,0,c15cc34d,2ae,0,...) at sleepq_switch+0xf0/frame 0xedf0dbc4 sleepq_timedwait(c1b078f8,0,edf0dc24,0,0,...) at sleepq_timedwait+0x48/frame 0xedf0dbe8 _cv_timedwait_sbt(c1b078f8,c1b078d8,fffffed8,0,0,...) at _cv_timedwait_sbt+0x23c/frame 0xedf0dc38 sched_sync(0,edf0dce8,c15bd5d8,406,0,...) at sched_sync+0x6c0/frame 0xedf0dcac fork_exit(c0d20e70,0,edf0dce8) at fork_exit+0x7e/frame 0xedf0dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0dcd4 --- trap 0, eip = 0, esp = 0xedf0dd20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100083 td 0xc939d6a0 sched_switch(c939d6a0,0,104,196,edf0abc4,...) at sched_switch+0x4e1/frame 0xedf0ab8c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf0abc4 sleepq_switch(c939d6a0,0,c15cc34d,2ae,c939d6a0,...) at sleepq_switch+0xf0/frame 0xedf0abf8 sleepq_timedwait(c1b06604,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf0ac1c _sleep(c1b06604,c1b06580,54,c15d5ffe,fffffed8,...) at _sleep+0x326/frame 0xedf0ac78 buf_daemon(0,edf0ace8,c15bd5d8,406,0,...) at buf_daemon+0x8c/frame 0xedf0acac fork_exit(c0cfef60,0,edf0ace8) at fork_exit+0x7e/frame 0xedf0acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0acd4 --- trap 0, eip = 0, esp = 0xedf0ad20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100101 td 0xc96279f0 sched_switch(c96279f0,0,104,196,edf52bb4,...) at sched_switch+0x4e1/frame 0xedf52b7c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf52bb4 sleepq_switch(c96279f0,0,c15cc34d,2ae,c96279f0,...) at sleepq_switch+0xf0/frame 0xedf52be8 sleepq_timedwait(c9a8b284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf52c0c _sleep(c9a8b284,c9a8b200,54,c160ad09,7fffff6c,...) at _sleep+0x326/frame 0xedf52c68 softdep_flush(c9a81000,edf52ce8,c15bd5d8,406,0,...) at softdep_flush+0x192/frame 0xedf52cac fork_exit(c0f24c10,c9a81000,edf52ce8) at fork_exit+0x7e/frame 0xedf52cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf52cd4 --- trap 0, eip = 0, esp = 0xedf52d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100103 td 0xc9627350 sched_switch(c9627350,0,104,196,edf58bb4,...) at sched_switch+0x4e1/frame 0xedf58b7c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf58bb4 sleepq_switch(c9627350,0,c15cc34d,2ae,c9627350,...) at sleepq_switch+0xf0/frame 0xedf58be8 sleepq_timedwait(c9a8ae84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf58c0c _sleep(c9a8ae84,c9a8ae00,54,c160ad09,7fffff6c,...) at _sleep+0x326/frame 0xedf58c68 softdep_flush(c9ad55d8,edf58ce8,c15bd5d8,406,0,...) at softdep_flush+0x192/frame 0xedf58cac fork_exit(c0f24c10,c9ad55d8,edf58ce8) at fork_exit+0x7e/frame 0xedf58cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf58cd4 --- trap 0, eip = 0, esp = 0xedf58d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100104 td 0xc9627000 sched_switch(c9627000,0,104,196,edf5bbb4,...) at sched_switch+0x4e1/frame 0xedf5bb7c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf5bbb4 sleepq_switch(c9627000,0,c15cc34d,2ae,c9627000,...) at sleepq_switch+0xf0/frame 0xedf5bbe8 sleepq_timedwait(c9a8ac84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf5bc0c _sleep(c9a8ac84,c9a8ac00,54,c160ad09,7fffff6c,...) at _sleep+0x326/frame 0xedf5bc68 softdep_flush(c9ad52ec,edf5bce8,c15bd5d8,406,0,...) at softdep_flush+0x192/frame 0xedf5bcac fork_exit(c0f24c10,c9ad52ec,edf5bce8) at fork_exit+0x7e/frame 0xedf5bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf5bcd4 --- trap 0, eip = 0, esp = 0xedf5bd20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100178 td 0xc97e4000 sched_switch(c97e4000,0,104,196,f3947bb4,...) at sched_switch+0x4e1/frame 0xf3947b7c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xf3947bb4 sleepq_switch(c97e4000,0,c15cc34d,2ae,c97e4000,...) at sleepq_switch+0xf0/frame 0xf3947be8 sleepq_timedwait(ca715c84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf3947c0c _sleep(ca715c84,ca715c00,54,c160ad09,7fffff6c,...) at _sleep+0x326/frame 0xf3947c68 softdep_flush(c9648000,f3947ce8,c15bd5d8,406,0,...) at softdep_flush+0x192/frame 0xf3947cac fork_exit(c0f24c10,c9648000,f3947ce8) at fork_exit+0x7e/frame 0xf3947cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3947cd4 --- trap 0, eip = 0, esp = 0xf3947d20, ebp = 0 --- Tracing command bufspacedaemon pid 19 tid 100082 td 0xc939d9f0 sched_switch(c939d9f0,0,104,196,edf07bc4,...) at sched_switch+0x4e1/frame 0xedf07b8c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf07bc4 sleepq_switch(c939d9f0,0,c15cc34d,2ae,c939d9f0,...) at sleepq_switch+0xf0/frame 0xedf07bf8 sleepq_timedwait(c1b07248,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf07c1c _sleep(c1b07248,c1b07000,25c,c15aecc3,fffffed8,...) at _sleep+0x326/frame 0xedf07c78 bufspace_daemon(0,edf07ce8,c15bd5d8,406,0,...) at bufspace_daemon+0x1ff/frame 0xedf07cac fork_exit(c0cfe910,0,edf07ce8) at fork_exit+0x7e/frame 0xedf07cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf07cd4 --- trap 0, eip = 0, esp = 0xedf07d20, ebp = 0 --- Tracing command vmdaemon pid 18 tid 100081 td 0xc939e000 sched_switch(c939e000,0,104,196,edf04b84,...) at sched_switch+0x4e1/frame 0xedf04b4c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf04b84 sleepq_switch(c939e000,0,c15cc34d,28b,c939e000,...) at sleepq_switch+0xf0/frame 0xedf04bb8 sleepq_wait(c1b0cda4,74,c15d5ffe,0,0,...) at sleepq_wait+0x48/frame 0xedf04bdc _sleep(c1b0cda4,c1b0cd8c,74,c15d5ffe,0,...) at _sleep+0x352/frame 0xedf04c38 vm_daemon(0,edf04ce8,c15bd5d8,406,0,...) at vm_daemon+0xb6/frame 0xedf04cac fork_exit(c0f84250,0,edf04ce8) at fork_exit+0x7e/frame 0xedf04cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf04cd4 --- trap 0, eip = 0, esp = 0xedf04d20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100080 td 0xc939e350 sched_switch(c939e350,0,104,196,edf01b00,...) at sched_switch+0x4e1/frame 0xedf01ac8 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf01b00 sleepq_switch(c939e350,0,c15cc34d,2ae,c939e350,...) at sleepq_switch+0xf0/frame 0xedf01b34 sleepq_timedwait(c1a8bf0d,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf01b58 _sleep(c1a8bf0d,0,0,c15d5ffe,7fffff6c,...) at _sleep+0x326/frame 0xedf01bb4 pause_sbt(c15d5ffe,7fffff6c,0,0,0,...) at pause_sbt+0x91/frame 0xedf01bf0 vm_pageout(0,edf01ce8,c15bd5d8,406,0,...) at vm_pageout+0x26b/frame 0xedf01cac fork_exit(c0f82780,0,edf01ce8) at fork_exit+0x7e/frame 0xedf01cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf01cd4 --- trap 0, eip = 0, esp = 0xedf01d20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100090 td 0xc960a9f0 sched_switch(c960a9f0,0,104,196,edf1fbcc,...) at sched_switch+0x4e1/frame 0xedf1fb94 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedf1fbcc sleepq_switch(c960a9f0,0,c15cc34d,28b,c960a9f0,...) at sleepq_switch+0xf0/frame 0xedf1fc00 sleepq_wait(c1b0c9a0,54,edf1fc6c,0,0,...) at sleepq_wait+0x48/frame 0xedf1fc24 _sleep(c1b0c9a0,c1b0c98c,54,c160f7ba,0,...) at _sleep+0x352/frame 0xedf1fc80 uma_reclaim_worker(0,edf1fce8,c15bd5d8,406,0,...) at uma_reclaim_worker+0x90/frame 0xedf1fcac fork_exit(c0f63e50,0,edf1fce8) at fork_exit+0x7e/frame 0xedf1fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1fcd4 --- trap 0, eip = 0, esp = 0xedf1fd20, ebp = 0 --- Tracing command soaiod4 pid 16 tid 100079 td 0xc939e6a0 sched_switch(c939e6a0,0,104,196,edefebbc,...) at sched_switch+0x4e1/frame 0xedefeb84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedefebbc sleepq_switch(c939e6a0,0,c15cc34d,2ae,c939e6a0,...) at sleepq_switch+0xf0/frame 0xedefebf0 sleepq_timedwait(c1b06054,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedefec14 _sleep(c1b06054,c1b06034,0,c15aecc3,ffffdd50,...) at _sleep+0x326/frame 0xedefec70 soaio_kproc_loop(4,edefece8,c15bd5d8,406,0,...) at soaio_kproc_loop+0x13a/frame 0xedefecac fork_exit(c0cc3c20,4,edefece8) at fork_exit+0x7e/frame 0xedefecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefecd4 --- trap 0, eip = 0, esp = 0xedefed20, ebp = 0 --- Tracing command soaiod3 pid 15 tid 100078 td 0xc90ce350 sched_switch(c90ce350,0,104,196,edefbbbc,...) at sched_switch+0x4e1/frame 0xedefbb84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedefbbbc sleepq_switch(c90ce350,0,c15cc34d,2ae,c90ce350,...) at sleepq_switch+0xf0/frame 0xedefbbf0 sleepq_timedwait(c1b06054,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedefbc14 _sleep(c1b06054,c1b06034,0,c15aecc3,ffffdd50,...) at _sleep+0x326/frame 0xedefbc70 soaio_kproc_loop(3,edefbce8,c15bd5d8,406,0,...) at soaio_kproc_loop+0x13a/frame 0xedefbcac fork_exit(c0cc3c20,3,edefbce8) at fork_exit+0x7e/frame 0xedefbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefbcd4 --- trap 0, eip = 0, esp = 0xedefbd20, ebp = 0 --- Tracing command soaiod2 pid 9 tid 100077 td 0xc90ce6a0 sched_switch(c90ce6a0,0,104,196,edef8bbc,...) at sched_switch+0x4e1/frame 0xedef8b84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedef8bbc sleepq_switch(c90ce6a0,0,c15cc34d,2ae,c90ce6a0,...) at sleepq_switch+0xf0/frame 0xedef8bf0 sleepq_timedwait(c1b06054,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedef8c14 _sleep(c1b06054,c1b06034,0,c15aecc3,ffffdd50,...) at _sleep+0x326/frame 0xedef8c70 soaio_kproc_loop(2,edef8ce8,c15bd5d8,406,0,...) at soaio_kproc_loop+0x13a/frame 0xedef8cac fork_exit(c0cc3c20,2,edef8ce8) at fork_exit+0x7e/frame 0xedef8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedef8cd4 --- trap 0, eip = 0, esp = 0xedef8d20, ebp = 0 --- Tracing command soaiod1 pid 8 tid 100076 td 0xc90ce9f0 sched_switch(c90ce9f0,0,104,196,edef5bbc,...) at sched_switch+0x4e1/frame 0xedef5b84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedef5bbc sleepq_switch(c90ce9f0,0,c15cc34d,2ae,c90ce9f0,...) at sleepq_switch+0xf0/frame 0xedef5bf0 sleepq_timedwait(c1b06054,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedef5c14 _sleep(c1b06054,c1b06034,0,c15aecc3,ffffdd50,...) at _sleep+0x326/frame 0xedef5c70 soaio_kproc_loop(1,edef5ce8,c15bd5d8,406,0,...) at soaio_kproc_loop+0x13a/frame 0xedef5cac fork_exit(c0cc3c20,1,edef5ce8) at fork_exit+0x7e/frame 0xedef5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedef5cd4 --- trap 0, eip = 0, esp = 0xedef5d20, ebp = 0 --- Tracing command rand_harvestq pid 7 tid 100073 td 0xc90fe6a0 sched_switch(c90fe6a0,0,104,196,edd6cb9c,...) at sched_switch+0x4e1/frame 0xedd6cb64 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedd6cb9c sleepq_switch(c90fe6a0,0,c15cc34d,2ae,c90fe6a0,...) at sleepq_switch+0xf0/frame 0xedd6cbd0 sleepq_timedwait(c196557c,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedd6cbf4 _sleep(c196557c,0,0,c15aecc3,19999999,...) at _sleep+0x326/frame 0xedd6cc50 random_kthread(0,edd6cce8,c15bd5d8,406,0,...) at random_kthread+0x24b/frame 0xedd6ccac fork_exit(c0974910,0,edd6cce8) at fork_exit+0x7e/frame 0xedd6ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd6ccd4 --- trap 0, eip = 0, esp = 0xedd6cd20, ebp = 0 --- Tracing command sctp_iterator pid 6 tid 100072 td 0xc90fe9f0 sched_switch(c90fe9f0,0,104,196,edd69bcc,...) at sched_switch+0x4e1/frame 0xedd69b94 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedd69bcc sleepq_switch(c90fe9f0,0,c15cc34d,28b,c90fe9f0,...) at sleepq_switch+0xf0/frame 0xedd69c00 sleepq_wait(c1b667d8,0,c15efd31,0,0,...) at sleepq_wait+0x48/frame 0xedd69c24 _sleep(c1b667d8,c1b667a0,0,c15efd31,0,...) at _sleep+0x352/frame 0xedd69c80 sctp_iterator_thread(0,edd69ce8,c15bd5d8,406,0,...) at sctp_iterator_thread+0x7c/frame 0xedd69cac fork_exit(c0ddb680,0,edd69ce8) at fork_exit+0x7e/frame 0xedd69cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd69cd4 --- trap 0, eip = 0, esp = 0xedd69d20, ebp = 0 --- Tracing command fdc0 pid 5 tid 100068 td 0xc90ff9f0 sched_switch(c90ff9f0,0,104,196,edd5cb78,...) at sched_switch+0x4e1/frame 0xedd5cb40 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd5cb78 sleepq_switch(c90ff9f0,0,c15cc34d,28b,c90ff9f0,...) at sleepq_switch+0xf0/frame 0xedd5cbac sleepq_wait(c905de3c,5c,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xedd5cbd0 _sleep(c905de3c,c905def0,5c,c15aecc3,0,...) at _sleep+0x352/frame 0xedd5cc2c fdc_thread(c905de00,edd5cce8,c15bd5d8,406,0,...) at fdc_thread+0x12fc/frame 0xedd5ccac fork_exit(c11567c0,c905de00,edd5cce8) at fork_exit+0x7e/frame 0xedd5ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd5ccd4 --- trap 0, eip = 0, esp = 0xedd5cd20, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc900f000 sched_switch(c900f000,0,104,196,edcd3be8,...) at sched_switch+0x4e1/frame 0xedcd3bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcd3be8 sleepq_switch(c900f000,0,c15cc34d,28b,c9045acc,...) at sleepq_switch+0xf0/frame 0xedcd3c1c sleepq_wait(c9045acc,0,edcd3c70,1,0,...) at sleepq_wait+0x48/frame 0xedcd3c40 _cv_wait(c9045acc,c9045cf8,c15937d6,76,c9045ad4,...) at _cv_wait+0x20b/frame 0xedcd3c84 usb_process(c9045ac4,edcd3ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcd3cac fork_exit(c0a99680,c9045ac4,edcd3ce8) at fork_exit+0x7e/frame 0xedcd3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcd3cd4 --- trap 0, eip = 0, esp = 0xedcd3d20, ebp = 0 --- Tracing command usb pid 14 tid 100034 td 0xc900e9f0 sched_switch(c900e9f0,0,104,196,edcd6be8,...) at sched_switch+0x4e1/frame 0xedcd6bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcd6be8 sleepq_switch(c900e9f0,0,c15cc34d,28b,c9045afc,...) at sleepq_switch+0xf0/frame 0xedcd6c1c sleepq_wait(c9045afc,0,edcd6c70,1,0,...) at sleepq_wait+0x48/frame 0xedcd6c40 _cv_wait(c9045afc,c9045cf8,c15937d6,76,c9045b04,...) at _cv_wait+0x20b/frame 0xedcd6c84 usb_process(c9045af4,edcd6ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcd6cac fork_exit(c0a99680,c9045af4,edcd6ce8) at fork_exit+0x7e/frame 0xedcd6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcd6cd4 --- trap 0, eip = 0, esp = 0xedcd6d20, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc900e6a0 sched_switch(c900e6a0,0,104,196,edcd9be8,...) at sched_switch+0x4e1/frame 0xedcd9bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcd9be8 sleepq_switch(c900e6a0,0,c15cc34d,28b,c9045b2c,...) at sleepq_switch+0xf0/frame 0xedcd9c1c sleepq_wait(c9045b2c,0,edcd9c70,1,0,...) at sleepq_wait+0x48/frame 0xedcd9c40 _cv_wait(c9045b2c,c9045cf8,c15937d6,76,c9045b34,...) at _cv_wait+0x20b/frame 0xedcd9c84 usb_process(c9045b24,edcd9ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcd9cac fork_exit(c0a99680,c9045b24,edcd9ce8) at fork_exit+0x7e/frame 0xedcd9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcd9cd4 --- trap 0, eip = 0, esp = 0xedcd9d20, ebp = 0 --- Tracing command usb pid 14 tid 100036 td 0xc900e350 sched_switch(c900e350,0,104,196,edcdcbe8,...) at sched_switch+0x4e1/frame 0xedcdcbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcdcbe8 sleepq_switch(c900e350,0,c15cc34d,28b,c9045b5c,...) at sleepq_switch+0xf0/frame 0xedcdcc1c sleepq_wait(c9045b5c,0,edcdcc70,1,0,...) at sleepq_wait+0x48/frame 0xedcdcc40 _cv_wait(c9045b5c,c9045cf8,c15937d6,76,c9045b64,...) at _cv_wait+0x20b/frame 0xedcdcc84 usb_process(c9045b54,edcdcce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcdccac fork_exit(c0a99680,c9045b54,edcdcce8) at fork_exit+0x7e/frame 0xedcdccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcdccd4 --- trap 0, eip = 0, esp = 0xedcdcd20, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc900e000 sched_switch(c900e000,0,104,196,edcdfbe8,...) at sched_switch+0x4e1/frame 0xedcdfbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcdfbe8 sleepq_switch(c900e000,0,c15cc34d,28b,c9045b8c,...) at sleepq_switch+0xf0/frame 0xedcdfc1c sleepq_wait(c9045b8c,0,edcdfc70,1,0,...) at sleepq_wait+0x48/frame 0xedcdfc40 _cv_wait(c9045b8c,c9045cf8,c15937d6,76,c9045b94,...) at _cv_wait+0x20b/frame 0xedcdfc84 usb_process(c9045b84,edcdfce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcdfcac fork_exit(c0a99680,c9045b84,edcdfce8) at fork_exit+0x7e/frame 0xedcdfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcdfcd4 --- trap 0, eip = 0, esp = 0xedcdfd20, ebp = 0 --- Tracing command usb pid 14 tid 100039 td 0xc8f266a0 sched_switch(c8f266a0,0,104,196,edce6be8,...) at sched_switch+0x4e1/frame 0xedce6bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedce6be8 sleepq_switch(c8f266a0,0,c15cc34d,28b,c90b4acc,...) at sleepq_switch+0xf0/frame 0xedce6c1c sleepq_wait(c90b4acc,0,edce6c70,1,0,...) at sleepq_wait+0x48/frame 0xedce6c40 _cv_wait(c90b4acc,c90b4cf8,c15937d6,76,c90b4ad4,...) at _cv_wait+0x20b/frame 0xedce6c84 usb_process(c90b4ac4,edce6ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedce6cac fork_exit(c0a99680,c90b4ac4,edce6ce8) at fork_exit+0x7e/frame 0xedce6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce6cd4 --- trap 0, eip = 0, esp = 0xedce6d20, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc90bc9f0 sched_switch(c90bc9f0,0,104,196,edce9be8,...) at sched_switch+0x4e1/frame 0xedce9bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedce9be8 sleepq_switch(c90bc9f0,0,c15cc34d,28b,c90b4afc,...) at sleepq_switch+0xf0/frame 0xedce9c1c sleepq_wait(c90b4afc,0,edce9c70,1,0,...) at sleepq_wait+0x48/frame 0xedce9c40 _cv_wait(c90b4afc,c90b4cf8,c15937d6,76,c90b4b04,...) at _cv_wait+0x20b/frame 0xedce9c84 usb_process(c90b4af4,edce9ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedce9cac fork_exit(c0a99680,c90b4af4,edce9ce8) at fork_exit+0x7e/frame 0xedce9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce9cd4 --- trap 0, eip = 0, esp = 0xedce9d20, ebp = 0 --- Tracing command usb pid 14 tid 100041 td 0xc90bc6a0 sched_switch(c90bc6a0,0,104,196,edcecbe8,...) at sched_switch+0x4e1/frame 0xedcecbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcecbe8 sleepq_switch(c90bc6a0,0,c15cc34d,28b,c90b4b2c,...) at sleepq_switch+0xf0/frame 0xedcecc1c sleepq_wait(c90b4b2c,0,edcecc70,1,0,...) at sleepq_wait+0x48/frame 0xedcecc40 _cv_wait(c90b4b2c,c90b4cf8,c15937d6,76,c90b4b34,...) at _cv_wait+0x20b/frame 0xedcecc84 usb_process(c90b4b24,edcecce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedceccac fork_exit(c0a99680,c90b4b24,edcecce8) at fork_exit+0x7e/frame 0xedceccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedceccd4 --- trap 0, eip = 0, esp = 0xedcecd20, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc90bc350 sched_switch(c90bc350,0,104,196,edcefbe8,...) at sched_switch+0x4e1/frame 0xedcefbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcefbe8 sleepq_switch(c90bc350,0,c15cc34d,28b,c90b4b5c,...) at sleepq_switch+0xf0/frame 0xedcefc1c sleepq_wait(c90b4b5c,0,edcefc70,1,0,...) at sleepq_wait+0x48/frame 0xedcefc40 _cv_wait(c90b4b5c,c90b4cf8,c15937d6,76,c90b4b64,...) at _cv_wait+0x20b/frame 0xedcefc84 usb_process(c90b4b54,edcefce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcefcac fork_exit(c0a99680,c90b4b54,edcefce8) at fork_exit+0x7e/frame 0xedcefcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcefcd4 --- trap 0, eip = 0, esp = 0xedcefd20, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc90bc000 sched_switch(c90bc000,0,104,196,edcf2be8,...) at sched_switch+0x4e1/frame 0xedcf2bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcf2be8 sleepq_switch(c90bc000,0,c15cc34d,28b,c90b4b8c,...) at sleepq_switch+0xf0/frame 0xedcf2c1c sleepq_wait(c90b4b8c,0,edcf2c70,1,0,...) at sleepq_wait+0x48/frame 0xedcf2c40 _cv_wait(c90b4b8c,c90b4cf8,c15937d6,76,c90b4b94,...) at _cv_wait+0x20b/frame 0xedcf2c84 usb_process(c90b4b84,edcf2ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcf2cac fork_exit(c0a99680,c90b4b84,edcf2ce8) at fork_exit+0x7e/frame 0xedcf2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf2cd4 --- trap 0, eip = 0, esp = 0xedcf2d20, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc90bb6a0 sched_switch(c90bb6a0,0,104,196,edcf9be8,...) at sched_switch+0x4e1/frame 0xedcf9bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcf9be8 sleepq_switch(c90bb6a0,0,c15cc34d,28b,c90bdacc,...) at sleepq_switch+0xf0/frame 0xedcf9c1c sleepq_wait(c90bdacc,0,edcf9c70,1,0,...) at sleepq_wait+0x48/frame 0xedcf9c40 _cv_wait(c90bdacc,c90bdcf8,c15937d6,76,c90bdad4,...) at _cv_wait+0x20b/frame 0xedcf9c84 usb_process(c90bdac4,edcf9ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcf9cac fork_exit(c0a99680,c90bdac4,edcf9ce8) at fork_exit+0x7e/frame 0xedcf9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf9cd4 --- trap 0, eip = 0, esp = 0xedcf9d20, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc90bb350 sched_switch(c90bb350,0,104,196,edcfcbe8,...) at sched_switch+0x4e1/frame 0xedcfcbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcfcbe8 sleepq_switch(c90bb350,0,c15cc34d,28b,c90bdafc,...) at sleepq_switch+0xf0/frame 0xedcfcc1c sleepq_wait(c90bdafc,0,edcfcc70,1,0,...) at sleepq_wait+0x48/frame 0xedcfcc40 _cv_wait(c90bdafc,c90bdcf8,c15937d6,76,c90bdb04,...) at _cv_wait+0x20b/frame 0xedcfcc84 usb_process(c90bdaf4,edcfcce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcfccac fork_exit(c0a99680,c90bdaf4,edcfcce8) at fork_exit+0x7e/frame 0xedcfccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcfccd4 --- trap 0, eip = 0, esp = 0xedcfcd20, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc90bb000 sched_switch(c90bb000,0,104,196,edcffbe8,...) at sched_switch+0x4e1/frame 0xedcffbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedcffbe8 sleepq_switch(c90bb000,0,c15cc34d,28b,c90bdb2c,...) at sleepq_switch+0xf0/frame 0xedcffc1c sleepq_wait(c90bdb2c,0,edcffc70,1,0,...) at sleepq_wait+0x48/frame 0xedcffc40 _cv_wait(c90bdb2c,c90bdcf8,c15937d6,76,c90bdb34,...) at _cv_wait+0x20b/frame 0xedcffc84 usb_process(c90bdb24,edcffce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedcffcac fork_exit(c0a99680,c90bdb24,edcffce8) at fork_exit+0x7e/frame 0xedcffcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcffcd4 --- trap 0, eip = 0, esp = 0xedcffd20, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc90ba9f0 sched_switch(c90ba9f0,0,104,196,edd02be8,...) at sched_switch+0x4e1/frame 0xedd02bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd02be8 sleepq_switch(c90ba9f0,0,c15cc34d,28b,c90bdb5c,...) at sleepq_switch+0xf0/frame 0xedd02c1c sleepq_wait(c90bdb5c,0,edd02c70,1,0,...) at sleepq_wait+0x48/frame 0xedd02c40 _cv_wait(c90bdb5c,c90bdcf8,c15937d6,76,c90bdb64,...) at _cv_wait+0x20b/frame 0xedd02c84 usb_process(c90bdb54,edd02ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd02cac fork_exit(c0a99680,c90bdb54,edd02ce8) at fork_exit+0x7e/frame 0xedd02cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd02cd4 --- trap 0, eip = 0, esp = 0xedd02d20, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc90ba6a0 sched_switch(c90ba6a0,0,104,196,edd05be8,...) at sched_switch+0x4e1/frame 0xedd05bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd05be8 sleepq_switch(c90ba6a0,0,c15cc34d,28b,c90bdb8c,...) at sleepq_switch+0xf0/frame 0xedd05c1c sleepq_wait(c90bdb8c,0,edd05c70,1,0,...) at sleepq_wait+0x48/frame 0xedd05c40 _cv_wait(c90bdb8c,c90bdcf8,c15937d6,76,c90bdb94,...) at _cv_wait+0x20b/frame 0xedd05c84 usb_process(c90bdb84,edd05ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd05cac fork_exit(c0a99680,c90bdb84,edd05ce8) at fork_exit+0x7e/frame 0xedd05cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd05cd4 --- trap 0, eip = 0, esp = 0xedd05d20, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc90ba350 sched_switch(c90ba350,0,104,196,edd09be8,...) at sched_switch+0x4e1/frame 0xedd09bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd09be8 sleepq_switch(c90ba350,0,c15cc34d,28b,c90c3acc,...) at sleepq_switch+0xf0/frame 0xedd09c1c sleepq_wait(c90c3acc,0,edd09c70,1,0,...) at sleepq_wait+0x48/frame 0xedd09c40 _cv_wait(c90c3acc,c90c3cf8,c15937d6,76,c90c3ad4,...) at _cv_wait+0x20b/frame 0xedd09c84 usb_process(c90c3ac4,edd09ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd09cac fork_exit(c0a99680,c90c3ac4,edd09ce8) at fork_exit+0x7e/frame 0xedd09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd09cd4 --- trap 0, eip = 0, esp = 0xedd09d20, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc90ba000 sched_switch(c90ba000,0,104,196,edd0cbe8,...) at sched_switch+0x4e1/frame 0xedd0cbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd0cbe8 sleepq_switch(c90ba000,0,c15cc34d,28b,c90c3afc,...) at sleepq_switch+0xf0/frame 0xedd0cc1c sleepq_wait(c90c3afc,0,edd0cc70,1,0,...) at sleepq_wait+0x48/frame 0xedd0cc40 _cv_wait(c90c3afc,c90c3cf8,c15937d6,76,c90c3b04,...) at _cv_wait+0x20b/frame 0xedd0cc84 usb_process(c90c3af4,edd0cce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd0ccac fork_exit(c0a99680,c90c3af4,edd0cce8) at fork_exit+0x7e/frame 0xedd0ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd0ccd4 --- trap 0, eip = 0, esp = 0xedd0cd20, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xc90109f0 sched_switch(c90109f0,0,104,196,edd0fbe8,...) at sched_switch+0x4e1/frame 0xedd0fbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd0fbe8 sleepq_switch(c90109f0,0,c15cc34d,28b,c90c3b2c,...) at sleepq_switch+0xf0/frame 0xedd0fc1c sleepq_wait(c90c3b2c,0,edd0fc70,1,0,...) at sleepq_wait+0x48/frame 0xedd0fc40 _cv_wait(c90c3b2c,c90c3cf8,c15937d6,76,c90c3b34,...) at _cv_wait+0x20b/frame 0xedd0fc84 usb_process(c90c3b24,edd0fce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd0fcac fork_exit(c0a99680,c90c3b24,edd0fce8) at fork_exit+0x7e/frame 0xedd0fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd0fcd4 --- trap 0, eip = 0, esp = 0xedd0fd20, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc90ce000 sched_switch(c90ce000,0,104,196,edd12be8,...) at sched_switch+0x4e1/frame 0xedd12bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd12be8 sleepq_switch(c90ce000,0,c15cc34d,28b,c90c3b5c,...) at sleepq_switch+0xf0/frame 0xedd12c1c sleepq_wait(c90c3b5c,0,edd12c70,1,0,...) at sleepq_wait+0x48/frame 0xedd12c40 _cv_wait(c90c3b5c,c90c3cf8,c15937d6,76,c90c3b64,...) at _cv_wait+0x20b/frame 0xedd12c84 usb_process(c90c3b54,edd12ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd12cac fork_exit(c0a99680,c90c3b54,edd12ce8) at fork_exit+0x7e/frame 0xedd12cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd12cd4 --- trap 0, eip = 0, esp = 0xedd12d20, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xc90cd9f0 sched_switch(c90cd9f0,0,104,196,edd15be8,...) at sched_switch+0x4e1/frame 0xedd15bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd15be8 sleepq_switch(c90cd9f0,0,c15cc34d,28b,c90c3b8c,...) at sleepq_switch+0xf0/frame 0xedd15c1c sleepq_wait(c90c3b8c,0,edd15c70,1,0,...) at sleepq_wait+0x48/frame 0xedd15c40 _cv_wait(c90c3b8c,c90c3cf8,c15937d6,76,c90c3b94,...) at _cv_wait+0x20b/frame 0xedd15c84 usb_process(c90c3b84,edd15ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd15cac fork_exit(c0a99680,c90c3b84,edd15ce8) at fork_exit+0x7e/frame 0xedd15cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd15cd4 --- trap 0, eip = 0, esp = 0xedd15d20, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc90cd6a0 sched_switch(c90cd6a0,0,104,196,edd19be8,...) at sched_switch+0x4e1/frame 0xedd19bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd19be8 sleepq_switch(c90cd6a0,0,c15cc34d,28b,c90d3acc,...) at sleepq_switch+0xf0/frame 0xedd19c1c sleepq_wait(c90d3acc,0,edd19c70,1,0,...) at sleepq_wait+0x48/frame 0xedd19c40 _cv_wait(c90d3acc,c90d3cf8,c15937d6,76,c90d3ad4,...) at _cv_wait+0x20b/frame 0xedd19c84 usb_process(c90d3ac4,edd19ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd19cac fork_exit(c0a99680,c90d3ac4,edd19ce8) at fork_exit+0x7e/frame 0xedd19cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd19cd4 --- trap 0, eip = 0, esp = 0xedd19d20, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc90cd350 sched_switch(c90cd350,0,104,196,edd1cbe8,...) at sched_switch+0x4e1/frame 0xedd1cbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd1cbe8 sleepq_switch(c90cd350,0,c15cc34d,28b,c90d3afc,...) at sleepq_switch+0xf0/frame 0xedd1cc1c sleepq_wait(c90d3afc,0,edd1cc70,1,0,...) at sleepq_wait+0x48/frame 0xedd1cc40 _cv_wait(c90d3afc,c90d3cf8,c15937d6,76,c90d3b04,...) at _cv_wait+0x20b/frame 0xedd1cc84 usb_process(c90d3af4,edd1cce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd1ccac fork_exit(c0a99680,c90d3af4,edd1cce8) at fork_exit+0x7e/frame 0xedd1ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd1ccd4 --- trap 0, eip = 0, esp = 0xedd1cd20, ebp = 0 --- Tracing command usb pid 14 tid 100057 td 0xc90cd000 sched_switch(c90cd000,0,104,196,edd1fbe8,...) at sched_switch+0x4e1/frame 0xedd1fbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd1fbe8 sleepq_switch(c90cd000,0,c15cc34d,28b,c90d3b2c,...) at sleepq_switch+0xf0/frame 0xedd1fc1c sleepq_wait(c90d3b2c,0,edd1fc70,1,0,...) at sleepq_wait+0x48/frame 0xedd1fc40 _cv_wait(c90d3b2c,c90d3cf8,c15937d6,76,c90d3b34,...) at _cv_wait+0x20b/frame 0xedd1fc84 usb_process(c90d3b24,edd1fce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd1fcac fork_exit(c0a99680,c90d3b24,edd1fce8) at fork_exit+0x7e/frame 0xedd1fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd1fcd4 --- trap 0, eip = 0, esp = 0xedd1fd20, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xc90cc9f0 sched_switch(c90cc9f0,0,104,196,edd22be8,...) at sched_switch+0x4e1/frame 0xedd22bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd22be8 sleepq_switch(c90cc9f0,0,c15cc34d,28b,c90d3b5c,...) at sleepq_switch+0xf0/frame 0xedd22c1c sleepq_wait(c90d3b5c,0,edd22c70,1,0,...) at sleepq_wait+0x48/frame 0xedd22c40 _cv_wait(c90d3b5c,c90d3cf8,c15937d6,76,c90d3b64,...) at _cv_wait+0x20b/frame 0xedd22c84 usb_process(c90d3b54,edd22ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd22cac fork_exit(c0a99680,c90d3b54,edd22ce8) at fork_exit+0x7e/frame 0xedd22cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd22cd4 --- trap 0, eip = 0, esp = 0xedd22d20, ebp = 0 --- Tracing command usb pid 14 tid 100059 td 0xc90cc6a0 sched_switch(c90cc6a0,0,104,196,edd25be8,...) at sched_switch+0x4e1/frame 0xedd25bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd25be8 sleepq_switch(c90cc6a0,0,c15cc34d,28b,c90d3b8c,...) at sleepq_switch+0xf0/frame 0xedd25c1c sleepq_wait(c90d3b8c,0,edd25c70,1,0,...) at sleepq_wait+0x48/frame 0xedd25c40 _cv_wait(c90d3b8c,c90d3cf8,c15937d6,76,c90d3b94,...) at _cv_wait+0x20b/frame 0xedd25c84 usb_process(c90d3b84,edd25ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd25cac fork_exit(c0a99680,c90d3b84,edd25ce8) at fork_exit+0x7e/frame 0xedd25cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd25cd4 --- trap 0, eip = 0, esp = 0xedd25d20, ebp = 0 --- Tracing command usb pid 14 tid 100061 td 0xc90cc000 sched_switch(c90cc000,0,104,196,edd2dbe8,...) at sched_switch+0x4e1/frame 0xedd2dbb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd2dbe8 sleepq_switch(c90cc000,0,c15cc34d,28b,c9063ca4,...) at sleepq_switch+0xf0/frame 0xedd2dc1c sleepq_wait(c9063ca4,0,edd2dc70,1,0,...) at sleepq_wait+0x48/frame 0xedd2dc40 _cv_wait(c9063ca4,c9063ed0,c15937d6,76,c9063cac,...) at _cv_wait+0x20b/frame 0xedd2dc84 usb_process(c9063c9c,edd2dce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd2dcac fork_exit(c0a99680,c9063c9c,edd2dce8) at fork_exit+0x7e/frame 0xedd2dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd2dcd4 --- trap 0, eip = 0, esp = 0xedd2dd20, ebp = 0 --- Tracing command usb pid 14 tid 100062 td 0xc90cb9f0 sched_switch(c90cb9f0,0,104,196,edd30be8,...) at sched_switch+0x4e1/frame 0xedd30bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd30be8 sleepq_switch(c90cb9f0,0,c15cc34d,28b,c9063cd4,...) at sleepq_switch+0xf0/frame 0xedd30c1c sleepq_wait(c9063cd4,0,edd30c70,1,0,...) at sleepq_wait+0x48/frame 0xedd30c40 _cv_wait(c9063cd4,c9063ed0,c15937d6,76,c9063cdc,...) at _cv_wait+0x20b/frame 0xedd30c84 usb_process(c9063ccc,edd30ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd30cac fork_exit(c0a99680,c9063ccc,edd30ce8) at fork_exit+0x7e/frame 0xedd30cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd30cd4 --- trap 0, eip = 0, esp = 0xedd30d20, ebp = 0 --- Tracing command usb pid 14 tid 100063 td 0xc90cb6a0 sched_switch(c90cb6a0,0,104,196,edd33be8,...) at sched_switch+0x4e1/frame 0xedd33bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd33be8 sleepq_switch(c90cb6a0,0,c15cc34d,28b,c9063d04,...) at sleepq_switch+0xf0/frame 0xedd33c1c sleepq_wait(c9063d04,0,edd33c70,1,0,...) at sleepq_wait+0x48/frame 0xedd33c40 _cv_wait(c9063d04,c9063ed0,c15937d6,76,c9063d0c,...) at _cv_wait+0x20b/frame 0xedd33c84 usb_process(c9063cfc,edd33ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd33cac fork_exit(c0a99680,c9063cfc,edd33ce8) at fork_exit+0x7e/frame 0xedd33cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd33cd4 --- trap 0, eip = 0, esp = 0xedd33d20, ebp = 0 --- Tracing command usb pid 14 tid 100064 td 0xc90cb350 sched_switch(c90cb350,0,104,196,edd36be8,...) at sched_switch+0x4e1/frame 0xedd36bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd36be8 sleepq_switch(c90cb350,0,c15cc34d,28b,c9063d34,...) at sleepq_switch+0xf0/frame 0xedd36c1c sleepq_wait(c9063d34,0,edd36c70,1,0,...) at sleepq_wait+0x48/frame 0xedd36c40 _cv_wait(c9063d34,c9063ed0,c15937d6,76,c9063d3c,...) at _cv_wait+0x20b/frame 0xedd36c84 usb_process(c9063d2c,edd36ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd36cac fork_exit(c0a99680,c9063d2c,edd36ce8) at fork_exit+0x7e/frame 0xedd36cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd36cd4 --- trap 0, eip = 0, esp = 0xedd36d20, ebp = 0 --- Tracing command usb pid 14 tid 100065 td 0xc90cb000 sched_switch(c90cb000,0,104,196,edd39be8,...) at sched_switch+0x4e1/frame 0xedd39bb0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd39be8 sleepq_switch(c90cb000,0,c15cc34d,28b,c9063d64,...) at sleepq_switch+0xf0/frame 0xedd39c1c sleepq_wait(c9063d64,0,edd39c70,1,0,...) at sleepq_wait+0x48/frame 0xedd39c40 _cv_wait(c9063d64,c9063ed0,c15937d6,76,c9063d6c,...) at _cv_wait+0x20b/frame 0xedd39c84 usb_process(c9063d5c,edd39ce8,c15bd5d8,406,0,...) at usb_process+0x150/frame 0xedd39cac fork_exit(c0a99680,c9063d5c,edd39ce8) at fork_exit+0x7e/frame 0xedd39cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd39cd4 --- trap 0, eip = 0, esp = 0xedd39d20, ebp = 0 --- Tracing command cam pid 4 tid 100028 td 0xc9010350 sched_switch(c9010350,0,104,196,e4b74ba4,...) at sched_switch+0x4e1/frame 0xe4b74b6c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b74ba4 sleepq_switch(c9010350,0,c15cc34d,28b,c9010350,...) at sleepq_switch+0xf0/frame 0xe4b74bd8 sleepq_wait(c18b1600,5c,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b74bfc _sleep(c18b1600,c18b1580,5c,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b74c58 xpt_done_td(c18b1580,e4b74ce8,c15bd5d8,406,0,...) at xpt_done_td+0x17e/frame 0xe4b74cac fork_exit(c04dd410,c18b1580,e4b74ce8) at fork_exit+0x7e/frame 0xe4b74cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b74cd4 --- trap 0, eip = 0, esp = 0xe4b74d20, ebp = 0 --- Tracing command cam pid 4 tid 100075 td 0xc90fe000 sched_switch(c90fe000,0,104,196,edd72ba4,...) at sched_switch+0x4e1/frame 0xedd72b6c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xedd72ba4 sleepq_switch(c90fe000,0,c15cc34d,28b,c90fe000,...) at sleepq_switch+0xf0/frame 0xedd72bd8 sleepq_wait(c18b14ac,5c,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xedd72bfc _sleep(c18b14ac,c18b14fc,5c,c15aecc3,0,...) at _sleep+0x352/frame 0xedd72c58 xpt_scanner_thread(0,edd72ce8,c15bd5d8,406,0,...) at xpt_scanner_thread+0xa2/frame 0xedd72cac fork_exit(c04dd7c0,0,edd72ce8) at fork_exit+0x7e/frame 0xedd72cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd72cd4 --- trap 0, eip = 0, esp = 0xedd72d20, ebp = 0 --- Tracing command crypto returns pid 3 tid 100024 td 0xc8e4c9f0 sched_switch(c8e4c9f0,0,104,196,e4b68bac,...) at sched_switch+0x4e1/frame 0xe4b68b74 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b68bac sleepq_switch(c8e4c9f0,0,c15cc34d,28b,c8e4c9f0,...) at sleepq_switch+0xf0/frame 0xe4b68be0 sleepq_wait(c1b0bcf0,6c,c1602b30,0,0,...) at sleepq_wait+0x48/frame 0xe4b68c04 _sleep(c1b0bcf0,c1b0bcdc,6c,c1602b30,0,...) at _sleep+0x352/frame 0xe4b68c60 crypto_ret_proc(0,e4b68ce8,c15bd5d8,406,0,...) at crypto_ret_proc+0x1f5/frame 0xe4b68cac fork_exit(c0ecc830,0,e4b68ce8) at fork_exit+0x7e/frame 0xe4b68cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b68cd4 --- trap 0, eip = 0, esp = 0xe4b68d20, ebp = 0 --- Tracing command crypto pid 2 tid 100023 td 0xc8f24000 sched_switch(c8f24000,0,104,196,e4b65bbc,...) at sched_switch+0x4e1/frame 0xe4b65b84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b65bbc sleepq_switch(c8f24000,0,c15cc34d,28b,c8f24000,...) at sleepq_switch+0xf0/frame 0xe4b65bf0 sleepq_wait(c1b0bc38,6c,c1602b24,0,0,...) at sleepq_wait+0x48/frame 0xe4b65c14 _sleep(c1b0bc38,c1b0bc20,6c,c1602b24,0,...) at _sleep+0x352/frame 0xe4b65c70 crypto_proc(0,e4b65ce8,c15bd5d8,406,0,...) at crypto_proc+0x2c1/frame 0xe4b65cac fork_exit(c0ecc400,0,e4b65ce8) at fork_exit+0x7e/frame 0xe4b65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b65cd4 --- trap 0, eip = 0, esp = 0xe4b65d20, ebp = 0 --- Tracing command geom pid 13 tid 100019 td 0xc8f25000 sched_switch(c8f25000,0,104,196,e4b59bbc,...) at sched_switch+0x4e1/frame 0xe4b59b84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b59bbc sleepq_switch(c8f25000,0,c15cc34d,28b,c8f25000,...) at sleepq_switch+0xf0/frame 0xe4b59bf0 sleepq_wait(c1b61944,5c,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b59c14 _sleep(c1b61944,c1a89f2c,25c,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b59c70 g_run_events(0,e4b59ce8,c15bd5d8,406,0,...) at g_run_events+0x67/frame 0xe4b59cac fork_exit(c0b99530,0,e4b59ce8) at fork_exit+0x7e/frame 0xe4b59cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b59cd4 --- trap 0, eip = 0, esp = 0xe4b59d20, ebp = 0 --- Tracing command geom pid 13 tid 100020 td 0xc8f249f0 sched_switch(c8f249f0,0,104,196,e4b5cbac,...) at sched_switch+0x4e1/frame 0xe4b5cb74 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b5cbac sleepq_switch(c8f249f0,0,c15cc34d,28b,c8f249f0,...) at sleepq_switch+0xf0/frame 0xe4b5cbe0 sleepq_wait(c1b61948,5c,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b5cc04 _sleep(c1b61948,c1a89f74,25c,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b5cc60 g_io_schedule_up(c8f249f0,0,c15b0b4a,5f,e4b5ccd4,...) at g_io_schedule_up+0x12a/frame 0xe4b5cc94 g_up_procbody(0,e4b5cce8,c15bd5d8,406,0,...) at g_up_procbody+0x7d/frame 0xe4b5ccac fork_exit(c0b995b0,0,e4b5cce8) at fork_exit+0x7e/frame 0xe4b5ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b5ccd4 --- trap 0, eip = 0, esp = 0xe4b5cd20, ebp = 0 --- Tracing command geom pid 13 tid 100021 td 0xc8f246a0 sched_switch(c8f246a0,0,104,196,e4b5fba8,...) at sched_switch+0x4e1/frame 0xe4b5fb70 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b5fba8 sleepq_switch(c8f246a0,0,c15cc34d,28b,c8f246a0,...) at sleepq_switch+0xf0/frame 0xe4b5fbdc sleepq_wait(c1b6194c,5c,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b5fc00 _sleep(c1b6194c,c1a89f54,25c,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b5fc5c g_io_schedule_down(c8f246a0,0,c15b0b4a,6b,e4b5fcd4,...) at g_io_schedule_down+0xec/frame 0xe4b5fc94 g_down_procbody(0,e4b5fce8,c15bd5d8,406,0,...) at g_down_procbody+0x7d/frame 0xe4b5fcac fork_exit(c0b99630,0,e4b5fce8) at fork_exit+0x7e/frame 0xe4b5fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b5fcd4 --- trap 0, eip = 0, esp = 0xe4b5fd20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc8e4a6a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc8e4a350 sched_switch(c8e4a350,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xe4b38c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xe4b38c70 ithread_loop(c8ea6010,e4b38ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xe4b38cac fork_exit(c0c13e80,c8ea6010,e4b38ce8) at fork_exit+0x7e/frame 0xe4b38cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b38cd4 --- trap 0, eip = 0, esp = 0xe4b38d20, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc8e4a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc8e3f9f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc8e3f6a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc8e3f350 sched_switch(c8e3f350,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xe4b44c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xe4b44c70 ithread_loop(c8ea5f70,e4b44ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xe4b44cac fork_exit(c0c13e80,c8ea5f70,e4b44ce8) at fork_exit+0x7e/frame 0xe4b44cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b44cd4 --- trap 0, eip = 0, esp = 0xe4b44d20, ebp = 0 --- Tracing command intr pid 12 tid 100014 td 0xc8f26350 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100016 td 0xc8f259f0 sched_switch(c8f259f0,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xe4b50c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xe4b50c70 ithread_loop(c8ea5f50,e4b50ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xe4b50cac fork_exit(c0c13e80,c8ea5f50,e4b50ce8) at fork_exit+0x7e/frame 0xe4b50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b50cd4 --- trap 0, eip = 0, esp = 0xe4b50d20, ebp = 0 --- Tracing command intr pid 12 tid 100017 td 0xc8f256a0 sched_switch(c8f256a0,0,104,196,e4b53ac4,...) at sched_switch+0x4e1/frame 0xe4b53a8c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b53ac4 sleepq_switch(c8f256a0,0,c15cc34d,2ae,c8f256a0,...) at sleepq_switch+0xf0/frame 0xe4b53af8 sleepq_timedwait(e4b53bac,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe4b53b1c _sleep(e4b53bac,c1b6212c,5c,c15bb205,1999997c,...) at _sleep+0x326/frame 0xe4b53b78 destroy_devl(c1b6213c,0,c15bad24,48,c8f22d80,...) at destroy_devl+0x27b/frame 0xe4b53bbc destroy_dev_tq(0,1,c15ccda3,1be,c8f22d94,...) at destroy_dev_tq+0xb1/frame 0xe4b53be0 taskqueue_run_locked(c8f22dac,0,c15ccda3,1d3,0,...) at taskqueue_run_locked+0x12b/frame 0xe4b53c1c taskqueue_run(c8f22d80) at taskqueue_run+0x5d/frame 0xe4b53c3c taskqueue_swi_giant_run(0,0,c15bd85d,4ed,c8e9e048,...) at taskqueue_swi_giant_run+0x11/frame 0xe4b53c48 intr_event_execute_handlers(c1a9a290,c8e9e000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xe4b53c70 ithread_loop(c8ea5f40,e4b53ce8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xe4b53cac fork_exit(c0c13e80,c8ea5f40,e4b53ce8) at fork_exit+0x7e/frame 0xe4b53cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b53cd4 --- trap 0, eip = 0, esp = 0xe4b53d20, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc9010000 sched_switch(c9010000,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xe4ba6c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xe4ba6c70 ithread_loop(c8ea5170,e4ba6ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xe4ba6cac fork_exit(c0c13e80,c8ea5170,e4ba6ce8) at fork_exit+0x7e/frame 0xe4ba6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4ba6cd4 --- trap 0, eip = 0, esp = 0xe4ba6d20, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc900f9f0 (CPU 1) kdb_enter(c15c5390,c15c5390,c15f5842,f12ae814,1,...) at kdb_enter+0x3a/frame 0xf12ae7b0 vpanic(c15f5842,f12ae814,c15f5842,f12ae814,f12ae814,...) at vpanic+0x132/frame 0xf12ae7e4 kassert_panic(c15f5842,0,8,168,fffdf7b0,...) at kassert_panic+0xd9/frame 0xf12ae808 tcp_sack_doack(ca12f610,f12ae8e8,cd0f0aa3,0,c89a5d00,...) at tcp_sack_doack+0x486/frame 0xf12ae888 tcp_do_segment(cceaf300,cb8af022,ca48b830,ca12f610,40,...) at tcp_do_segment+0x23f4/frame 0xf12ae940 tcp_input(f12aea8c,f12aea88,6,1,246,...) at tcp_input+0x11f2/frame 0xf12aea40 ip_input(cceaf300,1b7,c156d1e1,8,c1965514,...) at ip_input+0x25f/frame 0xf12aeaac netisr_dispatch_src(1,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeae4 netisr_dispatch(1,cceaf300,4e,0,c156d1e1,...) at netisr_dispatch+0x20/frame 0xf12aeaf8 ether_demux(c8e0bc00,cceaf300,6,0,8eb70,...) at ether_demux+0x154/frame 0xf12aeb24 ether_nh_input(cceaf300,f12aeb9c,c9047a40,0,0,...) at ether_nh_input+0x386/frame 0xf12aeb54 netisr_dispatch_src(5,0,cceaf300) at netisr_dispatch_src+0xa3/frame 0xf12aeb8c netisr_dispatch(5,cceaf300,942,cc1e99f0,0,...) at netisr_dispatch+0x20/frame 0xf12aeba0 ether_input(c8e0bc00,cceaf300,c156deb4,942,1a014029,...) at ether_input+0x61/frame 0xf12aebc8 re_rxeof(c9049140,0,c156deb4,a4f,c02c0008,...) at re_rxeof+0x5ce/frame 0xf12aec18 re_intr_msi(c9047000,0,0,93b5dfe3,c8e9b048,...) at re_intr_msi+0xba/frame 0xf12aec48 intr_event_execute_handlers(c1a9a990,c8e9b000,c15bd85d,560,c15bd5d8,...) at intr_event_execute_handlers+0x8e/frame 0xf12aec70 ithread_loop(c8ea6e10,f12aece8,c15bd5d8,406,0,...) at ithread_loop+0x90/frame 0xf12aecac fork_exit(c0c13e80,c8ea6e10,f12aece8) at fork_exit+0x7e/frame 0xf12aecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12aecd4 --- trap 0, eip = 0, esp = 0xf12aed20, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc900f6a0 sched_switch(c900f6a0,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xf12b2c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xf12b2c70 ithread_loop(c8ea6dc0,f12b2ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xf12b2cac fork_exit(c0c13e80,c8ea6dc0,f12b2ce8) at fork_exit+0x7e/frame 0xf12b2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12b2cd4 --- trap 0, eip = 0, esp = 0xf12b2d20, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xc900f350 sched_switch(c900f350,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xedcd0c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xedcd0c70 ithread_loop(c8ea6c40,edcd0ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xedcd0cac fork_exit(c0c13e80,c8ea6c40,edcd0ce8) at fork_exit+0x7e/frame 0xedcd0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcd0cd4 --- trap 0, eip = 0, esp = 0xedcd0d20, ebp = 0 --- Tracing command intr pid 12 tid 100038 td 0xc8f269f0 sched_switch(c8f269f0,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xedce3c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xedce3c70 ithread_loop(c8ea6bc0,edce3ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xedce3cac fork_exit(c0c13e80,c8ea6bc0,edce3ce8) at fork_exit+0x7e/frame 0xedce3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce3cd4 --- trap 0, eip = 0, esp = 0xedce3d20, ebp = 0 --- Tracing command intr pid 12 tid 100044 td 0xc90bb9f0 sched_switch(c90bb9f0,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xedcf6c38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xedcf6c70 ithread_loop(c8ea6b40,edcf6ce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xedcf6cac fork_exit(c0c13e80,c8ea6b40,edcf6ce8) at fork_exit+0x7e/frame 0xedcf6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf6cd4 --- trap 0, eip = 0, esp = 0xedcf6d20, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc90cc350 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100066 td 0xc9100350 sched_switch(c9100350,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xedd3ec38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xedd3ec70 ithread_loop(c8ea6950,edd3ece8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xedd3ecac fork_exit(c0c13e80,c8ea6950,edd3ece8) at fork_exit+0x7e/frame 0xedd3ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd3ecd4 --- trap 0, eip = 0, esp = 0xedd3ed20, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xc9100000 sched_switch(c9100000,0,109,196,c186d654,...) at sched_switch+0x4e1/frame 0xedd4fc38 mi_switch(109,0,c15bd85d,555,c15bd5d8,...) at mi_switch+0x18c/frame 0xedd4fc70 ithread_loop(c8ea65c0,edd4fce8,c15bd5d8,406,0,...) at ithread_loop+0x1f0/frame 0xedd4fcac fork_exit(c0c13e80,c8ea65c0,edd4fce8) at fork_exit+0x7e/frame 0xedd4fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd4fcd4 --- trap 0, eip = 0, esp = 0xedd4fd20, ebp = 0 --- Tracing command intr pid 12 tid 100069 td 0xc90ff6a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100070 td 0xc90ff350 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xc8e4b6a0 sched_switch(c8e4b6a0,0,108,192,405,...) at sched_switch+0x4e1/frame 0xe4b28c00 mi_switch(108,0,c15c8433,405,c1a9b080,...) at mi_switch+0x18c/frame 0xe4b28c38 sched_idletd(0,e4b28ce8,c15bd5d8,406,0,...) at sched_idletd+0x465/frame 0xe4b28cac fork_exit(c0c7e950,0,e4b28ce8) at fork_exit+0x7e/frame 0xe4b28cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b28cd4 --- trap 0, eip = 0, esp = 0xe4b28d20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc8e4b350 sched_switch(c8e4b350,0,608,192,c1b6cc00,...) at sched_switch+0x4e1/frame 0xe4b2bbe4 mi_switch(608,0,c15c5e90,d3,c1a9aa08,...) at mi_switch+0x18c/frame 0xe4b2bc1c critical_exit(0,e4b2bc80,c15c8433,a57,c1a9b780,...) at critical_exit+0xa2/frame 0xe4b2bc38 sched_idletd(0,e4b2bce8,c15bd5d8,406,0,...) at sched_idletd+0x403/frame 0xe4b2bcac fork_exit(c0c7e950,0,e4b2bce8) at fork_exit+0x7e/frame 0xe4b2bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b2bcd4 --- trap 0, eip = 0, esp = 0xe4b2bd20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc8e4b000 sched_switch(c8e4b000,0,608,192,c1b6d000,...) at sched_switch+0x4e1/frame 0xe4b2ebe4 mi_switch(608,0,c15c5e90,d3,c1a9b108,...) at mi_switch+0x18c/frame 0xe4b2ec1c critical_exit(0,e4b2ec80,c15c8433,a57,c1a9a280,...) at critical_exit+0xa2/frame 0xe4b2ec38 sched_idletd(0,e4b2ece8,c15bd5d8,406,0,...) at sched_idletd+0x403/frame 0xe4b2ecac fork_exit(c0c7e950,0,e4b2ece8) at fork_exit+0x7e/frame 0xe4b2ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b2ecd4 --- trap 0, eip = 0, esp = 0xe4b2ed20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc8e4a9f0 sched_switch(c8e4a9f0,0,108,192,405,...) at sched_switch+0x4e1/frame 0xe4b31c00 mi_switch(108,0,c15c8433,405,c1a9a280,...) at mi_switch+0x18c/frame 0xe4b31c38 sched_idletd(0,e4b31ce8,c15bd5d8,406,0,...) at sched_idletd+0x465/frame 0xe4b31cac fork_exit(c0c7e950,0,e4b31ce8) at fork_exit+0x7e/frame 0xe4b31cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b31cd4 --- trap 0, eip = 0, esp = 0xe4b31d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc8e4b9f0 sched_switch(c8e4b9f0,0,104,196,e4b24994,...) at sched_switch+0x4e1/frame 0xe4b2495c mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b24994 sleepq_switch(c8e4b9f0,0,c15cc34d,1c2,c15cc34d,...) at sleepq_switch+0xf0/frame 0xe4b249c8 sleepq_catch_signals(c15cc34d,170,c8e3da90,3,c8e4b9f0,...) at sleepq_catch_signals+0x443/frame 0xe4b24a0c sleepq_wait_sig(c8e3d9d8,6c,c15d0099,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4b24a30 _sleep(c8e3d9d8,c8e3da80,16c,c15d0099,0,...) at _sleep+0x33f/frame 0xe4b24a8c kern_wait6(c8e4b9f0,7,0,0,e4b24b24,...) at kern_wait6+0x47d/frame 0xe4b24af8 sys_wait4(c8e4b9f0,e4b24ca8,c15bd083,4,c8e3da80,...) at sys_wait4+0x8b/frame 0xe4b24c18 syscall(e4b24ce8) at syscall+0x3bf/frame 0xe4b24cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xe4b24cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x8065167, esp = 0xbfbfe91c, ebp = 0xbfbfe930 --- Tracing command audit pid 10 tid 100001 td 0xc8e4c000 sched_switch(c8e4c000,0,104,196,e4b21bbc,...) at sched_switch+0x4e1/frame 0xe4b21b84 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xe4b21bbc sleepq_switch(c8e4c000,0,c15cc34d,28b,c1b696c8,...) at sleepq_switch+0xf0/frame 0xe4b21bf0 sleepq_wait(c1b696c8,0,e4b21c44,1,0,...) at sleepq_wait+0x48/frame 0xe4b21c14 _cv_wait(c1b696c8,c1b69654,c1604fd6,1ab,c1a9a280,...) at _cv_wait+0x20b/frame 0xe4b21c58 audit_worker(0,e4b21ce8,c15bd5d8,406,0,...) at audit_worker+0x94/frame 0xe4b21cac fork_exit(c0eef190,0,e4b21ce8) at fork_exit+0x7e/frame 0xe4b21cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b21cd4 --- trap 0, eip = 0, esp = 0xe4b21d20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1b61cb0 sched_switch(c1b61cb0,0,104,196,c2022c3c,...) at sched_switch+0x4e1/frame 0xc2022c04 mi_switch(104,0,c15cc34d,215,0,...) at mi_switch+0x18c/frame 0xc2022c3c sleepq_switch(c1b61cb0,0,c15cc34d,2ae,c1b61cb0,...) at sleepq_switch+0xf0/frame 0xc2022c70 sleepq_timedwait(c1b61964,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc2022c94 _sleep(c1b61964,0,54,c1610208,fffff470,...) at _sleep+0x326/frame 0xc2022cf0 swapper() at swapper+0x2c7/frame 0xc2022d38 begin() at begin+0x22 Tracing command kernel pid 0 tid 100013 td 0xc8e3f000 sched_switch(c8e3f000,0,104,196,e4b47bc0,...) at sched_switch+0x4e1/frame 0xe4b47b88 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b47bc0 sleepq_switch(c8e3f000,0,c15cc34d,28b,c8e3f000,...) at sleepq_switch+0xf0/frame 0xe4b47bf4 sleepq_wait(c8f23000,0,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b47c18 _sleep(c8f23000,c8f2301c,0,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b47c74 taskqueue_thread_loop(c1b66080,e4b47ce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b47cac fork_exit(c0ca5e30,c1b66080,e4b47ce8) at fork_exit+0x7e/frame 0xe4b47cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b47cd4 --- trap 0, eip = 0, esp = 0xe4b47d20, ebp = 0 --- Tracing command kernel pid 0 tid 100015 td 0xc8f26000 sched_switch(c8f26000,0,104,196,e4b4dbc0,...) at sched_switch+0x4e1/frame 0xe4b4db88 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b4dbc0 sleepq_switch(c8f26000,0,c15cc34d,28b,c8f26000,...) at sleepq_switch+0xf0/frame 0xe4b4dbf4 sleepq_wait(c8f22e80,0,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b4dc18 _sleep(c8f22e80,c8f22e9c,0,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b4dc74 taskqueue_thread_loop(c1b62240,e4b4dce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b4dcac fork_exit(c0ca5e30,c1b62240,e4b4dce8) at fork_exit+0x7e/frame 0xe4b4dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b4dcd4 --- trap 0, eip = 0, esp = 0xe4b4dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc8f25350 sched_switch(c8f25350,0,104,196,e4b56bc0,...) at sched_switch+0x4e1/frame 0xe4b56b88 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b56bc0 sleepq_switch(c8f25350,0,c15cc34d,28b,c8f25350,...) at sleepq_switch+0xf0/frame 0xe4b56bf4 sleepq_wait(c8f22d00,0,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b56c18 _sleep(c8f22d00,c8f22d1c,0,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b56c74 taskqueue_thread_loop(c1b66008,e4b56ce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b56cac fork_exit(c0ca5e30,c1b66008,e4b56ce8) at fork_exit+0x7e/frame 0xe4b56cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b56cd4 --- trap 0, eip = 0, esp = 0xe4b56d20, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8f24350 sched_switch(c8f24350,0,104,196,e4b62bc0,...) at sched_switch+0x4e1/frame 0xe4b62b88 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b62bc0 sleepq_switch(c8f24350,0,c15cc34d,28b,c8f24350,...) at sleepq_switch+0xf0/frame 0xe4b62bf4 sleepq_wait(c8f22c80,0,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xe4b62c18 _sleep(c8f22c80,c8f22c9c,0,c15aecc3,0,...) at _sleep+0x352/frame 0xe4b62c74 taskqueue_thread_loop(c1aa83a0,e4b62ce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b62cac fork_exit(c0ca5e30,c1aa83a0,e4b62ce8) at fork_exit+0x7e/frame 0xe4b62cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b62cd4 --- trap 0, eip = 0, esp = 0xe4b62d20, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc8e4c6a0 sched_switch(c8e4c6a0,0,104,196,e4b6bbd8,...) at sched_switch+0x4e1/frame 0xe4b6bba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b6bbd8 sleepq_switch(c8e4c6a0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xe4b6bc0c sleepq_wait(c8f22c00,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xe4b6bc30 msleep_spin_sbt(c8f22c00,c8f22c1c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xe4b6bc74 taskqueue_thread_loop(c1b58208,e4b6bce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b6bcac fork_exit(c0ca5e30,c1b58208,e4b6bce8) at fork_exit+0x7e/frame 0xe4b6bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b6bcd4 --- trap 0, eip = 0, esp = 0xe4b6bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc8e4c350 sched_switch(c8e4c350,0,104,196,e4b6ebd8,...) at sched_switch+0x4e1/frame 0xe4b6eba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b6ebd8 sleepq_switch(c8e4c350,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xe4b6ec0c sleepq_wait(c8f22c00,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xe4b6ec30 msleep_spin_sbt(c8f22c00,c8f22c1c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xe4b6ec74 taskqueue_thread_loop(c1b58208,e4b6ece8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b6ecac fork_exit(c0ca5e30,c1b58208,e4b6ece8) at fork_exit+0x7e/frame 0xe4b6ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b6ecd4 --- trap 0, eip = 0, esp = 0xe4b6ed20, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc90106a0 sched_switch(c90106a0,0,104,196,e4b71bd8,...) at sched_switch+0x4e1/frame 0xe4b71ba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xe4b71bd8 sleepq_switch(c90106a0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xe4b71c0c sleepq_wait(c8f22c00,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xe4b71c30 msleep_spin_sbt(c8f22c00,c8f22c1c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xe4b71c74 taskqueue_thread_loop(c1b58208,e4b71ce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b71cac fork_exit(c0ca5e30,c1b58208,e4b71ce8) at fork_exit+0x7e/frame 0xe4b71cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b71cd4 --- trap 0, eip = 0, esp = 0xe4b71d20, ebp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xc90ff000 sched_switch(c90ff000,0,104,196,edd65bd8,...) at sched_switch+0x4e1/frame 0xedd65ba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd65bd8 sleepq_switch(c90ff000,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xedd65c0c sleepq_wait(c8f22980,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xedd65c30 msleep_spin_sbt(c8f22980,c8f2299c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedd65c74 taskqueue_thread_loop(c1b56638,edd65ce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xedd65cac fork_exit(c0ca5e30,c1b56638,edd65ce8) at fork_exit+0x7e/frame 0xedd65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd65cd4 --- trap 0, eip = 0, esp = 0xedd65d20, ebp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xc90fe350 sched_switch(c90fe350,0,104,196,edd6fbc0,...) at sched_switch+0x4e1/frame 0xedd6fb88 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedd6fbc0 sleepq_switch(c90fe350,0,c15cc34d,28b,c90fe350,...) at sleepq_switch+0xf0/frame 0xedd6fbf4 sleepq_wait(c8f22b80,0,c15aecc3,0,0,...) at sleepq_wait+0x48/frame 0xedd6fc18 _sleep(c8f22b80,c8f22b9c,0,c15aecc3,0,...) at _sleep+0x352/frame 0xedd6fc74 taskqueue_thread_loop(c18b1524,edd6fce8,c15bd5d8,406,0,...) at taskqueue_thread_loop+0x144/frame 0xedd6fcac fork_exit(c0ca5e30,c18b1524,edd6fce8) at fork_exit+0x7e/frame 0xedd6fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd6fcd4 --- trap 0, eip = 0, esp = 0xedd6fd20, ebp = 0 --- Tracing command kernel pid 0 tid 100086 td 0xc939c9f0 sched_switch(c939c9f0,0,104,196,edf13bd8,...) at sched_switch+0x4e1/frame 0xedf13ba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf13bd8 sleepq_switch(c939c9f0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xedf13c0c sleepq_wait(c8f22500,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xedf13c30 msleep_spin_sbt(c8f22500,c8f2251c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedf13c74 gtaskqueue_thread_loop(c8f12004,edf13ce8,c15bd5d8,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf13cac fork_exit(c0c91d60,c8f12004,edf13ce8) at fork_exit+0x7e/frame 0xedf13cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf13cd4 --- trap 0, eip = 0, esp = 0xedf13d20, ebp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xc939c6a0 sched_switch(c939c6a0,0,104,196,edf16bd8,...) at sched_switch+0x4e1/frame 0xedf16ba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf16bd8 sleepq_switch(c939c6a0,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xedf16c0c sleepq_wait(c8f22480,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xedf16c30 msleep_spin_sbt(c8f22480,c8f2249c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedf16c74 gtaskqueue_thread_loop(c8f12014,edf16ce8,c15bd5d8,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf16cac fork_exit(c0c91d60,c8f12014,edf16ce8) at fork_exit+0x7e/frame 0xedf16cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf16cd4 --- trap 0, eip = 0, esp = 0xedf16d20, ebp = 0 --- Tracing command kernel pid 0 tid 100088 td 0xc939c350 sched_switch(c939c350,0,104,196,edf19bd8,...) at sched_switch+0x4e1/frame 0xedf19ba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf19bd8 sleepq_switch(c939c350,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xedf19c0c sleepq_wait(c8f22400,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xedf19c30 msleep_spin_sbt(c8f22400,c8f2241c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedf19c74 gtaskqueue_thread_loop(c8f12024,edf19ce8,c15bd5d8,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf19cac fork_exit(c0c91d60,c8f12024,edf19ce8) at fork_exit+0x7e/frame 0xedf19cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf19cd4 --- trap 0, eip = 0, esp = 0xedf19d20, ebp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xc939c000 sched_switch(c939c000,0,104,196,edf1cbd8,...) at sched_switch+0x4e1/frame 0xedf1cba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf1cbd8 sleepq_switch(c939c000,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xedf1cc0c sleepq_wait(c8f22380,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xedf1cc30 msleep_spin_sbt(c8f22380,c8f2239c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedf1cc74 gtaskqueue_thread_loop(c8f12034,edf1cce8,c15bd5d8,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf1ccac fork_exit(c0c91d60,c8f12034,edf1cce8) at fork_exit+0x7e/frame 0xedf1ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1ccd4 --- trap 0, eip = 0, esp = 0xedf1cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xc9629000 sched_switch(c9629000,0,104,196,edf22bd8,...) at sched_switch+0x4e1/frame 0xedf22ba0 mi_switch(104,0,c15cc34d,215,c186d654,...) at mi_switch+0x18c/frame 0xedf22bd8 sleepq_switch(c9629000,0,c15cc34d,28b,0,...) at sleepq_switch+0xf0/frame 0xedf22c0c sleepq_wait(c95df100,0,c15c63ea,c15aecc3,0,...) at sleepq_wait+0x48/frame 0xedf22c30 msleep_spin_sbt(c95df100,c95df11c,c15aecc3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedf22c74 gtaskqueue_thread_loop(c8f11c04,edf22ce8,c15bd5d8,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf22cac fork_exit(c0c91d60,c8f11c04,edf22ce8) at fork_exit+0x7e/frame 0xedf22cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf22cd4 --- trap 0, eip = 0, esp = 0xedf22d20, ebp = 0 --- db:0:allt> dump Physical memory: 3427 MB Dumping 217 MB: 202 186 170 154 138 122 106 90 74 58 42 26 10 Dump complete db:0:dump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:206 #1 0xc056a96e in db_dump (dummy=0xc0c9330a, dummy2=Unhandled dwarf expression opcode 0x9d ) at ../../../ddb/db_command.c:546 #2 0xc056a738 in db_command (cmd_table=) at ../../../ddb/db_command.c:453 #3 0xc056ee78 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc056a738 in db_command (cmd_table=) at ../../../ddb/db_command.c:453 #5 0xc056a450 in db_command_loop () at ../../../ddb/db_command.c:506 #6 0xc056d3da in db_trap (type=, code=) at ../../../ddb/db_main.c:248 #7 0xc0c93ac7 in kdb_trap (tf=) at ../../../kern/subr_kdb.c:654 #8 0xc11e0a5c in trap (frame=0xf12ae764) at ../../../i386/i386/trap.c:711 #9 0xc11cc5ea in calltrap () at ../../../i386/i386/exception.s:172 #10 0xc0c9330a in kdb_enter (why=0xc15c5390 "panic", msg=) at cpufunc.h:60 #11 0xc0c502c2 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:752 #12 0xc0c50189 in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:649 #13 0xc0e4be06 in tcp_sack_doack (tp=, to=, th_ack=) at ../../../netinet/tcp_sack.c:474 #14 0xc0e44054 in tcp_do_segment (m=, th=, so=, tp=, drop_hdrlen=, tlen=, iptos=, ti_locked=) at ../../../netinet/tcp_input.c:2501 #15 0xc0e40c22 in tcp_input (mp=, offp=, proto=) at ../../../netinet/tcp_input.c:1444 #16 0xc0dca13f in ip_input (m=) at ../../../netinet/ip_input.c:809 #17 0xc0d629b3 in netisr_dispatch_src (proto=, source=, m=0xcceaf300) at ../../../net/netisr.c:1120 #18 0xc0d62d80 in netisr_dispatch (proto=0x1, m=0xcceaf300) at ../../../net/netisr.c:1211 #19 0xc0d4d0e4 in ether_demux (ifp=, m=0xc15ca693) at ../../../net/if_ethersubr.c:848 #20 0xc0d4dee6 in ether_nh_input (m=) at ../../../net/if_ethersubr.c:637 #21 0xc0d629b3 in netisr_dispatch_src (proto=, source=, m=0xcceaf300) at ../../../net/netisr.c:1120 #22 0xc0d62d80 in netisr_dispatch (proto=0x5, m=0xcceaf300) at ../../../net/netisr.c:1211 #23 0xc0d4d431 in ether_input (ifp=, m=0x0) at ../../../net/if_ethersubr.c:757 #24 0xc097c65e in re_rxeof () at ../../../dev/re/if_re.c:2371 #25 0xc0979caa in re_intr_msi (xsc=0xc9047000) at ../../../dev/re/if_re.c:2667 #26 0xc0c1391e in intr_event_execute_handlers (p=0xc1a9a990, ie=) at ../../../kern/kern_intr.c:1262 #27 0xc0c13f10 in ithread_loop (arg=) at ../../../kern/kern_intr.c:1275 #28 0xc0c10f3e in fork_exit (callout=0xc0c13e80 ) at ../../../kern/kern_fork.c:1038 #29 0xc11cc6b0 in fork_trampoline () at ../../../i386/i386/exception.s:287 Current language: auto; currently minimal (kgdb) f 13 #13 0xc0e4be06 in tcp_sack_doack (tp=, to=, th_ack=) at ../../../netinet/tcp_sack.c:474 474 KASSERT(!TAILQ_EMPTY(&tp->snd_holes), (kgdb) l 469 /* fack is advanced. */ 470 tp->snd_fack = sblkp->end; 471 sack_changed = 1; 472 } 473 /* We must have at least one SACK hole in scoreboard. */ 474 KASSERT(!TAILQ_EMPTY(&tp->snd_holes), 475 ("SACK scoreboard must not be empty")); 476 cur = TAILQ_LAST(&tp->snd_holes, sackhole_head); /* Last SACK hole. */ 477 /* 478 * Since the incoming sack blocks are sorted, we can process them (kgdb) p *tp Cannot access memory at address 0xa5a5a5a5 (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/kern/subr_witness.c =================================================================== --- /usr/src/sys/kern/subr_witness.c (revision 305815) +++ /usr/src/sys/kern/subr_witness.c (working copy) @@ -623,12 +623,12 @@ static struct witness_order_list_entry order_lists { "vnode interlock", &lock_class_mtx_sleep }, { NULL, NULL }, /* - * VFS namecache + * vfs namecache */ - { "ncglobal", &lock_class_rw }, + { "ncen", &lock_class_mtx_sleep }, + { "ncvn", &lock_class_mtx_sleep }, { "ncbuc", &lock_class_rw }, { "vnode interlock", &lock_class_mtx_sleep }, - { "ncneg", &lock_class_mtx_sleep }, { NULL, NULL }, /* * ZFS locking Index: /usr/src/sys/kern/vfs_cache.c =================================================================== --- /usr/src/sys/kern/vfs_cache.c (revision 305815) +++ /usr/src/sys/kern/vfs_cache.c (working copy) @@ -150,22 +150,48 @@ struct namecache_ts { * is for DELETE, or NOCACHE is set (rewrite), and the * name is located in the cache, it will be dropped. * - * These locks are used (in the order in which they can be taken): + * These locks are used (in order in which they can be taken): * NAME TYPE ROLE - * cache_lock rwlock global, needed for all modifications - * bucketlock rwlock for access to given hash bucket + * ncelock mtx per entry, taken if the entry is to be zapped (see below) + * vnodelock mtx vnode lists and v_cache_dd field protection + * bucketlock rwlock for access to given to given set of hash buckets * ncneg_mtx mtx negative entry LRU management * - * A name -> vnode lookup can be safely performed by either locking cache_lock - * or the relevant hash bucket. + * Additionally ncneg_shrink_lock mtx is used to have at most one thread doing + * LRU list shrinking. * - * ".." and vnode -> name lookups require cache_lock. + * It is legal to take multiple vnodelock and bucketlock locks. The locking + * order is lower address first. Both are recursive. * - * Modifications require both cache_lock and relevant bucketlock taken for - * writing. + * "." lookups are lockless. * - * Negative entry LRU management requires ncneg_mtx taken on top of either - * cache_lock or bucketlock. + * ".." and vnode -> name lookups require vnodelock. + * + * name -> vnode lookup requires relevant bucketlock to be held for reading. + * + * Insertions and removals of entries require involved vnodes and bucketlocks + * to be write-locked to prevent other threads from seeing the entry. + * + * Some lookups result in removal of found entry (e.g. getting rid of negative + * entry with the intent to create a positive one), which poses a problem when + * multiple threads reach the state. Similarly, two different threads can purge + * two different vnodes and try to remove the same name. + * + * Problematic cases are resolved with the help of ncelock placed in the entry. + * + * The general scheme requires users to acquire one lock allowing to find the + * entry (either vnodelock or bucketlock). Then they trylock the ncelock lock + * and on failure drop their locks and retry the lookup. The thread which + * succeeded takes all locks in order, effectively guaranteeing that no other + * thread can access the entry. Threads which retry fail their lookups if the + * entry was removed and no new matching entry was inserted. + * + * Note that ncelock itself does not prevent other threads from seeing the entry. + * Rather, it is only used to safely take all relevant locks in order and that's + * what keeps other threads out. + * As such, as a microoptisation the code can trylock things in reverse order. + * Similarly, if the thread already holds the top lock (lowest vnode address), + * it can just lock things in order without having to resort to ncelock trylock. */ /* @@ -196,16 +222,10 @@ SYSCTL_UINT(_vfs, OID_AUTO, ncsizefactor, CTLFLAG_ struct nchstats nchstats; /* cache effectiveness statistics */ -static struct rwlock cache_lock; -RW_SYSINIT(vfscache, &cache_lock, "ncglobal"); +static struct mtx ncneg_shrink_lock; +MTX_SYSINIT(vfscache_shrink_neg, &ncneg_shrink_lock, "Name Cache shrink neg", + MTX_DEF); -#define CACHE_TRY_WLOCK() rw_try_wlock(&cache_lock) -#define CACHE_UPGRADE_LOCK() rw_try_upgrade(&cache_lock) -#define CACHE_RLOCK() rw_rlock(&cache_lock) -#define CACHE_RUNLOCK() rw_runlock(&cache_lock) -#define CACHE_WLOCK() rw_wlock(&cache_lock) -#define CACHE_WUNLOCK() rw_wunlock(&cache_lock) - static struct mtx_padalign ncneg_mtx; MTX_SYSINIT(vfscache_neg, &ncneg_mtx, "ncneg", MTX_DEF); @@ -214,6 +234,51 @@ static struct rwlock_padalign *bucketlocks; #define HASH2BUCKETLOCK(hash) \ ((struct rwlock *)(&bucketlocks[((hash) % numbucketlocks)])) +static u_int numvnodelocks; +static struct mtx *vnodelocks; +static inline struct mtx * +VP2VNODELOCK(struct vnode *vp) +{ + struct mtx *vlp; + + if (vp == NULL) + return (NULL); + /* XXXMJG find the right method */ + vlp = &vnodelocks[(((uintptr_t)(vp) >> 8) % numvnodelocks)]; + return (vlp); +} + +static u_int numncelocks; +static struct mtx *ncelocks; +static inline struct mtx * +NCP2NCELOCK(struct namecache *ncp) +{ + struct mtx *nclp; + + /* XXXMJG find the right method */ + nclp = &ncelocks[(((uintptr_t)(ncp) >> 8) % numncelocks)]; + return (nclp); +} + +static int random_trylock_do_fail = 0; +SYSCTL_INT(_debug, OID_AUTO, cache_random_trylock_do_fail, CTLFLAG_RW, + &random_trylock_do_fail, 0, "VFS cache random trylock fail"); + +static u_long random_trylock_numfail; +SYSCTL_ULONG(_debug, OID_AUTO, cache_random_trylock_numfail, CTLFLAG_RW, + &random_trylock_numfail, 0, "VFS cache random trylock fail"); + +static int cache_mtx_trylock(struct mtx *lock) +{ + + if (*(volatile int *)&random_trylock_do_fail && (cpu_ticks() % 2)) { + random_trylock_numfail++; + return (0); + } + + return (mtx_trylock(lock)); +} + /* * UMA zones for the VFS cache. * @@ -333,15 +398,43 @@ static long numupgrades; STATNODE_ULONG(numupgrade "Number of updates of the cache after lookup (write lock + retry)"); static long zap_and_exit_bucket_fail; STATNODE_ULONG(zap_and_exit_bucket_fail, "Number of times bucketlocked zap_and_exit case failed to writelock"); +static long cache_lock_vnodes_cel_3_failures; +STATNODE_ULONG(cache_lock_vnodes_cel_3_failures, + "Number of times bucketlocked zap_and_exit case failed to writelock"); -static void cache_zap(struct namecache *ncp); -static int vn_vptocnp_locked(struct vnode **vp, struct ucred *cred, char *buf, - u_int *buflen); +static void cache_zap_locked_ncp(struct namecache *ncp); static int vn_fullpath1(struct thread *td, struct vnode *vp, struct vnode *rdir, char *buf, char **retbuf, u_int buflen); static MALLOC_DEFINE(M_VFSCACHE, "vfscache", "VFS name cache entries"); +static inline void +cache_assert_vlp_locked(struct mtx *vlp) +{ + + if (vlp != NULL) + mtx_assert(vlp, MA_OWNED); +} + +static inline void +cache_assert_ncp_locked(struct namecache *ncp) +{ + struct mtx *ncelp; + + ncelp = NCP2NCELOCK(ncp); + + mtx_assert(ncelp, MA_OWNED); +} + +static inline void +cache_assert_vnode_locked(struct vnode *vp) +{ + struct mtx *vlp; + + vlp = VP2VNODELOCK(vp); + cache_assert_vlp_locked(vlp); +} + static uint32_t cache_get_hash(char *name, u_char len, struct vnode *dvp) { @@ -352,22 +445,63 @@ cache_get_hash(char *name, u_char len, struct vnod return (hash); } +static inline struct rwlock * +NCP2BUCKETLOCK(struct namecache *ncp) +{ + uint32_t hash; + + hash = cache_get_hash(nc_get_name(ncp), ncp->nc_nlen, ncp->nc_dvp); + return (HASH2BUCKETLOCK(hash)); +} + +static int +cache_trylock_ncp(struct namecache *ncp) +{ + struct mtx *ncelp; + + ncelp = NCP2NCELOCK(ncp); + + return (cache_mtx_trylock(ncelp)); +} + +static void +cache_unlock_ncp(struct namecache *ncp) +{ + struct mtx *ncelp; + + ncelp = NCP2NCELOCK(ncp); + + mtx_unlock(ncelp); +} + + #ifdef INVARIANTS static void cache_assert_bucket_locked(struct namecache *ncp, int mode) { - struct rwlock *bucketlock; - uint32_t hash; + struct rwlock *blp; - hash = cache_get_hash(nc_get_name(ncp), ncp->nc_nlen, ncp->nc_dvp); - bucketlock = HASH2BUCKETLOCK(hash); - rw_assert(bucketlock, mode); + blp = NCP2BUCKETLOCK(ncp); + rw_assert(blp, mode); } #else #define cache_assert_bucket_locked(x, y) do { } while (0) #endif +#define cache_sort(x, y) _cache_sort((void **)(x), (void **)(y)) static void +_cache_sort(void **p1, void **p2) +{ + void *tmp; + + if (*p1 > *p2) { + tmp = *p2; + *p2 = *p1; + *p1 = tmp; + } +} + +static void cache_lock_all_buckets(void) { u_int i; @@ -385,6 +519,24 @@ cache_unlock_all_buckets(void) rw_wunlock(&bucketlocks[i]); } +static void +cache_lock_all_vnodes(void) +{ + u_int i; + + for (i = 0; i < numvnodelocks; i++) + mtx_lock(&vnodelocks[i]); +} + +static void +cache_unlock_all_vnodes(void) +{ + u_int i; + + for (i = 0; i < numvnodelocks; i++) + mtx_unlock(&vnodelocks[i]); +} + static int sysctl_nchstats(SYSCTL_HANDLER_ARGS) { @@ -426,9 +578,9 @@ retry: if (req->oldptr == NULL) return SYSCTL_OUT(req, 0, n_nchash * sizeof(int)); cntbuf = malloc(n_nchash * sizeof(int), M_TEMP, M_ZERO | M_WAITOK); - CACHE_RLOCK(); + cache_lock_all_buckets(); if (n_nchash != nchash + 1) { - CACHE_RUNLOCK(); + cache_unlock_all_buckets(); free(cntbuf, M_TEMP); goto retry; } @@ -436,7 +588,7 @@ retry: for (ncpp = nchashtbl, i = 0; i < n_nchash; ncpp++, i++) LIST_FOREACH(ncp, ncpp, nc_hash) cntbuf[i]++; - CACHE_RUNLOCK(); + cache_unlock_all_buckets(); for (error = 0, i = 0; i < n_nchash; i++) if ((error = SYSCTL_OUT(req, &cntbuf[i], sizeof(int))) != 0) break; @@ -459,7 +611,7 @@ sysctl_debug_hashstat_nchash(SYSCTL_HANDLER_ARGS) if (!req->oldptr) return SYSCTL_OUT(req, 0, 4 * sizeof(int)); - CACHE_RLOCK(); + cache_lock_all_buckets(); n_nchash = nchash + 1; /* nchash is max index, not count */ used = 0; maxlength = 0; @@ -476,7 +628,7 @@ sysctl_debug_hashstat_nchash(SYSCTL_HANDLER_ARGS) maxlength = count; } n_nchash = nchash + 1; - CACHE_RUNLOCK(); + cache_unlock_all_buckets(); pct = (used * 100) / (n_nchash / 100); error = SYSCTL_OUT(req, &n_nchash, sizeof(n_nchash)); if (error) @@ -497,6 +649,14 @@ SYSCTL_PROC(_debug_hashstat, OID_AUTO, nchash, CTL "nchash statistics (number of total/used buckets, maximum chain length, usage percentage)"); #endif +static void +cache_dump_ncp(struct vnode *dvp, struct vnode *vp, struct namecache *ncp, int line) +{ + + panic("dvp %p vp %p ncp %p ncp->vp %p ncp->dvp %p LINE %d\n", + dvp, vp, ncp, ncp->nc_vp, ncp->nc_dvp, line); +} + /* * Negative entries management */ @@ -504,6 +664,7 @@ static void cache_negative_hit(struct namecache *ncp) { + MPASS(ncp->nc_vp == NULL); mtx_lock(&ncneg_mtx); TAILQ_REMOVE(&ncneg, ncp, nc_dst); TAILQ_INSERT_TAIL(&ncneg, ncp, nc_dst); @@ -514,7 +675,6 @@ static void cache_negative_insert(struct namecache *ncp) { - rw_assert(&cache_lock, RA_WLOCKED); cache_assert_bucket_locked(ncp, RA_WLOCKED); MPASS(ncp->nc_vp == NULL); mtx_lock(&ncneg_mtx); @@ -527,7 +687,6 @@ static void cache_negative_remove(struct namecache *ncp) { - rw_assert(&cache_lock, RA_WLOCKED); cache_assert_bucket_locked(ncp, RA_WLOCKED); MPASS(ncp->nc_vp == NULL); mtx_lock(&ncneg_mtx); @@ -536,17 +695,27 @@ cache_negative_remove(struct namecache *ncp) mtx_unlock(&ncneg_mtx); } -static struct namecache * +static void cache_negative_zap_one(void) { struct namecache *ncp; - rw_assert(&cache_lock, RA_WLOCKED); + if (!mtx_trylock(&ncneg_shrink_lock)) + return; + + mtx_lock(&ncneg_mtx); ncp = TAILQ_FIRST(&ncneg); - KASSERT(ncp->nc_vp == NULL, ("ncp %p vp %p on ncneg", - ncp, ncp->nc_vp)); - cache_zap(ncp); - return (ncp); + if (ncp == NULL || !cache_trylock_ncp(ncp)) { + mtx_unlock(&ncneg_mtx); + ncp = NULL; + } else { + mtx_unlock(&ncneg_mtx); + KASSERT(ncp->nc_vp == NULL, ("ncp %p vp %p on ncneg", + ncp, ncp->nc_vp)); + cache_zap_locked_ncp(ncp); + } + mtx_unlock(&ncneg_shrink_lock); + cache_free(ncp); } /* @@ -556,11 +725,15 @@ cache_negative_zap_one(void) * pointer to a vnode or if it is just a negative cache entry. */ static void -cache_zap_locked(struct namecache *ncp) +cache_zap_locked_all(struct namecache *ncp) { - rw_assert(&cache_lock, RA_WLOCKED); + cache_assert_vnode_locked(ncp->nc_vp); + cache_assert_vnode_locked(ncp->nc_dvp); cache_assert_bucket_locked(ncp, RA_WLOCKED); + if (ncp->nc_vp == NULL) + cache_assert_ncp_locked(ncp); + CTR2(KTR_VFS, "cache_zap(%p) vp %p", ncp, ncp->nc_vp); if (ncp->nc_vp != NULL) { SDT_PROBE3(vfs, namecache, zap, done, ncp->nc_dvp, @@ -577,7 +750,7 @@ static void LIST_REMOVE(ncp, nc_src); if (LIST_EMPTY(&ncp->nc_dvp->v_cache_src)) { ncp->nc_flag |= NCF_DVDROP; - numcachehv--; + atomic_subtract_rel_long(&numcachehv, 1); } } if (ncp->nc_vp) { @@ -587,24 +760,197 @@ static void } else { cache_negative_remove(ncp); } - numcache--; + atomic_subtract_rel_long(&numcache, 1); } static void -cache_zap(struct namecache *ncp) +cache_lock_vnodes(struct mtx *vlp1, struct mtx *vlp2) { - struct rwlock *bucketlock; - uint32_t hash; - rw_assert(&cache_lock, RA_WLOCKED); + cache_sort(&vlp1, &vlp2); - hash = cache_get_hash(nc_get_name(ncp), ncp->nc_nlen, ncp->nc_dvp); - bucketlock = HASH2BUCKETLOCK(hash); - rw_wlock(bucketlock); - cache_zap_locked(ncp); - rw_wunlock(bucketlock); + if (vlp1 != NULL) + mtx_lock(vlp1); + mtx_lock(vlp2); } +static int +cache_trylock_vnodes(struct mtx *vlp1, struct mtx *vlp2) +{ + + cache_sort(&vlp1, &vlp2); + MPASS(vlp2 != NULL); + + if (vlp1 != NULL) { + if (!mtx_trylock(vlp1)) + return (EAGAIN); + } + if (!mtx_trylock(vlp2)) { + if (vlp1 != NULL) + mtx_unlock(vlp1); + return (EAGAIN); + } + + return (0); +} + +static void +cache_unlock_vnodes(struct mtx *vlp1, struct mtx *vlp2) +{ + + MPASS(vlp1 != NULL || vlp2 != NULL); + + if (vlp1 != NULL) + mtx_unlock(vlp1); + if (vlp2 != NULL) + mtx_unlock(vlp2); +} + +static void +cache_zap_locked_ncp(struct namecache *ncp) +{ + struct rwlock *blp; + struct mtx *dvlp, *vlp; + + cache_assert_ncp_locked(ncp); + + blp = NCP2BUCKETLOCK(ncp); + dvlp = VP2VNODELOCK(ncp->nc_dvp); + vlp = VP2VNODELOCK(ncp->nc_vp); + + cache_lock_vnodes(dvlp, vlp); + rw_wlock(blp); + + cache_zap_locked_all(ncp); + + rw_wunlock(blp); + cache_unlock_vnodes(dvlp, vlp); + cache_unlock_ncp(ncp); +} + +static int +cache_zap_locked_vnode(struct namecache *ncp, struct vnode *vp) +{ + struct mtx *vlp; + + MPASS(vp == ncp->nc_dvp || vp == ncp->nc_vp); + cache_assert_vnode_locked(vp); + vlp = VP2VNODELOCK(vp); + + if (!cache_trylock_ncp(ncp)) { + mtx_unlock(vlp); + return (EAGAIN); + } + + mtx_unlock(vlp); + cache_zap_locked_ncp(ncp); + return (0); +} + +static int +cache_zap_locked_vnode_kl(struct namecache *ncp, struct vnode *vp) +{ + struct mtx *pvlp, *vlp1, *vlp2, *to_unlock; + struct rwlock *blp; + + MPASS(vp == ncp->nc_dvp || vp == ncp->nc_vp); + cache_assert_vnode_locked(vp); + + pvlp = VP2VNODELOCK(vp); + blp = NCP2BUCKETLOCK(ncp); + if (ncp->nc_vp == NULL) { + if (!cache_trylock_ncp(ncp)) + goto out_unlock_pvlp; + rw_wlock(blp); + cache_zap_locked_all(ncp); + rw_wunlock(blp); + cache_unlock_ncp(ncp); + return (0); + } + + vlp1 = VP2VNODELOCK(ncp->nc_dvp); + vlp2 = VP2VNODELOCK(ncp->nc_vp); + cache_sort(&vlp1, &vlp2); + if (vlp1 == pvlp) { + mtx_lock(vlp2); + to_unlock = vlp2; + } else { + if (!cache_mtx_trylock(vlp1)) + goto out_unlock_pvlp; + to_unlock = vlp1; + } + rw_wlock(blp); + cache_zap_locked_all(ncp); + rw_wunlock(blp); + mtx_unlock(to_unlock); + return (0); + +out_unlock_pvlp: + mtx_unlock(pvlp); + return (EAGAIN); +} + +static int +cache_zap_rlocked_bucket(struct namecache *ncp, struct rwlock *blp) +{ + + cache_assert_bucket_locked(ncp, RA_RLOCKED); + + if (!cache_trylock_ncp(ncp)) { + rw_runlock(blp); + return (EAGAIN); + } + + rw_runlock(blp); + cache_zap_locked_ncp(ncp); + return (0); +} + +static int +cache_zap_wlocked_bucket_kl(struct namecache *ncp, struct rwlock *blp) +{ + struct mtx *dvlp, *vlp; + + cache_assert_bucket_locked(ncp, RA_WLOCKED); + + dvlp = VP2VNODELOCK(ncp->nc_dvp); + if (ncp->nc_vp == NULL) { + if (!cache_trylock_ncp(ncp)) + goto out_unlock_bucket; + if (!cache_mtx_trylock(dvlp)) { + cache_unlock_ncp(ncp); + goto out_unlock_bucket; + } + cache_zap_locked_all(ncp); + mtx_unlock(dvlp); + cache_unlock_ncp(ncp); + return (0); + } + + vlp = VP2VNODELOCK(ncp->nc_vp); + if (cache_trylock_vnodes(dvlp, vlp) == 0) { + cache_zap_locked_all(ncp); + cache_unlock_vnodes(dvlp, vlp); + return (0); + } + +out_unlock_bucket: + rw_wunlock(blp); + return (EAGAIN); +} + +static void +cache_lookup_unlock(struct rwlock *blp, struct mtx *vlp) +{ + + if (blp != NULL) { + rw_runlock(blp); + mtx_assert(vlp, MA_NOTOWNED); + } else { + mtx_unlock(vlp); + } +} + /* * Lookup an entry in the cache * @@ -622,32 +968,15 @@ static void * not recursively acquired. */ -enum { UNLOCKED, WLOCKED, RLOCKED }; - -static void -cache_unlock(int cache_locked) -{ - - switch (cache_locked) { - case UNLOCKED: - break; - case WLOCKED: - CACHE_WUNLOCK(); - break; - case RLOCKED: - CACHE_RUNLOCK(); - break; - } -} - int cache_lookup(struct vnode *dvp, struct vnode **vpp, struct componentname *cnp, struct timespec *tsp, int *ticksp) { - struct rwlock *bucketlock; struct namecache *ncp; + struct rwlock *blp; + struct mtx *dvlp; uint32_t hash; - int error, ltype, cache_locked; + int error, ltype; if (!doingcache) { cnp->cn_flags &= ~MAKEENTRY; @@ -654,12 +983,11 @@ cache_lookup(struct vnode *dvp, struct vnode **vpp return (0); } retry: - bucketlock = NULL; - cache_locked = UNLOCKED; + blp = NULL; + dvlp = VP2VNODELOCK(dvp); error = 0; counter_u64_add(numcalls, 1); -retry_wlocked: if (cnp->cn_nameptr[0] == '.') { if (cnp->cn_namelen == 1) { *vpp = dvp; @@ -693,32 +1021,32 @@ retry: } if (cnp->cn_namelen == 2 && cnp->cn_nameptr[1] == '.') { counter_u64_add(dotdothits, 1); - if (cache_locked == UNLOCKED) { - CACHE_RLOCK(); - cache_locked = RLOCKED; - } - - if (dvp->v_cache_dd == NULL) { +retry_dotdot: + mtx_lock(dvlp); + ncp = dvp->v_cache_dd; + if (ncp == NULL) { SDT_PROBE3(vfs, namecache, lookup, miss, dvp, "..", NULL); - goto unlock; + mtx_unlock(dvlp); + return (0); } if ((cnp->cn_flags & MAKEENTRY) == 0) { - if (cache_locked != WLOCKED && - !CACHE_UPGRADE_LOCK()) - goto wlock; - ncp = NULL; - if (dvp->v_cache_dd->nc_flag & NCF_ISDOTDOT) { - ncp = dvp->v_cache_dd; - cache_zap(ncp); + if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) { + if (ncp->nc_dvp != dvp) + panic("dvp %p v_cache_dd %p\n", dvp, ncp); + if (cache_zap_locked_vnode(ncp, dvp) != 0) + goto retry_dotdot; + /* XXXMJG ensure this is really null here. + * note the lock is dropped in the meantime. + */ + cache_free(ncp); + } else { + dvp->v_cache_dd = NULL; + mtx_unlock(dvlp); } - dvp->v_cache_dd = NULL; - CACHE_WUNLOCK(); - cache_free(ncp); return (0); } - ncp = dvp->v_cache_dd; - if (ncp->nc_flag & NCF_ISDOTDOT) + if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) *vpp = ncp->nc_vp; else *vpp = ncp->nc_dvp; @@ -739,10 +1067,8 @@ retry: } hash = cache_get_hash(cnp->cn_nameptr, cnp->cn_namelen, dvp); - if (cache_locked == UNLOCKED) { - bucketlock = HASH2BUCKETLOCK(hash); - rw_rlock(bucketlock); - } + blp = HASH2BUCKETLOCK(hash); + rw_rlock(blp); LIST_FOREACH(ncp, (NCHHASH(hash)), nc_hash) { counter_u64_add(numchecks, 1); @@ -795,24 +1121,9 @@ negative_success: SDT_PROBE2(vfs, namecache, lookup, hit__negative, dvp, nc_get_name(ncp)); cache_out_ts(ncp, tsp, ticksp); - MPASS(bucketlock != NULL || cache_locked != UNLOCKED); - if (bucketlock != NULL) - rw_runlock(bucketlock); - cache_unlock(cache_locked); + cache_lookup_unlock(blp, dvlp); return (ENOENT); -wlock: - /* - * We need to update the cache after our lookup, so upgrade to - * a write lock and retry the operation. - */ - CACHE_RUNLOCK(); -wlock_unlocked: - CACHE_WLOCK(); - numupgrades++; - cache_locked = WLOCKED; - goto retry_wlocked; - success: /* * On success we return a locked and ref'd vnode as per the lookup @@ -825,10 +1136,7 @@ success: VOP_UNLOCK(dvp, 0); } vhold(*vpp); - MPASS(bucketlock != NULL || cache_locked != UNLOCKED); - if (bucketlock != NULL) - rw_runlock(bucketlock); - cache_unlock(cache_locked); + cache_lookup_unlock(blp, dvlp); error = vget(*vpp, cnp->cn_lkflags | LK_VNHELD, cnp->cn_thread); if (cnp->cn_flags & ISDOTDOT) { vn_lock(dvp, ltype | LK_RETRY); @@ -850,33 +1158,227 @@ success: return (-1); unlock: - MPASS(bucketlock != NULL || cache_locked != UNLOCKED); - if (bucketlock != NULL) - rw_runlock(bucketlock); - cache_unlock(cache_locked); + cache_lookup_unlock(blp, dvlp); return (0); zap_and_exit: - if (bucketlock != NULL) { - rw_assert(&cache_lock, RA_UNLOCKED); - if (!CACHE_TRY_WLOCK()) { - rw_runlock(bucketlock); - bucketlock = NULL; - zap_and_exit_bucket_fail++; - goto wlock_unlocked; - } - cache_locked = WLOCKED; - rw_runlock(bucketlock); - bucketlock = NULL; - } else if (cache_locked != WLOCKED && !CACHE_UPGRADE_LOCK()) - goto wlock; - cache_zap(ncp); - CACHE_WUNLOCK(); + if (blp != NULL) + error = cache_zap_rlocked_bucket(ncp, blp); + else + error = cache_zap_locked_vnode(ncp, dvp); + if (error != 0) { + zap_and_exit_bucket_fail++; + goto retry; + } cache_free(ncp); return (0); } +struct celockstate { + struct mtx *vlp[3]; + struct rwlock *blp[2]; + struct namecache *ncp; +}; +CTASSERT((nitems(((struct celockstate *)0)->vlp) == 3)); +CTASSERT((nitems(((struct celockstate *)0)->blp) == 2)); + +static inline void +cache_celockstate_init(struct celockstate *cel) +{ + + bzero(cel, sizeof(*cel)); +} + +static void +cache_lock_vnodes_cel(struct celockstate *cel, struct vnode *vp, + struct vnode *dvp) +{ + struct mtx *vlp1, *vlp2; + + MPASS(cel->vlp[0] == NULL); + MPASS(cel->vlp[1] == NULL); + MPASS(cel->vlp[2] == NULL); + + MPASS(vp != NULL || dvp != NULL); + + vlp1 = VP2VNODELOCK(vp); + vlp2 = VP2VNODELOCK(dvp); + cache_sort(&vlp1, &vlp2); + + if (vlp1 != NULL) { + mtx_lock(vlp1); + cel->vlp[0] = vlp1; + } + mtx_lock(vlp2); + cel->vlp[1] = vlp2; +} + +static void +cache_unlock_vnodes_cel(struct celockstate *cel) +{ + + MPASS(cel->vlp[0] != NULL || cel->vlp[1] != NULL); + + if (cel->vlp[0] != NULL) + mtx_unlock(cel->vlp[0]); + if (cel->vlp[1] != NULL) + mtx_unlock(cel->vlp[1]); + if (cel->vlp[2] != NULL) + mtx_unlock(cel->vlp[2]); +} + +static int +cache_lock_vnodes_cel_3(struct celockstate *cel, struct vnode *vp) +{ + struct mtx *vlp; + int error; + + cache_assert_vlp_locked(cel->vlp[0]); + cache_assert_vlp_locked(cel->vlp[1]); + MPASS(cel->vlp[2] == NULL); + + MPASS(vp != NULL); + + vlp = VP2VNODELOCK(vp); + + error = 0; + if (vlp > cel->vlp[1]) { + mtx_lock(vlp); + } else { + if (!cache_mtx_trylock(vlp)) { + cache_lock_vnodes_cel_3_failures++; + error = EAGAIN; + goto out; + } + } + cel->vlp[2] = vlp; +out: + return (error); +} + +static void +cache_lock_buckets_cel(struct celockstate *cel, struct rwlock *blp1, + struct rwlock *blp2) +{ + + MPASS(cel->blp[0] == NULL); + MPASS(cel->blp[1] == NULL); + + cache_sort(&blp1, &blp2); + + if (blp1 != NULL) { + rw_wlock(blp1); + cel->blp[0] = blp1; + } + rw_wlock(blp2); + cel->blp[1] = blp2; +} + +static void +cache_unlock_buckets_cel(struct celockstate *cel) +{ + + if (cel->blp[0] != NULL) + rw_wunlock(cel->blp[0]); + rw_wunlock(cel->blp[1]); +} + /* + * Lock part of the cache affected by the insertion. + * + * This means vnodelocks for dvp, vp and the relevant bucketlock. + * However, insertion can result in removal of an old entry. In this + * case we have an additional vnode and bucketlock pair to lock. If the + * entry is negative, ncelock is locked instead of the vnode. + * + * That is, in the worst case we have to lock 3 vnodes and 2 bucketlocks, while + * preserving the locking order (smaller address first). + */ +static void +cache_enter_lock(struct celockstate *cel, struct vnode *dvp, struct vnode *vp, + uint32_t hash) +{ + struct namecache *ncp; + struct rwlock *blps[2]; + + blps[0] = HASH2BUCKETLOCK(hash); + for (;;) { + blps[1] = NULL; + cache_lock_vnodes_cel(cel, dvp, vp); + if (vp == NULL || vp->v_type != VDIR) + break; + ncp = vp->v_cache_dd; + if (ncp == NULL) + break; + if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) + break; + if (ncp->nc_dvp != vp && ncp->nc_vp != vp) + cache_dump_ncp(dvp, vp, ncp, __LINE__); + blps[1] = NCP2BUCKETLOCK(ncp); + if (ncp->nc_vp != NULL) { + if (cache_lock_vnodes_cel_3(cel, ncp->nc_vp) == 0) + break; + } else { + if (cache_trylock_ncp(ncp)) { + cel->ncp = ncp; + break; + } + } + cache_unlock_vnodes_cel(cel); + cel->vlp[0] = NULL; + cel->vlp[1] = NULL; + printf("%s: restarting for dvp %p vp %p ncp %p\n", __func__, dvp, vp, ncp); + } + cache_lock_buckets_cel(cel, blps[0], blps[1]); +} + +static void +cache_enter_lock_dd(struct celockstate *cel, struct vnode *dvp, struct vnode *vp, + uint32_t hash) +{ + struct namecache *ncp; + struct rwlock *blps[2]; + + blps[0] = HASH2BUCKETLOCK(hash); + for (;;) { + blps[1] = NULL; + cache_lock_vnodes_cel(cel, dvp, vp); + ncp = dvp->v_cache_dd; + if (ncp == NULL) + break; + if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) + break; + if (ncp->nc_dvp != dvp && ncp->nc_vp != dvp) + cache_dump_ncp(dvp, vp, ncp, __LINE__); + blps[1] = NCP2BUCKETLOCK(ncp); + if (ncp->nc_vp != NULL) { + if (cache_lock_vnodes_cel_3(cel, ncp->nc_vp) == 0) + break; + } else { + if (cache_trylock_ncp(ncp)) { + cel->ncp = ncp; + break; + } + } + cache_unlock_vnodes_cel(cel); + cel->vlp[0] = NULL; + cel->vlp[1] = NULL; + printf("%s: restarting for dvp %p vp %p ncp %p\n", __func__, dvp, vp, ncp); + } + cache_lock_buckets_cel(cel, blps[0], blps[1]); +} + +static void +cache_enter_unlock(struct celockstate *cel) +{ + + cache_unlock_buckets_cel(cel); + cache_unlock_vnodes_cel(cel); + if (cel->ncp != NULL) + cache_unlock_ncp(cel->ncp); +} + +/* * Add an entry to the cache. */ void @@ -883,8 +1385,8 @@ void cache_enter_time(struct vnode *dvp, struct vnode *vp, struct componentname *cnp, struct timespec *tsp, struct timespec *dtsp) { - struct rwlock *bucketlock; - struct namecache *ncp, *n2, *ndd, *nneg; + struct celockstate cel; + struct namecache *ncp, *n2, *ndd; struct namecache_ts *n3; struct nchashhead *ncpp; uint32_t hash; @@ -906,13 +1408,16 @@ cache_enter_time(struct vnode *dvp, struct vnode * if (numcache >= desiredvnodes * ncsizefactor) return; - ndd = nneg = NULL; + cache_celockstate_init(&cel); + ndd = NULL; flag = 0; if (cnp->cn_nameptr[0] == '.') { if (cnp->cn_namelen == 1) return; if (cnp->cn_namelen == 2 && cnp->cn_nameptr[1] == '.') { - CACHE_WLOCK(); + len = cnp->cn_namelen; + hash = cache_get_hash(cnp->cn_nameptr, len, dvp); + cache_enter_lock_dd(&cel, dvp, vp, hash); /* * If dotdot entry already exists, just retarget it * to new parent vnode, otherwise continue with new @@ -935,12 +1440,13 @@ cache_enter_time(struct vnode *dvp, struct vnode * cache_negative_insert(ncp); } ncp->nc_vp = vp; - CACHE_WUNLOCK(); + cache_enter_unlock(&cel); return; } dvp->v_cache_dd = NULL; + cache_enter_unlock(&cel); + cache_celockstate_init(&cel); SDT_PROBE3(vfs, namecache, enter, done, dvp, "..", vp); - CACHE_WUNLOCK(); flag = NCF_ISDOTDOT; } } @@ -966,7 +1472,7 @@ cache_enter_time(struct vnode *dvp, struct vnode * len = ncp->nc_nlen = cnp->cn_namelen; hash = cache_get_hash(cnp->cn_nameptr, len, dvp); strlcpy(nc_get_name(ncp), cnp->cn_nameptr, len + 1); - CACHE_WLOCK(); + cache_enter_lock(&cel, dvp, vp, hash); /* * See if this vnode or negative entry is already in the cache @@ -993,9 +1499,7 @@ cache_enter_time(struct vnode *dvp, struct vnode * n3->nc_flag |= NCF_DTS; } } - CACHE_WUNLOCK(); - cache_free(ncp); - return; + goto out_unlock_free; } } @@ -1004,17 +1508,14 @@ cache_enter_time(struct vnode *dvp, struct vnode * * See if we are trying to add .. entry, but some other lookup * has populated v_cache_dd pointer already. */ - if (dvp->v_cache_dd != NULL) { - CACHE_WUNLOCK(); - cache_free(ncp); - return; - } + if (dvp->v_cache_dd != NULL) + goto out_unlock_free; KASSERT(vp == NULL || vp->v_type == VDIR, ("wrong vnode type %p", vp)); dvp->v_cache_dd = ncp; } - numcache++; + atomic_add_rel_long(&numcache, 1); if (vp != NULL) { if (vp->v_type == VDIR) { if (flag != NCF_ISDOTDOT) { @@ -1024,9 +1525,9 @@ cache_enter_time(struct vnode *dvp, struct vnode * * directory's parent. */ if ((ndd = vp->v_cache_dd) != NULL) { - if ((ndd->nc_flag & NCF_ISDOTDOT) != 0) - cache_zap(ndd); - else + if ((ndd->nc_flag & NCF_ISDOTDOT) != 0) { + cache_zap_locked_all(ndd); + } else ndd = NULL; } vp->v_cache_dd = ncp; @@ -1039,14 +1540,11 @@ cache_enter_time(struct vnode *dvp, struct vnode * if (flag != NCF_ISDOTDOT) { if (LIST_EMPTY(&dvp->v_cache_src)) { vhold(dvp); - numcachehv++; + atomic_add_rel_long(&numcachehv, 1); } LIST_INSERT_HEAD(&dvp->v_cache_src, ncp, nc_src); } - bucketlock = HASH2BUCKETLOCK(hash); - rw_wlock(bucketlock); - /* * Insert the new namecache entry into the appropriate chain * within the cache entries table. @@ -1069,12 +1567,15 @@ cache_enter_time(struct vnode *dvp, struct vnode * SDT_PROBE2(vfs, namecache, enter_negative, done, dvp, nc_get_name(ncp)); } - rw_wunlock(bucketlock); + cache_enter_unlock(&cel); if (numneg * ncnegfactor > numcache) - nneg = cache_negative_zap_one(); - CACHE_WUNLOCK(); + cache_negative_zap_one(); cache_free(ndd); - cache_free(nneg); + return; +out_unlock_free: + cache_enter_unlock(&cel); + cache_free(ncp); + return; } static u_int @@ -1112,13 +1613,21 @@ nchinit(void *dummy __unused) NULL, NULL, NULL, NULL, UMA_ALIGN_PTR, UMA_ZONE_ZINIT); nchashtbl = hashinit(desiredvnodes * 2, M_VFSCACHE, &nchash); - numbucketlocks = cache_roundup_2(mp_ncpus * 16); - if (numbucketlocks > nchash) - numbucketlocks = nchash; + numbucketlocks = cache_roundup_2(mp_ncpus * 64); bucketlocks = malloc(sizeof(*bucketlocks) * numbucketlocks, M_VFSCACHE, M_WAITOK | M_ZERO); for (i = 0; i < numbucketlocks; i++) - rw_init_flags(&bucketlocks[i], "ncbuc", RW_DUPOK); + rw_init_flags(&bucketlocks[i], "ncbuc", RW_DUPOK | RW_RECURSE); + numvnodelocks = cache_roundup_2(mp_ncpus * 64); + vnodelocks = malloc(sizeof(*vnodelocks) * numvnodelocks, M_VFSCACHE, + M_WAITOK | M_ZERO); + for (i = 0; i < numvnodelocks; i++) + mtx_init(&vnodelocks[i], "ncvn", NULL, MTX_DUPOK | MTX_RECURSE); + numncelocks = cache_roundup_2(mp_ncpus * 64); + ncelocks = malloc(sizeof(*ncelocks) * numncelocks, M_VFSCACHE, + M_WAITOK | M_ZERO); + for (i = 0; i < numncelocks; i++) + mtx_init(&ncelocks[i], "ncen", NULL, MTX_DEF); numcalls = counter_u64_alloc(M_WAITOK); dothits = counter_u64_alloc(M_WAITOK); @@ -1158,7 +1667,7 @@ cache_changesize(int newmaxvnodes) * None of the namecache entries in the table can be removed * because to do so, they have to be removed from the hash table. */ - CACHE_WLOCK(); + cache_lock_all_vnodes(); cache_lock_all_buckets(); old_nchashtbl = nchashtbl; old_nchash = nchash; @@ -1173,7 +1682,7 @@ cache_changesize(int newmaxvnodes) } } cache_unlock_all_buckets(); - CACHE_WUNLOCK(); + cache_unlock_all_vnodes(); free(old_nchashtbl, M_VFSCACHE); } @@ -1185,30 +1694,40 @@ cache_purge(struct vnode *vp) { TAILQ_HEAD(, namecache) ncps; struct namecache *ncp, *nnp; + struct mtx *vlp; CTR1(KTR_VFS, "cache_purge(%p)", vp); SDT_PROBE1(vfs, namecache, purge, done, vp); TAILQ_INIT(&ncps); - CACHE_WLOCK(); + if (LIST_EMPTY(&vp->v_cache_src) && TAILQ_EMPTY(&vp->v_cache_dst) && + vp->v_cache_dd == NULL) + return; + vlp = VP2VNODELOCK(vp); +retry: + mtx_lock(vlp); while (!LIST_EMPTY(&vp->v_cache_src)) { ncp = LIST_FIRST(&vp->v_cache_src); - cache_zap(ncp); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); } while (!TAILQ_EMPTY(&vp->v_cache_dst)) { ncp = TAILQ_FIRST(&vp->v_cache_dst); - cache_zap(ncp); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); } - if (vp->v_cache_dd != NULL) { - ncp = vp->v_cache_dd; - KASSERT(ncp->nc_flag & NCF_ISDOTDOT, - ("lost dotdot link")); - cache_zap(ncp); - TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); - } + ncp = vp->v_cache_dd; + if (ncp == NULL) + goto out; + KASSERT(ncp->nc_flag & NCF_ISDOTDOT, + ("lost dotdot link")); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; + TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); +out: KASSERT(vp->v_cache_dd == NULL, ("incomplete purge")); - CACHE_WUNLOCK(); + mtx_unlock(vlp); TAILQ_FOREACH_SAFE(ncp, &ncps, nc_dst, nnp) { cache_free(ncp); } @@ -1222,18 +1741,22 @@ cache_purge_negative(struct vnode *vp) { TAILQ_HEAD(, namecache) ncps; struct namecache *ncp, *nnp; + struct mtx *vlp; CTR1(KTR_VFS, "cache_purge_negative(%p)", vp); SDT_PROBE1(vfs, namecache, purge_negative, done, vp); TAILQ_INIT(&ncps); - CACHE_WLOCK(); + vlp = VP2VNODELOCK(vp); +retry: + mtx_lock(vlp); LIST_FOREACH_SAFE(ncp, &vp->v_cache_src, nc_src, nnp) { if (ncp->nc_vp != NULL) continue; - cache_zap(ncp); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); } - CACHE_WUNLOCK(); + mtx_unlock(vlp); TAILQ_FOREACH_SAFE(ncp, &ncps, nc_dst, nnp) { cache_free(ncp); } @@ -1245,33 +1768,41 @@ cache_purge_negative(struct vnode *vp) void cache_purgevfs(struct mount *mp) { + /* + * XXXMJG implement batching of free vnode list insertions + */ TAILQ_HEAD(, namecache) ncps; - struct rwlock *bucketlock; + struct rwlock *blp; struct nchashhead *bucket; struct namecache *ncp, *nnp; u_long i, j, n_nchash; + int error; /* Scan hash tables for applicable entries */ SDT_PROBE1(vfs, namecache, purgevfs, done, mp); TAILQ_INIT(&ncps); - CACHE_WLOCK(); n_nchash = nchash + 1; for (i = 0; i < numbucketlocks; i++) { - bucketlock = (struct rwlock *)&bucketlocks[i]; - rw_wlock(bucketlock); + blp = (struct rwlock *)&bucketlocks[i]; + rw_wlock(blp); for (j = i; j < n_nchash; j += numbucketlocks) { +retry: bucket = &nchashtbl[j]; LIST_FOREACH_SAFE(ncp, bucket, nc_hash, nnp) { cache_assert_bucket_locked(ncp, RA_WLOCKED); if (ncp->nc_dvp->v_mount != mp) continue; - cache_zap_locked(ncp); + error = cache_zap_wlocked_bucket_kl(ncp, blp); + if (error != 0) { + printf("%s: error on ncp %p\n", __func__, ncp); + rw_wlock(blp); + goto retry; + } TAILQ_INSERT_HEAD(&ncps, ncp, nc_dst); } } - rw_wunlock(bucketlock); + rw_wunlock(blp); } - CACHE_WUNLOCK(); TAILQ_FOREACH_SAFE(ncp, &ncps, nc_dst, nnp) { cache_free(ncp); } @@ -1443,23 +1974,13 @@ vn_fullpath_global(struct thread *td, struct vnode int vn_vptocnp(struct vnode **vp, struct ucred *cred, char *buf, u_int *buflen) { - int error; - - CACHE_RLOCK(); - error = vn_vptocnp_locked(vp, cred, buf, buflen); - if (error == 0) - CACHE_RUNLOCK(); - return (error); -} - -static int -vn_vptocnp_locked(struct vnode **vp, struct ucred *cred, char *buf, - u_int *buflen) -{ struct vnode *dvp; struct namecache *ncp; + struct mtx *vlp; int error; + vlp = VP2VNODELOCK(*vp); + mtx_lock(vlp); TAILQ_FOREACH(ncp, &((*vp)->v_cache_dst), nc_dst) { if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) break; @@ -1466,7 +1987,7 @@ vn_vptocnp(struct vnode **vp, struct ucred *cred, } if (ncp != NULL) { if (*buflen < ncp->nc_nlen) { - CACHE_RUNLOCK(); + mtx_unlock(vlp); vrele(*vp); counter_u64_add(numfullpathfail4, 1); error = ENOMEM; @@ -1481,14 +2002,13 @@ vn_vptocnp(struct vnode **vp, struct ucred *cred, dvp = *vp; *vp = ncp->nc_dvp; vref(*vp); - CACHE_RUNLOCK(); + mtx_unlock(vlp); vrele(dvp); - CACHE_RLOCK(); return (0); } SDT_PROBE1(vfs, namecache, fullpath, miss, vp); - CACHE_RUNLOCK(); + mtx_unlock(vlp); vn_lock(*vp, LK_SHARED | LK_RETRY); error = VOP_VPTOCNP(*vp, &dvp, cred, buf, buflen); vput(*vp); @@ -1499,10 +2019,8 @@ vn_vptocnp(struct vnode **vp, struct ucred *cred, } *vp = dvp; - CACHE_RLOCK(); if (dvp->v_iflag & VI_DOOMED) { /* forced unmount */ - CACHE_RUNLOCK(); vrele(dvp); error = ENOENT; SDT_PROBE3(vfs, namecache, fullpath, return, error, vp, NULL); @@ -1536,13 +2054,11 @@ vn_fullpath1(struct thread *td, struct vnode *vp, SDT_PROBE1(vfs, namecache, fullpath, entry, vp); counter_u64_add(numfullpathcalls, 1); vref(vp); - CACHE_RLOCK(); if (vp->v_type != VDIR) { - error = vn_vptocnp_locked(&vp, td->td_ucred, buf, &buflen); + error = vn_vptocnp(&vp, td->td_ucred, buf, &buflen); if (error) return (error); if (buflen == 0) { - CACHE_RUNLOCK(); vrele(vp); return (ENOMEM); } @@ -1552,7 +2068,6 @@ vn_fullpath1(struct thread *td, struct vnode *vp, while (vp != rdir && vp != rootvnode) { if (vp->v_vflag & VV_ROOT) { if (vp->v_iflag & VI_DOOMED) { /* forced unmount */ - CACHE_RUNLOCK(); vrele(vp); error = ENOENT; SDT_PROBE3(vfs, namecache, fullpath, return, @@ -1561,14 +2076,11 @@ vn_fullpath1(struct thread *td, struct vnode *vp, } vp1 = vp->v_mount->mnt_vnodecovered; vref(vp1); - CACHE_RUNLOCK(); vrele(vp); vp = vp1; - CACHE_RLOCK(); continue; } if (vp->v_type != VDIR) { - CACHE_RUNLOCK(); vrele(vp); counter_u64_add(numfullpathfail1, 1); error = ENOTDIR; @@ -1576,11 +2088,10 @@ vn_fullpath1(struct thread *td, struct vnode *vp, error, vp, NULL); break; } - error = vn_vptocnp_locked(&vp, td->td_ucred, buf, &buflen); + error = vn_vptocnp(&vp, td->td_ucred, buf, &buflen); if (error) break; if (buflen == 0) { - CACHE_RUNLOCK(); vrele(vp); error = ENOMEM; SDT_PROBE3(vfs, namecache, fullpath, return, error, @@ -1594,7 +2105,6 @@ vn_fullpath1(struct thread *td, struct vnode *vp, return (error); if (!slash_prefixed) { if (buflen == 0) { - CACHE_RUNLOCK(); vrele(vp); counter_u64_add(numfullpathfail4, 1); SDT_PROBE3(vfs, namecache, fullpath, return, ENOMEM, @@ -1604,7 +2114,6 @@ vn_fullpath1(struct thread *td, struct vnode *vp, buf[--buflen] = '/'; } counter_u64_add(numfullpathfound, 1); - CACHE_RUNLOCK(); vrele(vp); SDT_PROBE3(vfs, namecache, fullpath, return, 0, startvp, buf + buflen); @@ -1617,20 +2126,22 @@ vn_dir_dd_ino(struct vnode *vp) { struct namecache *ncp; struct vnode *ddvp; + struct mtx *vlp; ASSERT_VOP_LOCKED(vp, "vn_dir_dd_ino"); - CACHE_RLOCK(); + vlp = VP2VNODELOCK(vp); + mtx_lock(vlp); TAILQ_FOREACH(ncp, &(vp->v_cache_dst), nc_dst) { if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) continue; ddvp = ncp->nc_dvp; vhold(ddvp); - CACHE_RUNLOCK(); + mtx_unlock(vlp); if (vget(ddvp, LK_SHARED | LK_NOWAIT | LK_VNHELD, curthread)) return (NULL); return (ddvp); } - CACHE_RUNLOCK(); + mtx_unlock(vlp); return (NULL); } @@ -1638,19 +2149,21 @@ int vn_commname(struct vnode *vp, char *buf, u_int buflen) { struct namecache *ncp; + struct mtx *vlp; int l; - CACHE_RLOCK(); + vlp = VP2VNODELOCK(vp); + mtx_lock(vlp); TAILQ_FOREACH(ncp, &vp->v_cache_dst, nc_dst) if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) break; if (ncp == NULL) { - CACHE_RUNLOCK(); + mtx_unlock(vlp); return (ENOENT); } l = min(ncp->nc_nlen, buflen - 1); memcpy(buf, nc_get_name(ncp), l); - CACHE_RUNLOCK(); + mtx_unlock(vlp); buf[l] = '\0'; return (0); } -- Test scenario: misc/nfs9.sh