GENERIC HEAD from 2013-04-27 12:46:04 UTC, r249985M, vmcore.611 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r249985M: Sat Apr 27 16:57:29 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (trunk 178860) 20130405 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3498315776 (3336 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 595273 free (1185 frags, 74261 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 184784 free (4352 frags, 22554 blocks, 0.4% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 49672594 free (1578 frags, 6208877 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3651349 free (255325 frags, 424503 blocks, 2.5% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 9291369 free (160473 frags, 1141362 blocks, 0.6% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Apr 28 09:22:03 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xe3820918 bufwait (bufwait) @ kern/vfs_bio.c:3070 2nd 0xc7d96600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c109491c,c1c,c0b0ee90,c80c0c10,...) at db_trace_self_wrapper+0x2d/frame 0xf5cba798 kdb_backtrace(c108e41f,c7d96600,c10c04dd,c7582268,c10c0122,...) at kdb_backtrace+0x30/frame 0xf5cba800 witness_checkorder(c7d96600,9,c10c0119,11c,0,...) at witness_checkorder+0xbaa/frame 0xf5cba850 _sx_xlock(c7d96600,0,c10c0119,11c,c80c3800,...) at _sx_xlock+0x77/frame 0xf5cba880 ufsdirhash_add(c7d4c1d0,f5cba978,3dc8,f5cba900,f5cba904,...) at ufsdirhash_add+0x4a/frame 0xf5cba8b0 ufs_direnter(c80c0b40,c8325b40,f5cba978,f5cbab64,e382456c,...) at ufs_direnter+0x63b/frame 0xf5cba930 ufs_mkdir(f5cbac00,c10e5a63,c10b9de6,c80c0b40,f5cbabfc,...) at ufs_mkdir+0x884/frame 0xf5cbaad0 VOP_MKDIR_APV(c11e446c,f5cbac00,f5cbab64,f5cbab90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xf5cbab00 kern_mkdirat(c7e2a000,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1fc/frame 0xf5cbac24 sys_mkdir(c7e2a000,f5cbacc8,14,c10893dd,7b3,...) at sys_mkdir+0x31/frame 0xf5cbac40 syscall(f5cbad08) at syscall+0x2ed/frame 0xf5cbacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cbacfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28174ea7, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc7d74e44 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc80c0a0c syncer (syncer) @ kern/vfs_subr.c:2278 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c757b318,c757b2b0,c757b318,c757b2b0,...) at db_trace_self_wrapper+0x2d/frame 0xf5c9e8b0 kdb_backtrace(c108e41f,c80c0a0c,c1097ecb,c75822d0,c1097818,...) at kdb_backtrace+0x30/frame 0xf5c9e918 witness_checkorder(c80c0a0c,9,c109780f,8e6,c80c0a78,...) at witness_checkorder+0xbaa/frame 0xf5c9e968 __lockmgr_args(c80c0a0c,80100,c80c0a78,0,0,0,c109780f,8e6) at __lockmgr_args+0x816/frame 0xf5c9ea48 vop_stdlock(f5c9eac0,f5c9ea90,246,c137ddec,c137ddd8,...) at vop_stdlock+0x53/frame 0xf5c9ea78 VOP_LOCK1_APV(c11c478c,f5c9eac0,c0a738ba,c80c0a78,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5c9eaa8 _vn_lock(c80c09d8,80100,c109780f,8e6,c80c0a88,...) at _vn_lock+0xca/frame 0xf5c9eae8 vputx(c80c22ec,0,c1096e1f,50f,c1bae814,...) at vputx+0x330/frame 0xf5c9eb30 dounmount(c80c22ec,8080000,c7e09600,493,c0acfc55,...) at dounmount+0x371/frame 0xf5c9eb90 sys_unmount(c7e09600,f5c9ecc8,c10dec7f,d6,0,...) at sys_unmount+0x3cd/frame 0xf5c9ec40 syscall(f5c9ed08) at syscall+0x2ed/frame 0xf5c9ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9ecfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- lock order reversal: 1st 0xc80c0b74 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xe3820918 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xc832573c ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,f5c9e770,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf5c9e6e0 kdb_backtrace(c108e438,c832573c,c1076516,c7582200,c1097818,...) at kdb_backtrace+0x30/frame 0xf5c9e748 witness_checkorder(c832573c,9,c109780f,877,c83257a8,...) at witness_checkorder+0xbaa/frame 0xf5c9e798 __lockmgr_args(c832573c,80100,c83257a8,0,0,...) at __lockmgr_args+0x816/frame 0xf5c9e878 ffs_lock(f5c9e900,6a4,c757b1e0,c7580798,c757b1e0,...) at ffs_lock+0xad/frame 0xf5c9e8b8 VOP_LOCK1_APV(c11e446c,f5c9e900,0,f5c9e93c,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5c9e8e8 _vn_lock(c8325708,80100,c109780f,877,c1096a85,...) at _vn_lock+0xca/frame 0xf5c9e928 vget(c8325708,80100,c7e09600,57,0,...) at vget+0x77/frame 0xf5c9e960 vfs_hash_get(c80c22ec,12d8400,80000,c7e09600,f5c9ea40,...) at vfs_hash_get+0xff/frame 0xf5c9e98c ffs_vgetf(c80c22ec,12d8400,80000,f5c9ea40,1,...) at ffs_vgetf+0x47/frame 0xf5c9e9e8 softdep_sync_buf(c80c0b40,e38208b8,1,108,0,...) at softdep_sync_buf+0x2ea/frame 0xf5c9ea50 ffs_syncvnode(c80c0b40,1,0,619,0,...) at ffs_syncvnode+0x2a3/frame 0xf5c9eaa8 ffs_sync(c80c22ec,1,f5c9eb68,50f,c1bae814,...) at ffs_sync+0x23e/frame 0xf5c9eb30 dounmount(c80c22ec,8080000,c7e09600,493,c0acfc55,...) at dounmount+0x43c/frame 0xf5c9eb90 sys_unmount(c7e09600,f5c9ecc8,c10dec7f,d6,0,...) at sys_unmount+0x3cd/frame 0xf5c9ec40 syscall(f5c9ed08) at syscall+0x2ed/frame 0xf5c9ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9ecfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- lock order reversal: 1st 0xc7d74e44 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc7deacdc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,0,33,c1076516,67e,...) at db_trace_self_wrapper+0x2d/frame 0xf5c9e830 kdb_backtrace(c108e41f,c7deacdc,c1082235,c7582060,c10bc807,...) at kdb_backtrace+0x30/frame 0xf5c9e898 witness_checkorder(c7deacdc,9,c10bc7fe,74a,c7dead48,...) at witness_checkorder+0xbaa/frame 0xf5c9e8e8 __lockmgr_args(c7deacdc,80400,c7dead48,0,0,0,c10bc7fe,74a) at __lockmgr_args+0x816/frame 0xf5c9e9c8 vop_stdlock(f5c9ea40,632,4,f5c9ea3c,c0a73da7,...) at vop_stdlock+0x53/frame 0xf5c9e9f8 VOP_LOCK1_APV(c11a9d0c,f5c9ea40,4,f5c9ea68,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5c9ea28 _vn_lock(c7deaca8,80400,c10bc7fe,74a,f5c9eaa8,...) at _vn_lock+0xca/frame 0xf5c9ea68 softdep_flushworklist(c80c22ec,f5c9eafc,c7e09600,62d,0,...) at softdep_flushworklist+0x6e/frame 0xf5c9eaa8 ffs_sync(c80c22ec,1,f5c9eb68,50f,c1bae814,...) at ffs_sync+0x2e5/frame 0xf5c9eb30 dounmount(c80c22ec,8080000,c7e09600,493,c0acfc55,...) at dounmount+0x43c/frame 0xf5c9eb90 sys_unmount(c7e09600,f5c9ecc8,c10dec7f,d6,0,...) at sys_unmount+0x3cd/frame 0xf5c9ec40 syscall(f5c9ed08) at syscall+0x2ed/frame 0xf5c9ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9ecfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Apr 28 09:22:34 x4 su: pho to root on /dev/pts/1 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 117490 files, 68641387 used, 49672594 free (1578 frags, 6208877 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 117490 files, 68641387 used, 49672594 free (1578 frags, 6208877 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun Apr 28 09:26:09 CEST 2013 FreeBSD/i386 (x4.osted.lan) (console) login: 20130428 09:26:13 all (1/29): tmpfs4.sh 20130428 09:26:15 all (2/29): nfs12.sh 20130428 09:26:58 all (3/29): pread.sh 20130428 09:27:39 all (4/29): nfs6.sh 20130428 09:29:13 all (5/29): nfs2.sh 20130428 09:39:17 all (6/29): nfs3.sh 20130428 09:40:08 all (7/29): nfs13.sh 20130428 09:40:08 all (8/29): tmpfs5.sh 20130428 09:40:27 all (9/29): nullfs9.sh 20130428 09:40:27 all (10/29): tmpfs2.sh Apr 28 09:40:28 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 28 09:40:29 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument : : Apr 28 09:44:17 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument Apr 28 09:44:17 x4 mountd[578]: can't delete exports for /mnt13: Invalid argument Apr 28 09:44:17 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 28 09:44:17 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument Apr 28 09:44:17 x4 mountd[578]: can't delete exports for /mnt7: Invalid argument Apr 28 09:44:17 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 28 09:44:18 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 28 09:44:18 x4 mountd[578]: can't delete exports for /mnt13: Invalid argument Apr 28 09:44:18 x4 mountd[578]: can't delete exports for /mnt2: Invalid argument Apr 28 09:44:18 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument 20130428 09:44:19 all (11/29): nfs9.sh Apr 28 09:44:18 x4 last message repeated 2 times Expensive timeout(9) function: 0xc091d170(0xc78ddaa0) 0.025852168 s lock order reversal: 1st 0xcb2258ac vm object (vm object) @ vm/vm_pageout.c:967 2nd 0xcc3775d8 struct mount mtx (struct mount mtx) @ kern/vfs_mount.c:433 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,1,7f961966,7d0,6001d80,...) at db_trace_self_wrapper+0x2d/frame 0xe3bf8a90 kdb_backtrace(c108e41f,cc3775d8,c107257e,c757b5f0,c1096e28,...) at kdb_backtrace+0x30/frame 0xe3bf8af4 witness_checkorder(cc3775d8,9,c1096e1f,1b1,0,...) at witness_checkorder+0xbaa/frame 0xe3bf8b44 __mtx_lock_flags(cc3775e8,0,c1096e1f,1b1,e3bf8bf8,...) at __mtx_lock_flags+0x98/frame 0xe3bf8b78 vfs_ref(cc3775d8,c11c3e8c,e3bf8bf8,e3bf8bfc,e3bf8be0,...) at vfs_ref+0x2e/frame 0xe3bf8b98 vop_stdgetwritemount(e3bf8bf8,c10e5ddb,c794d300,c13c1990,c13c1980,...) at vop_stdgetwritemount+0x1e/frame 0xe3bf8bb0 VOP_GETWRITEMOUNT_APV(c11ab130,e3bf8bf8,c1403000,8,c11f9270,...) at VOP_GETWRITEMOUNT_APV+0x118/frame 0xe3bf8be0 vn_start_write(cc49bca8,e3bf8c6c,2,484,7fffff6c,...) at vn_start_write+0x3c/frame 0xe3bf8c18 vm_pageout(0,e3bf8d08,c1080960,3d7,0,...) at vm_pageout+0xba0/frame 0xe3bf8ccc fork_exit(c0d27f70,0,e3bf8d08) at fork_exit+0x7f/frame 0xe3bf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf8cf4 --- trap 0, eip = 0, esp = 0xe3bf8d40, ebp = 0 --- lock order reversal: 1st 0xc8428120 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 2nd 0xe37e99b8 bufwait (bufwait) @ vm/vm_pager.c:312 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,f5d444c8,c0a744ab,12c0,c124fb3c,...) at db_trace_self_wrapper+0x2d/frame 0xf5d44490 kdb_backtrace(c108e41f,e37e99b8,c1094914,c757e440,c10c542c,...) at kdb_backtrace+0x30/frame 0xf5d444f8 witness_checkorder(e37e99b8,9,c10c5423,138,0,...) at witness_checkorder+0xbaa/frame 0xf5d44548 __lockmgr_args(e37e99b8,80000,0,0,0,0,c10c5423,138) at __lockmgr_args+0x816/frame 0xf5d44628 initpbuf(c14034a8,0,c10c5423,163,48a,...) at initpbuf+0xcc/frame 0xf5d44654 getpbuf(c13aeae4,c10c1608,48a,456,9c4,...) at getpbuf+0x159/frame 0xf5d44688 swap_pager_getpages(c99d4378,f5d44754,1,0,f5d4482c,...) at swap_pager_getpages+0x2ae/frame 0xf5d446e8 vm_fault_hold(c90b7e80,28855000,1,0,0,...) at vm_fault_hold+0xa2f/frame 0xf5d44848 vm_fault(c90b7e80,28855000,1,0,c90b7e80,...) at vm_fault+0x82/frame 0xf5d44870 trap_pfault(288550f8,c123f680,0,f5d44928,c0aaf5ab,...) at trap_pfault+0x1ba/frame 0xf5d448e8 trap(f5d44a34) at trap+0x53d/frame 0xf5d44a28 calltrap() at calltrap+0x6/frame 0xf5d44a28 --- trap 0xc, eip = 0xc0ea9b5f, esp = 0xf5d44a74, ebp = 0xf5d44aa8 --- copyin(f5d44c10,0) at copyin+0x33/frame 0xf5d44aa8 uiomove(c81e2e18,8,f5d44c10,1,0,...) at uiomove+0x1f/frame 0xf5d44ab8 m_uiotombuf(f5d44c10,2,bf64,0,0,...) at m_uiotombuf+0xe0/frame 0xf5d44aec sosend_generic(c8428000,0,f5d44c10,0,0,...) at sosend_generic+0x2d9/frame 0xf5d44b5c soo_write(cc77a540,f5d44c10,cb54c280,0,c7e28900,...) at soo_write+0x5d/frame 0xf5d44b8c dofilewrite(cc77a540,f5d44c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf5d44bc4 kern_writev(c7e28900,3,f5d44c10,0,288550f8,...) at kern_writev+0x66/frame 0xf5d44bf0 sys_write(c7e28900,f5d44cc8,ef,1dcab40d,7a4,...) at sys_write+0x5c/frame 0xf5d44c40 syscall(f5d44d08) at syscall+0x2ed/frame 0xf5d44cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d44cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2819afb7, esp = 0xbfbfd644, ebp = 0xbfbfd6a0 --- lock order reversal: 1st 0xc7cb2028 filedesc structure (filedesc structure) @ kern/kern_descrip.c:3328 2nd 0xe37ea390 bufwait (bufwait) @ vm/vm_pager.c:312 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,63736564,2e706972,33333a63,a3832,...) at db_trace_self_wrapper+0x2d/frame 0xf6037290 kdb_backtrace(c108e41f,e37ea390,c1094914,c757e440,c10c542c,...) at kdb_backtrace+0x30/frame 0xf60372f8 witness_checkorder(e37ea390,9,c10c5423,138,0,...) at witness_checkorder+0xbaa/frame 0xf6037348 __lockmgr_args(e37ea390,80000,0,0,0,0,c10c5423,138) at __lockmgr_args+0x816/frame 0xf6037428 initpbuf(c14034a8,0,c10c5423,163,48a,...) at initpbuf+0xcc/frame 0xf6037454 getpbuf(c13aeae4,c10c1608,48a,c0d23070,cb18b030,...) at getpbuf+0x159/frame 0xf6037488 swap_pager_getpages(cb18b000,f6037554,8,0,f603762c,...) at swap_pager_getpages+0x2ae/frame 0xf60374e8 vm_fault_hold(c76d3d98,28c00000,2,0,0,...) at vm_fault_hold+0xa2f/frame 0xf6037648 vm_fault(c76d3d98,28c00000,2,0,c76d3d98,...) at vm_fault+0x82/frame 0xf6037670 trap_pfault(28c00000,1,c10968bb,20b,0,...) at trap_pfault+0x1ba/frame 0xf60376e8 trap(f6037830) at trap+0x53d/frame 0xf6037824 calltrap() at calltrap+0x6/frame 0xf6037824 --- trap 0xc, eip = 0xc0ea9af3, esp = 0xf6037870, ebp = 0xf6037898 --- copyout(f6037b58,c8453000,1b2f,f6037ac8,c7e3208f,...) at copyout+0x37/frame 0xf6037898 sbuf_sysctl_drain(f6037b58,c8453000,1b2f,f6037ac8,c7e3208f,...) at sbuf_sysctl_drain+0x1f/frame 0xf60378b4 sbuf_drain(0,c0b2c52e,c7d4d708,0,c757a1a0,...) at sbuf_drain+0x30/frame 0xf60378d0 sbuf_put_byte(c0ad6170,1,c108ec9e,f6037944,cc3ed900,...) at sbuf_put_byte+0x56/frame 0xf60378f8 sbuf_bcat(f6037ac8,c7e32000,178,1,c11b9ca4,...) at sbuf_bcat+0x50/frame 0xf6037920 export_fd_to_sb(5db9,3,1,0,0,...) at export_fd_to_sb+0x54e/frame 0xf6037a40 kern_proc_filedesc_out(c8e108b8,f6037ac8,2630235,f6037b58,c1087c8e,...) at kern_proc_filedesc_out+0x5b1/frame 0xf6037aa8 sysctl_kern_proc_filedesc(c11b5a90,f6037be0,1,f6037b58,f6037b58,...) at sysctl_kern_proc_filedesc+0x7c/frame 0xf6037afc sysctl_root(f6037b58,0,c1087c8e,642,cc42dc44,...) at sysctl_root+0x200/frame 0xf6037b38 userland_sysctl(cc3ed900,f6037bd4,4,28c00000,bfbfbdf0,...) at userland_sysctl+0x1ad/frame 0xf6037b9c sys___sysctl(cc3ed900,f6037cc8,14,c10893dd,7b3,...) at sys___sysctl+0x95/frame 0xf6037c40 syscall(f6037d08) at syscall+0x2ed/frame 0xf6037cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6037cfc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281ad5c7, esp = 0xbfbfbd94, ebp = 0xbfbfbdbc --- lock order reversal: 1st 0xc7921028 filedesc structure (filedesc structure) @ kern/kern_descrip.c:796 2nd 0xc811246c ufs (ufs) @ kern/vfs_subr.c:4392 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,63736564,2e706972,39373a63,c0000a36,...) at db_trace_self_wrapper+0x2d/frame 0xf5cb68d0 kdb_backtrace(c108e41f,c811246c,c1076516,c7582200,c1097818,...) at kdb_backtrace+0x30/frame 0xf5cb6938 witness_checkorder(c811246c,9,c109780f,1128,c81124d8,...) at witness_checkorder+0xbaa/frame 0xf5cb6988 __lockmgr_args(c811246c,80400,c81124d8,0,0,...) at __lockmgr_args+0x816/frame 0xf5cb6a68 ffs_lock(f5cb6af0,f5cb6ac0,c0b1b138,c811246c,f5cb6af0,...) at ffs_lock+0xad/frame 0xf5cb6aa8 VOP_LOCK1_APV(c11e446c,f5cb6af0,c8e1b01c,0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5cb6ad8 _vn_lock(c8112438,80400,c109780f,1128) at _vn_lock+0xca/frame 0xf5cb6b14 vfs_knllock(c8112438,0,c108026e,71d,c84a8dc8,...) at vfs_knllock+0x29/frame 0xf5cb6b2c knlist_remove_kq(0,0) at knlist_remove_kq+0x87/frame 0xf5cb6b50 knlist_remove(c8e1b01c,c84a8dc8,0) at knlist_remove+0x1f/frame 0xf5cb6b60 filt_vfsdetach(c84a8dc8,0,c108026e,827,c757e780,...) at filt_vfsdetach+0x2f/frame 0xf5cb6b7c knote_fdclose(c7e2a300,3,c107f9d1,454,0,...) at knote_fdclose+0xde/frame 0xf5cb6bb8 closefp(c89fe1c0,c7e2a300,1,b4,cd1c2188,...) at closefp+0x6b/frame 0xf5cb6be4 do_dup(c7e2a300,1,5,3,c7e2a558) at do_dup+0x34e/frame 0xf5cb6c20 sys_dup2(c7e2a300,f5cb6cc8,14,c10893dd,7b3,...) at sys_dup2+0x34/frame 0xf5cb6c40 syscall(f5cb6d08) at syscall+0x2ed/frame 0xf5cb6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb6cfc --- syscall (90, FreeBSD ELF32, sys_dup2), eip = 0x2810c0d3, esp = 0xbfbfdb60, ebp = 0xbfbfdb98 --- 20130428 10:07:14 all (12/29): tmpfs7.sh 20130428 10:07:20 all (13/29): nfs8.sh 20130428 10:07:22 all (14/29): mountu.sh 20130428 10:07:38 all (15/29): tmpfs3.sh 20130428 10:19:14 all (16/29): nfsrename.sh 20130428 10:22:20 all (17/29): nfs11.sh Apr 28 10:25:35 x4 su: pho to root on /dev/pts/2 20130428 10:25:50 all (18/29): nfs4.sh lock order reversal: 1st 0xca22d19c null (null) @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:737 2nd 0xe388b9e8 bufwait (bufwait) @ kern/vfs_bio.c:3070 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,666c6c75,756e2f73,765f6c6c,73706f6e,...) at db_trace_self_wrapper+0x2d/frame 0xf62635f8 kdb_backtrace(c108e41f,e388b9e8,c1094914,c757e440,c1094925,...) at kdb_backtrace+0x30/frame 0xf6263660 witness_checkorder(e388b9e8,9,c109491c,bfe,ca463ed0,...) at witness_checkorder+0xbaa/frame 0xf62636b0 __lockmgr_args(e388b9e8,81900,ca463ed0,c107e5b3,60,...) at __lockmgr_args+0x816/frame 0xf6263790 getblk(ca463e10,100140,0,8000,0,...) at getblk+0x1e8/frame 0xf6263800 breadn_flags(ca463e10,100140,0,8000,0,...) at breadn_flags+0x40/frame 0xf6263830 ffs_update(c9b5cca8,0,1,ca49e9b4,c11f6178,...) at ffs_update+0x191/frame 0xf62638a8 ufs_inactive(f6263930,c10e5bff,c109780f,9c7,c11f6178,...) at ufs_inactive+0x352/frame 0xf62638d8 VOP_INACTIVE_APV(c11e446c,f6263930,c109780f,9c7,f6263950,...) at VOP_INACTIVE_APV+0x124/frame 0xf6263908 vinactive(c9b5cca8,ca49e900,c109780f,8c5,c9b5cd58,...) at vinactive+0x181/frame 0xf6263950 vputx(c9b5cca8,0,cc0adc59,2e6,0,...) at vputx+0x38a/frame 0xf6263998 null_reclaim(f6263a60,c10e5c53,1,ca22d238,ca22d254,...) at null_reclaim+0x136/frame 0xf62639f0 VOP_RECLAIM_APV(cc0ae1fc,f6263a60,0,0,0,...) at VOP_RECLAIM_APV+0x124/frame 0xf6263a20 vgonel(ca22d218,0,c109780f,a78,cc0ae1fc,...) at vgonel+0x50c/frame 0xf6263a84 vrecycle(ca22d168,f6263ae0,c0ed25d4,f6263b08,c10e5bff,...) at vrecycle+0x55/frame 0xf6263aa4 null_inactive(f6263b08,c10e5bff,c109780f,9c7,c11f6178,...) at null_inactive+0x2b/frame 0xf6263ab0 VOP_INACTIVE_APV(cc0ae1fc,f6263b08,c109780f,9c7,c0a738ba,...) at VOP_INACTIVE_APV+0x124/frame 0xf6263ae0 vinactive(ca22d168,ca49e900,c109780f,8e7,ca22d218,...) at vinactive+0x181/frame 0xf6263b28 vputx(ca22d168,c1098f28,32c,329,0,...) at vputx+0x38a/frame 0xf6263b70 kern_chdir(ca49e900,bfbfd7f4,0) at kern_chdir+0x1d5/frame 0xf6263c2c sys_chdir(ca49e900,f6263cc8,c10dec7f,d6,0,...) at sys_chdir+0x22/frame 0xf6263c40 syscall(f6263d08) at syscall+0x2ed/frame 0xf6263cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6263cfc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280c09cb, esp = 0xbfbfd1fc, ebp = 0xbfbfd6f0 --- 20130428 11:09:58 all (1/29): nfs6.sh Expensive timeout(9) function: 0xc091d170(0xc78f3aa0) 0.057257905 s 20130428 11:11:36 all (2/29): tmpfs5.sh 20130428 11:11:55 all (3/29): nfs11.sh 20130428 11:24:52 all (4/29): nfs9.sh Apr 28 11:28:25 x4 kernel: Failed to write core file for process thr2 (error 70) Apr 28 11:34:31 x4 kernel: Failed to write core file for process thr1 (error 70) Apr 28 11:34:31 x4 last message repeated 5 times witness_lock_list_get: witness exhausted 20130428 11:47:50 all (5/29): nfs4.sh 20130428 11:50:04 all (6/29): mountu.sh 20130428 11:50:23 all (7/29): nfs13.sh 20130428 11:50:24 all (8/29): nfs7.sh Apr 28 11:57:58 x4 kernel: pid 13206 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 11:58:18 x4 kernel: pid 13208 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 11:58:34 x4 kernel: pid 13230 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 11:58:34 x4 kernel: pid 13232 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 12:00:10 x4 kernel: pid 13229 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 12:00:11 x4 kernel: pid 13211 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 12:00:12 x4 kernel: pid 13231 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 12:00:25 x4 kernel: pid 13209 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 12:07:22 x4 kernel: pid 32215 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 12:07:23 x4 kernel: pid 32216 (lockf), uid 1004, was killed: exceeded maximum CPU limit 20130428 12:07:25 all (9/29): nfs13.sh 20130428 12:07:26 all (10/29): nfs.sh 20130428 12:19:08 all (11/29): lockf.sh 20130428 12:19:26 all (12/29): tmpfs2.sh Apr 28 12:19:28 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 28 12:19:28 x4 mountd[578]: can't delete exports for /mnt9: Invalid argument Apr 28 12:19:28 x4 mountd[578]: can't delete exports for /mnt6: Invalid argument Apr 28 12:19:28 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument : : Apr 28 12:22:40 x4 mountd[578]: can't delete exports for /mnt6: Invalid argument Apr 28 12:22:40 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument Apr 28 12:22:40 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 28 12:22:40 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument 20130428 12:22:42 all (13/29): nfs12.sh 20130428 12:23:25 all (14/29): sendfile5.sh 20130428 12:24:29 all (15/29): tmpfs9.sh 20130428 12:27:32 all (16/29): nullfs9.sh 20130428 12:27:33 all (17/29): tmpfs7.sh 20130428 12:27:36 all (18/29): nullfs8.sh 20130428 12:31:12 all (19/29): tmpfs3.sh 20130428 12:41:41 all (20/29): nfs3.sh 20130428 12:42:39 all (21/29): pread.sh 20130428 13:06:20 all (22/29): nfsrename.sh 20130428 13:09:16 all (23/29): tmpfs8.sh 20130428 13:09:51 all (24/29): tmpfs4.sh 20130428 13:09:52 all (25/29): tmpfs.sh 20130428 13:21:17 all (26/29): nfs5.sh 20130428 13:22:32 all (27/29): crossmp2.sh 20130428 13:24:29 all (28/29): nfs8.sh 20130428 13:24:30 all (29/29): nfs2.sh 20130428 13:34:35 all (1/29): tmpfs4.sh 20130428 13:34:36 all (2/29): pread.sh 20130428 13:34:49 all (3/29): nfs12.sh 20130428 13:35:31 all (4/29): nfs11.sh 20130428 13:46:14 all (5/29): tmpfs8.sh 20130428 13:46:50 all (6/29): nullfs9.sh 20130428 13:46:50 all (7/29): nfs.sh 20130428 13:58:25 all (8/29): nfs3.sh 20130428 13:59:33 all (9/29): nfs2.sh 20130428 14:10:36 all (10/29): nfs7.sh Apr 28 14:13:36 x4 su: pho to root on /dev/pts/2 20130428 14:13:43 all (11/29): nfs9.sh 20130428 14:21:15 all (1/29): nullfs9.sh 20130428 14:21:16 all (2/29): tmpfs8.sh 20130428 14:21:50 all (3/29): nullfs8.sh 20130428 14:25:32 all (4/29): nfs6.sh 20130428 14:27:04 all (5/29): nfs5.sh Apr 28 14:27:15 x4 kernel: pid 588 (nfsd), uid 0 inumber 4425 on /mnt: filesystem full Apr 28 14:27:15 x4 kernel: pid 588 (nfsd), uid 0 inumber 4622 on /mnt: filesystem full 20130428 14:28:17 all (6/29): nfs12.sh 20130428 14:28:59 all (7/29): nfs13.sh 20130428 14:28:59 all (8/29): lockf.sh 20130428 14:29:10 all (9/29): tmpfs3.sh 20130428 14:40:45 all (10/29): nfs7.sh 20130428 14:52:06 all (11/29): tmpfs4.sh 20130428 14:52:07 all (12/29): nfs9.sh 20130428 15:15:26 all (13/29): tmpfs9.sh 20130428 15:18:20 all (14/29): pread.sh 20130428 15:18:49 all (15/29): crossmp2.sh 20130428 15:21:07 all (16/29): nfs4.sh 20130428 15:24:28 all (17/29): nfs.sh 20130428 15:35:27 all (18/29): nfs11.sh 20130428 15:47:07 all (19/29): tmpfs2.sh Apr 28 15:47:09 x4 mountd[578]: can't delete exports for /mnt5: Invalid argument Apr 28 15:47:09 x4 mountd[578]: can't delete exports for /mnt3: Invalid argument Apr 28 15:47:09 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument : : Apr 28 15:50:20 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 28 15:50:20 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 28 15:50:20 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 28 15:50:20 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument 20130428 15:50:20 all (20/29): nfsrename.sh 20130428 15:53:20 all (21/29): nfs13.sh 20130428 15:53:20 all (22/29): tmpfs5.sh 20130428 15:53:36 all (23/29): nfs2.sh 20130428 16:05:38 all (24/29): nfs3.sh 20130428 16:07:25 all (25/29): tmpfs7.sh 20130428 16:07:29 all (26/29): mountu.sh 20130428 16:07:45 all (27/29): tmpfs.sh 20130428 16:12:42 all (28/29): sendfile5.sh Apr 28 16:14:14 x4 mountd[578]: can't delete exports for /mnt: Invalid argument mount option is unknown 20130428 16:17:53 all (1/29): tmpfs.sh 20130428 16:28:52 all (2/29): nfs2.sh 20130428 16:38:56 all (3/29): nfs6.sh 20130428 16:40:31 all (4/29): nfs13.sh 20130428 16:40:32 all (5/29): nullfs9.sh 20130428 16:40:32 all (6/29): nfsrename.sh 20130428 16:43:33 all (7/29): nfs7.sh 20130428 16:56:34 all (8/29): nfs4.sh 20130428 16:58:58 all (9/29): nfs5.sh Apr 28 16:59:35 x4 kernel: pid 588 (nfsd), uid 0 inumber 12831 on /mnt: filesystem full 20130428 17:00:08 all (10/29): tmpfs5.sh 20130428 17:00:26 all (11/29): tmpfs3.sh 20130428 17:11:34 all (12/29): nfs11.sh 20130428 17:24:17 all (13/29): tmpfs2.sh Apr 28 17:24:18 x4 mountd[578]: can't delete exports for /mnt9: Invalid argument Apr 28 17:24:18 x4 mountd[578]: can't delete exports for /mnt4: Invalid argument Apr 28 17:24:18 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument : : Apr 28 17:27:25 x4 mountd[578]: can't delete exports for /mnt13: Invalid argument Apr 28 17:27:25 x4 mountd[578]: can't delete exports for /mnt10: Invalid argument Apr 28 17:27:26 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 28 17:27:26 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument 20130428 17:27:26 all (14/29): tmpfs9.sh 20130428 17:30:33 all (15/29): nfs12.sh 20130428 17:31:16 all (16/29): nfs3.sh 20130428 17:32:36 all (17/29): nfs.sh 20130428 17:44:43 all (18/29): lockf.sh 20130428 17:44:52 all (19/29): tmpfs4.sh 20130428 17:44:55 all (20/29): nullfs8.sh 20130428 17:48:44 all (21/29): tmpfs7.sh 20130428 17:48:47 all (22/29): nfs13.sh 20130428 17:48:48 all (23/29): pread.sh 20130428 17:49:06 all (24/29): sendfile5.sh 20130428 17:50:09 all (25/29): nfs9.sh 20130428 18:11:44 all (26/29): crossmp2.sh 20130428 18:14:24 all (27/29): nfs8.sh 20130428 18:14:26 all (28/29): mountu.sh 20130428 18:14:43 all (29/29): tmpfs8.sh 20130428 18:15:16 all (1/29): crossmp2.sh 20130428 18:18:09 all (2/29): nullfs8.sh 20130428 18:22:50 all (3/29): nfs13.sh 20130428 18:22:51 all (4/29): nfs11.sh nfsv4 expired locks lost nfscl: never fnd open nfscl: never fnd open nfscl: never fnd open 20130428 18:34:12 all (5/29): tmpfs7.sh 20130428 18:34:29 all (6/29): nfs4.sh 20130428 18:35:45 all (7/29): nfs6.sh 20130428 18:37:19 all (8/29): nfsrename.sh 20130428 18:41:47 all (9/29): tmpfs3.sh 20130428 18:53:20 all (10/29): mountu.sh 20130428 18:53:46 all (11/29): nfs9.sh 20130428 19:13:55 all (12/29): nfs7.sh Apr 28 19:25:48 x4 kernel: pid 32578 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 19:26:26 x4 kernel: pid 32581 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 19:26:30 x4 kernel: pid 32583 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 19:26:32 x4 kernel: pid 32582 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 19:27:54 x4 kernel: pid 32586 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 28 19:27:55 x4 kernel: pid 32576 (lockf), uid 1004, was killed: exceeded maximum CPU limit 20130428 19:28:13 all (13/29): tmpfs9.sh 20130428 19:31:17 all (14/29): nfs5.sh 20130428 19:32:32 all (15/29): tmpfs4.sh 20130428 19:32:33 all (16/29): pread.sh 20130428 20:53:33 all (17/29): tmpfs.sh Apr 28 21:05:43 x4 su: pho to root on /dev/pts/2 20130428 21:07:13 all (1/1): pread.sh 20130428 21:07:29 all (1/1): pread.sh 20130428 21:07:46 all (1/1): pread.sh 20130428 21:08:03 all (1/1): pread.sh 20130428 21:08:20 all (1/1): pread.sh 20130428 21:08:37 all (1/1): pread.sh 20130428 21:09:09 all (1/1): pread.sh 20130428 21:09:26 all (1/1): pread.sh 20130428 21:09:43 all (1/1): pread.sh 20130428 21:10:00 all (1/1): pread.sh 20130428 21:10:17 all (1/1): pread.sh 20130428 21:10:34 all (1/1): pread.sh 20130428 21:10:51 all (1/1): pread.sh 20130428 21:11:08 all (1/1): pread.sh 20130428 21:11:25 all (1/1): pread.sh 20130428 21:11:42 all (1/1): pread.sh 20130428 21:11:59 all (1/1): pread.sh 20130428 21:12:15 all (1/1): pread.sh 20130428 21:12:32 all (1/1): pread.sh 20130428 21:13:09 all (1/219): jail3.sh 20130428 21:13:09 all (2/219): truncate.sh 20130428 21:25:16 all (3/219): suj28.sh 20130428 21:38:45 all (1/209): umountf2.sh 20130428 21:48:26 all (2/209): newfs5.sh 20130428 21:48:38 all (3/209): rename2.sh 20130428 22:09:13 all (1/12): sendfile5.sh 20130428 22:10:17 all (2/12): tmpfs5.sh 20130428 22:10:35 all (3/12): tmpfs9.sh 20130428 22:13:31 all (4/12): nullfs9.sh 20130428 22:13:32 all (5/12): pread.sh 20130428 22:14:00 all (6/12): tmpfs.sh 20130428 22:25:01 all (7/12): tmpfs4.sh 20130428 22:25:02 all (8/12): tmpfs3.sh 20130428 22:36:19 all (9/12): tmpfs2.sh Apr 28 22:36:20 x4 mountd[578]: can't delete exports for /mnt0: Invalid argument Apr 28 22:36:20 x4 mountd[578]: can't delete exports for /mnt13: Invalid argument Apr 28 22:36:20 x4 mountd[578]: can't delete exports for /mnt3: Invalid argument Apr 28 22:36:21 x4 mountd[578]: can't delete exports for /mnt0: Invalid argument : : Apr 28 22:55:39 x4 mountd[578]: can't delete exports for /mnt9: Invalid argument Apr 28 22:55:39 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument 20130428 22:55:40 all (7/12): nfs13.sh 20130428 22:55:40 all (8/12): nullfs9.sh 20130428 22:55:41 all (9/12): tmpfs4.sh 20130428 22:55:42 all (10/12): tmpfs3.sh 20130428 23:07:02 all (11/12): tmpfs9.sh 20130428 23:09:49 all (12/12): pread.sh 20130428 23:10:19 all (1/12): tmpfs9.sh 20130428 23:13:39 all (2/12): tmpfs8.sh 20130428 23:14:14 all (3/12): pread.sh 20130428 23:14:40 all (4/12): sendfile5.sh 20130428 23:15:44 all (5/12): tmpfs5.sh 20130428 23:16:02 all (6/12): tmpfs.sh 20130428 23:27:59 all (7/12): nfs13.sh 20130428 23:28:00 all (8/12): tmpfs2.sh Apr 28 23:28:01 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 28 23:28:01 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 28 23:28:01 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument : : Apr 28 23:31:10 x4 mountd[578]: can't delete exports for /mnt2: Invalid argument Apr 28 23:31:10 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 28 23:31:10 x4 mountd[578]: can't delete exports for /mnt6: Invalid argument Apr 28 23:31:10 x4 mountd[578]: can't delete exports for /mnt4: Invalid argument 20130428 23:31:11 all (9/12): tmpfs4.sh 20130428 23:31:12 all (10/12): tmpfs3.sh Apr 28 23:31:10 x4 mountd[578]: can't delete exports for /mnt4: Invalid argument 20130428 23:42:33 all (11/12): nullfs9.sh Apr 28 23:42:33 x4 mountd[578]: can't delete exports for /mnt: Invalid argument 20130428 23:42:34 all (12/12): tmpfs7.sh 20130428 23:42:36 all (1/12): tmpfs5.sh 20130428 23:42:52 all (2/12): tmpfs8.sh 20130428 23:43:26 all (3/12): nullfs9.sh 20130428 23:43:27 all (4/12): tmpfs3.sh 20130428 23:54:04 all (5/12): tmpfs9.sh 20130428 23:57:24 all (6/12): tmpfs7.sh 20130428 23:57:27 all (7/12): tmpfs.sh 20130429 00:08:18 all (8/12): nfs13.sh 20130429 00:08:18 all (9/12): pread.sh 20130429 00:08:47 all (10/12): tmpfs2.sh Apr 29 00:08:47 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 29 00:08:47 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 29 00:08:48 x4 mountd[578]: can't delete exports for /mnt2: Invalid argument Apr 29 00:08:48 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 29 00:08:48 x4 mountd[578]: can't delete exports for /mnt9: Invalid argument : : Apr 29 03:07:26 x4 mountd[578]: can't delete exports for /mnt7: Invalid argument Apr 29 03:07:26 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 29 03:07:26 x4 mountd[578]: can't delete exports for /mnt6: Invalid argument Apr 29 03:07:26 x4 mountd[578]: can't delete exports for /mnt2: Invalid argument Apr 29 03:07:26 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 29 03:07:26 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt5: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt0: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt3: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt12: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt13: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt1: Invalid argument Apr 29 03:07:27 x4 mountd[578]: can't delete exports for /mnt7: Invalid argument Apr 29 03:07:28 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 29 03:07:28 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 29 03:07:29 x4 mountd[578]: can't delete exports for /mnt5: Invalid argument Apr 29 03:07:29 x4 mountd[578]: can't delete exports for /mnt11: Invalid argument Apr 29 03:07:29 x4 mountd[578]: can't delete exports for /mnt4: Invalid argument Apr 29 03:07:29 x4 mountd[578]: can't delete exports for /mnt13: Invalid argument Apr 29 03:07:29 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument VNASSERT failed 0xcf1e7708: tag tmpfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_DOOMED) v_object 0xcd737afc ref 1 pages 3 lock type tmpfs: EXCL by thread 0xce111c00 (pid 87083, find, tid 101458) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc0b1b333 at vop_stdlock+0x53 #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xca8e6f76 at tmpfs_alloc_vp+0x286 #5 0xca8e246d at tmpfs_lookup+0x5dd #6 0xc0ecf554 at VOP_CACHEDLOOKUP_APV+0x124 #7 0xc0b17d20 at vfs_cache_lookup+0xf0 #8 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #9 0xc0b20b18 at lookup+0x528 #10 0xc0b2020d at namei+0x47d #11 0xc0b38142 at kern_statat_vnhook+0xc2 #12 0xc0b38329 at sys_lstat+0x59 #13 0xc0eac9cd at syscall+0x2ed #14 0xc0e94f41 at Xint0x80_syscall+0x21 panic: vop_reclaim left v_object vp=0xcf1e7708, tag=tmpfs cpuid = 1 KDB: enter: panic [ thread pid 87083 tid 101458 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 87083 tid 101458 td 0xce111c00 kdb_enter(c1086de3,c1086de3,c10988b6,f61d178c,c10988b6,...) at kdb_enter+0x3d/frame 0xf61d1720 vpanic(c12320f2,100,c10988b6,f61d178c,f61d178c,...) at vpanic+0x143/frame 0xf61d175c kassert_panic(c10988b6,cf1e7708,ca8eb410,af7,1,...) at kassert_panic+0xea/frame 0xf61d1780 vgonel(cf1e77b8,0,c109780f,a88,10,...) at vgonel+0x79d/frame 0xf61d17e4 insmntque_stddtr(cf1e7708,0,c109780f,48b,cf1e77b8,...) at insmntque_stddtr+0x46/frame 0xf61d1804 insmntque1(cf1e7708,c80d35d8,c0b29f10,0) at insmntque1+0x233/frame 0xf61d1830 insmntque(cf1e7708,c80d35d8,213,212,0,...) at insmntque+0x28/frame 0xf61d1848 tmpfs_alloc_vp(c80d35d8,cf1c9088,80000,f61d1b50,f61d18ec,...) at tmpfs_alloc_vp+0x3a8/frame 0xf61d18a8 tmpfs_lookup(f61d1950,c10e53fc,c0b1b138,cf23f19c,f61d1948,...) at tmpfs_lookup+0x5dd/frame 0xf61d1900 VOP_CACHEDLOOKUP_APV(ca8ec9a4,f61d1950,f61d1b64,0,0,...) at VOP_CACHEDLOOKUP_APV+0x124/frame 0xf61d1930 vfs_cache_lookup(f61d19e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xf0/frame 0xf61d1978 VOP_LOOKUP_APV(ca8ec9a4,f61d19e8,f61d1b64,205,f61d19f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf61d19a8 lookup(f61d1b18,c1096c53,107,ce,200,...) at lookup+0x528/frame 0xf61d1a10 namei(f61d1b18,ffffffdf,c7d0d480,0,ce111c00,...) at namei+0x47d/frame 0xf61d1a98 kern_statat_vnhook(ce111c00,200,ffffff9c,2888e5d8,0,...) at kern_statat_vnhook+0xc2/frame 0xf61d1ba8 sys_lstat(ce111c00,f61d1cc8,14,c10893dd,7b3,...) at sys_lstat+0x59/frame 0xf61d1c40 syscall(f61d1d08) at syscall+0x2ed/frame 0xf61d1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61d1cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd664, ebp = 0xbfbfd6f0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x626d80 curthread = 0xc8b72000: pid 87155 "sh" curpcb = 0xf66cfd60 fpcurthread = none idlethread = 0xc76cd900: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5ffbd80 curthread = 0xce111c00: pid 87083 "find" curpcb = 0xf61d1d60 fpcurthread = none idlethread = 0xc76cd600: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5ffed80 curthread = 0xc92e5c00: pid 87136 "grep" curpcb = 0xf61b6d60 fpcurthread = none idlethread = 0xc76cd300: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6001d80 curthread = 0xc8e22000: pid 95757 "find" curpcb = 0xf5edfd60 fpcurthread = none idlethread = 0xc76cd000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes 0xc7d4d708: tag ufs, type VDIR usecount 188, writecount 0, refcount 191 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xc7d53818 ref 0 pages 1 lock type ufs: SHARED (count 6) with exclusive waiters pending #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc0cef47d at ffs_lock+0xad #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0a4fdf4 at kern_execve+0x544 #7 0xc0a4f693 at sys_execve+0x53 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 ino 2, on dev ada0s1a 0xcd286e10: tag ufs, type VDIR usecount 1, writecount 0, refcount 7 mountedhere 0xc80d35d8 flags (VI_ACTIVE) v_object 0xcfe50940 ref 0 pages 0 lock type ufs: EXCL by thread 0xc7da2300 (pid 87110, umount, tid 100322) with shared waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc0cef47d at ffs_lock+0xad #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b24629 at dounmount+0x99 #5 0xc0b2454d at sys_unmount+0x3cd #6 0xc0eac9cd at syscall+0x2ed #7 0xc0e94f41 at Xint0x80_syscall+0x21 ino 164869, on dev ada0s1a 0xc8447ca8: tag ufs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb77db90 ref 0 pages 0 lock type ufs: SHARED (count 1) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc0cef47d at ffs_lock+0xad #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b3b0b4 at kern_getdirentries+0x114 #5 0xc0b3af71 at sys_getdirentries+0x41 #6 0xc0eac9cd at syscall+0x2ed #7 0xc0e94f41 at Xint0x80_syscall+0x21 ino 1484525, on dev ada0s1d 0xcf23f168: tag tmpfs, type VDIR usecount 3, writecount 0, refcount 5 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xcf01565c ref 0 pages 0 lock type tmpfs: EXCL by thread 0xce111c00 (pid 87083, find, tid 101458) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc0b1b333 at vop_stdlock+0x53 #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b38142 at kern_statat_vnhook+0xc2 #7 0xc0b38329 at sys_lstat+0x59 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 tag VT_TMPFS, tmpfs_node 0xceffa000, flags 0x0, links 2 mode 0755, owner 0, group 0, size 288, status 0x2 db:0:lockedvnods> show mount 0xc7d2fbb0 /dev/ad4s1a on / (ufs) 0xc7d30000 devfs on /dev (devfs) 0xc80c25d8 /dev/ad4s1f on /home (ufs) 0xc80c2000 /dev/ad4s1d on /usr (ufs) 0xc80d3000 /dev/ad4s1e on /var (ufs) 0xc80d2bb0 procfs on /proc (procfs) 0xc8f1fbb0 /dev/label/tmp on /tmp (ufs) 0xc80d35d8 tmpfs on /mnt0 (tmpfs) 0xce60f8c4 tmpfs on /mnt8 (tmpfs) 0xcb00a2ec tmpfs on /mnt11 (tmpfs) 0xcc3e3bb0 tmpfs on /mnt1 (tmpfs) 0xcc3e35d8 tmpfs on /mnt5 (tmpfs) 0xcc392bb0 tmpfs on /mnt13 (tmpfs) 0xcb00a5d8 tmpfs on /mnt3 (tmpfs) 0xcc3fc000 tmpfs on /mnt6 (tmpfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 87156 40698 49799 0 LL+ *vm objec 0xc98d9b80 sh 87155 40714 49799 0 R+ CPU 0 sh 87154 40714 49799 0 R+ sh 87153 40696 49799 0 RL+ sh 87152 40711 49799 0 R+ sh 87151 40695 49799 0 LL+ *vm page 0xcd151580 cp 87150 40681 49799 0 LVL+ *vm page 0xcd151580 sh 87149 40707 49799 0 LL+ *vm page 0xcd151580 sh 87148 40683 49799 0 LL+ *vm page 0xcd151580 grep 87147 40683 49799 0 L+ *vm page 0xcd151580 sh 87145 40712 49799 0 R+ cp 87144 40705 49799 0 L+ *vm page 0xcd151580 sh 87143 40710 49799 0 LL+ *vm page 0xcd151580 grep 87142 40710 49799 0 R+ mount 87141 40704 49799 0 L+ *vm page 0xcd151580 sh 87140 40704 49799 0 R+ mount 87139 40678 49799 0 LL+ *vm page 0xcd151580 find 87137 40682 49799 0 RL+ find 87136 40677 49799 0 RE+ CPU 2 grep 87133 40703 49799 0 RL+ find 87130 40685 49799 0 LL+ *vm page 0xcd151580 grep 87128 40679 49799 0 LL+ *vm page 0xcd151580 grep 87125 40701 49799 0 LE+ *vm page 0xcd151580 grep 87117 40713 49799 0 D+ ufs 0xcd286e44 find 87116 40676 49799 0 D+ ufs 0xcd286e44 find 87115 40709 49799 0 D+ ufs 0xcd286e44 find 87113 40700 49799 0 D+ ufs 0xcd286e44 find 87110 40675 49799 0 D+ tmpfs 0xcf23f19c umount 87109 40697 49799 0 LE+ *vm page 0xcd151580 grep 87084 40684 49799 0 RE+ find 87083 40686 49799 0 R+ CPU 1 find 87082 40680 49799 0 D+ ufs 0xcd286e44 find 87073 40715 49799 0 D+ ufs 0xcd286e44 find 85781 793 790 1001 S nanslp 0xc123348a sleep 40715 40621 49799 0 S+ wait 0xcdfd12e8 sh 40714 40621 49799 0 S+ wait 0xcd6272e8 sh 40713 40621 49799 0 S+ wait 0xcc42d2e8 sh 40712 40621 49799 0 S+ wait 0xcbdb28b8 sh 40711 40621 49799 0 S+ wait 0xc9dbaba0 sh 40710 40621 49799 0 S+ wait 0xcc3b02e8 sh 40709 40621 49799 0 S+ wait 0xc7c32ba0 sh 40707 40621 49799 0 S+ piperd 0xc7db8000 sh 40705 40621 49799 0 S+ wait 0xc9dc02e8 sh 40704 40621 49799 0 S+ wait 0xca283000 sh 40703 40621 49799 0 S+ wait 0xc8e38000 sh 40701 40621 49799 0 S+ wait 0xc7d612e8 sh 40700 40621 49799 0 S+ wait 0xc8e822e8 sh 40699 40621 49799 0 LL+ *vm page 0xcd151580 sh 40698 40621 49799 0 LL+ *vm page 0xcd151580 sh 40697 40621 49799 0 S+ wait 0xcc57bba0 sh 40696 40621 49799 0 S+ wait 0xcd6268b8 sh 40695 40621 49799 0 S+ wait 0xcdfcfba0 sh 40686 40621 49799 0 S+ wait 0xcd61c2e8 sh 40685 40621 49799 0 S+ wait 0xcc7888b8 sh 40684 40621 49799 0 S+ wait 0xcac1f8b8 sh 40683 40621 49799 0 S+ wait 0xc92fc8b8 sh 40682 40621 49799 0 S+ wait 0xcd61e000 sh 40681 40621 49799 0 D+ ppwait 0xc9d96b74 sh 40680 40621 49799 0 S+ wait 0xc9dbeba0 sh 40679 40621 49799 0 S+ wait 0xcd83a2e8 sh 40678 40621 49799 0 S+ wait 0xca2878b8 sh 40677 40621 49799 0 S+ wait 0xc9d945d0 sh 40676 40621 49799 0 S+ wait 0xc8e38ba0 sh 40675 40621 49799 0 S+ wait 0xc8c79ba0 sh 40621 49799 49799 0 S+ pause 0xc9b5334c sh 95774 95758 89234 0 S piperd 0xc90134c8 cat 95758 95744 89234 0 S wait 0xc9da55d0 sh 95757 95744 89234 0 R CPU 3 find 95744 95710 89234 0 S wait 0xc81372e8 sh 95711 95585 89234 0 S piperd 0xc8d66330 mail 95710 95585 89234 0 S wait 0xcb82f8b8 sh 95585 95418 89234 0 S wait 0xcc42c5d0 sh 95418 95371 89234 0 S wait 0xcd62c5d0 lockf 95371 95339 89234 0 S wait 0xcbdaf000 sh 95339 89254 89234 0 S wait 0xc8abb8b8 sh 89255 89247 89234 0 S piperd 0xc9e0b990 mail 89254 89247 89234 0 S wait 0xcd62c2e8 sh 89247 89244 89234 0 S wait 0xcb148ba0 sh 89244 89234 89234 0 S wait 0xc7d618b8 lockf 89234 89230 89234 0 Ss wait 0xcd6235d0 sh 89230 734 734 0 S piperd 0xc8d574c8 cron 49799 841 49799 0 S+ wait 0xc9d96000 sh 32347 32344 32347 0 S+ ttyin 0xc900ac70 bash 32344 32328 32344 0 S+ pause 0xc833891c csh 32328 94281 32328 1001 S+ wait 0xca283ba0 su 94281 94280 94281 1001 Ss+ wait 0xcdfd22e8 bash 94280 94278 94278 1001 S select 0xcd68c964 sshd 94278 723 94278 0 Ss select 0xca649124 sshd 1319 1 1319 0 Ss+ ttyin 0xc778ee70 getty 1318 1 1318 0 Ss+ ttyin 0xc7936070 getty 1317 1 1317 0 Ss+ ttyin 0xc7936270 getty 1316 1 1316 0 Ss+ ttyin 0xc7936470 getty 1315 1 1315 0 Ss+ ttyin 0xc778da70 getty 1314 1 1314 0 Ss+ ttyin 0xc778d870 getty 1313 1 1313 0 Ss+ ttyin 0xc778d070 getty 1312 1 1312 0 Ss+ ttyin 0xc778d270 getty 1311 1 1311 0 Ss+ ttyin 0xc778d470 getty 1294 1 1294 0 Ss select 0xc7cbc064 inetd 1270 1 1270 0 Ss nanslp 0xc1233489 watchdogd 841 834 841 0 S+ wait 0xc8e13000 bash 834 833 834 0 S+ pause 0xc8e10c04 csh 833 813 833 1001 S+ wait 0xc84db2e8 su 813 812 813 1001 Ss+ wait 0xc8338ba0 bash 812 810 810 1001 S select 0xc84e10a4 sshd 810 723 810 0 Ss select 0xc7c0b564 sshd 794 790 790 1001 S piperd 0xc7e274c8 awk 793 790 790 1001 S wait 0xc80c9ba0 sh 792 787 792 1001 Ss+ select 0xc7c0b664 top 791 789 791 1001 Ss kqread 0xc7cddc80 tail 790 788 790 1001 Ss wait 0xc7c325d0 sh 789 782 782 1001 S select 0xc7cbcb64 sshd 788 783 783 1001 S select 0xc7d987e4 sshd 787 781 781 1001 S select 0xc7c0bba4 sshd 783 723 783 0 Ss select 0xc7c0baa4 sshd 782 723 782 0 Ss select 0xc7bd3e24 sshd 781 723 781 0 Ss select 0xc7d986e4 sshd 734 1 734 0 Ss nanslp 0xc123348b cron 729 1 729 25 Ss pause 0xc84da34c sendmail 726 1 726 0 Ss select 0xc7d98564 sendmail 723 1 723 0 Ss select 0xc7c8fd64 sshd 691 1 691 0 Ss select 0xc7d97124 moused 690 671 671 0 S select 0xc7d984e4 smbd 688 673 673 0 S select 0xc7d984a4 winbindd 673 1 673 0 Ss select 0xc7c0b5e4 winbindd 671 1 671 0 Ss select 0xc7c0b5a4 smbd 669 1 669 0 Ss select 0xc7bd3c64 nmbd 645 1 645 0 Ss select 0xc7c8f924 ntpd 588 584 584 0 S (threaded) nfsd 100123 S rpcsvc 0xc784ce10 nfsd: service 100122 S rpcsvc 0xc784cdd0 nfsd: service 100121 S rpcsvc 0xc784cd90 nfsd: service 100096 S rpcsvc 0xc7c7f1d0 nfsd: master 584 1 584 0 Ss select 0xc7d973a4 nfsd 578 1 578 0 Ds ufs 0xc7d4d73c mountd 571 567 567 0 S select 0xc7c8f024 nfsuserd 570 567 567 0 S sbwait 0xc80f88d8 nfsuserd 569 567 567 0 S sbwait 0xc80f88d8 nfsuserd 568 567 567 0 S sbwait 0xc80f88d8 nfsuserd 567 1 567 0 Ss pause 0xc7dfc634 nfsuserd 538 1 538 0 Ss select 0xc7c8fda4 rpcbind 523 1 523 0 Ss select 0xc7d974a4 syslogd 420 1 420 0 Ss select 0xc7c0a264 devd 17 0 0 0 DL sdflush 0xc13ae994 [softdepflush] 16 0 0 0 DL syncer 0xc13aa424 [syncer] 9 0 0 0 DL vlruwt 0xc7c30ba0 [vnlru] 8 0 0 0 DL psleep 0xc13aa19c [bufdaemon] 7 0 0 0 DL pgzero 0xc13af294 [pagezero] 6 0 0 0 DL psleep 0xc13aee5c [vmdaemon] 5 0 0 0 DL psleep 0xc1403484 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc11fefa4 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc13fee58 [sctp_iterator] 2 0 0 0 DL - 0xc789bc3c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc78ffd34 [usbus5] 100057 D - 0xc78ffd04 [usbus5] 100056 D - 0xc78ffcd4 [usbus5] 100055 D - 0xc78ffca4 [usbus5] 100053 D - 0xc78f3b5c [usbus4] 100052 D - 0xc78f3b2c [usbus4] 100051 D - 0xc78f3afc [usbus4] 100050 D - 0xc78f3acc [usbus4] 100049 D - 0xc78efb5c [usbus3] 100048 D - 0xc78efb2c [usbus3] 100047 D - 0xc78efafc [usbus3] 100046 D - 0xc78efacc [usbus3] 100045 D - 0xc78e2b5c [usbus2] 100044 D - 0xc78e2b2c [usbus2] 100043 D - 0xc78e2afc [usbus2] 100042 D - 0xc78e2acc [usbus2] 100040 D - 0xc78ddb5c [usbus1] 100039 D - 0xc78ddb2c [usbus1] 100038 D - 0xc78ddafc [usbus1] 100037 D - 0xc78ddacc [usbus1] 100035 D - 0xc78d4b5c [usbus0] 100034 D - 0xc78d4b2c [usbus0] 100033 D - 0xc78d4afc [usbus0] 100032 D - 0xc78d4acc [usbus0] 14 0 0 0 DL - 0xc1219104 [yarrow] 13 0 0 0 DL (threaded) [geom] 100016 D - 0xc13faa64 [g_down] 100015 D - 0xc13faa60 [g_up] 100014 D - 0xc13faa5c [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100025 I [swi2: cambio] 100020 I [swi5: fast taskq] 100018 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc76cbba0 [init] 10 0 0 0 DL audit_wo 0xc1401f54 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc1232382 [deadlkres] 100064 D - 0xc786d300 [mca taskq] 100026 D - 0xc76c6400 [ffs_trim taskq] 100024 D - 0xc76c6500 [kqueue taskq] 100023 D - 0xc76c6580 [acpi_task_2] 100022 D - 0xc76c6580 [acpi_task_1] 100021 D - 0xc76c6580 [acpi_task_0] 100019 D - 0xc76c6700 [thread taskq] 100013 D - 0xc7714000 [firmware taskq] 100000 D sched 0xc13faae4 [swapper] db:0:ps> allt Tracing command sh pid 87156 tid 100347 td 0xcb855900 sched_switch(cb855900,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf683d84c mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf683d880 turnstile_wait(c98d9b80,ce0a5900,0,c0d0ea4e,c1bb7480,...) at turnstile_wait+0x3b4/frame 0xf683d8b0 __rw_wlock_hard(cfd61cc8,cb855900,c10c3bc5,4d4,0,...) at __rw_wlock_hard+0x353/frame 0xf683d930 _rw_wlock_cookie(cfd61cc8,c10c3bc5,4d4,c91e86a0,c91e8658,...) at _rw_wlock_cookie+0xdd/frame 0xf683d960 vm_object_shadow(c8e8ce34,c8e8ce38,800000,eb4,17f798,...) at vm_object_shadow+0x2d/frame 0xf683d984 vm_map_lookup(f683dae0,28876000,2,f683dae4,f683dad4,...) at vm_map_lookup+0x1e8/frame 0xf683d9c0 vm_fault_hold(c91e8658,28876000,2,0,0,...) at vm_fault_hold+0xd0/frame 0xf683db20 vm_fault(c91e8658,28876000,2,0,c91e8658,...) at vm_fault+0x82/frame 0xf683db48 trap_pfault(288760d9,f683dd08,c90be028,cd05b738,f683dc04,...) at trap_pfault+0x1ba/frame 0xf683dbc0 trap(f683dd08) at trap+0x5da/frame 0xf683dcfc calltrap() at calltrap+0x6/frame 0xf683dcfc --- trap 0xc, eip = 0x8054c7a, esp = 0xbfbfd608, ebp = 0xbfbfd618 --- Tracing command sh pid 87155 tid 100818 td 0xc8b72000 cpustop_handler(0,13,f66cf888,c0eab5bb,c11e446c,...) at cpustop_handler+0x2f/frame 0xf66cf738 ipi_nmi_handler(c11e446c,c8b72000,c8b72000,626d80,f9c5,...) at ipi_nmi_handler+0x37/frame 0xf66cf748 trap(f66cf894) at trap+0x3b/frame 0xf66cf888 calltrap() at calltrap+0x6/frame 0xf66cf888 --- trap 0x13, eip = 0xc0ea781c, esp = 0xf66cf8d4, ebp = 0xf66cf940 --- pmap_remove_pages(d23f8368,0,c108059e,3fe,f66cf9e8,...) at pmap_remove_pages+0x28c/frame 0xf66cf940 exec_new_vmspace(f66cfae0,c11f14d0,8,f66cfae0,ca8a98bc,...) at exec_new_vmspace+0x16d/frame 0xf66cf980 exec_elf32_imgact(f66cfae0,f66cfbc0,c108059e,170,0,...) at exec_elf32_imgact+0x50f/frame 0xf66cfa08 kern_execve(c8b72000,f66cfc08,0,2887b2ec,2887b2fc,...) at kern_execve+0x68b/frame 0xf66cfbe8 sys_execve(c8b72000,f66cfcc8,14,c10893dd,7b3,...) at sys_execve+0x53/frame 0xf66cfc40 syscall(f66cfd08) at syscall+0x2ed/frame 0xf66cfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf66cfcfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd404, ebp = 0xbfbfd534 --- Tracing command sh pid 87154 tid 101124 td 0xc92b5600 sched_switch(c92b5600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6837a14 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6837a48 sleepq_switch(c92b5600,0,c108cb51,26b,0,...) at sleepq_switch+0x1b9/frame 0xf6837a7c sleepq_wait(c1ba2048,0,c108f111,3,0,...) at sleepq_wait+0x48/frame 0xf6837aa0 _sx_xlock_hard(c1ba2048,c92b5600,0,c10c2a43,257,...) at _sx_xlock_hard+0x4c2/frame 0xf6837b38 _sx_xlock(c1ba2048,0,c10c2a43,257,0,...) at _sx_xlock+0xde/frame 0xf6837b68 _vm_map_lock(c1ba2000,c10c2a43,257,c92b5600,c9da82e8,...) at _vm_map_lock+0x4e/frame 0xf6837b84 kmem_alloc_wait(c1ba2000,40400,c91ab028,c8d950e0,f6837c04,...) at kmem_alloc_wait+0x4c/frame 0xf6837bc0 exec_copyin_args(f6837c08,2887b3c4,0,2887b2d0,2887b2d8,...) at exec_copyin_args+0x41/frame 0xf6837be8 sys_execve(c92b5600,f6837cc8,c0eb32b0,c1825c90,0,...) at sys_execve+0x38/frame 0xf6837c40 syscall(f6837d08) at syscall+0x2ed/frame 0xf6837cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6837cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd404, ebp = 0xbfbfd534 --- Tracing command sh pid 87153 tid 101457 td 0xce111300 sched_switch(ce111300,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf61ce894 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf61ce8c8 turnstile_wait(c98d9b80,cc60f000,0,c11bb1bc,cae78378,...) at turnstile_wait+0x3b4/frame 0xf61ce8f8 __mtx_lock_sleep(c1403410,ce111300,c10c4288,c10c4288,4ae,...) at __mtx_lock_sleep+0x28e/frame 0xf61ce968 __mtx_lock_flags(c1403410,0,c10c4288,4ae,0,...) at __mtx_lock_flags+0xfd/frame 0xf61ce99c vm_page_alloc(cf4ab2e4,0,0,0,f61cead4,...) at vm_page_alloc+0x9c/frame 0xf61ce9c0 vm_fault_hold(cc6893a0,8065000,2,0,0,...) at vm_fault_hold+0x3d9/frame 0xf61ceb20 vm_fault(cc6893a0,8065000,2,0,cc6893a0,...) at vm_fault+0x82/frame 0xf61ceb48 trap_pfault(8065310,c7934800,c7934828,cd05bce8,f61cec04,...) at trap_pfault+0x1ba/frame 0xf61cebc0 trap(f61ced08) at trap+0x5da/frame 0xf61cecfc calltrap() at calltrap+0x6/frame 0xf61cecfc --- trap 0xc, eip = 0x8053d13, esp = 0xbfbfd610, ebp = 0xbfbfd618 --- Tracing command sh pid 87152 tid 100578 td 0xcb86fc00 sched_switch(cb86fc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6627a14 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6627a48 sleepq_switch(cb86fc00,0,c108cb51,26b,0,...) at sleepq_switch+0x1b9/frame 0xf6627a7c sleepq_wait(c1ba2048,0,c108f111,3,0,...) at sleepq_wait+0x48/frame 0xf6627aa0 _sx_xlock_hard(c1ba2048,cb86fc00,0,c10c2a43,257,...) at _sx_xlock_hard+0x4c2/frame 0xf6627b38 _sx_xlock(c1ba2048,0,c10c2a43,257,0,...) at _sx_xlock+0xde/frame 0xf6627b68 _vm_map_lock(c1ba2000,c10c2a43,257,cb86fc00,cc3718b8,...) at _vm_map_lock+0x4e/frame 0xf6627b84 kmem_alloc_wait(c1ba2000,40400,0,c919b828,c919b884,...) at kmem_alloc_wait+0x4c/frame 0xf6627bc0 exec_copyin_args(f6627c08,2887b5c0,0,2887b470,2887b4d4,...) at exec_copyin_args+0x41/frame 0xf6627be8 sys_execve(cb86fc00,f6627cc8,c0eb32b0,c7200c90,0,...) at sys_execve+0x38/frame 0xf6627c40 syscall(f6627d08) at syscall+0x2ed/frame 0xf6627cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6627cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd4e4, ebp = 0xbfbfd614 --- Tracing command cp pid 87151 tid 100084 td 0xc7e09c00 sched_switch(c7e09c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf5c8e8bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf5c8e8f0 turnstile_wait(cd151580,cc3bdc00,0,c7d5c0b0,e11,...) at turnstile_wait+0x3b4/frame 0xf5c8e920 __mtx_lock_sleep(c1402910,c7e09c00,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf5c8e98c __mtx_lock_flags(c1402910,0,c10c256f,396,3,...) at __mtx_lock_flags+0xfd/frame 0xf5c8e9c0 vm_fault_hold(c7d5c000,2806a000,2,0,0,...) at vm_fault_hold+0x1da0/frame 0xf5c8eb20 vm_fault(c7d5c000,2806a000,2,0,c7d5c000,...) at vm_fault+0x82/frame 0xf5c8eb48 trap_pfault(2806a3fc,f5c8ed08,c878bc28,c7df3930,f5c8ec04,...) at trap_pfault+0x1ba/frame 0xf5c8ebc0 trap(f5c8ed08) at trap+0x5da/frame 0xf5c8ecfc calltrap() at calltrap+0x6/frame 0xf5c8ecfc --- trap 0xc, eip = 0x280586c3, esp = 0xbfbfcd94, ebp = 0xbfbfcddc --- Tracing command sh pid 87150 tid 101183 td 0xc8c05c00 sched_switch(c8c05c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf6883514 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf6883548 turnstile_wait(cd151580,cc3bdc00,0,c90b7f30,e11,...) at turnstile_wait+0x3b4/frame 0xf6883578 __mtx_lock_sleep(c1402910,c8c05c00,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf68835e4 __mtx_lock_flags(c1402910,0,c10c256f,396,7,...) at __mtx_lock_flags+0xfd/frame 0xf6883618 vm_fault_hold(c90b7e80,bfbfd000,2,0,0,...) at vm_fault_hold+0x1da0/frame 0xf6883778 vm_fault(c90b7e80,bfbfd000,2,0,c90b7e80,...) at vm_fault+0x82/frame 0xf68837a0 trap_pfault(bfbfd9c0,c11b9ca4,c8c05c00,c13aa4a8,92,...) at trap_pfault+0x1ba/frame 0xf6883818 trap(f6883964) at trap+0x53d/frame 0xf6883958 calltrap() at calltrap+0x6/frame 0xf6883958 --- trap 0xc, eip = 0xc0ea9af3, esp = 0xf68839a4, ebp = 0xf6883a08 --- copyout(f6883ae0,f6883bc0,c108059e,170,0,...) at copyout+0x37/frame 0xf6883a08 kern_execve(c8c05c00,f6883c08,0,2887b468,2887b498,...) at kern_execve+0xba7/frame 0xf6883be8 sys_execve(c8c05c00,f6883cc8,c0eb32b0,c7200c90,0,...) at sys_execve+0x53/frame 0xf6883c40 syscall(f6883d08) at syscall+0x2ed/frame 0xf6883cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6883cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd41c, ebp = 0xbfbfd54c --- Tracing command sh pid 87149 tid 100986 td 0xc8fb3c00 sched_switch(c8fb3c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf67b98bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf67b98f0 turnstile_wait(cd151580,cc3bdc00,0,1,0,...) at turnstile_wait+0x3b4/frame 0xf67b9920 __mtx_lock_sleep(c1402910,c8fb3c00,c10c256f,c10c256f,14c,...) at __mtx_lock_sleep+0x28e/frame 0xf67b998c __mtx_lock_flags(c1402910,0,c10c256f,14c,f67b9ad4,...) at __mtx_lock_flags+0xfd/frame 0xf67b99c0 vm_fault_hold(cb11a0e8,2887b000,2,0,0,...) at vm_fault_hold+0x2c1/frame 0xf67b9b20 vm_fault(cb11a0e8,2887b000,2,0,cb11a0e8,...) at vm_fault+0x82/frame 0xf67b9b48 trap_pfault(2887b2c0,c8bdac00,c8bdac28,c7df3b60,f67b9c04,...) at trap_pfault+0x1ba/frame 0xf67b9bc0 trap(f67b9d08) at trap+0x5da/frame 0xf67b9cfc calltrap() at calltrap+0x6/frame 0xf67b9cfc --- trap 0xc, eip = 0x805048c, esp = 0xbfbfd028, ebp = 0xbfbfd14c --- Tracing command grep pid 87148 tid 100540 td 0xcbb76c00 sched_switch(cbb76c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf5f068bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf5f068f0 turnstile_wait(cd151580,cc3bdc00,0,cb0edc78,e11,...) at turnstile_wait+0x3b4/frame 0xf5f06920 __mtx_lock_sleep(c1402910,cbb76c00,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf5f0698c __mtx_lock_flags(c1402910,0,c10c256f,396,3,...) at __mtx_lock_flags+0xfd/frame 0xf5f069c0 vm_fault_hold(cb0edbc8,28858000,1,0,0,...) at vm_fault_hold+0x1da0/frame 0xf5f06b20 vm_fault(cb0edbc8,28858000,1,0,cb0edbc8,...) at vm_fault+0x82/frame 0xf5f06b48 trap_pfault(28858000,f5f06d08,6a,39b1c,18124,...) at trap_pfault+0x1ba/frame 0xf5f06bc0 trap(f5f06d08) at trap+0x5da/frame 0xf5f06cfc calltrap() at calltrap+0x6/frame 0xf5f06cfc --- trap 0xc, eip = 0x2813c057, esp = 0xbfbfcbdc, ebp = 0xbfbfcc28 --- Tracing command sh pid 87147 tid 101238 td 0xcc531c00 sched_switch(cc531c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf68ca764 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf68ca798 turnstile_wait(cd151580,cc3bdc00,0,2f5,f9c5,...) at turnstile_wait+0x3b4/frame 0xf68ca7c8 __mtx_lock_sleep(c1402910,cc531c00,c10c3bc5,c10c3bc5,2ed,...) at __mtx_lock_sleep+0x28e/frame 0xf68ca838 __mtx_lock_flags(c1402910,0,c10c3bc5,2ed,8,...) at __mtx_lock_flags+0xfd/frame 0xf68ca86c vm_object_terminate(cf7a3784,c10c3bc5,280,cb55e830,f68ca8fc,...) at vm_object_terminate+0x1b1/frame 0xf68ca8a8 vm_object_deallocate(cf7a3784,cb496ca8,0,c90b7b28,1000,...) at vm_object_deallocate+0x4c9/frame 0xf68ca8fc vm_map_process_deferred(c90b7b28,c10c2d0e,b32,b2f,c759d000,...) at vm_map_process_deferred+0x8e/frame 0xf68ca91c vm_map_remove(c90b7ae0,1000,bfc00000,3fe,f68ca9e8,...) at vm_map_remove+0xd6/frame 0xf68ca940 exec_new_vmspace(f68caae0,c11f14d0,8,f68caae0,cfc10700,...) at exec_new_vmspace+0x186/frame 0xf68ca980 exec_elf32_imgact(f68caae0,f68cabc0,c108059e,170,0,...) at exec_elf32_imgact+0x50f/frame 0xf68caa08 kern_execve(cc531c00,f68cac08,0,2887b2d0,2887b2d8,...) at kern_execve+0x68b/frame 0xf68cabe8 sys_execve(cc531c00,f68cacc8,14,c10893dd,7b3,...) at sys_execve+0x53/frame 0xf68cac40 syscall(f68cad08) at syscall+0x2ed/frame 0xf68cacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf68cacfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd404, ebp = 0xbfbfd534 --- Tracing command cp pid 87145 tid 100134 td 0xc84eec00 sched_switch(c84eec00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d9987c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5d998b0 sleepq_switch(c84eec00,0,c108cb51,26b,0,...) at sleepq_switch+0x1b9/frame 0xf5d998e4 sleepq_wait(c1ba2048,0,c108f111,3,0,...) at sleepq_wait+0x48/frame 0xf5d99908 _sx_xlock_hard(c1ba2048,c84eec00,0,c10c2a43,276,...) at _sx_xlock_hard+0x4c2/frame 0xf5d9999c _sx_xlock(c1ba2048,0,c10c2a43,276,c1ba2000,...) at _sx_xlock+0xde/frame 0xf5d999cc _vm_map_lock(c1ba2000,c10c2a43,276,c84da000,f5d99c08,...) at _vm_map_lock+0x4e/frame 0xf5d999e8 kmem_free_wakeup(c1ba2000,ecf15000,40400,36f,1dc0,...) at kmem_free_wakeup+0x37/frame 0xf5d99a08 kern_execve(c84eec00,f5d99c08,0,2887b468,2887b498,...) at kern_execve+0x959/frame 0xf5d99be8 sys_execve(c84eec00,f5d99cc8,8,c10874bc,db,...) at sys_execve+0x53/frame 0xf5d99c40 syscall(f5d99d08) at syscall+0x2ed/frame 0xf5d99cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d99cfc --- syscall (0, FreeBSD ELF32, nosys), eip = 0x2804cea0, esp = 0xbfbfd7e0, ebp = 0 --- Tracing command sh pid 87144 tid 101236 td 0xcb7f1600 sched_switch(cb7f1600,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf68c46fc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf68c4730 turnstile_wait(cd151580,cc3bdc00,0,c0d2cc4d,c1bb6800,...) at turnstile_wait+0x3b4/frame 0xf68c4760 __mtx_lock_sleep(c1402910,cb7f1600,c10c3bc5,c10c3bc5,665,...) at __mtx_lock_sleep+0x28e/frame 0xf68c47d0 __mtx_lock_flags(c1402910,0,c10c3bc5,665,0,...) at __mtx_lock_flags+0xfd/frame 0xf68c4804 vm_object_backing_scan(cf7a30a4,c10c3bc5,69e,68d,269,...) at vm_object_backing_scan+0x17e/frame 0xf68c4874 vm_object_collapse(ccc952e4,c10c3bc5,269,d2579418,f68c48fc,...) at vm_object_collapse+0xac/frame 0xf68c48a8 vm_object_deallocate(ce2d0940,cbcac5a0,0,cc687218,1000,...) at vm_object_deallocate+0x4f0/frame 0xf68c48fc vm_map_process_deferred(cc687218,c10c2d0e,b32,b2f,c759d000,...) at vm_map_process_deferred+0x8e/frame 0xf68c491c vm_map_remove(cc6871d0,1000,bfc00000,3fe,f68c49e8,...) at vm_map_remove+0xd6/frame 0xf68c4940 exec_new_vmspace(f68c4ae0,c11f14d0,8,f68c4ae0,cb66066c,...) at exec_new_vmspace+0x186/frame 0xf68c4980 exec_elf32_imgact(f68c4ae0,f68c4bc0,c108059e,170,0,...) at exec_elf32_imgact+0x50f/frame 0xf68c4a08 kern_execve(cb7f1600,f68c4c08,0,2887b470,2887b4d4,...) at kern_execve+0x68b/frame 0xf68c4be8 sys_execve(cb7f1600,f68c4cc8,c10dec7f,e9,7b3,...) at sys_execve+0x53/frame 0xf68c4c40 syscall(f68c4d08) at syscall+0x2ed/frame 0xf68c4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf68c4cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd4e4, ebp = 0xbfbfd614 --- Tracing command grep pid 87143 tid 100312 td 0xcc3e6600 sched_switch(cc3e6600,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf60498bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf60498f0 turnstile_wait(cd151580,cc3bdc00,0,c84c5c78,e11,...) at turnstile_wait+0x3b4/frame 0xf6049920 __mtx_lock_sleep(c1402910,cc3e6600,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf604998c __mtx_lock_flags(c1402910,0,c10c256f,396,3,...) at __mtx_lock_flags+0xfd/frame 0xf60499c0 vm_fault_hold(c84c5bc8,2885d000,1,0,0,...) at vm_fault_hold+0x1da0/frame 0xf6049b20 vm_fault(c84c5bc8,2885d000,1,0,c84c5bc8,...) at vm_fault+0x82/frame 0xf6049b48 trap_pfault(2885d000,f6049d08,0,f6049c04,c0a4b44b,...) at trap_pfault+0x1ba/frame 0xf6049bc0 trap(f6049d08) at trap+0x5da/frame 0xf6049cfc calltrap() at calltrap+0x6/frame 0xf6049cfc --- trap 0xc, eip = 0x2813c057, esp = 0xbfbfcbdc, ebp = 0xbfbfcc28 --- Tracing command mount pid 87142 tid 100432 td 0xcb7f0600 sched_switch(cb7f0600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62a287c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf62a28b0 sleepq_switch(cb7f0600,0,c108cb51,26b,0,...) at sleepq_switch+0x1b9/frame 0xf62a28e4 sleepq_wait(c1ba2048,0,c108f111,3,0,...) at sleepq_wait+0x48/frame 0xf62a2908 _sx_xlock_hard(c1ba2048,cb7f0600,0,c10c2a43,276,...) at _sx_xlock_hard+0x4c2/frame 0xf62a299c _sx_xlock(c1ba2048,0,c10c2a43,276,c1ba2000,...) at _sx_xlock+0xde/frame 0xf62a29cc _vm_map_lock(c1ba2000,c10c2a43,276,c94ef8b8,f62a2c08,...) at _vm_map_lock+0x4e/frame 0xf62a29e8 kmem_free_wakeup(c1ba2000,ecf56000,40400,36f,0,...) at kmem_free_wakeup+0x37/frame 0xf62a2a08 kern_execve(cb7f0600,f62a2c08,0,2887b2d0,2887b2d8,...) at kern_execve+0x959/frame 0xf62a2be8 sys_execve(cb7f0600,f62a2cc8,c0eb32b0,c71fdc90,0,...) at sys_execve+0x53/frame 0xf62a2c40 syscall(f62a2d08) at syscall+0x2ed/frame 0xf62a2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62a2cfc --- syscall (0, FreeBSD ELF32, nosys), eip = 0x2804cea0, esp = 0xbfbfd90c, ebp = 0 --- Tracing command sh pid 87141 tid 100358 td 0xcc396600 sched_switch(cc396600,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf60f0764 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf60f0798 turnstile_wait(cd151580,cc3bdc00,0,c1250134,8,...) at turnstile_wait+0x3b4/frame 0xf60f07c8 __mtx_lock_sleep(c1402910,cc396600,c10c3bc5,c10c3bc5,2ed,...) at __mtx_lock_sleep+0x28e/frame 0xf60f0838 __mtx_lock_flags(c1402910,0,c10c3bc5,2ed,8,...) at __mtx_lock_flags+0xfd/frame 0xf60f086c vm_object_terminate(cf8c69d4,c10c3bc5,280,d2579418,f60f08fc,...) at vm_object_terminate+0x1b1/frame 0xf60f08a8 vm_object_deallocate(cf8c69d4,cb64a828,0,cc684c10,1000,...) at vm_object_deallocate+0x4c9/frame 0xf60f08fc vm_map_process_deferred(cc684c10,c10c2d0e,b32,b2f,c759d000,...) at vm_map_process_deferred+0x8e/frame 0xf60f091c vm_map_remove(cc684bc8,1000,bfc00000,3fe,f60f09e8,...) at vm_map_remove+0xd6/frame 0xf60f0940 exec_new_vmspace(f60f0ae0,c11f14d0,8,f60f0ae0,ca8a98bc,...) at exec_new_vmspace+0x186/frame 0xf60f0980 exec_elf32_imgact(f60f0ae0,f60f0bc0,c108059e,170,0,...) at exec_elf32_imgact+0x50f/frame 0xf60f0a08 kern_execve(cc396600,f60f0c08,0,2887b2ec,2887b2fc,...) at kern_execve+0x68b/frame 0xf60f0be8 sys_execve(cc396600,f60f0cc8,cc396600,0,cc396600,...) at sys_execve+0x53/frame 0xf60f0c40 syscall(f60f0d08) at syscall+0x2ed/frame 0xf60f0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf60f0cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28152493, esp = 0xbfbfd404, ebp = 0xbfbfd534 --- Tracing command mount pid 87140 tid 100934 td 0xc8ce1600 sched_switch(c8ce1600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf676187c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf67618b0 sleepq_switch(c8ce1600,0,c108cb51,26b,0,...) at sleepq_switch+0x1b9/frame 0xf67618e4 sleepq_wait(c1ba2048,0,c108f111,3,0,...) at sleepq_wait+0x48/frame 0xf6761908 _sx_xlock_hard(c1ba2048,c8ce1600,0,c10c2a43,276,...) at _sx_xlock_hard+0x4c2/frame 0xf676199c _sx_xlock(c1ba2048,0,c10c2a43,276,c1ba2000,...) at _sx_xlock+0xde/frame 0xf67619cc _vm_map_lock(c1ba2000,c10c2a43,276,cd8528b8,f6761c08,...) at _vm_map_lock+0x4e/frame 0xf67619e8 kmem_free_wakeup(c1ba2000,ecd8f000,40400,36f,1c0,...) at kmem_free_wakeup+0x37/frame 0xf6761a08 kern_execve(c8ce1600,f6761c08,0,2887b2d0,2887b2d8,...) at kern_execve+0x959/frame 0xf6761be8 sys_execve(c8ce1600,f6761cc8,c0eb32b0,c1825c90,0,...) at sys_execve+0x53/frame 0xf6761c40 syscall(f6761d08) at syscall+0x2ed/frame 0xf6761cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6761cfc --- syscall (0, FreeBSD ELF32, nosys), eip = 0x2804cea0, esp = 0xbfbfd90c, ebp = 0 --- Tracing command find pid 87139 tid 101229 td 0xc8d35300 sched_switch(c8d35300,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf68bb8bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf68bb8f0 turnstile_wait(cd151580,cc3bdc00,0,c76d3280,e11,...) at turnstile_wait+0x3b4/frame 0xf68bb920 __mtx_lock_sleep(c1402910,c8d35300,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf68bb98c __mtx_lock_flags(c1402910,0,c10c256f,396,3,...) at __mtx_lock_flags+0xfd/frame 0xf68bb9c0 vm_fault_hold(c76d31d0,28823000,1,0,0,...) at vm_fault_hold+0x1da0/frame 0xf68bbb20 vm_fault(c76d31d0,28823000,1,0,c76d31d0,...) at vm_fault+0x82/frame 0xf68bbb48 trap_pfault(28823000,f68bbd08,f68bbc10,ffffffff,ffffffff,...) at trap_pfault+0x1ba/frame 0xf68bbbc0 trap(f68bbd08) at trap+0x5da/frame 0xf68bbcfc calltrap() at calltrap+0x6/frame 0xf68bbcfc --- trap 0xc, eip = 0x280fa057, esp = 0xbfbfcd14, ebp = 0xbfbfcd60 --- Tracing command find pid 87137 tid 100765 td 0xcbc3c300 sched_switch(cbc3c300,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf6528894 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf65288c8 turnstile_wait(c98d9b80,cc60f000,0,c11bb1bc,c811dd60,...) at turnstile_wait+0x3b4/frame 0xf65288f8 __mtx_lock_sleep(c1403410,cbc3c300,c10c4288,c10c4288,4ae,...) at __mtx_lock_sleep+0x28e/frame 0xf6528968 __mtx_lock_flags(c1403410,0,c10c4288,4ae,0,...) at __mtx_lock_flags+0xfd/frame 0xf652899c vm_page_alloc(ccf3dde0,6e0,0,40,f6528ad4,...) at vm_page_alloc+0x9c/frame 0xf65289c0 vm_fault_hold(c811dcb0,28889000,1,0,0,...) at vm_fault_hold+0x3d9/frame 0xf6528b20 vm_fault(c811dcb0,28889000,1,0,c811dcb0,...) at vm_fault+0x82/frame 0xf6528b48 trap_pfault(28889000,f6528d08,420c144,0,cbc3c300,...) at trap_pfault+0x1ba/frame 0xf6528bc0 trap(f6528d08) at trap+0x5da/frame 0xf6528cfc calltrap() at calltrap+0x6/frame 0xf6528cfc --- trap 0xc, eip = 0x280fa057, esp = 0xbfbfd154, ebp = 0xbfbfd1a0 --- Tracing command grep pid 87136 tid 100407 td 0xc92e5c00 cpustop_handler(2,13,f61b6b74,c0eab5bb,ef,...) at cpustop_handler+0x2f/frame 0xf61b6a28 ipi_nmi_handler(ef,eac737d8,f9c5,1,eab529fa,...) at ipi_nmi_handler+0x37/frame 0xf61b6a38 trap(f61b6b80) at trap+0x3b/frame 0xf61b6b74 calltrap() at calltrap+0x6/frame 0xf61b6b74 --- trap 0x13, eip = 0xc0a9ad3f, esp = 0xf61b6bc0, ebp = 0xf61b6bd0 --- tidhash_remove(c92e5c00,0,c10806dc,18a,f61b6c40,...) at tidhash_remove+0xf/frame 0xf61b6bd0 exit1(c92e5c00,0,f61b6cfc,c0eac9cd,c92e5c00,...) at exit1+0x8eb/frame 0xf61b6c30 sys_sys_exit(c92e5c00,f61b6cc8,c0eb32b0,c71fdc90,0,...) at sys_sys_exit+0x1d/frame 0xf61b6c40 syscall(f61b6d08) at syscall+0x2ed/frame 0xf61b6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61b6cfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x2816c7f3, esp = 0xbfbfd6dc, ebp = 0xbfbfd6ec --- Tracing command find pid 87133 tid 101093 td 0xcca2f000 sched_switch(cca2f000,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf6819894 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf68198c8 turnstile_wait(c98d9b80,cc60f000,0,c11bb1bc,cb11af30,...) at turnstile_wait+0x3b4/frame 0xf68198f8 __mtx_lock_sleep(c1403410,cca2f000,c10c4288,c10c4288,4ae,...) at __mtx_lock_sleep+0x28e/frame 0xf6819968 __mtx_lock_flags(c1403410,0,c10c4288,4ae,0,...) at __mtx_lock_flags+0xfd/frame 0xf681999c vm_page_alloc(ced86094,65b,0,40,f6819ad4,...) at vm_page_alloc+0x9c/frame 0xf68199c0 vm_fault_hold(cb11ae80,28804000,2,0,0,...) at vm_fault_hold+0x3d9/frame 0xf6819b20 vm_fault(cb11ae80,28804000,2,0,cb11ae80,...) at vm_fault+0x82/frame 0xf6819b48 trap_pfault(28804000,f6819d08,400000,3,7,...) at trap_pfault+0x1ba/frame 0xf6819bc0 trap(f6819d08) at trap+0x5da/frame 0xf6819cfc calltrap() at calltrap+0x6/frame 0xf6819cfc --- trap 0xc, eip = 0x2818f603, esp = 0xbfbfcd10, ebp = 0xbfbfcd44 --- Tracing command grep pid 87130 tid 101003 td 0xcc60f000 sched_switch(cc60f000,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf6c8d8bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf6c8d8f0 turnstile_wait(cd151580,cc3bdc00,0,ce2f9b90,e11,...) at turnstile_wait+0x3b4/frame 0xf6c8d920 __mtx_lock_sleep(c1402910,cc60f000,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf6c8d98c __mtx_lock_flags(c1402910,0,c10c256f,396,3,...) at __mtx_lock_flags+0xfd/frame 0xf6c8d9c0 vm_fault_hold(ce2f9ae0,2884b000,1,0,0,...) at vm_fault_hold+0x1da0/frame 0xf6c8db20 vm_fault(ce2f9ae0,2884b000,1,0,ce2f9ae0,...) at vm_fault+0x82/frame 0xf6c8db48 trap_pfault(2884b000,f6c8dd08,6a,39b1c,18124,...) at trap_pfault+0x1ba/frame 0xf6c8dbc0 trap(f6c8dd08) at trap+0x5da/frame 0xf6c8dcfc calltrap() at calltrap+0x6/frame 0xf6c8dcfc --- trap 0xc, eip = 0x2813c057, esp = 0xbfbfcbdc, ebp = 0xbfbfcc28 --- Tracing command grep pid 87128 tid 100960 td 0xcb8eb300 sched_switch(cb8eb300,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf6c1e8bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf6c1e8f0 turnstile_wait(cd151580,cc3bdc00,0,c7d5c8d8,e11,...) at turnstile_wait+0x3b4/frame 0xf6c1e920 __mtx_lock_sleep(c1402910,cb8eb300,c10c256f,c10c256f,396,...) at __mtx_lock_sleep+0x28e/frame 0xf6c1e98c __mtx_lock_flags(c1402910,0,c10c256f,396,3,...) at __mtx_lock_flags+0xfd/frame 0xf6c1e9c0 vm_fault_hold(c7d5c828,28833000,1,0,0,...) at vm_fault_hold+0x1da0/frame 0xf6c1eb20 vm_fault(c7d5c828,28833000,1,0,c7d5c828,...) at vm_fault+0x82/frame 0xf6c1eb48 trap_pfault(28833000,f6c1ed08,0,f6c1ec04,c0a4b44b,...) at trap_pfault+0x1ba/frame 0xf6c1ebc0 trap(f6c1ed08) at trap+0x5da/frame 0xf6c1ecfc calltrap() at calltrap+0x6/frame 0xf6c1ecfc --- trap 0xc, eip = 0x2813c057, esp = 0xbfbfcccc, ebp = 0xbfbfcd18 --- Tracing command grep pid 87125 tid 100757 td 0xce125c00 sched_switch(ce125c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf61959d4 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf6195a08 turnstile_wait(cd151580,cc3bdc00,0,0,c10c1d4c,...) at turnstile_wait+0x3b4/frame 0xf6195a38 __mtx_lock_sleep(c1402910,ce125c00,c10c3bc5,c10c3bc5,777,...) at __mtx_lock_sleep+0x28e/frame 0xf6195aa8 __mtx_lock_flags(c1402910,0,c10c3bc5,777,cbc12b0c,...) at __mtx_lock_flags+0xfd/frame 0xf6195adc vm_object_page_remove(cbc12afc,0,0,28,0,...) at vm_object_page_remove+0x1d2/frame 0xf6195b0c vm_map_delete(d23f91d0,1000,bfc00000,b2f,ce125c00,...) at vm_map_delete+0x18b/frame 0xf6195b84 vm_map_remove(d23f91d0,1000,bfc00000,d23f9280,cc57c000,...) at vm_map_remove+0x8b/frame 0xf6195ba8 vmspace_exit(ce125c00,0,c10806dc,140,f6195c40,...) at vmspace_exit+0xe1/frame 0xf6195bd0 exit1(ce125c00,100,f6195cfc,c0eac9cd,ce125c00,...) at exit1+0x644/frame 0xf6195c30 sys_sys_exit(ce125c00,f6195cc8,c0eb32b0,c1825c90,0,...) at sys_sys_exit+0x1d/frame 0xf6195c40 syscall(f6195d08) at syscall+0x2ed/frame 0xf6195cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6195cfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x2816c7f3, esp = 0xbfbfd758, ebp = 0xbfbfd768 --- Tracing command find pid 87117 tid 100293 td 0xcc3f8900 sched_switch(cc3f8900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6010634 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6010668 sleepq_switch(cc3f8900,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf601069c sleepq_wait(cd286e44,60,c1076516,4,1,...) at sleepq_wait+0x48/frame 0xf60106c0 sleeplk(cd286eb0,c1076516,60,33,1,...) at sleeplk+0x126/frame 0xf6010708 __lockmgr_args(cd286e44,200100,cd286eb0,0,0,...) at __lockmgr_args+0x60b/frame 0xf60107e8 ffs_lock(f6010870,f6010840,c0b1b138,c7d4d73c,f6010870,...) at ffs_lock+0xad/frame 0xf6010828 VOP_LOCK1_APV(c11e446c,f6010870,0,f60108e4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf6010858 _vn_lock(cd286e10,200100,c109780f,877,2a1,...) at _vn_lock+0xca/frame 0xf6010898 vget(cd286e10,200100,cc3f8900,29d,c11f6178,...) at vget+0x77/frame 0xf60108d0 cache_lookup(c7d4d708,f6010b50,f6010b64,0,0,...) at cache_lookup+0x5a8/frame 0xf6010930 vfs_cache_lookup(f60109e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xbc/frame 0xf6010978 VOP_LOOKUP_APV(c11e446c,f60109e8,f6010b64,205,f60109f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf60109a8 lookup(f6010b18,c1096c53,107,ce,cbc097b8,...) at lookup+0x528/frame 0xf6010a10 namei(f6010b18,ffffffdf,c7d0d480,0,cc3f8900,...) at namei+0x47d/frame 0xf6010a98 kern_statat_vnhook(cc3f8900,200,ffffff9c,288042f8,0,...) at kern_statat_vnhook+0xc2/frame 0xf6010ba8 sys_lstat(cc3f8900,f6010cc8,c0eb32b0,c71fdc90,0,...) at sys_lstat+0x59/frame 0xf6010c40 syscall(f6010d08) at syscall+0x2ed/frame 0xf6010cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6010cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd6c4, ebp = 0xbfbfd74c --- Tracing command find pid 87116 tid 100696 td 0xcc84c300 sched_switch(cc84c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf66b6634 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf66b6668 sleepq_switch(cc84c300,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf66b669c sleepq_wait(cd286e44,60,c1076516,4,1,...) at sleepq_wait+0x48/frame 0xf66b66c0 sleeplk(cd286eb0,c1076516,60,33,1,...) at sleeplk+0x126/frame 0xf66b6708 __lockmgr_args(cd286e44,200100,cd286eb0,0,0,...) at __lockmgr_args+0x60b/frame 0xf66b67e8 ffs_lock(f66b6870,f66b6840,c0b1b138,c7d4d73c,f66b6870,...) at ffs_lock+0xad/frame 0xf66b6828 VOP_LOCK1_APV(c11e446c,f66b6870,0,f66b68e4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf66b6858 _vn_lock(cd286e10,200100,c109780f,877,2a1,...) at _vn_lock+0xca/frame 0xf66b6898 vget(cd286e10,200100,cc84c300,29d,c11f6178,...) at vget+0x77/frame 0xf66b68d0 cache_lookup(c7d4d708,f66b6b50,f66b6b64,0,0,...) at cache_lookup+0x5a8/frame 0xf66b6930 vfs_cache_lookup(f66b69e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xbc/frame 0xf66b6978 VOP_LOOKUP_APV(c11e446c,f66b69e8,f66b6b64,205,f66b69f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf66b69a8 lookup(f66b6b18,c1096c53,107,ce,cbc097b8,...) at lookup+0x528/frame 0xf66b6a10 namei(f66b6b18,ffffffdf,c7d0d480,0,cc84c300,...) at namei+0x47d/frame 0xf66b6a98 kern_statat_vnhook(cc84c300,200,ffffff9c,288042f8,0,...) at kern_statat_vnhook+0xc2/frame 0xf66b6ba8 sys_lstat(cc84c300,f66b6cc8,c0eb32b0,c71fdc90,0,...) at sys_lstat+0x59/frame 0xf66b6c40 syscall(f66b6d08) at syscall+0x2ed/frame 0xf66b6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf66b6cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd6c4, ebp = 0xbfbfd74c --- Tracing command find pid 87115 tid 100602 td 0xcac5c300 sched_switch(cac5c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf65e2634 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf65e2668 sleepq_switch(cac5c300,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf65e269c sleepq_wait(cd286e44,60,c1076516,4,1,...) at sleepq_wait+0x48/frame 0xf65e26c0 sleeplk(cd286eb0,c1076516,60,33,1,...) at sleeplk+0x126/frame 0xf65e2708 __lockmgr_args(cd286e44,200100,cd286eb0,0,0,...) at __lockmgr_args+0x60b/frame 0xf65e27e8 ffs_lock(f65e2870,f65e2840,c0b1b138,c7d4d73c,f65e2870,...) at ffs_lock+0xad/frame 0xf65e2828 VOP_LOCK1_APV(c11e446c,f65e2870,0,f65e28e4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf65e2858 _vn_lock(cd286e10,200100,c109780f,877,2a1,...) at _vn_lock+0xca/frame 0xf65e2898 vget(cd286e10,200100,cac5c300,29d,c11f6178,...) at vget+0x77/frame 0xf65e28d0 cache_lookup(c7d4d708,f65e2b50,f65e2b64,0,0,...) at cache_lookup+0x5a8/frame 0xf65e2930 vfs_cache_lookup(f65e29e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xbc/frame 0xf65e2978 VOP_LOOKUP_APV(c11e446c,f65e29e8,f65e2b64,205,f65e29f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf65e29a8 lookup(f65e2b18,c1096c53,107,ce,cbc097b8,...) at lookup+0x528/frame 0xf65e2a10 namei(f65e2b18,ffffffdf,c7d0d480,0,cac5c300,...) at namei+0x47d/frame 0xf65e2a98 kern_statat_vnhook(cac5c300,200,ffffff9c,288042f8,0,...) at kern_statat_vnhook+0xc2/frame 0xf65e2ba8 sys_lstat(cac5c300,f65e2cc8,c0eb32b0,c1825c90,0,...) at sys_lstat+0x59/frame 0xf65e2c40 syscall(f65e2d08) at syscall+0x2ed/frame 0xf65e2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf65e2cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd6c4, ebp = 0xbfbfd74c --- Tracing command find pid 87113 tid 102328 td 0xcd0d6300 sched_switch(cd0d6300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6d68634 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6d68668 sleepq_switch(cd0d6300,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf6d6869c sleepq_wait(cd286e44,60,c1076516,4,1,...) at sleepq_wait+0x48/frame 0xf6d686c0 sleeplk(cd286eb0,c1076516,60,33,1,...) at sleeplk+0x126/frame 0xf6d68708 __lockmgr_args(cd286e44,200100,cd286eb0,0,0,...) at __lockmgr_args+0x60b/frame 0xf6d687e8 ffs_lock(f6d68870,f6d68840,c0b1b138,c7d4d73c,f6d68870,...) at ffs_lock+0xad/frame 0xf6d68828 VOP_LOCK1_APV(c11e446c,f6d68870,0,f6d688e4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf6d68858 _vn_lock(cd286e10,200100,c109780f,877,2a1,...) at _vn_lock+0xca/frame 0xf6d68898 vget(cd286e10,200100,cd0d6300,29d,c11f6178,...) at vget+0x77/frame 0xf6d688d0 cache_lookup(c7d4d708,f6d68b50,f6d68b64,0,0,...) at cache_lookup+0x5a8/frame 0xf6d68930 vfs_cache_lookup(f6d689e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xbc/frame 0xf6d68978 VOP_LOOKUP_APV(c11e446c,f6d689e8,f6d68b64,205,f6d689f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf6d689a8 lookup(f6d68b18,c1096c53,107,ce,cbc097b8,...) at lookup+0x528/frame 0xf6d68a10 namei(f6d68b18,ffffffdf,c7d0d480,0,cd0d6300,...) at namei+0x47d/frame 0xf6d68a98 kern_statat_vnhook(cd0d6300,200,ffffff9c,288042f8,0,...) at kern_statat_vnhook+0xc2/frame 0xf6d68ba8 sys_lstat(cd0d6300,f6d68cc8,c0eb32b0,c7200c90,0,...) at sys_lstat+0x59/frame 0xf6d68c40 syscall(f6d68d08) at syscall+0x2ed/frame 0xf6d68cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6d68cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd6c4, ebp = 0xbfbfd74c --- Tracing command umount pid 87110 tid 100322 td 0xc7da2300 sched_switch(c7da2300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6067824 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6067858 sleepq_switch(c7da2300,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf606788c sleepq_wait(cf23f19c,60,ca8eb410,4,0,...) at sleepq_wait+0x48/frame 0xf60678b0 sleeplk(cf23f208,ca8eb410,60,33,0,...) at sleeplk+0x126/frame 0xf60678f8 __lockmgr_args(cf23f19c,80100,cf23f208,0,0,0,c109780f,877) at __lockmgr_args+0xa44/frame 0xf60679d8 vop_stdlock(f6067a50,cf1de640,a8a,f6067acc,f6067a50,...) at vop_stdlock+0x53/frame 0xf6067a08 VOP_LOCK1_APV(ca8ec9a4,f6067a50,c7da2300,c1ba4a00,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf6067a38 _vn_lock(cf23f168,80100,c109780f,877,ca8eb1d2,...) at _vn_lock+0xca/frame 0xf6067a78 vget(cf23f168,80100,c7da2300,1c5,c0b2c946,...) at vget+0x77/frame 0xf6067ab0 tmpfs_alloc_vp(c80d35d8,ceffa000,80000,f6067b68,0,...) at tmpfs_alloc_vp+0x171/frame 0xf6067b0c tmpfs_root(c80d35d8,80000,f6067b68,50f,c1bae814,...) at tmpfs_root+0x61/frame 0xf6067b30 dounmount(c80d35d8,8080000,c7da2300,493,c0acfc55,...) at dounmount+0x3af/frame 0xf6067b90 sys_unmount(c7da2300,f6067cc8,c10dec7f,d6,0,...) at sys_unmount+0x3cd/frame 0xf6067c40 syscall(f6067d08) at syscall+0x2ed/frame 0xf6067cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6067cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd114, ebp = 0xbfbfd1e0 --- Tracing command grep pid 87109 tid 100318 td 0xcc363300 sched_switch(cc363300,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf605b9d4 mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf605ba08 turnstile_wait(cd151580,cc3bdc00,0,3a657209,e7339ea7,...) at turnstile_wait+0x3b4/frame 0xf605ba38 __mtx_lock_sleep(c1402910,cc363300,c10c3bc5,c10c3bc5,777,...) at __mtx_lock_sleep+0x28e/frame 0xf605baa8 __mtx_lock_flags(c1402910,0,c10c3bc5,777,cc3f28bc,...) at __mtx_lock_flags+0xfd/frame 0xf605badc vm_object_page_remove(cc3f28ac,0,0,28,0,...) at vm_object_page_remove+0x1d2/frame 0xf605bb0c vm_map_delete(cc387ae0,1000,bfc00000,b2f,cc363300,...) at vm_map_delete+0x18b/frame 0xf605bb84 vm_map_remove(cc387ae0,1000,bfc00000,cc387b90,cc37a5d0,...) at vm_map_remove+0x8b/frame 0xf605bba8 vmspace_exit(cc363300,0,c10806dc,140,f605bc40,...) at vmspace_exit+0xe1/frame 0xf605bbd0 exit1(cc363300,100,f605bcfc,c0eac9cd,cc363300,...) at exit1+0x644/frame 0xf605bc30 sys_sys_exit(cc363300,f605bcc8,c0eb32b0,c7200c90,0,...) at sys_sys_exit+0x1d/frame 0xf605bc40 syscall(f605bd08) at syscall+0x2ed/frame 0xf605bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf605bcfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x2816c7f3, esp = 0xbfbfd758, ebp = 0xbfbfd768 --- Tracing command find pid 87084 tid 100276 td 0xcc3bdc00 sched_switch(cc3bdc00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf5fc09bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf5fc09f0 turnstile_wait(c98d9b80,cc60f000,0,cbf2b880,f5fc0aa8,...) at turnstile_wait+0x3b4/frame 0xf5fc0a20 __mtx_lock_sleep(c1403410,cc3bdc00,c10c4288,c10c4288,782,...) at __mtx_lock_sleep+0x28e/frame 0xf5fc0a8c __mtx_lock_flags(c1403410,0,c10c4288,782,c521a240,...) at __mtx_lock_flags+0xfd/frame 0xf5fc0ac0 vm_page_free_toq(c521a240,0,c10c3bc5,777,cc156138,...) at vm_page_free_toq+0x14b/frame 0xf5fc0adc vm_object_page_remove(cc156128,257,0,a57,0,...) at vm_object_page_remove+0x266/frame 0xf5fc0b0c vm_map_delete(c811d0e8,1000,bfc00000,b2f,cc3bdc00,...) at vm_map_delete+0x18b/frame 0xf5fc0b84 vm_map_remove(c811d0e8,1000,bfc00000,c811d198,cc3b3000,...) at vm_map_remove+0x8b/frame 0xf5fc0ba8 vmspace_exit(cc3bdc00,0,c10806dc,140,cc3bdc00,...) at vmspace_exit+0xe1/frame 0xf5fc0bd0 exit1(cc3bdc00,100,f5fc0cfc,c0eac9cd,cc3bdc00,...) at exit1+0x644/frame 0xf5fc0c30 sys_sys_exit(cc3bdc00,f5fc0cc8,c0eb32b0,c1825c90,0,...) at sys_sys_exit+0x1d/frame 0xf5fc0c40 syscall(f5fc0d08) at syscall+0x2ed/frame 0xf5fc0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5fc0cfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x2812a7f3, esp = 0xbfbfd7a4, ebp = 0xbfbfd7b4 --- Tracing command find pid 87083 tid 101458 td 0xce111c00 kdb_enter(c1086de3,c1086de3,c10988b6,f61d178c,c10988b6,...) at kdb_enter+0x3d/frame 0xf61d1720 vpanic(c12320f2,100,c10988b6,f61d178c,f61d178c,...) at vpanic+0x143/frame 0xf61d175c kassert_panic(c10988b6,cf1e7708,ca8eb410,af7,1,...) at kassert_panic+0xea/frame 0xf61d1780 vgonel(cf1e77b8,0,c109780f,a88,10,...) at vgonel+0x79d/frame 0xf61d17e4 insmntque_stddtr(cf1e7708,0,c109780f,48b,cf1e77b8,...) at insmntque_stddtr+0x46/frame 0xf61d1804 insmntque1(cf1e7708,c80d35d8,c0b29f10,0) at insmntque1+0x233/frame 0xf61d1830 insmntque(cf1e7708,c80d35d8,213,212,0,...) at insmntque+0x28/frame 0xf61d1848 tmpfs_alloc_vp(c80d35d8,cf1c9088,80000,f61d1b50,f61d18ec,...) at tmpfs_alloc_vp+0x3a8/frame 0xf61d18a8 tmpfs_lookup(f61d1950,c10e53fc,c0b1b138,cf23f19c,f61d1948,...) at tmpfs_lookup+0x5dd/frame 0xf61d1900 VOP_CACHEDLOOKUP_APV(ca8ec9a4,f61d1950,f61d1b64,0,0,...) at VOP_CACHEDLOOKUP_APV+0x124/frame 0xf61d1930 vfs_cache_lookup(f61d19e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xf0/frame 0xf61d1978 VOP_LOOKUP_APV(ca8ec9a4,f61d19e8,f61d1b64,205,f61d19f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf61d19a8 lookup(f61d1b18,c1096c53,107,ce,200,...) at lookup+0x528/frame 0xf61d1a10 namei(f61d1b18,ffffffdf,c7d0d480,0,ce111c00,...) at namei+0x47d/frame 0xf61d1a98 kern_statat_vnhook(ce111c00,200,ffffff9c,2888e5d8,0,...) at kern_statat_vnhook+0xc2/frame 0xf61d1ba8 sys_lstat(ce111c00,f61d1cc8,14,c10893dd,7b3,...) at sys_lstat+0x59/frame 0xf61d1c40 syscall(f61d1d08) at syscall+0x2ed/frame 0xf61d1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61d1cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd664, ebp = 0xbfbfd6f0 --- Tracing command find pid 87082 tid 101498 td 0xca42c600 sched_switch(ca42c600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62ae604 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf62ae638 sleepq_switch(ca42c600,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf62ae66c sleepq_wait(cd286e44,60,c1076516,4,1,...) at sleepq_wait+0x48/frame 0xf62ae690 sleeplk(cd286eb0,c1076516,60,33,1,...) at sleeplk+0x126/frame 0xf62ae6d8 __lockmgr_args(cd286e44,200100,cd286eb0,0,0,...) at __lockmgr_args+0x60b/frame 0xf62ae7b8 ffs_lock(f62ae840,f62ae810,c0b1b138,c7d4d73c,f62ae840,...) at ffs_lock+0xad/frame 0xf62ae7f8 VOP_LOCK1_APV(c11e446c,f62ae840,0,f62ae8b4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf62ae828 _vn_lock(cd286e10,200100,c109780f,877,2a1,...) at _vn_lock+0xca/frame 0xf62ae868 vget(cd286e10,200100,ca42c600,29d,c11f6178,...) at vget+0x77/frame 0xf62ae8a0 cache_lookup(c7d4d708,f62aebb8,f62aebcc,0,0,...) at cache_lookup+0x5a8/frame 0xf62ae900 vfs_cache_lookup(f62ae9b8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xbc/frame 0xf62ae948 VOP_LOOKUP_APV(c11e446c,f62ae9b8,f62aebcc,205,f62ae9c0,...) at VOP_LOOKUP_APV+0x124/frame 0xf62ae978 lookup(f62aeb80,c1096c53,107,ce,c109491c,...) at lookup+0x528/frame 0xf62ae9e0 namei(f62aeb80,c11b8190,c10968bb,c8750b74,c8750b74,...) at namei+0x47d/frame 0xf62aea68 vn_open_cred(f62aeb80,f62aebfc,40,0,c7d0d480,c89fe690) at vn_open_cred+0x24d/frame 0xf62aeb38 vn_open(f62aeb80,f62aebfc,40,c89fe690,c8750bf0,...) at vn_open+0x3b/frame 0xf62aeb58 kern_openat(ca42c600,ffffff9c,2887b100,0,120004,28804240) at kern_openat+0x1ec/frame 0xf62aec20 sys_open(ca42c600,f62aecc8,14,c10893dd,7b3,...) at sys_open+0x38/frame 0xf62aec40 syscall(f62aed08) at syscall+0x2ed/frame 0xf62aecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62aecfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28186137, esp = 0xbfbfd6d8, ebp = 0xbfbfd6f0 --- Tracing command find pid 87073 tid 100769 td 0xc8983900 sched_switch(c8983900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf652e634 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf652e668 sleepq_switch(c8983900,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf652e69c sleepq_wait(cd286e44,60,c1076516,4,1,...) at sleepq_wait+0x48/frame 0xf652e6c0 sleeplk(cd286eb0,c1076516,60,33,1,...) at sleeplk+0x126/frame 0xf652e708 __lockmgr_args(cd286e44,200100,cd286eb0,0,0,...) at __lockmgr_args+0x60b/frame 0xf652e7e8 ffs_lock(f652e870,f652e840,c0b1b138,c7d4d73c,f652e870,...) at ffs_lock+0xad/frame 0xf652e828 VOP_LOCK1_APV(c11e446c,f652e870,0,f652e8e4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf652e858 _vn_lock(cd286e10,200100,c109780f,877,2a1,...) at _vn_lock+0xca/frame 0xf652e898 vget(cd286e10,200100,c8983900,29d,c11f6178,...) at vget+0x77/frame 0xf652e8d0 cache_lookup(c7d4d708,f652eb50,f652eb64,0,0,...) at cache_lookup+0x5a8/frame 0xf652e930 vfs_cache_lookup(f652e9e8,c10e539b,c10b9ead,c1096c53,c11f6178,...) at vfs_cache_lookup+0xbc/frame 0xf652e978 VOP_LOOKUP_APV(c11e446c,f652e9e8,f652eb64,205,f652e9f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf652e9a8 lookup(f652eb18,c1096c53,107,ce,cbc097b8,...) at lookup+0x528/frame 0xf652ea10 namei(f652eb18,ffffffdf,c7d0d480,0,c8983900,...) at namei+0x47d/frame 0xf652ea98 kern_statat_vnhook(c8983900,200,ffffff9c,288042f8,0,...) at kern_statat_vnhook+0xc2/frame 0xf652eba8 sys_lstat(c8983900,f652ecc8,c0eb32b0,c71fac90,0,...) at sys_lstat+0x59/frame 0xf652ec40 syscall(f652ed08) at syscall+0x2ed/frame 0xf652ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf652ecfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817ce87, esp = 0xbfbfd6c4, ebp = 0xbfbfd74c --- Tracing command sleep pid 85781 tid 100607 td 0xc8ed9300 sched_switch(c8ed9300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf65eba64 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf65eba98 sleepq_switch(c8ed9300,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf65ebacc sleepq_catch_signals(c0acb130,c8ed9300,2,201,2,...) at sleepq_catch_signals+0x361/frame 0xf65ebb14 sleepq_timedwait_sig(c123348a,6c,f9cb,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf65ebb3c _sleep(c123348a,0,16c,c10884ca,cf22a1e5,...) at _sleep+0x331/frame 0xf65ebb98 kern_nanosleep(bfbfdce0,f65ebc18,f65ebc20,2,a,...) at kern_nanosleep+0x158/frame 0xf65ebc00 sys_nanosleep(c8ed9300,f65ebcc8,14,c10893dd,7b3,...) at sys_nanosleep+0x6b/frame 0xf65ebc40 syscall(f65ebd08) at syscall+0x2ed/frame 0xf65ebcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf65ebcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164173, esp = 0xbfbfdcac, ebp = 0xbfbfdcf4 --- Tracing command sh pid 40715 tid 101446 td 0xc88c4600 sched_switch(c88c4600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf619e98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf619e9c0 sleepq_switch(c88c4600,0,c108cb51,1ab,f619ea38,...) at sleepq_switch+0x1b9/frame 0xf619e9f4 sleepq_catch_signals(0,c108cb51,162,1770,c88c4600,...) at sleepq_catch_signals+0x361/frame 0xf619ea3c sleepq_wait_sig(cdfd12e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf619ea60 _sleep(cdfd12e8,cdfd137c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf619eabc kern_wait6(c88c4600,7,0,0,f619eb4c,...) at kern_wait6+0x45c/frame 0xf619eb20 sys_wait4(c88c4600,f619ecc8,c0eb32b0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf619ec40 syscall(f619ed08) at syscall+0x2ed/frame 0xf619ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf619ecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40714 tid 100651 td 0xca2c2300 sched_switch(ca2c2300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf648f98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf648f9c0 sleepq_switch(ca2c2300,0,c108cb51,1ab,f648fa38,...) at sleepq_switch+0x1b9/frame 0xf648f9f4 sleepq_catch_signals(0,c108cb51,162,e70,ca2c2300,...) at sleepq_catch_signals+0x361/frame 0xf648fa3c sleepq_wait_sig(cd6272e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf648fa60 _sleep(cd6272e8,cd62737c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf648fabc kern_wait6(ca2c2300,7,0,0,f648fb4c,...) at kern_wait6+0x45c/frame 0xf648fb20 sys_wait4(ca2c2300,f648fcc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf648fc40 syscall(f648fd08) at syscall+0x2ed/frame 0xf648fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf648fcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40713 tid 100309 td 0xcc3ed000 sched_switch(cc3ed000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf604098c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf60409c0 sleepq_switch(cc3ed000,0,c108cb51,1ab,f6040a38,...) at sleepq_switch+0x1b9/frame 0xf60409f4 sleepq_catch_signals(0,c108cb51,162,570,cc3ed000,...) at sleepq_catch_signals+0x361/frame 0xf6040a3c sleepq_wait_sig(cc42d2e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6040a60 _sleep(cc42d2e8,cc42d37c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6040abc kern_wait6(cc3ed000,7,0,0,f6040b4c,...) at kern_wait6+0x45c/frame 0xf6040b20 sys_wait4(cc3ed000,f6040cc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf6040c40 syscall(f6040d08) at syscall+0x2ed/frame 0xf6040cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6040cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40712 tid 100351 td 0xcc397c00 sched_switch(cc397c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf60db98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf60db9c0 sleepq_switch(cc397c00,0,c108cb51,1ab,f60dba38,...) at sleepq_switch+0x1b9/frame 0xf60db9f4 sleepq_catch_signals(0,c108cb51,162,d80,cc397c00,...) at sleepq_catch_signals+0x361/frame 0xf60dba3c sleepq_wait_sig(cbdb28b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf60dba60 _sleep(cbdb28b8,cbdb294c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf60dbabc kern_wait6(cc397c00,7,0,0,f60dbb4c,...) at kern_wait6+0x45c/frame 0xf60dbb20 sys_wait4(cc397c00,f60dbcc8,c10dec7f,e9,7b3,...) at sys_wait4+0x94/frame 0xf60dbc40 syscall(f60dbd08) at syscall+0x2ed/frame 0xf60dbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf60dbcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd508, ebp = 0xbfbfd520 --- Tracing command sh pid 40711 tid 101064 td 0xc8c95000 sched_switch(c8c95000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67fe98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf67fe9c0 sleepq_switch(c8c95000,0,c108cb51,1ab,f67fea38,...) at sleepq_switch+0x1b9/frame 0xf67fe9f4 sleepq_catch_signals(0,c108cb51,162,108,c8c95000,...) at sleepq_catch_signals+0x361/frame 0xf67fea3c sleepq_wait_sig(c9dbaba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf67fea60 _sleep(c9dbaba0,c9dbac34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf67feabc kern_wait6(c8c95000,7,0,0,f67feb4c,...) at kern_wait6+0x45c/frame 0xf67feb20 sys_wait4(c8c95000,f67fecc8,c0eb32b0,c1825c90,0,...) at sys_wait4+0x94/frame 0xf67fec40 syscall(f67fed08) at syscall+0x2ed/frame 0xf67fecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67fecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40710 tid 102211 td 0xc832c000 sched_switch(c832c000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf666098c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf66609c0 sleepq_switch(c832c000,0,c108cb51,1ab,f6660a38,...) at sleepq_switch+0x1b9/frame 0xf66609f4 sleepq_catch_signals(0,c108cb51,162,15f0,c832c000,...) at sleepq_catch_signals+0x361/frame 0xf6660a3c sleepq_wait_sig(cc3b02e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6660a60 _sleep(cc3b02e8,cc3b037c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6660abc kern_wait6(c832c000,7,0,0,f6660b4c,...) at kern_wait6+0x45c/frame 0xf6660b20 sys_wait4(c832c000,f6660cc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf6660c40 syscall(f6660d08) at syscall+0x2ed/frame 0xf6660cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6660cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40709 tid 100105 td 0xc7d64c00 sched_switch(c7d64c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cec98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5cec9c0 sleepq_switch(c7d64c00,0,c108cb51,1ab,f5ceca38,...) at sleepq_switch+0x1b9/frame 0xf5cec9f4 sleepq_catch_signals(0,c108cb51,162,d08,c7d64c00,...) at sleepq_catch_signals+0x361/frame 0xf5ceca3c sleepq_wait_sig(c7c32ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5ceca60 _sleep(c7c32ba0,c7c32c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5cecabc kern_wait6(c7d64c00,7,0,0,f5cecb4c,...) at kern_wait6+0x45c/frame 0xf5cecb20 sys_wait4(c7d64c00,f5ceccc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf5cecc40 syscall(f5cecd08) at syscall+0x2ed/frame 0xf5ceccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ceccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40707 tid 100965 td 0xcc580000 sched_switch(cc580000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6788a1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf6788a50 sleepq_switch(cc580000,0,c108cb51,1ab,f6788ac8,...) at sleepq_switch+0x1b9/frame 0xf6788a84 sleepq_catch_signals(0,c108cb51,162,c00,cc580000,...) at sleepq_catch_signals+0x361/frame 0xf6788acc sleepq_wait_sig(c7db8000,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6788af0 _sleep(c7db8000,c7db8180,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf6788b4c pipe_read(cdc0b038,f6788c10,c7d0d480,0,cc580000,...) at pipe_read+0x2dc/frame 0xf6788b90 dofileread(cdc0b038,f6788c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf6788bc4 kern_readv(cc580000,3,f6788c10,f6788c30,bfbfd488,...) at kern_readv+0x66/frame 0xf6788bf0 sys_read(cc580000,f6788cc8,c10dec7f,e9,0,...) at sys_read+0x5c/frame 0xf6788c40 syscall(f6788d08) at syscall+0x2ed/frame 0xf6788cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6788cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28201fc7, esp = 0xbfbfd3f4, ebp = 0xbfbfd51c --- Tracing command sh pid 40705 tid 101043 td 0xc87e6600 sched_switch(c87e6600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67e998c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf67e99c0 sleepq_switch(c87e6600,0,c108cb51,1ab,f67e9a38,...) at sleepq_switch+0x1b9/frame 0xf67e99f4 sleepq_catch_signals(0,c108cb51,162,15f0,c87e6600,...) at sleepq_catch_signals+0x361/frame 0xf67e9a3c sleepq_wait_sig(c9dc02e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf67e9a60 _sleep(c9dc02e8,c9dc037c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf67e9abc kern_wait6(c87e6600,7,0,0,f67e9b4c,...) at kern_wait6+0x45c/frame 0xf67e9b20 sys_wait4(c87e6600,f67e9cc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf67e9c40 syscall(f67e9d08) at syscall+0x2ed/frame 0xf67e9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67e9cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40704 tid 101471 td 0xca443000 sched_switch(ca443000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf624698c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf62469c0 sleepq_switch(ca443000,0,c108cb51,1ab,f6246a38,...) at sleepq_switch+0x1b9/frame 0xf62469f4 sleepq_catch_signals(0,c108cb51,162,480,ca443000,...) at sleepq_catch_signals+0x361/frame 0xf6246a3c sleepq_wait_sig(ca283000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6246a60 _sleep(ca283000,ca283094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6246abc kern_wait6(ca443000,7,0,0,f6246b4c,...) at kern_wait6+0x45c/frame 0xf6246b20 sys_wait4(ca443000,f6246cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf6246c40 syscall(f6246d08) at syscall+0x2ed/frame 0xf6246cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6246cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40703 tid 101527 td 0xc959f600 sched_switch(c959f600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf633798c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf63379c0 sleepq_switch(c959f600,0,c108cb51,1ab,f6337a38,...) at sleepq_switch+0x1b9/frame 0xf63379f4 sleepq_catch_signals(0,c108cb51,162,c00,c959f600,...) at sleepq_catch_signals+0x361/frame 0xf6337a3c sleepq_wait_sig(c8e38000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6337a60 _sleep(c8e38000,c8e38094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6337abc kern_wait6(c959f600,7,0,0,f6337b4c,...) at kern_wait6+0x45c/frame 0xf6337b20 sys_wait4(c959f600,f6337cc8,8,c10874bc,db,...) at sys_wait4+0x94/frame 0xf6337c40 syscall(f6337d08) at syscall+0x2ed/frame 0xf6337cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6337cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40701 tid 100102 td 0xc7d68300 sched_switch(c7d68300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cd798c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5cd79c0 sleepq_switch(c7d68300,0,c108cb51,1ab,f5cd7a38,...) at sleepq_switch+0x1b9/frame 0xf5cd79f4 sleepq_catch_signals(0,c108cb51,162,1770,c7d68300,...) at sleepq_catch_signals+0x361/frame 0xf5cd7a3c sleepq_wait_sig(c7d612e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5cd7a60 _sleep(c7d612e8,c7d6137c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5cd7abc kern_wait6(c7d68300,7,0,0,f5cd7b4c,...) at kern_wait6+0x45c/frame 0xf5cd7b20 sys_wait4(c7d68300,f5cd7cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf5cd7c40 syscall(f5cd7d08) at syscall+0x2ed/frame 0xf5cd7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cd7cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40700 tid 100170 td 0xc8e88900 sched_switch(c8e88900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e1898c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5e189c0 sleepq_switch(c8e88900,0,c108cb51,1ab,f5e18a38,...) at sleepq_switch+0x1b9/frame 0xf5e189f4 sleepq_catch_signals(0,c108cb51,162,12f0,c8e88900,...) at sleepq_catch_signals+0x361/frame 0xf5e18a3c sleepq_wait_sig(c8e822e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5e18a60 _sleep(c8e822e8,c8e8237c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5e18abc kern_wait6(c8e88900,7,0,0,f5e18b4c,...) at kern_wait6+0x45c/frame 0xf5e18b20 sys_wait4(c8e88900,f5e18cc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf5e18c40 syscall(f5e18d08) at syscall+0x2ed/frame 0xf5e18cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e18cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40699 tid 100203 td 0xc84f0c00 sched_switch(c84f0c00,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf5ee28bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf5ee28f0 turnstile_wait(cd151580,cc3bdc00,0,c7576b88,8,...) at turnstile_wait+0x3b4/frame 0xf5ee2920 __mtx_lock_sleep(c1402910,c84f0c00,c10c256f,c10c256f,14c,...) at __mtx_lock_sleep+0x28e/frame 0xf5ee298c __mtx_lock_flags(c1402910,0,c10c256f,14c,f5ee2ad4,...) at __mtx_lock_flags+0xfd/frame 0xf5ee29c0 vm_fault_hold(cb0ed740,2807e000,2,0,0,...) at vm_fault_hold+0x2c1/frame 0xf5ee2b20 vm_fault(cb0ed740,2807e000,2,0,cb0ed740,...) at vm_fault+0x82/frame 0xf5ee2b48 trap_pfault(2807e4c4,f5ee2d08,c88f8828,0,c11b9ca4,...) at trap_pfault+0x1ba/frame 0xf5ee2bc0 trap(f5ee2d08) at trap+0x5da/frame 0xf5ee2cfc calltrap() at calltrap+0x6/frame 0xf5ee2cfc --- trap 0xc, eip = 0x28170ef4, esp = 0xbfbfd018, ebp = 0xbfbfd498 --- Tracing command sh pid 40698 tid 101252 td 0xce0a5900 sched_switch(ce0a5900,0,103,1b0,0,...) at sched_switch+0x4b9/frame 0xf68d08bc mi_switch(103,0,c108d778,2e6,f9c5,...) at mi_switch+0x1c9/frame 0xf68d08f0 turnstile_wait(cd151580,cc3bdc00,0,c13aefec,9,...) at turnstile_wait+0x3b4/frame 0xf68d0920 __mtx_lock_sleep(c1402910,ce0a5900,c10c256f,c10c256f,14c,...) at __mtx_lock_sleep+0x28e/frame 0xf68d098c __mtx_lock_flags(c1402910,0,c10c256f,14c,f68d0ad4,...) at __mtx_lock_flags+0xfd/frame 0xf68d09c0 vm_fault_hold(cf3b31d0,28876000,2,0,0,...) at vm_fault_hold+0x2c1/frame 0xf68d0b20 vm_fault(cf3b31d0,28876000,2,0,cf3b31d0,...) at vm_fault+0x82/frame 0xf68d0b48 trap_pfault(288760d0,0,ce0a5900,ca82b37c,c90be000,...) at trap_pfault+0x1ba/frame 0xf68d0bc0 trap(f68d0d08) at trap+0x5da/frame 0xf68d0cfc calltrap() at calltrap+0x6/frame 0xf68d0cfc --- trap 0xc, eip = 0x805569f, esp = 0xbfbfd620, ebp = 0xbfbfd640 --- Tracing command sh pid 40697 tid 100766 td 0xce0c3900 sched_switch(ce0c3900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf61a498c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf61a49c0 sleepq_switch(ce0c3900,0,c108cb51,1ab,f61a4a38,...) at sleepq_switch+0x1b9/frame 0xf61a49f4 sleepq_catch_signals(0,c108cb51,162,288,ce0c3900,...) at sleepq_catch_signals+0x361/frame 0xf61a4a3c sleepq_wait_sig(cc57bba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf61a4a60 _sleep(cc57bba0,cc57bc34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf61a4abc kern_wait6(ce0c3900,7,0,0,f61a4b4c,...) at kern_wait6+0x45c/frame 0xf61a4b20 sys_wait4(ce0c3900,f61a4cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf61a4c40 syscall(f61a4d08) at syscall+0x2ed/frame 0xf61a4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61a4cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40696 tid 100660 td 0xca2b7900 sched_switch(ca2b7900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf649898c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf64989c0 sleepq_switch(ca2b7900,0,c108cb51,1ab,f6498a38,...) at sleepq_switch+0x1b9/frame 0xf64989f4 sleepq_catch_signals(0,c108cb51,162,1380,ca2b7900,...) at sleepq_catch_signals+0x361/frame 0xf6498a3c sleepq_wait_sig(cd6268b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6498a60 _sleep(cd6268b8,cd62694c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6498abc kern_wait6(ca2b7900,7,0,0,f6498b4c,...) at kern_wait6+0x45c/frame 0xf6498b20 sys_wait4(ca2b7900,f6498cc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf6498c40 syscall(f6498d08) at syscall+0x2ed/frame 0xf6498cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6498cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40695 tid 101453 td 0xcbf2cc00 sched_switch(cbf2cc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf61c298c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf61c29c0 sleepq_switch(cbf2cc00,0,c108cb51,1ab,f61c2a38,...) at sleepq_switch+0x1b9/frame 0xf61c29f4 sleepq_catch_signals(0,c108cb51,162,888,cbf2cc00,...) at sleepq_catch_signals+0x361/frame 0xf61c2a3c sleepq_wait_sig(cdfcfba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf61c2a60 _sleep(cdfcfba0,cdfcfc34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf61c2abc kern_wait6(cbf2cc00,7,0,0,f61c2b4c,...) at kern_wait6+0x45c/frame 0xf61c2b20 sys_wait4(cbf2cc00,f61c2cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf61c2c40 syscall(f61c2d08) at syscall+0x2ed/frame 0xf61c2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61c2cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd508, ebp = 0xbfbfd520 --- Tracing command sh pid 40686 tid 100734 td 0xc8482900 sched_switch(c8482900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf652298c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf65229c0 sleepq_switch(c8482900,0,c108cb51,1ab,f6522a38,...) at sleepq_switch+0x1b9/frame 0xf65229f4 sleepq_catch_signals(0,c108cb51,162,3f0,c8482900,...) at sleepq_catch_signals+0x361/frame 0xf6522a3c sleepq_wait_sig(cd61c2e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6522a60 _sleep(cd61c2e8,cd61c37c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6522abc kern_wait6(c8482900,7,0,0,f6522b4c,...) at kern_wait6+0x45c/frame 0xf6522b20 sys_wait4(c8482900,f6522cc8,c0eb32b0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf6522c40 syscall(f6522d08) at syscall+0x2ed/frame 0xf6522cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6522cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40685 tid 100440 td 0xcc136000 sched_switch(cc136000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf63ca98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf63ca9c0 sleepq_switch(cc136000,0,c108cb51,1ab,f63caa38,...) at sleepq_switch+0x1b9/frame 0xf63ca9f4 sleepq_catch_signals(0,c108cb51,162,480,cc136000,...) at sleepq_catch_signals+0x361/frame 0xf63caa3c sleepq_wait_sig(cc7888b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf63caa60 _sleep(cc7888b8,cc78894c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf63caabc kern_wait6(cc136000,7,0,0,f63cab4c,...) at kern_wait6+0x45c/frame 0xf63cab20 sys_wait4(cc136000,f63cacc8,c10dec7f,e9,7b3,...) at sys_wait4+0x94/frame 0xf63cac40 syscall(f63cad08) at syscall+0x2ed/frame 0xf63cacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf63cacfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40684 tid 100681 td 0xcc6adc00 sched_switch(cc6adc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf610298c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf61029c0 sleepq_switch(cc6adc00,0,c108cb51,1ab,f6102a38,...) at sleepq_switch+0x1b9/frame 0xf61029f4 sleepq_catch_signals(0,c108cb51,162,600,cc6adc00,...) at sleepq_catch_signals+0x361/frame 0xf6102a3c sleepq_wait_sig(cac1f8b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6102a60 _sleep(cac1f8b8,cac1f94c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6102abc kern_wait6(cc6adc00,7,0,0,f6102b4c,...) at kern_wait6+0x45c/frame 0xf6102b20 sys_wait4(cc6adc00,f6102cc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf6102c40 syscall(f6102d08) at syscall+0x2ed/frame 0xf6102cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6102cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40683 tid 100865 td 0xcbc0f900 sched_switch(cbc0f900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67ad98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf67ad9c0 sleepq_switch(cbc0f900,0,c108cb51,1ab,f67ada38,...) at sleepq_switch+0x1b9/frame 0xf67ad9f4 sleepq_catch_signals(0,c108cb51,162,a80,cbc0f900,...) at sleepq_catch_signals+0x361/frame 0xf67ada3c sleepq_wait_sig(c92fc8b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf67ada60 _sleep(c92fc8b8,c92fc94c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf67adabc kern_wait6(cbc0f900,7,0,0,f67adb4c,...) at kern_wait6+0x45c/frame 0xf67adb20 sys_wait4(cbc0f900,f67adcc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf67adc40 syscall(f67add08) at syscall+0x2ed/frame 0xf67adcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67adcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40682 tid 100816 td 0xcc85e300 sched_switch(cc85e300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf650198c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf65019c0 sleepq_switch(cc85e300,0,c108cb51,1ab,f6501a38,...) at sleepq_switch+0x1b9/frame 0xf65019f4 sleepq_catch_signals(0,c108cb51,162,1500,cc85e300,...) at sleepq_catch_signals+0x361/frame 0xf6501a3c sleepq_wait_sig(cd61e000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6501a60 _sleep(cd61e000,cd61e094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6501abc kern_wait6(cc85e300,7,0,0,f6501b4c,...) at kern_wait6+0x45c/frame 0xf6501b20 sys_wait4(cc85e300,f6501cc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf6501c40 syscall(f6501d08) at syscall+0x2ed/frame 0xf6501cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6501cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40681 tid 101499 td 0xca42c300 sched_switch(ca42c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62b1b70 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf62b1ba4 sleepq_switch(ca42c300,0,c108cb51,26b,ca42c300,...) at sleepq_switch+0x1b9/frame 0xf62b1bd8 sleepq_wait(c9d96b74,0,f62b1c2c,1,0,...) at sleepq_wait+0x48/frame 0xf62b1bfc _cv_wait(c9d96b74,c9d9694c,c10dec7f,e6,7b3,...) at _cv_wait+0x1f9/frame 0xf62b1c40 syscall(f62b1d08) at syscall+0x69c/frame 0xf62b1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62b1cfc --- syscall (87150), eip = 0x2813c354, esp = 0xbfbfd580, ebp = 0xbfbfd5d8 --- Tracing command sh pid 40680 tid 101050 td 0xc9036900 sched_switch(c9036900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67ef98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf67ef9c0 sleepq_switch(c9036900,0,c108cb51,1ab,f67efa38,...) at sleepq_switch+0x1b9/frame 0xf67ef9f4 sleepq_catch_signals(0,c108cb51,162,708,c9036900,...) at sleepq_catch_signals+0x361/frame 0xf67efa3c sleepq_wait_sig(c9dbeba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf67efa60 _sleep(c9dbeba0,c9dbec34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf67efabc kern_wait6(c9036900,7,0,0,f67efb4c,...) at kern_wait6+0x45c/frame 0xf67efb20 sys_wait4(c9036900,f67efcc8,f67efc8c,c0a58de0,c123f690,...) at sys_wait4+0x94/frame 0xf67efc40 syscall(f67efd08) at syscall+0x2ed/frame 0xf67efcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67efcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40679 tid 100992 td 0xc8fb0c00 sched_switch(c8fb0c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67ce98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf67ce9c0 sleepq_switch(c8fb0c00,0,c108cb51,1ab,f67cea38,...) at sleepq_switch+0x1b9/frame 0xf67ce9f4 sleepq_catch_signals(0,c108cb51,162,6f0,c8fb0c00,...) at sleepq_catch_signals+0x361/frame 0xf67cea3c sleepq_wait_sig(cd83a2e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf67cea60 _sleep(cd83a2e8,cd83a37c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf67ceabc kern_wait6(c8fb0c00,7,0,0,f67ceb4c,...) at kern_wait6+0x45c/frame 0xf67ceb20 sys_wait4(c8fb0c00,f67cecc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf67cec40 syscall(f67ced08) at syscall+0x2ed/frame 0xf67cecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67cecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40678 tid 101484 td 0xc95a2000 sched_switch(c95a2000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf628498c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf62849c0 sleepq_switch(c95a2000,0,c108cb51,1ab,f6284a38,...) at sleepq_switch+0x1b9/frame 0xf62849f4 sleepq_catch_signals(0,c108cb51,162,1200,c95a2000,...) at sleepq_catch_signals+0x361/frame 0xf6284a3c sleepq_wait_sig(ca2878b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6284a60 _sleep(ca2878b8,ca28794c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6284abc kern_wait6(c95a2000,7,0,0,f6284b4c,...) at kern_wait6+0x45c/frame 0xf6284b20 sys_wait4(c95a2000,f6284cc8,7b3,2,f6284cc4,...) at sys_wait4+0x94/frame 0xf6284c40 syscall(f6284d08) at syscall+0x2ed/frame 0xf6284cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6284cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40677 tid 101214 td 0xc8dcb900 sched_switch(c8dcb900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf68a798c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf68a79c0 sleepq_switch(c8dcb900,0,c108cb51,1ab,f68a7a38,...) at sleepq_switch+0x1b9/frame 0xf68a79f4 sleepq_catch_signals(0,c108cb51,162,df8,c8dcb900,...) at sleepq_catch_signals+0x361/frame 0xf68a7a3c sleepq_wait_sig(c9d945d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf68a7a60 _sleep(c9d945d0,c9d94664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf68a7abc kern_wait6(c8dcb900,7,0,0,f68a7b4c,...) at kern_wait6+0x45c/frame 0xf68a7b20 sys_wait4(c8dcb900,f68a7cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf68a7c40 syscall(f68a7d08) at syscall+0x2ed/frame 0xf68a7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf68a7cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd600, ebp = 0xbfbfd618 --- Tracing command sh pid 40676 tid 100563 td 0xcc505c00 sched_switch(cc505c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf69e598c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf69e59c0 sleepq_switch(cc505c00,0,c108cb51,1ab,f69e5a38,...) at sleepq_switch+0x1b9/frame 0xf69e59f4 sleepq_catch_signals(0,c108cb51,162,408,cc505c00,...) at sleepq_catch_signals+0x361/frame 0xf69e5a3c sleepq_wait_sig(c8e38ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf69e5a60 _sleep(c8e38ba0,c8e38c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf69e5abc kern_wait6(cc505c00,7,0,0,f69e5b4c,...) at kern_wait6+0x45c/frame 0xf69e5b20 sys_wait4(cc505c00,f69e5cc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf69e5c40 syscall(f69e5d08) at syscall+0x2ed/frame 0xf69e5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf69e5cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 40675 tid 101473 td 0xca49e900 sched_switch(ca49e900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf626398c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf62639c0 sleepq_switch(ca49e900,0,c108cb51,1ab,f6263a38,...) at sleepq_switch+0x1b9/frame 0xf62639f4 sleepq_catch_signals(0,c108cb51,162,588,ca49e900,...) at sleepq_catch_signals+0x361/frame 0xf6263a3c sleepq_wait_sig(c8c79ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6263a60 _sleep(c8c79ba0,c8c79c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6263abc kern_wait6(ca49e900,7,0,0,f6263b4c,...) at kern_wait6+0x45c/frame 0xf6263b20 sys_wait4(ca49e900,f6263cc8,c10dec7f,e9,7b3,...) at sys_wait4+0x94/frame 0xf6263c40 syscall(f6263d08) at syscall+0x2ed/frame 0xf6263cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6263cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd508, ebp = 0xbfbfd520 --- Tracing command sh pid 40621 tid 100221 td 0xca087900 sched_switch(ca087900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f1aaa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5f1aad4 sleepq_switch(ca087900,0,c108cb51,1ab,f5f1ab4c,...) at sleepq_switch+0x1b9/frame 0xf5f1ab08 sleepq_catch_signals(0,c108cb51,162,be8,ca087900,...) at sleepq_catch_signals+0x361/frame 0xf5f1ab50 sleepq_wait_sig(c9b5334c,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5f1ab74 _sleep(c9b5334c,c9b5337c,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5f1abd0 kern_sigsuspend(ca087900,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5f1ac10 sys_sigsuspend(ca087900,f5f1acc8,c10dec7f,e9,f5f1acc4,...) at sys_sigsuspend+0x58/frame 0xf5f1ac40 syscall(f5f1ad08) at syscall+0x2ed/frame 0xf5f1acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f1acfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2813a0ab, esp = 0xbfbfd724, ebp = 0xbfbfd7b4 --- Tracing command cat pid 95774 tid 101520 td 0xca404000 sched_switch(ca404000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62f0a1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf62f0a50 sleepq_switch(ca404000,0,c108cb51,1ab,f62f0ac8,...) at sleepq_switch+0x1b9/frame 0xf62f0a84 sleepq_catch_signals(0,c108cb51,162,17a0,ca404000,...) at sleepq_catch_signals+0x361/frame 0xf62f0acc sleepq_wait_sig(c90134c8,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf62f0af0 _sleep(c90134c8,c9013648,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf62f0b4c pipe_read(cda09ab8,f62f0c10,cb4b0a00,0,ca404000,...) at pipe_read+0x2dc/frame 0xf62f0b90 dofileread(cda09ab8,f62f0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf62f0bc4 kern_readv(ca404000,0,f62f0c10,cb516000,28803000,...) at kern_readv+0x66/frame 0xf62f0bf0 sys_read(ca404000,f62f0cc8,c0eb32b0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf62f0c40 syscall(f62f0d08) at syscall+0x2ed/frame 0xf62f0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62f0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28187fc7, esp = 0xbfbfdca4, ebp = 0xbfbfddb0 --- Tracing command sh pid 95758 tid 101151 td 0xcb7e2c00 sched_switch(cb7e2c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf685698c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf68569c0 sleepq_switch(cb7e2c00,0,c108cb51,1ab,f6856a38,...) at sleepq_switch+0x1b9/frame 0xf68569f4 sleepq_catch_signals(0,c108cb51,162,c78,cb7e2c00,...) at sleepq_catch_signals+0x361/frame 0xf6856a3c sleepq_wait_sig(c9da55d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6856a60 _sleep(c9da55d0,c9da5664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6856abc kern_wait6(cb7e2c00,7,0,0,f6856b4c,...) at kern_wait6+0x45c/frame 0xf6856b20 sys_wait4(cb7e2c00,f6856cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf6856c40 syscall(f6856d08) at syscall+0x2ed/frame 0xf6856cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6856cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd830, ebp = 0xbfbfd848 --- Tracing command find pid 95757 tid 100202 td 0xc8e22000 cpustop_handler(3,13,f5edf7b8,c0eab5bb,0,...) at cpustop_handler+0x2f/frame 0xf5edf668 ipi_nmi_handler(0,c8e22000,c7200cac,0,f9c5,...) at ipi_nmi_handler+0x37/frame 0xf5edf678 trap(f5edf7c4) at trap+0x3b/frame 0xf5edf7b8 calltrap() at calltrap+0x6/frame 0xf5edf7b8 --- trap 0x13, eip = 0xc0d176fa, esp = 0xf5edf804, ebp = 0xf5edf824 --- _vm_map_clip_start(e55d8000,e55d8000,f5edf88c,ad5,f5edf86c,...) at _vm_map_clip_start+0x6a/frame 0xf5edf824 vm_map_delete(c1ba21a4,e55d8000,e55dc000,b2f,e39366d0,...) at vm_map_delete+0x8a/frame 0xf5edf89c vm_map_remove(c1ba21a4,e55d8000,e55dc000,1,1,...) at vm_map_remove+0x8b/frame 0xf5edf8c0 bfreekva(c13aa1b0,0,c109491c,911,0,...) at bfreekva+0xc3/frame 0xf5edf8dc getnewbuf(0,4000,8,c7c,c0b1b138,...) at getnewbuf+0xcb/frame 0xf5edf940 getblk(c8447ca8,0,0,800,0,...) at getblk+0x749/frame 0xf5edf9b0 breadn_flags(c8447ca8,0,0,800,0,...) at breadn_flags+0x40/frame 0xf5edf9e0 ffs_read(f5edfb20,c10e5771,c7d45b00,60,f5edfad4,...) at ffs_read+0x3aa/frame 0xf5edfa90 VOP_READ_APV(c11e446c,f5edfb20,c11f6178,c8447ca8,c8447d48,...) at VOP_READ_APV+0x124/frame 0xf5edfac0 ufs_readdir(f5edfbe0,c10e5b52,c10b9f50,c1098f28,fde,...) at ufs_readdir+0xa1/frame 0xf5edfb48 VOP_READDIR_APV(c11e446c,f5edfbe0,c1098f28,fde,f5edfbdc,...) at VOP_READDIR_APV+0x124/frame 0xf5edfb78 kern_getdirentries(c8e22000,5,28850000,1000,f5edfc34,...) at kern_getdirentries+0x1a2/frame 0xf5edfc10 sys_getdirentries(c8e22000,f5edfcc8,7b3,2,f5edfcc4,...) at sys_getdirentries+0x41/frame 0xf5edfc40 syscall(f5edfd08) at syscall+0x2ed/frame 0xf5edfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5edfcfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280e0d1b, esp = 0xbfbfdbb4, ebp = 0xbfbfdbe4 --- Tracing command sh pid 95744 tid 101525 td 0xca3f9000 sched_switch(ca3f9000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62ff98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf62ff9c0 sleepq_switch(ca3f9000,0,c108cb51,1ab,f62ffa38,...) at sleepq_switch+0x1b9/frame 0xf62ff9f4 sleepq_catch_signals(0,c108cb51,162,e70,ca3f9000,...) at sleepq_catch_signals+0x361/frame 0xf62ffa3c sleepq_wait_sig(c81372e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf62ffa60 _sleep(c81372e8,c813737c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf62ffabc kern_wait6(ca3f9000,7,0,0,f62ffb4c,...) at kern_wait6+0x45c/frame 0xf62ffb20 sys_wait4(ca3f9000,f62ffcc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf62ffc40 syscall(f62ffd08) at syscall+0x2ed/frame 0xf62ffcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62ffcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdb88, ebp = 0xbfbfdba0 --- Tracing command mail pid 95711 tid 100267 td 0xcc3a9300 sched_switch(cc3a9300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5fa5a1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5fa5a50 sleepq_switch(cc3a9300,0,c108cb51,1ab,f5fa5ac8,...) at sleepq_switch+0x1b9/frame 0xf5fa5a84 sleepq_catch_signals(0,c108cb51,162,7c8,cc3a9300,...) at sleepq_catch_signals+0x361/frame 0xf5fa5acc sleepq_wait_sig(c8d66330,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5fa5af0 _sleep(c8d66330,c8d664b0,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf5fa5b4c pipe_read(c8d95070,f5fa5c10,cb4b0a00,0,cc3a9300,...) at pipe_read+0x2dc/frame 0xf5fa5b90 dofileread(c8d95070,f5fa5c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5fa5bc4 kern_readv(cc3a9300,0,f5fa5c10,0,28808000,...) at kern_readv+0x66/frame 0xf5fa5bf0 sys_read(cc3a9300,f5fa5cc8,c0eb32b0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5fa5c40 syscall(f5fa5d08) at syscall+0x2ed/frame 0xf5fa5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5fa5cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28198fc7, esp = 0xbfbfcfc4, ebp = 0xbfbfcfd8 --- Tracing command sh pid 95710 tid 100245 td 0xcb836300 sched_switch(cb836300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f6398c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5f639c0 sleepq_switch(cb836300,0,c108cb51,1ab,f5f63a38,...) at sleepq_switch+0x1b9/frame 0xf5f639f4 sleepq_catch_signals(0,c108cb51,162,600,cb836300,...) at sleepq_catch_signals+0x361/frame 0xf5f63a3c sleepq_wait_sig(cb82f8b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5f63a60 _sleep(cb82f8b8,cb82f94c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5f63abc kern_wait6(cb836300,7,0,0,f5f63b4c,...) at kern_wait6+0x45c/frame 0xf5f63b20 sys_wait4(cb836300,f5f63cc8,c0eb32b0,c71fdc90,0,...) at sys_wait4+0x94/frame 0xf5f63c40 syscall(f5f63d08) at syscall+0x2ed/frame 0xf5f63cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f63cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd8b0, ebp = 0xbfbfd8c8 --- Tracing command sh pid 95585 tid 100401 td 0xc9bb2900 sched_switch(c9bb2900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf64f598c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf64f59c0 sleepq_switch(c9bb2900,0,c108cb51,1ab,f64f5a38,...) at sleepq_switch+0x1b9/frame 0xf64f59f4 sleepq_catch_signals(0,c108cb51,162,1f8,c9bb2900,...) at sleepq_catch_signals+0x361/frame 0xf64f5a3c sleepq_wait_sig(cc42c5d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf64f5a60 _sleep(cc42c5d0,cc42c664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf64f5abc kern_wait6(c9bb2900,7,0,0,f64f5b4c,...) at kern_wait6+0x45c/frame 0xf64f5b20 sys_wait4(c9bb2900,f64f5cc8,c10dec7f,e9,7b3,...) at sys_wait4+0x94/frame 0xf64f5c40 syscall(f64f5d08) at syscall+0x2ed/frame 0xf64f5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf64f5cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdc00, ebp = 0xbfbfdc18 --- Tracing command lockf pid 95418 tid 100207 td 0xcc3c4600 sched_switch(cc3c4600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5eee98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5eee9c0 sleepq_switch(cc3c4600,0,c108cb51,1ab,f5eeea38,...) at sleepq_switch+0x1b9/frame 0xf5eee9f4 sleepq_catch_signals(0,c108cb51,162,1f8,cc3c4600,...) at sleepq_catch_signals+0x361/frame 0xf5eeea3c sleepq_wait_sig(cd62c5d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5eeea60 _sleep(cd62c5d0,cd62c664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5eeeabc kern_wait6(cc3c4600,0,17561,0,f5eeeb4c,...) at kern_wait6+0x45c/frame 0xf5eeeb20 sys_wait4(cc3c4600,f5eeecc8,c10dec7f,d6,7b3,...) at sys_wait4+0x94/frame 0xf5eeec40 syscall(f5eeed08) at syscall+0x2ed/frame 0xf5eeecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5eeecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280d84b3, esp = 0xbfbfdd18, ebp = 0xbfbfdd30 --- Tracing command sh pid 95371 tid 103846 td 0xc9bff000 sched_switch(c9bff000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf7fd198c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf7fd19c0 sleepq_switch(c9bff000,0,c108cb51,1ab,f7fd1a38,...) at sleepq_switch+0x1b9/frame 0xf7fd19f4 sleepq_catch_signals(0,c108cb51,162,1680,c9bff000,...) at sleepq_catch_signals+0x361/frame 0xf7fd1a3c sleepq_wait_sig(cbdaf000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf7fd1a60 _sleep(cbdaf000,cbdaf094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf7fd1abc kern_wait6(c9bff000,7,0,0,f7fd1b4c,...) at kern_wait6+0x45c/frame 0xf7fd1b20 sys_wait4(c9bff000,f7fd1cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf7fd1c40 syscall(f7fd1d08) at syscall+0x2ed/frame 0xf7fd1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf7fd1cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sh pid 95339 tid 101383 td 0xcba6a300 sched_switch(cba6a300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf66d598c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf66d59c0 sleepq_switch(cba6a300,0,c108cb51,1ab,f66d5a38,...) at sleepq_switch+0x1b9/frame 0xf66d59f4 sleepq_catch_signals(0,c108cb51,162,0,cba6a300,...) at sleepq_catch_signals+0x361/frame 0xf66d5a3c sleepq_wait_sig(c8abb8b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf66d5a60 _sleep(c8abb8b8,c8abb94c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf66d5abc kern_wait6(cba6a300,7,0,0,f66d5b4c,...) at kern_wait6+0x45c/frame 0xf66d5b20 sys_wait4(cba6a300,f66d5cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf66d5c40 syscall(f66d5d08) at syscall+0x2ed/frame 0xf66d5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf66d5cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdab0, ebp = 0xbfbfdac8 --- Tracing command mail pid 89255 tid 100256 td 0xcc3ad600 sched_switch(cc3ad600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f84a1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5f84a50 sleepq_switch(cc3ad600,0,c108cb51,1ab,f5f84ac8,...) at sleepq_switch+0x1b9/frame 0xf5f84a84 sleepq_catch_signals(0,c108cb51,162,3d8,cc3ad600,...) at sleepq_catch_signals+0x361/frame 0xf5f84acc sleepq_wait_sig(c9e0b990,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5f84af0 _sleep(c9e0b990,c9e0bb10,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf5f84b4c pipe_read(cdbffe00,f5f84c10,cb4b0a00,0,cc3ad600,...) at pipe_read+0x2dc/frame 0xf5f84b90 dofileread(cdbffe00,f5f84c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5f84bc4 kern_readv(cc3ad600,0,f5f84c10,0,28808000,...) at kern_readv+0x66/frame 0xf5f84bf0 sys_read(cc3ad600,f5f84cc8,c0eb32b0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5f84c40 syscall(f5f84d08) at syscall+0x2ed/frame 0xf5f84cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f84cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28198fc7, esp = 0xbfbfcfe4, ebp = 0xbfbfcff8 --- Tracing command sh pid 89254 tid 100635 td 0xcc9be000 sched_switch(cc9be000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf647798c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf64779c0 sleepq_switch(cc9be000,0,c108cb51,1ab,f6477a38,...) at sleepq_switch+0x1b9/frame 0xf64779f4 sleepq_catch_signals(0,c108cb51,162,3f0,cc9be000,...) at sleepq_catch_signals+0x361/frame 0xf6477a3c sleepq_wait_sig(cd62c2e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6477a60 _sleep(cd62c2e8,cd62c37c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6477abc kern_wait6(cc9be000,7,0,0,f6477b4c,...) at kern_wait6+0x45c/frame 0xf6477b20 sys_wait4(cc9be000,f6477cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf6477c40 syscall(f6477d08) at syscall+0x2ed/frame 0xf6477cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6477cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd8d0, ebp = 0xbfbfd8e8 --- Tracing command sh pid 89247 tid 100806 td 0xcba18600 sched_switch(cba18600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf66c698c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf66c69c0 sleepq_switch(cba18600,0,c108cb51,1ab,f66c6a38,...) at sleepq_switch+0x1b9/frame 0xf66c69f4 sleepq_catch_signals(0,c108cb51,162,408,cba18600,...) at sleepq_catch_signals+0x361/frame 0xf66c6a3c sleepq_wait_sig(cb148ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf66c6a60 _sleep(cb148ba0,cb148c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf66c6abc kern_wait6(cba18600,7,0,0,f66c6b4c,...) at kern_wait6+0x45c/frame 0xf66c6b20 sys_wait4(cba18600,f66c6cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf66c6c40 syscall(f66c6d08) at syscall+0x2ed/frame 0xf66c6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf66c6cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdc20, ebp = 0xbfbfdc38 --- Tracing command lockf pid 89244 tid 100085 td 0xc7d68900 sched_switch(c7d68900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c9298c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c929c0 sleepq_switch(c7d68900,0,c108cb51,1ab,f5c92a38,...) at sleepq_switch+0x1b9/frame 0xf5c929f4 sleepq_catch_signals(0,c108cb51,162,f00,c7d68900,...) at sleepq_catch_signals+0x361/frame 0xf5c92a3c sleepq_wait_sig(c7d618b8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5c92a60 _sleep(c7d618b8,c7d6194c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5c92abc kern_wait6(c7d68900,0,15c9f,0,f5c92b4c,...) at kern_wait6+0x45c/frame 0xf5c92b20 sys_wait4(c7d68900,f5c92cc8,c10dec7f,d6,0,...) at sys_wait4+0x94/frame 0xf5c92c40 syscall(f5c92d08) at syscall+0x2ed/frame 0xf5c92cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c92cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280d84b3, esp = 0xbfbfdd38, ebp = 0xbfbfdd50 --- Tracing command sh pid 89234 tid 100722 td 0xcc9ca000 sched_switch(cc9ca000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf64bf98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf64bf9c0 sleepq_switch(cc9ca000,0,c108cb51,1ab,f64bfa38,...) at sleepq_switch+0x1b9/frame 0xf64bf9f4 sleepq_catch_signals(0,c108cb51,162,1578,cc9ca000,...) at sleepq_catch_signals+0x361/frame 0xf64bfa3c sleepq_wait_sig(cd6235d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf64bfa60 _sleep(cd6235d0,cd623664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf64bfabc kern_wait6(cc9ca000,7,0,0,f64bfb4c,...) at kern_wait6+0x45c/frame 0xf64bfb20 sys_wait4(cc9ca000,f64bfcc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf64bfc40 syscall(f64bfd08) at syscall+0x2ed/frame 0xf64bfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf64bfcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd9e0, ebp = 0xbfbfd9f8 --- Tracing command cron pid 89230 tid 100261 td 0xcc3ab600 sched_switch(cc3ab600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f93a1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5f93a50 sleepq_switch(cc3ab600,0,c108cb51,1ab,f5f93ac8,...) at sleepq_switch+0x1b9/frame 0xf5f93a84 sleepq_catch_signals(0,c108cb51,162,11a0,cc3ab600,...) at sleepq_catch_signals+0x361/frame 0xf5f93acc sleepq_wait_sig(c8d574c8,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5f93af0 _sleep(c8d574c8,c8d57648,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf5f93b4c pipe_read(cdc0bd90,f5f93c10,c7cf8e80,0,cc3ab600,...) at pipe_read+0x2dc/frame 0xf5f93b90 dofileread(cdc0bd90,f5f93c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5f93bc4 kern_readv(cc3ab600,5,f5f93c10,0,2881b000,...) at kern_readv+0x66/frame 0xf5f93bf0 sys_read(cc3ab600,f5f93cc8,c10dec7f,e9,7b3,...) at sys_read+0x5c/frame 0xf5f93c40 syscall(f5f93d08) at syscall+0x2ed/frame 0xf5f93cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f93cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281aafc7, esp = 0xbfbfd630, ebp = 0xbfbfd644 --- Tracing command sh pid 49799 tid 101188 td 0xcbbd3000 sched_switch(cbbd3000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf688c98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf688c9c0 sleepq_switch(cbbd3000,0,c108cb51,1ab,f688ca38,...) at sleepq_switch+0x1b9/frame 0xf688c9f4 sleepq_catch_signals(0,c108cb51,162,900,cbbd3000,...) at sleepq_catch_signals+0x361/frame 0xf688ca3c sleepq_wait_sig(c9d96000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf688ca60 _sleep(c9d96000,c9d96094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf688cabc kern_wait6(cbbd3000,7,0,0,f688cb4c,...) at kern_wait6+0x45c/frame 0xf688cb20 sys_wait4(cbbd3000,f688ccc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf688cc40 syscall(f688cd08) at syscall+0x2ed/frame 0xf688ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf688ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd5c0, ebp = 0xbfbfd5d8 --- Tracing command bash pid 32347 tid 100933 td 0xc934f000 sched_switch(c934f000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf675e9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf675e9f0 sleepq_switch(c934f000,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf675ea24 sleepq_catch_signals(f675ea90,c0a73729,c900ac14,0,0,...) at sleepq_catch_signals+0x361/frame 0xf675ea6c sleepq_wait_sig(c900ac70,0,f675eac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf675ea90 _cv_wait_sig(c900ac70,c900ac04,c10918b1,531,f675ec10,...) at _cv_wait_sig+0x200/frame 0xf675ead4 tty_wait(c900ac00,c900ac70,f675ec10,1,0,...) at tty_wait+0x4b/frame 0xf675eaf8 ttydisc_read(c900ac00,f675ec10,0,a1,f675ec10,...) at ttydisc_read+0x377/frame 0xf675eb3c ttydev_read(cbe1d800,f675ec10,0,1,0,...) at ttydev_read+0x81/frame 0xf675eb5c devfs_read_f(cdbffab8,f675ec10,cba7db00,0,c934f000,...) at devfs_read_f+0x87/frame 0xf675eb90 dofileread(cdbffab8,f675ec10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf675ebc4 kern_readv(c934f000,0,f675ec10,0,bfbfcdff,...) at kern_readv+0x66/frame 0xf675ebf0 sys_read(c934f000,f675ecc8,14,c10893dd,7b3,...) at sys_read+0x5c/frame 0xf675ec40 syscall(f675ed08) at syscall+0x2ed/frame 0xf675ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf675ecfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2835ffc7, esp = 0xbfbfcddc, ebp = 0xbfbfce08 --- Tracing command csh pid 32344 tid 100136 td 0xc84ee600 sched_switch(c84ee600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5da8aa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5da8ad4 sleepq_switch(c84ee600,0,c108cb51,1ab,f5da8b4c,...) at sleepq_switch+0x1b9/frame 0xf5da8b08 sleepq_catch_signals(0,c108cb51,162,df8,c84ee600,...) at sleepq_catch_signals+0x361/frame 0xf5da8b50 sleepq_wait_sig(c833891c,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5da8b74 _sleep(c833891c,c833894c,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5da8bd0 kern_sigsuspend(c84ee600,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5da8c10 sys_sigsuspend(c84ee600,f5da8cc8,c10dec7f,e9,0,...) at sys_sigsuspend+0x58/frame 0xf5da8c40 syscall(f5da8d08) at syscall+0x2ed/frame 0xf5da8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da8cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816c0ab, esp = 0xbfbfd104, ebp = 0xbfbfd16c --- Tracing command su pid 32328 tid 101467 td 0xc8ae3000 sched_switch(c8ae3000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf623a98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf623a9c0 sleepq_switch(c8ae3000,0,c108cb51,1ab,f623aa38,...) at sleepq_switch+0x1b9/frame 0xf623a9f4 sleepq_catch_signals(0,c108cb51,162,e88,c8ae3000,...) at sleepq_catch_signals+0x361/frame 0xf623aa3c sleepq_wait_sig(ca283ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf623aa60 _sleep(ca283ba0,ca283c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf623aabc kern_wait6(c8ae3000,0,7e58,0,f623ab4c,...) at kern_wait6+0x45c/frame 0xf623ab20 sys_wait4(c8ae3000,f623acc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf623ac40 syscall(f623ad08) at syscall+0x2ed/frame 0xf623acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf623acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281104b3, esp = 0xbfbfd620, ebp = 0xbfbfd638 --- Tracing command bash pid 94281 tid 101441 td 0xcbf29600 sched_switch(cbf29600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf618c98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf618c9c0 sleepq_switch(cbf29600,0,c108cb51,1ab,f618ca38,...) at sleepq_switch+0x1b9/frame 0xf618c9f4 sleepq_catch_signals(0,c108cb51,162,12f0,cbf29600,...) at sleepq_catch_signals+0x361/frame 0xf618ca3c sleepq_wait_sig(cdfd22e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf618ca60 _sleep(cdfd22e8,cdfd237c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf618cabc kern_wait6(cbf29600,7,0,0,f618cb4c,...) at kern_wait6+0x45c/frame 0xf618cb20 sys_wait4(cbf29600,f618ccc8,c0eb32b0,c71fdc90,0,...) at sys_wait4+0x94/frame 0xf618cc40 syscall(f618cd08) at syscall+0x2ed/frame 0xf618ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf618ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b04b3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 94280 tid 101472 td 0xca43ec00 sched_switch(ca43ec00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf624990c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf6249940 sleepq_switch(ca43ec00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf6249974 sleepq_catch_signals(f62499e0,c0a73729,cd68c960,0,0,...) at sleepq_catch_signals+0x361/frame 0xf62499bc sleepq_wait_sig(cd68c964,0,f6249a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf62499e0 _cv_wait_sig(cd68c964,cd68c950,c108f895,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf6249a24 seltdwait(ffffffff,0,0,ca43ec00,0,...) at seltdwait+0x90/frame 0xf6249a58 kern_select(ca43ec00,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf6249bf8 sys_select(ca43ec00,f6249cc8,c0eb32b0,c1825c90,0,...) at sys_select+0x69/frame 0xf6249c40 syscall(f6249d08) at syscall+0x2ed/frame 0xf6249cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6249cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 94278 tid 101489 td 0xca43e300 sched_switch(ca43e300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6293984 mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf62939b8 sleepq_switch(ca43e300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf62939ec sleepq_catch_signals(f6293a58,c0a73729,ca649120,0,0,...) at sleepq_catch_signals+0x361/frame 0xf6293a34 sleepq_wait_sig(ca649124,0,f6293a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf6293a58 _cv_wait_sig(ca649124,ca649110,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf6293a9c seltdwait(ffffffff,0,0,ca43e300,14,...) at seltdwait+0x90/frame 0xf6293ad0 sys_poll(ca43e300,f6293cc8,c0eb32b0,c71fdc90,0,...) at sys_poll+0x44c/frame 0xf6293c40 syscall(f6293d08) at syscall+0x2ed/frame 0xf6293cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6293cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command getty pid 1319 tid 100119 td 0xc7e0ac00 sched_switch(c7e0ac00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d509bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d509f0 sleepq_switch(c7e0ac00,0,c108cb51,1ab,f5d50a68,...) at sleepq_switch+0x1b9/frame 0xf5d50a24 sleepq_catch_signals(0,c108cb51,162,ed0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d50a6c sleepq_wait_sig(c778ee70,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d50a90 _cv_wait_sig(c778ee70,c13fb414,c10918b1,531,f5d50c10,...) at _cv_wait_sig+0x200/frame 0xf5d50ad4 tty_wait(c778ee00,c778ee70,f5d50c10,1,0,...) at tty_wait+0x4b/frame 0xf5d50af8 ttydisc_read(c778ee00,f5d50c10,0,a1,f5d50c10,...) at ttydisc_read+0x377/frame 0xf5d50b3c ttydev_read(c7935100,f5d50c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d50b5c devfs_read_f(c7df36c8,f5d50c10,c76aae80,0,c7e0ac00,...) at devfs_read_f+0x87/frame 0xf5d50b90 dofileread(c7df36c8,f5d50c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d50bc4 kern_readv(c7e0ac00,0,f5d50c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d50bf0 sys_read(c7e0ac00,f5d50cc8,c0eb32b0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5d50c40 syscall(f5d50d08) at syscall+0x2ed/frame 0xf5d50cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d50cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1318 tid 100187 td 0xc8e25c00 sched_switch(c8e25c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e4b9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5e4b9f0 sleepq_switch(c8e25c00,0,c108cb51,1ab,f5e4ba68,...) at sleepq_switch+0x1b9/frame 0xf5e4ba24 sleepq_catch_signals(0,c108cb51,162,180,1,...) at sleepq_catch_signals+0x361/frame 0xf5e4ba6c sleepq_wait_sig(c7936070,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5e4ba90 _cv_wait_sig(c7936070,c13fb414,c10918b1,531,f5e4bc10,...) at _cv_wait_sig+0x200/frame 0xf5e4bad4 tty_wait(c7936000,c7936070,f5e4bc10,1,0,...) at tty_wait+0x4b/frame 0xf5e4baf8 ttydisc_read(c7936000,f5e4bc10,0,a1,f5e4bc10,...) at ttydisc_read+0x377/frame 0xf5e4bb3c ttydev_read(c7935200,f5e4bc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5e4bb5c devfs_read_f(c7d76658,f5e4bc10,c76aae80,0,c8e25c00,...) at devfs_read_f+0x87/frame 0xf5e4bb90 dofileread(c7d76658,f5e4bc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5e4bbc4 kern_readv(c8e25c00,0,f5e4bc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5e4bbf0 sys_read(c8e25c00,f5e4bcc8,c10dec7f,d6,0,...) at sys_read+0x5c/frame 0xf5e4bc40 syscall(f5e4bd08) at syscall+0x2ed/frame 0xf5e4bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e4bcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1317 tid 100182 td 0xc8e86600 sched_switch(c8e86600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e3c9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5e3c9f0 sleepq_switch(c8e86600,0,c108cb51,1ab,f5e3ca68,...) at sleepq_switch+0x1b9/frame 0xf5e3ca24 sleepq_catch_signals(0,c108cb51,162,1b0,1,...) at sleepq_catch_signals+0x361/frame 0xf5e3ca6c sleepq_wait_sig(c7936270,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5e3ca90 _cv_wait_sig(c7936270,c13fb414,c10918b1,531,f5e3cc10,...) at _cv_wait_sig+0x200/frame 0xf5e3cad4 tty_wait(c7936200,c7936270,f5e3cc10,1,0,...) at tty_wait+0x4b/frame 0xf5e3caf8 ttydisc_read(c7936200,f5e3cc10,0,a1,f5e3cc10,...) at ttydisc_read+0x377/frame 0xf5e3cb3c ttydev_read(c7935300,f5e3cc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5e3cb5c devfs_read_f(c7df3888,f5e3cc10,c76aae80,0,c8e86600,...) at devfs_read_f+0x87/frame 0xf5e3cb90 dofileread(c7df3888,f5e3cc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5e3cbc4 kern_readv(c8e86600,0,f5e3cc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5e3cbf0 sys_read(c8e86600,f5e3ccc8,14,c10893dd,7b3,...) at sys_read+0x5c/frame 0xf5e3cc40 syscall(f5e3cd08) at syscall+0x2ed/frame 0xf5e3ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e3ccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1316 tid 100075 td 0xc7d68c00 sched_switch(c7d68c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c6a9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c6a9f0 sleepq_switch(c7d68c00,0,c108cb51,1ab,f5c6aa68,...) at sleepq_switch+0x1b9/frame 0xf5c6aa24 sleepq_catch_signals(0,c108cb51,162,1e0,1,...) at sleepq_catch_signals+0x361/frame 0xf5c6aa6c sleepq_wait_sig(c7936470,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c6aa90 _cv_wait_sig(c7936470,c13fb414,c10918b1,531,f5c6ac10,...) at _cv_wait_sig+0x200/frame 0xf5c6aad4 tty_wait(c7936400,c7936470,f5c6ac10,1,0,...) at tty_wait+0x4b/frame 0xf5c6aaf8 ttydisc_read(c7936400,f5c6ac10,0,a1,f5c6ac10,...) at ttydisc_read+0x377/frame 0xf5c6ab3c ttydev_read(c7935400,f5c6ac10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c6ab5c devfs_read_f(c89fe930,f5c6ac10,c76aae80,0,c7d68c00,...) at devfs_read_f+0x87/frame 0xf5c6ab90 dofileread(c89fe930,f5c6ac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c6abc4 kern_readv(c7d68c00,0,f5c6ac10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c6abf0 sys_read(c7d68c00,f5c6acc8,c0eb32b0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5c6ac40 syscall(f5c6ad08) at syscall+0x2ed/frame 0xf5c6acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c6acfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1315 tid 100185 td 0xc8e30300 sched_switch(c8e30300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e459bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5e459f0 sleepq_switch(c8e30300,0,c108cb51,1ab,f5e45a68,...) at sleepq_switch+0x1b9/frame 0xf5e45a24 sleepq_catch_signals(0,c108cb51,162,ff0,1,...) at sleepq_catch_signals+0x361/frame 0xf5e45a6c sleepq_wait_sig(c778da70,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5e45a90 _cv_wait_sig(c778da70,c13fb414,c10918b1,531,f5e45c10,...) at _cv_wait_sig+0x200/frame 0xf5e45ad4 tty_wait(c778da00,c778da70,f5e45c10,1,0,...) at tty_wait+0x4b/frame 0xf5e45af8 ttydisc_read(c778da00,f5e45c10,0,a1,f5e45c10,...) at ttydisc_read+0x377/frame 0xf5e45b3c ttydev_read(c7935500,f5e45c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5e45b5c devfs_read_f(c7db6230,f5e45c10,c76aae80,0,c8e30300,...) at devfs_read_f+0x87/frame 0xf5e45b90 dofileread(c7db6230,f5e45c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5e45bc4 kern_readv(c8e30300,0,f5e45c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5e45bf0 sys_read(c8e30300,f5e45cc8,c0eb32b0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5e45c40 syscall(f5e45d08) at syscall+0x2ed/frame 0xf5e45cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e45cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1314 tid 100184 td 0xc8e30600 sched_switch(c8e30600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e429bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5e429f0 sleepq_switch(c8e30600,0,c108cb51,1ab,f5e42a68,...) at sleepq_switch+0x1b9/frame 0xf5e42a24 sleepq_catch_signals(0,c108cb51,162,fc0,1,...) at sleepq_catch_signals+0x361/frame 0xf5e42a6c sleepq_wait_sig(c778d870,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5e42a90 _cv_wait_sig(c778d870,c13fb414,c10918b1,531,f5e42c10,...) at _cv_wait_sig+0x200/frame 0xf5e42ad4 tty_wait(c778d800,c778d870,f5e42c10,1,0,...) at tty_wait+0x4b/frame 0xf5e42af8 ttydisc_read(c778d800,f5e42c10,0,a1,f5e42c10,...) at ttydisc_read+0x377/frame 0xf5e42b3c ttydev_read(c7935600,f5e42c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5e42b5c devfs_read_f(c7d751f8,f5e42c10,c76aae80,0,c8e30600,...) at devfs_read_f+0x87/frame 0xf5e42b90 dofileread(c7d751f8,f5e42c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5e42bc4 kern_readv(c8e30600,0,f5e42c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5e42bf0 sys_read(c8e30600,f5e42cc8,c0eb32b0,c1825c90,0,...) at sys_read+0x5c/frame 0xf5e42c40 syscall(f5e42d08) at syscall+0x2ed/frame 0xf5e42cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e42cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1313 tid 100093 td 0xc7da5000 sched_switch(c7da5000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cb29bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5cb29f0 sleepq_switch(c7da5000,0,c108cb51,1ab,f5cb2a68,...) at sleepq_switch+0x1b9/frame 0xf5cb2a24 sleepq_catch_signals(0,c108cb51,162,f00,1,...) at sleepq_catch_signals+0x361/frame 0xf5cb2a6c sleepq_wait_sig(c778d070,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cb2a90 _cv_wait_sig(c778d070,c13fb414,c10918b1,531,f5cb2c10,...) at _cv_wait_sig+0x200/frame 0xf5cb2ad4 tty_wait(c778d000,c778d070,f5cb2c10,1,0,...) at tty_wait+0x4b/frame 0xf5cb2af8 ttydisc_read(c778d000,f5cb2c10,0,a1,f5cb2c10,...) at ttydisc_read+0x377/frame 0xf5cb2b3c ttydev_read(c7935700,f5cb2c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5cb2b5c devfs_read_f(c7db6118,f5cb2c10,c76aae80,0,c7da5000,...) at devfs_read_f+0x87/frame 0xf5cb2b90 dofileread(c7db6118,f5cb2c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5cb2bc4 kern_readv(c7da5000,0,f5cb2c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5cb2bf0 sys_read(c7da5000,f5cb2cc8,c0eb32b0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5cb2c40 syscall(f5cb2d08) at syscall+0x2ed/frame 0xf5cb2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb2cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1312 tid 100150 td 0xc8e25000 sched_switch(c8e25000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ddc9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5ddc9f0 sleepq_switch(c8e25000,0,c108cb51,1ab,f5ddca68,...) at sleepq_switch+0x1b9/frame 0xf5ddca24 sleepq_catch_signals(0,c108cb51,162,f30,1,...) at sleepq_catch_signals+0x361/frame 0xf5ddca6c sleepq_wait_sig(c778d270,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5ddca90 _cv_wait_sig(c778d270,c13fb414,c10918b1,531,f5ddcc10,...) at _cv_wait_sig+0x200/frame 0xf5ddcad4 tty_wait(c778d200,c778d270,f5ddcc10,1,0,...) at tty_wait+0x4b/frame 0xf5ddcaf8 ttydisc_read(c778d200,f5ddcc10,0,a1,f5ddcc10,...) at ttydisc_read+0x377/frame 0xf5ddcb3c ttydev_read(c78eb600,f5ddcc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5ddcb5c devfs_read_f(c7df3968,f5ddcc10,c76aae80,0,c8e25000,...) at devfs_read_f+0x87/frame 0xf5ddcb90 dofileread(c7df3968,f5ddcc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5ddcbc4 kern_readv(c8e25000,0,f5ddcc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5ddcbf0 sys_read(c8e25000,f5ddccc8,c10dec7f,d6,db,...) at sys_read+0x5c/frame 0xf5ddcc40 syscall(f5ddcd08) at syscall+0x2ed/frame 0xf5ddccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ddccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1311 tid 100172 td 0xc8e88300 sched_switch(c8e88300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e1e9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5e1e9f0 sleepq_switch(c8e88300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5e1ea24 sleepq_catch_signals(f5e1ea90,c0a73729,c778d414,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5e1ea6c sleepq_wait_sig(c778d470,0,f5e1eac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5e1ea90 _cv_wait_sig(c778d470,c778d404,c10918b1,531,f5e1ec10,...) at _cv_wait_sig+0x200/frame 0xf5e1ead4 tty_wait(c778d400,c778d470,f5e1ec10,1,0,...) at tty_wait+0x4b/frame 0xf5e1eaf8 ttydisc_read(c778d400,f5e1ec10,0,a1,f5e1ec10,...) at ttydisc_read+0x377/frame 0xf5e1eb3c ttydev_read(c76b7c00,f5e1ec10,0,1,0,...) at ttydev_read+0x81/frame 0xf5e1eb5c devfs_read_f(c7d76e70,f5e1ec10,c76aae80,0,c8e88300,...) at devfs_read_f+0x87/frame 0xf5e1eb90 dofileread(c7d76e70,f5e1ec10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5e1ebc4 kern_readv(c8e88300,0,f5e1ec10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5e1ebf0 sys_read(c8e88300,f5e1ecc8,c0eb32b0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5e1ec40 syscall(f5e1ed08) at syscall+0x2ed/frame 0xf5e1ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e1ecfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 1294 tid 100152 td 0xc8e23900 sched_switch(c8e23900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5de290c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5de2940 sleepq_switch(c8e23900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5de2974 sleepq_catch_signals(f5de29e0,c0a73729,c7cbc060,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5de29bc sleepq_wait_sig(c7cbc064,0,f5de2a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5de29e0 _cv_wait_sig(c7cbc064,c7cbc050,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5de2a24 seltdwait(ffffffff,0,0,c8e23900,0,...) at seltdwait+0x90/frame 0xf5de2a58 kern_select(c8e23900,8,bfbfd070,0,0,...) at kern_select+0x88c/frame 0xf5de2bf8 sys_select(c8e23900,f5de2cc8,c0eb32b0,c71fdc90,0,...) at sys_select+0x69/frame 0xf5de2c40 syscall(f5de2d08) at syscall+0x2ed/frame 0xf5de2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5de2cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aef87, esp = 0xbfbfd014, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 1270 tid 100147 td 0xc7e03300 sched_switch(c7e03300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dd3a64 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5dd3a98 sleepq_switch(c7e03300,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5dd3acc sleepq_catch_signals(c0acb130,c7e03300,1,201,1,...) at sleepq_catch_signals+0x361/frame 0xf5dd3b14 sleepq_timedwait_sig(c1233489,6c,f9fa,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5dd3b3c _sleep(c1233489,0,16c,c10884ca,2d8df7c,...) at _sleep+0x331/frame 0xf5dd3b98 kern_nanosleep(bfbfdcb0,f5dd3c18,f5dd3c20,c84684f0,3c,...) at kern_nanosleep+0x158/frame 0xf5dd3c00 sys_nanosleep(c7e03300,f5dd3cc8,14,c10893dd,7b3,...) at sys_nanosleep+0x6b/frame 0xf5dd3c40 syscall(f5dd3d08) at syscall+0x2ed/frame 0xf5dd3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dd3cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28178173, esp = 0xbfbfdca4, ebp = 0xbfbfdce8 --- Tracing command bash pid 841 tid 100160 td 0xc8e32000 sched_switch(c8e32000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dfa98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5dfa9c0 sleepq_switch(c8e32000,0,c108cb51,1ab,f5dfaa38,...) at sleepq_switch+0x1b9/frame 0xf5dfa9f4 sleepq_catch_signals(0,c108cb51,162,480,c8e32000,...) at sleepq_catch_signals+0x361/frame 0xf5dfaa3c sleepq_wait_sig(c8e13000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5dfaa60 _sleep(c8e13000,c8e13094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5dfaabc kern_wait6(c8e32000,7,0,0,f5dfab4c,...) at kern_wait6+0x45c/frame 0xf5dfab20 sys_wait4(c8e32000,f5dfacc8,c0eb32b0,c71fdc90,0,...) at sys_wait4+0x94/frame 0xf5dfac40 syscall(f5dfad08) at syscall+0x2ed/frame 0xf5dfacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dfacfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b04b3, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command csh pid 834 tid 100161 td 0xc8e31c00 sched_switch(c8e31c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dfdaa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dfdad4 sleepq_switch(c8e31c00,0,c108cb51,1ab,f5dfdb4c,...) at sleepq_switch+0x1b9/frame 0xf5dfdb08 sleepq_catch_signals(0,c108cb51,162,c0,c8e31c00,...) at sleepq_catch_signals+0x361/frame 0xf5dfdb50 sleepq_wait_sig(c8e10c04,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5dfdb74 _sleep(c8e10c04,c8e10c34,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5dfdbd0 kern_sigsuspend(c8e31c00,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5dfdc10 sys_sigsuspend(c8e31c00,f5dfdcc8,c10dec7f,e9,0,...) at sys_sigsuspend+0x58/frame 0xf5dfdc40 syscall(f5dfdd08) at syscall+0x2ed/frame 0xf5dfdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dfdcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816c0ab, esp = 0xbfbfd114, ebp = 0xbfbfd17c --- Tracing command su pid 833 tid 100128 td 0xc84f0000 sched_switch(c84f0000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d8598c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d859c0 sleepq_switch(c84f0000,0,c108cb51,1ab,f5d85a38,...) at sleepq_switch+0x1b9/frame 0xf5d859f4 sleepq_catch_signals(0,c108cb51,162,870,c84f0000,...) at sleepq_catch_signals+0x361/frame 0xf5d85a3c sleepq_wait_sig(c84db2e8,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d85a60 _sleep(c84db2e8,c84db37c,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5d85abc kern_wait6(c84f0000,0,342,0,f5d85b4c,...) at kern_wait6+0x45c/frame 0xf5d85b20 sys_wait4(c84f0000,f5d85cc8,c0eb32b0,c71fdc90,0,...) at sys_wait4+0x94/frame 0xf5d85c40 syscall(f5d85d08) at syscall+0x2ed/frame 0xf5d85cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d85cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281104b3, esp = 0xbfbfd630, ebp = 0xbfbfd648 --- Tracing command bash pid 813 tid 100135 td 0xc84ee900 sched_switch(c84ee900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5da398c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5da39c0 sleepq_switch(c84ee900,0,c108cb51,1ab,f5da3a38,...) at sleepq_switch+0x1b9/frame 0xf5da39f4 sleepq_catch_signals(0,c108cb51,162,408,c84ee900,...) at sleepq_catch_signals+0x361/frame 0xf5da3a3c sleepq_wait_sig(c8338ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5da3a60 _sleep(c8338ba0,c8338c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5da3abc kern_wait6(c84ee900,7,0,0,f5da3b4c,...) at kern_wait6+0x45c/frame 0xf5da3b20 sys_wait4(c84ee900,f5da3cc8,8,c10874bc,db,...) at sys_wait4+0x94/frame 0xf5da3c40 syscall(f5da3d08) at syscall+0x2ed/frame 0xf5da3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da3cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b04b3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 812 tid 100148 td 0xc7e03000 sched_switch(c7e03000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dd690c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5dd6940 sleepq_switch(c7e03000,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5dd6974 sleepq_catch_signals(f5dd69e0,c0a73729,c84e10a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5dd69bc sleepq_wait_sig(c84e10a4,0,f5dd6a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dd69e0 _cv_wait_sig(c84e10a4,c84e1090,c108f895,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5dd6a24 seltdwait(ffffffff,0,0,c7e03000,0,...) at seltdwait+0x90/frame 0xf5dd6a58 kern_select(c7e03000,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5dd6bf8 sys_select(c7e03000,f5dd6cc8,c0eb32b0,c1825c90,0,...) at sys_select+0x69/frame 0xf5dd6c40 syscall(f5dd6d08) at syscall+0x2ed/frame 0xf5dd6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dd6cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 810 tid 100079 td 0xc7da6300 sched_switch(c7da6300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c7a984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5c7a9b8 sleepq_switch(c7da6300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c7a9ec sleepq_catch_signals(f5c7aa58,c0a73729,c7c0b560,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c7aa34 sleepq_wait_sig(c7c0b564,0,f5c7aa88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c7aa58 _cv_wait_sig(c7c0b564,c7c0b550,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5c7aa9c seltdwait(ffffffff,0,0,c7da6300,c11bc03c,...) at seltdwait+0x90/frame 0xf5c7aad0 sys_poll(c7da6300,f5c7acc8,c0eb32b0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5c7ac40 syscall(f5c7ad08) at syscall+0x2ed/frame 0xf5c7acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c7acfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command awk pid 794 tid 100144 td 0xc8e25600 sched_switch(c8e25600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dcaa1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5dcaa50 sleepq_switch(c8e25600,0,c108cb51,1ab,f5dcaac8,...) at sleepq_switch+0x1b9/frame 0xf5dcaa84 sleepq_catch_signals(0,c108cb51,162,11a0,c8e25600,...) at sleepq_catch_signals+0x361/frame 0xf5dcaacc sleepq_wait_sig(c7e274c8,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5dcaaf0 _sleep(c7e274c8,c7e27648,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf5dcab4c pipe_read(c7d755b0,f5dcac10,c7cf8d80,0,c8e25600,...) at pipe_read+0x2dc/frame 0xf5dcab90 dofileread(c7d755b0,f5dcac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5dcabc4 kern_readv(c8e25600,0,f5dcac10,f5dcac4c,28855000,...) at kern_readv+0x66/frame 0xf5dcabf0 sys_read(c8e25600,f5dcacc8,c0eb32b0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5dcac40 syscall(f5dcad08) at syscall+0x2ed/frame 0xf5dcacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dcacfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c1fc7, esp = 0xbfbfd9e0, ebp = 0xbfbfd9f4 --- Tracing command sh pid 793 tid 100143 td 0xc8e25900 sched_switch(c8e25900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dc798c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5dc79c0 sleepq_switch(c8e25900,0,c108cb51,1ab,f5dc7a38,...) at sleepq_switch+0x1b9/frame 0xf5dc79f4 sleepq_catch_signals(0,c108cb51,162,588,c8e25900,...) at sleepq_catch_signals+0x361/frame 0xf5dc7a3c sleepq_wait_sig(c80c9ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5dc7a60 _sleep(c80c9ba0,c80c9c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5dc7abc kern_wait6(c8e25900,7,0,0,f5dc7b4c,...) at kern_wait6+0x45c/frame 0xf5dc7b20 sys_wait4(c8e25900,f5dc7cc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf5dc7c40 syscall(f5dc7d08) at syscall+0x2ed/frame 0xf5dc7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dc7cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd938, ebp = 0xbfbfd950 --- Tracing command top pid 792 tid 100142 td 0xc7e03c00 sched_switch(c7e03c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dc4900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5dc4934 sleepq_switch(c7e03c00,0,c108cb51,1ab,c7c0b650,...) at sleepq_switch+0x1b9/frame 0xf5dc4968 sleepq_catch_signals(c11b9ca4,f5dc49d8,c0a73729,c7c0b660,0,...) at sleepq_catch_signals+0x361/frame 0xf5dc49b0 sleepq_timedwait_sig(c7c0b664,0,f5dc4a10,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5dc49d8 _cv_timedwait_sig_sbt(c7c0b664,c7c0b650,989b7b63,f9c6,10000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5dc4a24 seltdwait(f9c6,10000000,0,c7e03c00,0,...) at seltdwait+0xbc/frame 0xf5dc4a58 kern_select(c7e03c00,2,bfbfdbe8,0,0,...) at kern_select+0x88c/frame 0xf5dc4bf8 sys_select(c7e03c00,f5dc4cc8,c0eb32b0,c71fdc90,0,...) at sys_select+0x69/frame 0xf5dc4c40 syscall(f5dc4d08) at syscall+0x2ed/frame 0xf5dc4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dc4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281f3f87, esp = 0xbfbfdb8c, ebp = 0xbfbfdcf4 --- Tracing command tail pid 791 tid 100094 td 0xc7e2a300 sched_switch(c7e2a300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cb693c mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5cb6970 sleepq_switch(c7e2a300,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5cb69a4 sleepq_catch_signals(c0acb130,c7e2a300,2,201,2,...) at sleepq_catch_signals+0x361/frame 0xf5cb69ec sleepq_timedwait_sig(c7cddc80,68,f9c6,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5cb6a14 _sleep(c7cddc80,c7cddc80,168,c108046e,e3def5cf,...) at _sleep+0x331/frame 0xf5cb6a70 kern_kevent(c7e2a300,4,0,1,f5cb6c10,...) at kern_kevent+0x43a/frame 0xf5cb6bb8 sys_kevent(c7e2a300,f5cb6cc8,14,c10893dd,7b3,...) at sys_kevent+0x12b/frame 0xf5cb6c40 syscall(f5cb6d08) at syscall+0x2ed/frame 0xf5cb6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb6cfc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2816828f, esp = 0xbfbfdb9c, ebp = 0xbfbfdc48 --- Tracing command sh pid 790 tid 100107 td 0xc7d64600 sched_switch(c7d64600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d0698c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d069c0 sleepq_switch(c7d64600,0,c108cb51,1ab,f5d06a38,...) at sleepq_switch+0x1b9/frame 0xf5d069f4 sleepq_catch_signals(0,c108cb51,162,16f8,c7d64600,...) at sleepq_catch_signals+0x361/frame 0xf5d06a3c sleepq_wait_sig(c7c325d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d06a60 _sleep(c7c325d0,c7c32664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5d06abc kern_wait6(c7d64600,7,0,0,f5d06b4c,...) at kern_wait6+0x45c/frame 0xf5d06b20 sys_wait4(c7d64600,f5d06cc8,c0eb32b0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf5d06c40 syscall(f5d06d08) at syscall+0x2ed/frame 0xf5d06cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d06cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdb20, ebp = 0xbfbfdb38 --- Tracing command sshd pid 789 tid 100141 td 0xc7e2a600 sched_switch(c7e2a600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dc190c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5dc1940 sleepq_switch(c7e2a600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5dc1974 sleepq_catch_signals(f5dc19e0,c0a73729,c7cbcb60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5dc19bc sleepq_wait_sig(c7cbcb64,0,f5dc1a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dc19e0 _cv_wait_sig(c7cbcb64,c7cbcb50,c108f895,68e,5be,...) at _cv_wait_sig+0x200/frame 0xf5dc1a24 seltdwait(ffffffff,0,0,c7e2a600,0,...) at seltdwait+0x90/frame 0xf5dc1a58 kern_select(c7e2a600,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5dc1bf8 sys_select(c7e2a600,f5dc1cc8,7b3,2,f5dc1cc4,...) at sys_select+0x69/frame 0xf5dc1c40 syscall(f5dc1d08) at syscall+0x2ed/frame 0xf5dc1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dc1cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 788 tid 100116 td 0xc7e28600 sched_switch(c7e28600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d4790c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d47940 sleepq_switch(c7e28600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d47974 sleepq_catch_signals(f5d479e0,c0a73729,c7d987e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d479bc sleepq_wait_sig(c7d987e4,0,f5d47a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d479e0 _cv_wait_sig(c7d987e4,c7d987d0,c108f895,68e,5be,...) at _cv_wait_sig+0x200/frame 0xf5d47a24 seltdwait(ffffffff,0,0,c7e28600,0,...) at seltdwait+0x90/frame 0xf5d47a58 kern_select(c7e28600,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5d47bf8 sys_select(c7e28600,f5d47cc8,c0eb32b0,c1825c90,0,...) at sys_select+0x69/frame 0xf5d47c40 syscall(f5d47d08) at syscall+0x2ed/frame 0xf5d47cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d47cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 787 tid 100092 td 0xc78f9900 sched_switch(c78f9900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cae90c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5cae940 sleepq_switch(c78f9900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cae974 sleepq_catch_signals(f5cae9e0,c0a73729,c7c0bba0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cae9bc sleepq_wait_sig(c7c0bba4,0,f5caea10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cae9e0 _cv_wait_sig(c7c0bba4,c7c0bb90,c108f895,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5caea24 seltdwait(ffffffff,0,0,c78f9900,0,...) at seltdwait+0x90/frame 0xf5caea58 kern_select(c78f9900,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5caebf8 sys_select(c78f9900,f5caecc8,c0eb32b0,c1825c90,0,...) at sys_select+0x69/frame 0xf5caec40 syscall(f5caed08) at syscall+0x2ed/frame 0xf5caecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5caecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 783 tid 100101 td 0xc7e08300 sched_switch(c7e08300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cd3984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5cd39b8 sleepq_switch(c7e08300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cd39ec sleepq_catch_signals(f5cd3a58,c0a73729,c7c0baa0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cd3a34 sleepq_wait_sig(c7c0baa4,0,f5cd3a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cd3a58 _cv_wait_sig(c7c0baa4,c7c0ba90,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5cd3a9c seltdwait(ffffffff,0,0,c7e08300,0,...) at seltdwait+0x90/frame 0xf5cd3ad0 sys_poll(c7e08300,f5cd3cc8,14,c10893dd,7b3,...) at sys_poll+0x44c/frame 0xf5cd3c40 syscall(f5cd3d08) at syscall+0x2ed/frame 0xf5cd3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cd3cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 782 tid 100114 td 0xc7e28c00 sched_switch(c7e28c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d41984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d419b8 sleepq_switch(c7e28c00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d419ec sleepq_catch_signals(f5d41a58,c0a73729,c7bd3e20,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d41a34 sleepq_wait_sig(c7bd3e24,0,f5d41a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d41a58 _cv_wait_sig(c7bd3e24,c7bd3e10,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5d41a9c seltdwait(ffffffff,0,0,c7e28c00,0,...) at seltdwait+0x90/frame 0xf5d41ad0 sys_poll(c7e28c00,f5d41cc8,8,c10874bc,db,...) at sys_poll+0x44c/frame 0xf5d41c40 syscall(f5d41d08) at syscall+0x2ed/frame 0xf5d41cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d41cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 781 tid 100088 td 0xc7e09600 sched_switch(c7e09600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c9e984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5c9e9b8 sleepq_switch(c7e09600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c9e9ec sleepq_catch_signals(f5c9ea58,c0a73729,c7d986e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c9ea34 sleepq_wait_sig(c7d986e4,0,f5c9ea88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c9ea58 _cv_wait_sig(c7d986e4,c7d986d0,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5c9ea9c seltdwait(ffffffff,0,0,c7e09600,0,...) at seltdwait+0x90/frame 0xf5c9ead0 sys_poll(c7e09600,f5c9ecc8,14,c10893dd,7b3,...) at sys_poll+0x44c/frame 0xf5c9ec40 syscall(f5c9ed08) at syscall+0x2ed/frame 0xf5c9ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command cron pid 734 tid 100086 td 0xc7d68600 sched_switch(c7d68600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c96a64 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5c96a98 sleepq_switch(c7d68600,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5c96acc sleepq_catch_signals(c0acb130,c7d68600,3,201,3,...) at sleepq_catch_signals+0x361/frame 0xf5c96b14 sleepq_timedwait_sig(c123348b,6c,f9cd,793139b2,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5c96b3c _sleep(c123348b,0,16c,c10884ca,b2da4ae8,...) at _sleep+0x331/frame 0xf5c96b98 kern_nanosleep(bfbfde28,f5c96c18,f5c96c20,f5c96cc8,37,...) at kern_nanosleep+0x158/frame 0xf5c96c00 sys_nanosleep(c7d68600,f5c96cc8,0,0,c7d68600,...) at sys_nanosleep+0x6b/frame 0xf5c96c40 syscall(f5c96d08) at syscall+0x2ed/frame 0xf5c96cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c96cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28188173, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 729 tid 100133 td 0xc84ef000 sched_switch(c84ef000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d96aa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5d96ad4 sleepq_switch(c84ef000,0,c108cb51,1ab,f5d96b4c,...) at sleepq_switch+0x1b9/frame 0xf5d96b08 sleepq_catch_signals(0,c108cb51,162,1668,c84ef000,...) at sleepq_catch_signals+0x361/frame 0xf5d96b50 sleepq_wait_sig(c84da34c,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d96b74 _sleep(c84da34c,c84da37c,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5d96bd0 kern_sigsuspend(c84ef000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5d96c10 sys_sigsuspend(c84ef000,f5d96cc8,14,c10893dd,7b3,...) at sys_sigsuspend+0x58/frame 0xf5d96c40 syscall(f5d96d08) at syscall+0x2ed/frame 0xf5d96cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d96cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283550ab, esp = 0xbfbfc9f4, ebp = 0xbfbfca20 --- Tracing command sendmail pid 726 tid 100132 td 0xc84ef300 sched_switch(c84ef300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d93900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d93934 sleepq_switch(c84ef300,0,c108cb51,1ab,c7d98550,...) at sleepq_switch+0x1b9/frame 0xf5d93968 sleepq_catch_signals(c11b9ca4,f5d939d8,c0a73729,c7d98560,0,...) at sleepq_catch_signals+0x361/frame 0xf5d939b0 sleepq_timedwait_sig(c7d98564,0,f5d93a10,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d939d8 _cv_timedwait_sig_sbt(c7d98564,c7d98550,2a452eaa,f9c6,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d93a24 seltdwait(f9c6,50000000,0,c84ef300,0,...) at seltdwait+0xbc/frame 0xf5d93a58 kern_select(c84ef300,5,bfbfbfe0,0,0,...) at kern_select+0x88c/frame 0xf5d93bf8 sys_select(c84ef300,f5d93cc8,8,c10874bc,db,...) at sys_select+0x69/frame 0xf5d93c40 syscall(f5d93d08) at syscall+0x2ed/frame 0xf5d93cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d93cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2841cf87, esp = 0xbfbfbf44, ebp = 0xbfbfca00 --- Tracing command sshd pid 723 tid 100131 td 0xc84ef600 sched_switch(c84ef600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d9090c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d90940 sleepq_switch(c84ef600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d90974 sleepq_catch_signals(f5d909e0,c0a73729,c7c8fd60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d909bc sleepq_wait_sig(c7c8fd64,0,f5d90a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d909e0 _cv_wait_sig(c7c8fd64,c7c8fd50,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5d90a24 seltdwait(ffffffff,0,0,c84ef600,0,...) at seltdwait+0x90/frame 0xf5d90a58 kern_select(c84ef600,9,28c0c140,0,0,...) at kern_select+0x88c/frame 0xf5d90bf8 sys_select(c84ef600,f5d90cc8,0,0,c84ef600,...) at sys_select+0x69/frame 0xf5d90c40 syscall(f5d90d08) at syscall+0x2ed/frame 0xf5d90cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d90cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command moused pid 691 tid 100130 td 0xc84ef900 sched_switch(c84ef900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d8b90c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5d8b940 sleepq_switch(c84ef900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d8b974 sleepq_catch_signals(f5d8b9e0,c0a73729,c7d97120,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d8b9bc sleepq_wait_sig(c7d97124,0,f5d8ba10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d8b9e0 _cv_wait_sig(c7d97124,c7d97110,c108f895,68e,c84ef900,...) at _cv_wait_sig+0x200/frame 0xf5d8ba24 seltdwait(ffffffff,0,0,c84ef900,0,...) at seltdwait+0x90/frame 0xf5d8ba58 kern_select(c84ef900,400,bfbfdcb0,0,0,...) at kern_select+0x88c/frame 0xf5d8bbf8 sys_select(c84ef900,f5d8bcc8,21ca240a,21ca241a,21ca242a,...) at sys_select+0x69/frame 0xf5d8bc40 syscall(f5d8bd08) at syscall+0x2ed/frame 0xf5d8bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d8bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bcf87, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command smbd pid 690 tid 100129 td 0xc84efc00 sched_switch(c84efc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d88978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d889ac sleepq_switch(c84efc00,0,c108cb51,1ab,c7d984d0,...) at sleepq_switch+0x1b9/frame 0xf5d889e0 sleepq_catch_signals(c11b9ca4,f5d88a50,c0a73729,c7d984e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d88a28 sleepq_timedwait_sig(c7d984e4,0,f5d88a88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5d88a50 _cv_timedwait_sig_sbt(c7d984e4,c7d984d0,d3d858d4,20c4af,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d88a9c seltdwait(20c4af,b7fbe76c,20c49,c84efc00,0,...) at seltdwait+0xbc/frame 0xf5d88ad0 sys_poll(c84efc00,f5d88cc8,0,0,0,...) at sys_poll+0x44c/frame 0xf5d88c40 syscall(f5d88d08) at syscall+0x2ed/frame 0xf5d88cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d88cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b642df, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 688 tid 100127 td 0xc84f0300 sched_switch(c84f0300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d82978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d829ac sleepq_switch(c84f0300,0,c108cb51,1ab,c7d98490,...) at sleepq_switch+0x1b9/frame 0xf5d829e0 sleepq_catch_signals(c11b9ca4,f5d82a50,c0a73729,c7d984a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d82a28 sleepq_timedwait_sig(c7d984a4,0,f5d82a88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5d82a50 _cv_timedwait_sig_sbt(c7d984a4,c7d98490,fc31de5b,21bd74,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d82a9c seltdwait(21bd74,b7fbe76c,20c49,c84f0300,0,...) at seltdwait+0xbc/frame 0xf5d82ad0 sys_poll(c84f0300,f5d82cc8,14,c10893dd,7b3,...) at sys_poll+0x44c/frame 0xf5d82c40 syscall(f5d82d08) at syscall+0x2ed/frame 0xf5d82cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d82cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b2df, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command winbindd pid 673 tid 100113 td 0xc7e29000 sched_switch(c7e29000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d3e978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d3e9ac sleepq_switch(c7e29000,0,c108cb51,1ab,c7c0b5d0,...) at sleepq_switch+0x1b9/frame 0xf5d3e9e0 sleepq_catch_signals(c11b9ca4,f5d3ea50,c0a73729,c7c0b5e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d3ea28 sleepq_timedwait_sig(c7c0b5e4,0,f5d3ea88,f1a1b851,f,...) at sleepq_timedwait_sig+0x14/frame 0xf5d3ea50 _cv_timedwait_sig_sbt(c7c0b5e4,c7c0b5d0,afa5bfb2,f9dd,f1a1b851,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d3ea9c seltdwait(f9dd,f1a1b851,f,c7e29000,0,...) at seltdwait+0xbc/frame 0xf5d3ead0 sys_poll(c7e29000,f5d3ecc8,14,c10893dd,7b3,...) at sys_poll+0x44c/frame 0xf5d3ec40 syscall(f5d3ed08) at syscall+0x2ed/frame 0xf5d3ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d3ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b2df, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 671 tid 100124 td 0xc794e600 sched_switch(c794e600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d79978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d799ac sleepq_switch(c794e600,0,c108cb51,1ab,c7c0b590,...) at sleepq_switch+0x1b9/frame 0xf5d799e0 sleepq_catch_signals(c11b9ca4,f5d79a50,c0a73729,c7c0b5a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d79a28 sleepq_timedwait_sig(c7c0b5a4,0,f5d79a88,bffffbaa,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d79a50 _cv_timedwait_sig_sbt(c7c0b5a4,c7c0b590,9588e382,f9ed,bffffbaa,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d79a9c seltdwait(f9ed,bffffbaa,3,c794e600,c0a4dc5c,...) at seltdwait+0xbc/frame 0xf5d79ad0 sys_poll(c794e600,f5d79cc8,0,0,c794e600,...) at sys_poll+0x44c/frame 0xf5d79c40 syscall(f5d79d08) at syscall+0x2ed/frame 0xf5d79cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d79cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b642df, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 669 tid 100099 td 0xc7e08900 sched_switch(c7e08900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ccb978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5ccb9ac sleepq_switch(c7e08900,0,c108cb51,1ab,c7bd3c50,...) at sleepq_switch+0x1b9/frame 0xf5ccb9e0 sleepq_catch_signals(c11b9ca4,f5ccba50,c0a73729,c7bd3c60,0,...) at sleepq_catch_signals+0x361/frame 0xf5ccba28 sleepq_timedwait_sig(c7bd3c64,0,f5ccba88,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5ccba50 _cv_timedwait_sig_sbt(c7bd3c64,c7bd3c50,ca03dc2a,f9c7,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5ccba9c seltdwait(f9c7,9fffff47,0,c7e08900,c13aeb00,...) at seltdwait+0xbc/frame 0xf5ccbad0 sys_poll(c7e08900,f5ccbcc8,c0eb32b0,c71fac90,0,...) at sys_poll+0x44c/frame 0xf5ccbc40 syscall(f5ccbd08) at syscall+0x2ed/frame 0xf5ccbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ccbcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x215632df, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 645 tid 100078 td 0xc7da6600 sched_switch(c7da6600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c7690c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c76940 sleepq_switch(c7da6600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c76974 sleepq_catch_signals(f5c769e0,c0a73729,c7c8f920,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c769bc sleepq_wait_sig(c7c8f924,0,f5c76a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c769e0 _cv_wait_sig(c7c8f924,c7c8f910,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5c76a24 seltdwait(ffffffff,0,0,c7da6600,0,...) at seltdwait+0x90/frame 0xf5c76a58 kern_select(c7da6600,1c,bfbfdd48,0,0,...) at kern_select+0x88c/frame 0xf5c76bf8 sys_select(c7da6600,f5c76cc8,0,0,c7da6600,...) at sys_select+0x69/frame 0xf5c76c40 syscall(f5c76d08) at syscall+0x2ed/frame 0xf5c76cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c76cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28396f87, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 588 tid 100123 td 0xc794e900 sched_switch(c794e900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d5ca84 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5d5cab8 sleepq_switch(c794e900,0,c108cb51,1ab,c793a280,...) at sleepq_switch+0x1b9/frame 0xf5d5caec sleepq_catch_signals(c11b9ca4,f5d5cb5c,c0a73729,c793a290,0,...) at sleepq_catch_signals+0x361/frame 0xf5d5cb34 sleepq_timedwait_sig(c784ce10,0,f5d5cb94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d5cb5c _cv_timedwait_sig_sbt(c784ce10,c793a280,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d5cba8 svc_run_internal(f5d5ccf4,c0a5692f,c793a280,f5d5cd08,c1080960,...) at svc_run_internal+0xa5d/frame 0xf5d5ccc4 svc_thread_start(c793a280,f5d5cd08,c1080960,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d5cccc fork_exit(c0c8f740,c793a280,f5d5cd08) at fork_exit+0x7f/frame 0xf5d5ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d5ccf4 --- trap 0x3cb72e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 588 tid 100122 td 0xc794ec00 sched_switch(c794ec00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d59a84 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5d59ab8 sleepq_switch(c794ec00,0,c108cb51,1ab,c793a280,...) at sleepq_switch+0x1b9/frame 0xf5d59aec sleepq_catch_signals(c11b9ca4,f5d59b5c,c0a73729,c793a290,0,...) at sleepq_catch_signals+0x361/frame 0xf5d59b34 sleepq_timedwait_sig(c784cdd0,0,f5d59b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d59b5c _cv_timedwait_sig_sbt(c784cdd0,c793a280,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d59ba8 svc_run_internal(f5d59cf4,c0a5692f,c793a280,f5d59d08,c1080960,...) at svc_run_internal+0xa5d/frame 0xf5d59cc4 svc_thread_start(c793a280,f5d59d08,c1080960,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d59ccc fork_exit(c0c8f740,c793a280,f5d59d08) at fork_exit+0x7f/frame 0xf5d59cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d59cf4 --- trap 0x3cb72e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 588 tid 100121 td 0xc7d64000 sched_switch(c7d64000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d56a84 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5d56ab8 sleepq_switch(c7d64000,0,c108cb51,1ab,c793a280,...) at sleepq_switch+0x1b9/frame 0xf5d56aec sleepq_catch_signals(c11b9ca4,f5d56b5c,c0a73729,c793a290,0,...) at sleepq_catch_signals+0x361/frame 0xf5d56b34 sleepq_timedwait_sig(c784cd90,0,f5d56b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d56b5c _cv_timedwait_sig_sbt(c784cd90,c793a280,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d56ba8 svc_run_internal(f5d56cf4,c0a5692f,c793a280,f5d56d08,c1080960,...) at svc_run_internal+0xa5d/frame 0xf5d56cc4 svc_thread_start(c793a280,f5d56d08,c1080960,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d56ccc fork_exit(c0c8f740,c793a280,f5d56d08) at fork_exit+0x7f/frame 0xf5d56cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d56cf4 --- trap 0x3cb72e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 588 tid 100096 td 0xc7e09300 sched_switch(c7e09300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cbf2fc mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5cbf330 sleepq_switch(c7e09300,0,c108cb51,1ab,c793a280,...) at sleepq_switch+0x1b9/frame 0xf5cbf364 sleepq_catch_signals(c11b9ca4,f5cbf3d4,c0a73729,c793a290,0,...) at sleepq_catch_signals+0x361/frame 0xf5cbf3ac sleepq_timedwait_sig(c7c7f1d0,0,f5cbf40c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5cbf3d4 _cv_timedwait_sig_sbt(c7c7f1d0,c793a280,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cbf420 svc_run_internal(c0c8f740,c793a280,c7dff2e8,f5cbf568,0,...) at svc_run_internal+0xa5d/frame 0xf5cbf53c svc_run(c793a280,0,c107225f,1b5,0,...) at svc_run+0xc3/frame 0xf5cbf578 nfsrvd_nfsd(c7e09300,f5cbf6d0,c,246,c7951ed0,...) at nfsrvd_nfsd+0x1a2/frame 0xf5cbf6b0 nfssvc_nfsd(c7e09300,f5cbfcc8,0,c7e09300,f5cbfcfc,...) at nfssvc_nfsd+0xf4/frame 0xf5cbfc28 sys_nfssvc(c7e09300,f5cbfcc8,c10dec7f,d6,0,...) at sys_nfssvc+0xbf/frame 0xf5cbfc40 syscall(f5cbfd08) at syscall+0x2ed/frame 0xf5cbfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cbfcfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c26db, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 584 tid 100106 td 0xc7d64900 sched_switch(c7d64900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cf390c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5cf3940 sleepq_switch(c7d64900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cf3974 sleepq_catch_signals(f5cf39e0,c0a73729,c7d973a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cf39bc sleepq_wait_sig(c7d973a4,0,f5cf3a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cf39e0 _cv_wait_sig(c7d973a4,c7d97390,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5cf3a24 seltdwait(ffffffff,0,0,c7d64900,0,...) at seltdwait+0x90/frame 0xf5cf3a58 kern_select(c7d64900,7,bfbfdc30,0,0,...) at kern_select+0x88c/frame 0xf5cf3bf8 sys_select(c7d64900,f5cf3cc8,7b3,2,f5cf3cc4,...) at sys_select+0x69/frame 0xf5cf3c40 syscall(f5cf3d08) at syscall+0x2ed/frame 0xf5cf3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cf3cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189f87, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 578 tid 100109 td 0xc7e29c00 sched_switch(c7e29c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d326ec mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5d32720 sleepq_switch(c7e29c00,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf5d32754 sleepq_wait(c7d4d73c,60,c1076516,4,0,...) at sleepq_wait+0x48/frame 0xf5d32778 sleeplk(c7d4d7a8,c1076516,60,33,0,...) at sleeplk+0x126/frame 0xf5d327c0 __lockmgr_args(c7d4d73c,400400,c7d4d7a8,0,0,...) at __lockmgr_args+0xa44/frame 0xf5d328a0 ffs_lock(f5d32928,0,c7e29c00,3,f5d32960,...) at ffs_lock+0xad/frame 0xf5d328e0 VOP_LOCK1_APV(c11e446c,f5d32928,f5d32950,c0ecf1c0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5d32910 _vn_lock(c7d4d708,400400,c1096c53,388,f5d32998,...) at _vn_lock+0xca/frame 0xf5d32950 lookup(f5d32a88,c1096c53,107,ce,c10c1d4c,...) at lookup+0xca0/frame 0xf5d329b8 namei(f5d32a88,152,bfbfd700,8,8,...) at namei+0x47d/frame 0xf5d32a40 vfs_donmount(c7e29c00,1300,0,c96cc200,c96cc200,...) at vfs_donmount+0x8b8/frame 0xf5d32c18 sys_nmount(c7e29c00,f5d32cc8,0,0,c7e29c00,...) at sys_nmount+0x78/frame 0xf5d32c40 syscall(f5d32d08) at syscall+0x2ed/frame 0xf5d32cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d32cfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280d8f5b, esp = 0xbfbfd7ac, ebp = 0xbfbfdd08 --- Tracing command nfsuserd pid 571 tid 100098 td 0xc7e08c00 sched_switch(c7e08c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cc7900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cc7934 sleepq_switch(c7e08c00,0,c108cb51,1ab,c7c8f010,...) at sleepq_switch+0x1b9/frame 0xf5cc7968 sleepq_catch_signals(c11b9ca4,f5cc79d8,c0a73729,c7c8f020,0,...) at sleepq_catch_signals+0x361/frame 0xf5cc79b0 sleepq_timedwait_sig(c7c8f024,0,f5cc7a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5cc79d8 _cv_timedwait_sig_sbt(c7c8f024,c7c8f010,e1909f51,f9e3,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cc7a24 seltdwait(f9e3,e0000000,1,c7e08c00,0,...) at seltdwait+0xbc/frame 0xf5cc7a58 kern_select(c7e08c00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5cc7bf8 sys_select(c7e08c00,f5cc7cc8,c0eb32b0,c7200c90,0,...) at sys_select+0x69/frame 0xf5cc7c40 syscall(f5cc7d08) at syscall+0x2ed/frame 0xf5cc7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cc7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 570 tid 100110 td 0xc7e29900 sched_switch(c7e29900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d359bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d359f0 sleepq_switch(c7e29900,0,c108cb51,1ab,f5d35a68,...) at sleepq_switch+0x1b9/frame 0xf5d35a24 sleepq_catch_signals(0,c108cb51,162,780,c7e29900,...) at sleepq_catch_signals+0x361/frame 0xf5d35a6c sleepq_wait_sig(c80f88d8,68,c10935e9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d35a90 _sleep(c80f88d8,c80f8898,168,c10935e9,0,0,0,0,100) at _sleep+0x35b/frame 0xf5d35aec sbwait(c80f8874,0,c109387d,8d8,c7d75658,...) at sbwait+0xb8/frame 0xf5d35b24 soreceive_dgram(c80f8820,f5d35ba8,f5d35bb0,0,f5d35bac,...) at soreceive_dgram+0x101/frame 0xf5d35b70 kern_recvit(c7e29900,3,f5d35c10,0,0,...) at kern_recvit+0x1f0/frame 0xf5d35be8 sys_recvmsg(c7e29900,f5d35cc8,c0eb32b0,c71fac90,0,...) at sys_recvmsg+0x9d/frame 0xf5d35c40 syscall(f5d35d08) at syscall+0x2ed/frame 0xf5d35cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d35cfc --- syscall (27, FreeBSD ELF32, sys_recvmsg), eip = 0x2811f2ef, esp = 0xbfbfd4ac, ebp = 0xbfbfd5b8 --- Tracing command nfsuserd pid 569 tid 100111 td 0xc7e29600 sched_switch(c7e29600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d389bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d389f0 sleepq_switch(c7e29600,0,c108cb51,1ab,f5d38a68,...) at sleepq_switch+0x1b9/frame 0xf5d38a24 sleepq_catch_signals(0,c108cb51,162,780,c7e29600,...) at sleepq_catch_signals+0x361/frame 0xf5d38a6c sleepq_wait_sig(c80f88d8,68,c10935e9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d38a90 _sleep(c80f88d8,c80f8898,168,c10935e9,0,0,0,0,100) at _sleep+0x35b/frame 0xf5d38aec sbwait(c80f8874,0,c109387d,8d8,c7d75658,...) at sbwait+0xb8/frame 0xf5d38b24 soreceive_dgram(c80f8820,f5d38ba8,f5d38bb0,0,f5d38bac,...) at soreceive_dgram+0x101/frame 0xf5d38b70 kern_recvit(c7e29600,3,f5d38c10,0,0,...) at kern_recvit+0x1f0/frame 0xf5d38be8 sys_recvmsg(c7e29600,f5d38cc8,8,c10874bc,db,...) at sys_recvmsg+0x9d/frame 0xf5d38c40 syscall(f5d38d08) at syscall+0x2ed/frame 0xf5d38cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d38cfc --- syscall (27, FreeBSD ELF32, sys_recvmsg), eip = 0x2811f2ef, esp = 0xbfbfd4ac, ebp = 0xbfbfd5b8 --- Tracing command nfsuserd pid 568 tid 100112 td 0xc7e29300 sched_switch(c7e29300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d3b9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d3b9f0 sleepq_switch(c7e29300,0,c108cb51,1ab,f5d3ba68,...) at sleepq_switch+0x1b9/frame 0xf5d3ba24 sleepq_catch_signals(0,c108cb51,162,780,c7e29300,...) at sleepq_catch_signals+0x361/frame 0xf5d3ba6c sleepq_wait_sig(c80f88d8,68,c10935e9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d3ba90 _sleep(c80f88d8,c80f8898,168,c10935e9,0,0,0,0,100) at _sleep+0x35b/frame 0xf5d3baec sbwait(c80f8874,0,c109387d,8d8,c7d75658,...) at sbwait+0xb8/frame 0xf5d3bb24 soreceive_dgram(c80f8820,f5d3bba8,f5d3bbb0,0,f5d3bbac,...) at soreceive_dgram+0x101/frame 0xf5d3bb70 kern_recvit(c7e29300,3,f5d3bc10,0,0,...) at kern_recvit+0x1f0/frame 0xf5d3bbe8 sys_recvmsg(c7e29300,f5d3bcc8,c0eb32b0,c71fac90,0,...) at sys_recvmsg+0x9d/frame 0xf5d3bc40 syscall(f5d3bd08) at syscall+0x2ed/frame 0xf5d3bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d3bcfc --- syscall (27, FreeBSD ELF32, sys_recvmsg), eip = 0x2811f2ef, esp = 0xbfbfd4ac, ebp = 0xbfbfd5b8 --- Tracing command nfsuserd pid 567 tid 100100 td 0xc7e08600 sched_switch(c7e08600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ccfaa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5ccfad4 sleepq_switch(c7e08600,0,c108cb51,1ab,f5ccfb4c,...) at sleepq_switch+0x1b9/frame 0xf5ccfb08 sleepq_catch_signals(0,c108cb51,162,16b0,c7e08600,...) at sleepq_catch_signals+0x361/frame 0xf5ccfb50 sleepq_wait_sig(c7dfc634,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5ccfb74 _sleep(c7dfc634,c7dfc664,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5ccfbd0 kern_sigsuspend(c7e08600,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5ccfc10 sys_sigsuspend(c7e08600,f5ccfcc8,c0eb32b0,c7200c90,0,...) at sys_sigsuspend+0x58/frame 0xf5ccfc40 syscall(f5ccfd08) at syscall+0x2ed/frame 0xf5ccfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ccfcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c10ab, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command rpcbind pid 538 tid 100103 td 0xc7d68000 sched_switch(c7d68000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cdb978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cdb9ac sleepq_switch(c7d68000,0,c108cb51,1ab,c7c8fd90,...) at sleepq_switch+0x1b9/frame 0xf5cdb9e0 sleepq_catch_signals(c11b9ca4,f5cdba50,c0a73729,c7c8fda0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cdba28 sleepq_timedwait_sig(c7c8fda4,0,f5cdba88,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5cdba50 _cv_timedwait_sig_sbt(c7c8fda4,c7c8fd90,a1d2d479,f9c6,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cdba9c seltdwait(f9c6,dffffdd5,1,c7d68000,0,...) at seltdwait+0xbc/frame 0xf5cdbad0 sys_poll(c7d68000,f5cdbcc8,8,c10874bc,db,...) at sys_poll+0x44c/frame 0xf5cdbc40 syscall(f5cdbd08) at syscall+0x2ed/frame 0xf5cdbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cdbcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813e2df, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 523 tid 100091 td 0xc78f9c00 sched_switch(c78f9c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5caa90c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5caa940 sleepq_switch(c78f9c00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5caa974 sleepq_catch_signals(f5caa9e0,c0a73729,c7d974a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5caa9bc sleepq_wait_sig(c7d974a4,0,f5caaa10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5caa9e0 _cv_wait_sig(c7d974a4,c7d97490,c108f895,68e,c78f9c00,...) at _cv_wait_sig+0x200/frame 0xf5caaa24 seltdwait(ffffffff,0,0,c78f9c00,0,...) at seltdwait+0x90/frame 0xf5caaa58 kern_select(c78f9c00,9,28849100,0,0,...) at kern_select+0x88c/frame 0xf5caabf8 sys_select(c78f9c00,f5caacc8,c0eb32b0,c7200c90,0,...) at sys_select+0x69/frame 0xf5caac40 syscall(f5caad08) at syscall+0x2ed/frame 0xf5caacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5caacfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2819ff87, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 420 tid 100097 td 0xc7e09000 sched_switch(c7e09000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cc3900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cc3934 sleepq_switch(c7e09000,0,c108cb51,1ab,c7c0a250,...) at sleepq_switch+0x1b9/frame 0xf5cc3968 sleepq_catch_signals(c11b9ca4,f5cc39d8,c0a73729,c7c0a260,0,...) at sleepq_catch_signals+0x361/frame 0xf5cc39b0 sleepq_timedwait_sig(c7c0a264,0,f5cc3a10,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5cc39d8 _cv_timedwait_sig_sbt(c7c0a264,c7c0a250,9fc5f521,f9f4,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cc3a24 seltdwait(f9f4,c0000000,3,c7e09000,0,...) at seltdwait+0xbc/frame 0xf5cc3a58 kern_select(c7e09000,5,bfbfd998,0,0,...) at kern_select+0x88c/frame 0xf5cc3bf8 sys_select(c7e09000,f5cc3cc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5cc3c40 syscall(f5cc3d08) at syscall+0x2ed/frame 0xf5cc3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cc3cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095dc3, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc794c000 sched_switch(c794c000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0799ba4 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf0799bd8 sleepq_switch(c794c000,0,c108cb51,28e,c794c000,...) at sleepq_switch+0x1b9/frame 0xf0799c0c sleepq_timedwait(c13ae994,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0799c30 _sleep(c13ae994,c13ae914,54,c10bf0a0,fffffed8,...) at _sleep+0x345/frame 0xf0799c8c softdep_flush(0,f0799d08,c1080960,3d7,0,...) at softdep_flush+0x27c/frame 0xf0799ccc fork_exit(c0ce85d0,0,f0799d08) at fork_exit+0x7f/frame 0xf0799cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0799cf4 --- trap 0, eip = 0, esp = 0xf0799d40, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc794c300 sched_switch(c794c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0796b78 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf0796bac sleepq_switch(c794c300,0,c108cb51,28e,0,...) at sleepq_switch+0x1b9/frame 0xf0796be0 sleepq_timedwait(c13aa424,0,f0796c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xf0796c04 _cv_timedwait_sbt(c13aa424,c13aa404,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xf0796c50 sched_sync(0,f0796d08,c1080960,3d7,0,...) at sched_sync+0x682/frame 0xf0796ccc fork_exit(c0b32990,0,f0796d08) at fork_exit+0x7f/frame 0xf0796cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0796cf4 --- trap 0, eip = 0, esp = 0xf0796d40, ebp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xc794c600 sched_switch(c794c600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0793b78 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf0793bac sleepq_switch(c794c600,0,c108cb51,28e,c794c600,...) at sleepq_switch+0x1b9/frame 0xf0793be0 sleepq_timedwait(c7c30ba0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0793c04 _sleep(c7c30ba0,c13aa3dc,260,c1098ba6,fffffed8,...) at _sleep+0x345/frame 0xf0793c60 vnlru_proc(0,f0793d08,c1080960,3d7,0,...) at vnlru_proc+0xcf/frame 0xf0793ccc fork_exit(c0b331d0,0,f0793d08) at fork_exit+0x7f/frame 0xf0793cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0793cf4 --- trap 0, eip = 0, esp = 0xf0793d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc794c900 sched_switch(c794c900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0790bb0 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf0790be4 sleepq_switch(c794c900,0,c108cb51,28e,c794c900,...) at sleepq_switch+0x1b9/frame 0xf0790c18 sleepq_timedwait(c13aa19c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0790c3c _sleep(c13aa19c,c13aa184,54,c109566c,fffffed8,...) at _sleep+0x345/frame 0xf0790c98 buf_daemon(0,f0790d08,c1080960,3d7,0,...) at buf_daemon+0x8c/frame 0xf0790ccc fork_exit(c0b163c0,0,f0790d08) at fork_exit+0x7f/frame 0xf0790cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0790cf4 --- trap 0, eip = 0, esp = 0xf0790d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc794cc00 sched_switch(c794cc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bfebac mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bfebe0 sleepq_switch(c794cc00,0,c108cb51,28e,c794cc00,...) at sleepq_switch+0x1b9/frame 0xe3bfec14 sleepq_timedwait(c13af294,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bfec38 _sleep(c13af294,c1403400,0,c10c6347,fffea520,...) at _sleep+0x345/frame 0xe3bfec94 vm_pagezero(0,e3bfed08,c1080960,3d7,0,...) at vm_pagezero+0xc2/frame 0xe3bfeccc fork_exit(c0d2fa70,0,e3bfed08) at fork_exit+0x7f/frame 0xe3bfecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfecf4 --- trap 0, eip = 0, esp = 0xe3bfed40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc794d000 sched_switch(c794d000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bfbb78 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bfbbac sleepq_switch(c794d000,0,c108cb51,26b,c794d000,...) at sleepq_switch+0x1b9/frame 0xe3bfbbe0 sleepq_wait(c13aee5c,74,c109566c,0,0,...) at sleepq_wait+0x48/frame 0xe3bfbc04 _sleep(c13aee5c,c13aee44,74,c109566c,0,...) at _sleep+0x37c/frame 0xe3bfbc60 vm_daemon(0,e3bfbd08,c1080960,3d7,0,...) at vm_daemon+0xac/frame 0xe3bfbccc fork_exit(c0d27750,0,e3bfbd08) at fork_exit+0x7f/frame 0xe3bfbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfbcf4 --- trap 0, eip = 0, esp = 0xe3bfbd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc794d300 sched_switch(c794d300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bf8b30 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bf8b64 sleepq_switch(c794d300,0,c108cb51,28e,c794d300,...) at sleepq_switch+0x1b9/frame 0xe3bf8b98 sleepq_timedwait(c1403484,54,4,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bf8bbc _sleep(c1403484,c1403400,54,c109566c,fffffa38,...) at _sleep+0x345/frame 0xe3bf8c18 vm_pageout(0,e3bf8d08,c1080960,3d7,0,...) at vm_pageout+0x290/frame 0xe3bf8ccc fork_exit(c0d27f70,0,e3bf8d08) at fork_exit+0x7f/frame 0xe3bf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf8cf4 --- trap 0, eip = 0, esp = 0xe3bf8d40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc794d600 sched_switch(c794d600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bb5bb0 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bb5be4 sleepq_switch(c794d600,0,c108cb51,26b,c794d600,...) at sleepq_switch+0x1b9/frame 0xe3bb5c18 sleepq_wait(c11fefa4,5c,c0edb000,0,0,...) at sleepq_wait+0x48/frame 0xe3bb5c3c _sleep(c11fefa4,c11feff4,5c,c0edb000,0,...) at _sleep+0x37c/frame 0xe3bb5c98 xpt_scanner_thread(0,e3bb5d08,c1080960,3d7,0,...) at xpt_scanner_thread+0x11c/frame 0xe3bb5ccc fork_exit(c04b21c0,0,e3bb5d08) at fork_exit+0x7f/frame 0xe3bb5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bb5cf4 --- trap 0, eip = 0, esp = 0xe3bb5d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc794d900 sched_switch(c794d900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bb2bb8 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bb2bec sleepq_switch(c794d900,0,c108cb51,26b,c794d900,...) at sleepq_switch+0x1b9/frame 0xe3bb2c20 sleepq_wait(c13fee58,0,c10ac0e5,0,0,...) at sleepq_wait+0x48/frame 0xe3bb2c44 _sleep(c13fee58,c13fee20,0,c10ac0e5,0,...) at _sleep+0x37c/frame 0xe3bb2ca0 sctp_iterator_thread(0,e3bb2d08,c1080960,3d7,0,...) at sctp_iterator_thread+0x7c/frame 0xe3bb2ccc fork_exit(c0bd22c0,0,e3bb2d08) at fork_exit+0x7f/frame 0xe3bb2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bb2cf4 --- trap 0, eip = 0, esp = 0xe3bb2d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc78e9900 sched_switch(c78e9900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3ba2b48 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3ba2b7c sleepq_switch(c78e9900,0,c108cb51,28e,c78e9900,...) at sleepq_switch+0x1b9/frame 0xe3ba2bb0 sleepq_timedwait(c789bc3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3ba2bd4 _sleep(c789bc3c,c789bcf0,5c,c1072c22,fffffed8,...) at _sleep+0x345/frame 0xe3ba2c30 fdc_thread(c789bc00,e3ba2d08,c1080960,3d7,0,...) at fdc_thread+0x877/frame 0xe3ba2ccc fork_exit(c0e3a270,c789bc00,e3ba2d08) at fork_exit+0x7f/frame 0xe3ba2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba2cf4 --- trap 0, eip = 0, esp = 0xe3ba2d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc78f7300 sched_switch(c78f7300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b7ebd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b7ec08 sleepq_switch(c78f7300,0,c108cb51,26b,c78f7300,...) at sleepq_switch+0x1b9/frame 0xe3b7ec3c sleepq_wait(c78ffd34,0,e3b7ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b7ec60 _cv_wait(c78ffd34,c78ffe4c,c10643f7,77,c78ffd3c,...) at _cv_wait+0x1f9/frame 0xe3b7eca4 usb_process(c78ffd2c,e3b7ed08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b7eccc fork_exit(c09376f0,c78ffd2c,e3b7ed08) at fork_exit+0x7f/frame 0xe3b7ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b7ecf4 --- trap 0, eip = 0, esp = 0xe3b7ed40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc78f7600 sched_switch(c78f7600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b7bbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b7bc08 sleepq_switch(c78f7600,0,c108cb51,26b,c78f7600,...) at sleepq_switch+0x1b9/frame 0xe3b7bc3c sleepq_wait(c78ffd04,0,e3b7bc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b7bc60 _cv_wait(c78ffd04,c78ffe4c,c10643f7,77,c78ffd0c,...) at _cv_wait+0x1f9/frame 0xe3b7bca4 usb_process(c78ffcfc,e3b7bd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b7bccc fork_exit(c09376f0,c78ffcfc,e3b7bd08) at fork_exit+0x7f/frame 0xe3b7bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b7bcf4 --- trap 0, eip = 0, esp = 0xe3b7bd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc78f7900 sched_switch(c78f7900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b78bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b78c08 sleepq_switch(c78f7900,0,c108cb51,26b,c78f7900,...) at sleepq_switch+0x1b9/frame 0xe3b78c3c sleepq_wait(c78ffcd4,0,e3b78c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b78c60 _cv_wait(c78ffcd4,c78ffe4c,c10643f7,77,c78ffcdc,...) at _cv_wait+0x1f9/frame 0xe3b78ca4 usb_process(c78ffccc,e3b78d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b78ccc fork_exit(c09376f0,c78ffccc,e3b78d08) at fork_exit+0x7f/frame 0xe3b78cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b78cf4 --- trap 0, eip = 0, esp = 0xe3b78d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc78f7c00 sched_switch(c78f7c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b75bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b75c08 sleepq_switch(c78f7c00,0,c108cb51,26b,c78f7c00,...) at sleepq_switch+0x1b9/frame 0xe3b75c3c sleepq_wait(c78ffca4,0,e3b75c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b75c60 _cv_wait(c78ffca4,c78ffe4c,c10643f7,77,c78ffcac,...) at _cv_wait+0x1f9/frame 0xe3b75ca4 usb_process(c78ffc9c,e3b75d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b75ccc fork_exit(c09376f0,c78ffc9c,e3b75d08) at fork_exit+0x7f/frame 0xe3b75cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b75cf4 --- trap 0, eip = 0, esp = 0xe3b75d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc78f9300 sched_switch(c78f9300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b6cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b6cc08 sleepq_switch(c78f9300,0,c108cb51,26b,c78f9300,...) at sleepq_switch+0x1b9/frame 0xe3b6cc3c sleepq_wait(c78f3b5c,0,e3b6cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b6cc60 _cv_wait(c78f3b5c,c78f3c74,c10643f7,77,c78f3b64,...) at _cv_wait+0x1f9/frame 0xe3b6cca4 usb_process(c78f3b54,e3b6cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b6cccc fork_exit(c09376f0,c78f3b54,e3b6cd08) at fork_exit+0x7f/frame 0xe3b6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b6ccf4 --- trap 0, eip = 0, esp = 0xe3b6cd40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc78f9600 sched_switch(c78f9600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b69bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b69c08 sleepq_switch(c78f9600,0,c108cb51,26b,c78f9600,...) at sleepq_switch+0x1b9/frame 0xe3b69c3c sleepq_wait(c78f3b2c,0,e3b69c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b69c60 _cv_wait(c78f3b2c,c78f3c74,c10643f7,77,c78f3b34,...) at _cv_wait+0x1f9/frame 0xe3b69ca4 usb_process(c78f3b24,e3b69d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b69ccc fork_exit(c09376f0,c78f3b24,e3b69d08) at fork_exit+0x7f/frame 0xe3b69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b69cf4 --- trap 0, eip = 0, esp = 0xe3b69d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc78e6000 sched_switch(c78e6000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b66bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b66c08 sleepq_switch(c78e6000,0,c108cb51,26b,c78e6000,...) at sleepq_switch+0x1b9/frame 0xe3b66c3c sleepq_wait(c78f3afc,0,e3b66c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b66c60 _cv_wait(c78f3afc,c78f3c74,c10643f7,77,c78f3b04,...) at _cv_wait+0x1f9/frame 0xe3b66ca4 usb_process(c78f3af4,e3b66d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b66ccc fork_exit(c09376f0,c78f3af4,e3b66d08) at fork_exit+0x7f/frame 0xe3b66cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b66cf4 --- trap 0, eip = 0, esp = 0xe3b66d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc78e6300 sched_switch(c78e6300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b63bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b63c08 sleepq_switch(c78e6300,0,c108cb51,26b,c78e6300,...) at sleepq_switch+0x1b9/frame 0xe3b63c3c sleepq_wait(c78f3acc,0,e3b63c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b63c60 _cv_wait(c78f3acc,c78f3c74,c10643f7,77,c78f3ad4,...) at _cv_wait+0x1f9/frame 0xe3b63ca4 usb_process(c78f3ac4,e3b63d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b63ccc fork_exit(c09376f0,c78f3ac4,e3b63d08) at fork_exit+0x7f/frame 0xe3b63cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b63cf4 --- trap 0, eip = 0, esp = 0xe3b63d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc78e6600 sched_switch(c78e6600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b5fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5fc08 sleepq_switch(c78e6600,0,c108cb51,26b,c78e6600,...) at sleepq_switch+0x1b9/frame 0xe3b5fc3c sleepq_wait(c78efb5c,0,e3b5fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5fc60 _cv_wait(c78efb5c,c78efc74,c10643f7,77,c78efb64,...) at _cv_wait+0x1f9/frame 0xe3b5fca4 usb_process(c78efb54,e3b5fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b5fccc fork_exit(c09376f0,c78efb54,e3b5fd08) at fork_exit+0x7f/frame 0xe3b5fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5fcf4 --- trap 0, eip = 0, esp = 0xe3b5fd40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc78e6900 sched_switch(c78e6900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b5cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5cc08 sleepq_switch(c78e6900,0,c108cb51,26b,c78e6900,...) at sleepq_switch+0x1b9/frame 0xe3b5cc3c sleepq_wait(c78efb2c,0,e3b5cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5cc60 _cv_wait(c78efb2c,c78efc74,c10643f7,77,c78efb34,...) at _cv_wait+0x1f9/frame 0xe3b5cca4 usb_process(c78efb24,e3b5cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b5cccc fork_exit(c09376f0,c78efb24,e3b5cd08) at fork_exit+0x7f/frame 0xe3b5ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5ccf4 --- trap 0, eip = 0, esp = 0xe3b5cd40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc78e6c00 sched_switch(c78e6c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b59bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b59c08 sleepq_switch(c78e6c00,0,c108cb51,26b,c78e6c00,...) at sleepq_switch+0x1b9/frame 0xe3b59c3c sleepq_wait(c78efafc,0,e3b59c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b59c60 _cv_wait(c78efafc,c78efc74,c10643f7,77,c78efb04,...) at _cv_wait+0x1f9/frame 0xe3b59ca4 usb_process(c78efaf4,e3b59d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b59ccc fork_exit(c09376f0,c78efaf4,e3b59d08) at fork_exit+0x7f/frame 0xe3b59cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b59cf4 --- trap 0, eip = 0, esp = 0xe3b59d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc78e7000 sched_switch(c78e7000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b56bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b56c08 sleepq_switch(c78e7000,0,c108cb51,26b,c78e7000,...) at sleepq_switch+0x1b9/frame 0xe3b56c3c sleepq_wait(c78efacc,0,e3b56c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b56c60 _cv_wait(c78efacc,c78efc74,c10643f7,77,c78efad4,...) at _cv_wait+0x1f9/frame 0xe3b56ca4 usb_process(c78efac4,e3b56d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b56ccc fork_exit(c09376f0,c78efac4,e3b56d08) at fork_exit+0x7f/frame 0xe3b56cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b56cf4 --- trap 0, eip = 0, esp = 0xe3b56d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc78e7300 sched_switch(c78e7300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b52bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b52c08 sleepq_switch(c78e7300,0,c108cb51,26b,c78e7300,...) at sleepq_switch+0x1b9/frame 0xe3b52c3c sleepq_wait(c78e2b5c,0,e3b52c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b52c60 _cv_wait(c78e2b5c,c78e2c74,c10643f7,77,c78e2b64,...) at _cv_wait+0x1f9/frame 0xe3b52ca4 usb_process(c78e2b54,e3b52d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b52ccc fork_exit(c09376f0,c78e2b54,e3b52d08) at fork_exit+0x7f/frame 0xe3b52cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b52cf4 --- trap 0, eip = 0, esp = 0xe3b52d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc78e7600 sched_switch(c78e7600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b4fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4fc08 sleepq_switch(c78e7600,0,c108cb51,26b,c78e7600,...) at sleepq_switch+0x1b9/frame 0xe3b4fc3c sleepq_wait(c78e2b2c,0,e3b4fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4fc60 _cv_wait(c78e2b2c,c78e2c74,c10643f7,77,c78e2b34,...) at _cv_wait+0x1f9/frame 0xe3b4fca4 usb_process(c78e2b24,e3b4fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b4fccc fork_exit(c09376f0,c78e2b24,e3b4fd08) at fork_exit+0x7f/frame 0xe3b4fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4fcf4 --- trap 0, eip = 0, esp = 0xe3b4fd40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc78e7900 sched_switch(c78e7900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b4cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4cc08 sleepq_switch(c78e7900,0,c108cb51,26b,c78e7900,...) at sleepq_switch+0x1b9/frame 0xe3b4cc3c sleepq_wait(c78e2afc,0,e3b4cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4cc60 _cv_wait(c78e2afc,c78e2c74,c10643f7,77,c78e2b04,...) at _cv_wait+0x1f9/frame 0xe3b4cca4 usb_process(c78e2af4,e3b4cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b4cccc fork_exit(c09376f0,c78e2af4,e3b4cd08) at fork_exit+0x7f/frame 0xe3b4ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4ccf4 --- trap 0, eip = 0, esp = 0xe3b4cd40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc78e7c00 sched_switch(c78e7c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b49bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b49c08 sleepq_switch(c78e7c00,0,c108cb51,26b,c78e7c00,...) at sleepq_switch+0x1b9/frame 0xe3b49c3c sleepq_wait(c78e2acc,0,e3b49c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b49c60 _cv_wait(c78e2acc,c78e2c74,c10643f7,77,c78e2ad4,...) at _cv_wait+0x1f9/frame 0xe3b49ca4 usb_process(c78e2ac4,e3b49d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b49ccc fork_exit(c09376f0,c78e2ac4,e3b49d08) at fork_exit+0x7f/frame 0xe3b49cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b49cf4 --- trap 0, eip = 0, esp = 0xe3b49d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc78d8000 sched_switch(c78d8000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b42bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b42c08 sleepq_switch(c78d8000,0,c108cb51,26b,c78d8000,...) at sleepq_switch+0x1b9/frame 0xe3b42c3c sleepq_wait(c78ddb5c,0,e3b42c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b42c60 _cv_wait(c78ddb5c,c78ddc74,c10643f7,77,c78ddb64,...) at _cv_wait+0x1f9/frame 0xe3b42ca4 usb_process(c78ddb54,e3b42d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b42ccc fork_exit(c09376f0,c78ddb54,e3b42d08) at fork_exit+0x7f/frame 0xe3b42cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b42cf4 --- trap 0, eip = 0, esp = 0xe3b42d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc78d8300 sched_switch(c78d8300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b3fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3fc08 sleepq_switch(c78d8300,0,c108cb51,26b,c78d8300,...) at sleepq_switch+0x1b9/frame 0xe3b3fc3c sleepq_wait(c78ddb2c,0,e3b3fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3fc60 _cv_wait(c78ddb2c,c78ddc74,c10643f7,77,c78ddb34,...) at _cv_wait+0x1f9/frame 0xe3b3fca4 usb_process(c78ddb24,e3b3fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b3fccc fork_exit(c09376f0,c78ddb24,e3b3fd08) at fork_exit+0x7f/frame 0xe3b3fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3fcf4 --- trap 0, eip = 0, esp = 0xe3b3fd40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc78d8600 sched_switch(c78d8600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b3cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3cc08 sleepq_switch(c78d8600,0,c108cb51,26b,c78d8600,...) at sleepq_switch+0x1b9/frame 0xe3b3cc3c sleepq_wait(c78ddafc,0,e3b3cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3cc60 _cv_wait(c78ddafc,c78ddc74,c10643f7,77,c78ddb04,...) at _cv_wait+0x1f9/frame 0xe3b3cca4 usb_process(c78ddaf4,e3b3cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b3cccc fork_exit(c09376f0,c78ddaf4,e3b3cd08) at fork_exit+0x7f/frame 0xe3b3ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3ccf4 --- trap 0, eip = 0, esp = 0xe3b3cd40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc78d8900 sched_switch(c78d8900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b39bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b39c08 sleepq_switch(c78d8900,0,c108cb51,26b,c78d8900,...) at sleepq_switch+0x1b9/frame 0xe3b39c3c sleepq_wait(c78ddacc,0,e3b39c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b39c60 _cv_wait(c78ddacc,c78ddc74,c10643f7,77,c78ddad4,...) at _cv_wait+0x1f9/frame 0xe3b39ca4 usb_process(c78ddac4,e3b39d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b39ccc fork_exit(c09376f0,c78ddac4,e3b39d08) at fork_exit+0x7f/frame 0xe3b39cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b39cf4 --- trap 0, eip = 0, esp = 0xe3b39d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc78db000 sched_switch(c78db000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b32bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b32c08 sleepq_switch(c78db000,0,c108cb51,26b,c78db000,...) at sleepq_switch+0x1b9/frame 0xe3b32c3c sleepq_wait(c78d4b5c,0,e3b32c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b32c60 _cv_wait(c78d4b5c,c78d4c74,c10643f7,77,c78d4b64,...) at _cv_wait+0x1f9/frame 0xe3b32ca4 usb_process(c78d4b54,e3b32d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b32ccc fork_exit(c09376f0,c78d4b54,e3b32d08) at fork_exit+0x7f/frame 0xe3b32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b32cf4 --- trap 0, eip = 0, esp = 0xe3b32d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc78db300 sched_switch(c78db300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b2fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2fc08 sleepq_switch(c78db300,0,c108cb51,26b,c78db300,...) at sleepq_switch+0x1b9/frame 0xe3b2fc3c sleepq_wait(c78d4b2c,0,e3b2fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2fc60 _cv_wait(c78d4b2c,c78d4c74,c10643f7,77,c78d4b34,...) at _cv_wait+0x1f9/frame 0xe3b2fca4 usb_process(c78d4b24,e3b2fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b2fccc fork_exit(c09376f0,c78d4b24,e3b2fd08) at fork_exit+0x7f/frame 0xe3b2fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2fcf4 --- trap 0, eip = 0, esp = 0xe3b2fd40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc78db600 sched_switch(c78db600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b2cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2cc08 sleepq_switch(c78db600,0,c108cb51,26b,c78db600,...) at sleepq_switch+0x1b9/frame 0xe3b2cc3c sleepq_wait(c78d4afc,0,e3b2cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2cc60 _cv_wait(c78d4afc,c78d4c74,c10643f7,77,c78d4b04,...) at _cv_wait+0x1f9/frame 0xe3b2cca4 usb_process(c78d4af4,e3b2cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b2cccc fork_exit(c09376f0,c78d4af4,e3b2cd08) at fork_exit+0x7f/frame 0xe3b2ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2ccf4 --- trap 0, eip = 0, esp = 0xe3b2cd40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc78db900 sched_switch(c78db900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b29bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b29c08 sleepq_switch(c78db900,0,c108cb51,26b,c78db900,...) at sleepq_switch+0x1b9/frame 0xe3b29c3c sleepq_wait(c78d4acc,0,e3b29c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b29c60 _cv_wait(c78d4acc,c78d4c74,c10643f7,77,c78d4ad4,...) at _cv_wait+0x1f9/frame 0xe3b29ca4 usb_process(c78d4ac4,e3b29d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b29ccc fork_exit(c09376f0,c78d4ac4,e3b29d08) at fork_exit+0x7f/frame 0xe3b29cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b29cf4 --- trap 0, eip = 0, esp = 0xe3b29d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7776600 sched_switch(c7776600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7236bb4 mi_switch(104,0,c108cb51,1f5,c124f0f0,...) at mi_switch+0x1c9/frame 0xc7236be8 sleepq_switch(c7776600,0,c108cb51,28e,c1219104,...) at sleepq_switch+0x1b9/frame 0xc7236c1c sleepq_timedwait(c1219104,0,c1087a5d,c1072c22,0,...) at sleepq_timedwait+0x48/frame 0xc7236c40 msleep_spin_sbt(c1219104,c13f9790,c1072c22,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xc7236c88 random_kthread(0,c7236d08,c1080960,3d7,0,...) at random_kthread+0x2ea/frame 0xc7236ccc fork_exit(c0825e10,0,c7236d08) at fork_exit+0x7f/frame 0xc7236cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7236cf4 --- trap 0, eip = 0, esp = 0xc7236d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7776900 sched_switch(c7776900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7232b70 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc7232ba4 sleepq_switch(c7776900,0,c108cb51,26b,c7776900,...) at sleepq_switch+0x1b9/frame 0xc7232bd8 sleepq_wait(c13faa64,5c,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc7232bfc _sleep(c13faa64,c12306ac,25c,c1072c22,0,...) at _sleep+0x37c/frame 0xc7232c58 g_io_schedule_down(c7776900,0,c1074949,6c,c7232cf4,...) at g_io_schedule_down+0x5c/frame 0xc7232cb4 g_down_procbody(0,c7232d08,c1080960,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7232ccc fork_exit(c09e6610,0,c7232d08) at fork_exit+0x7f/frame 0xc7232cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7232cf4 --- trap 0, eip = 0, esp = 0xc7232d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7776c00 sched_switch(c7776c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc722fb98 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc722fbcc sleepq_switch(c7776c00,0,c108cb51,26b,c7776c00,...) at sleepq_switch+0x1b9/frame 0xc722fc00 sleepq_wait(c13faa60,5c,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc722fc24 _sleep(c13faa60,c12306cc,25c,c1072c22,0,...) at _sleep+0x37c/frame 0xc722fc80 g_io_schedule_up(c7776c00,0,c1074949,5f,c722fcf4,...) at g_io_schedule_up+0xe6/frame 0xc722fcb4 g_up_procbody(0,c722fd08,c1080960,3d7,0,...) at g_up_procbody+0x9d/frame 0xc722fccc fork_exit(c09e6570,0,c722fd08) at fork_exit+0x7f/frame 0xc722fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722fcf4 --- trap 0, eip = 0, esp = 0xc722fd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7777000 sched_switch(c7777000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc722cba8 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc722cbdc sleepq_switch(c7777000,0,c108cb51,26b,c7777000,...) at sleepq_switch+0x1b9/frame 0xc722cc10 sleepq_wait(c13faa5c,5c,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc722cc34 _sleep(c13faa5c,c1230684,25c,c1072c22,0,...) at _sleep+0x37c/frame 0xc722cc90 g_run_events(0,c722cd08,c1080960,3d7,0,...) at g_run_events+0x566/frame 0xc722cccc fork_exit(c09e64d0,0,c722cd08) at fork_exit+0x7f/frame 0xc722ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722ccf4 --- trap 0, eip = 0, esp = 0xc722cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc78e9300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc78e9600 sched_switch(c78e9600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3ba5c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3ba5c94 ithread_loop(c76c7910,e3ba5d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3ba5ccc fork_exit(c0a596b0,c76c7910,e3ba5d08) at fork_exit+0x7f/frame 0xe3ba5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba5cf4 --- trap 0, eip = 0, esp = 0xe3ba5d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc78e9c00 sched_switch(c78e9c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b95c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b95c94 ithread_loop(c76c7920,e3b95d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b95ccc fork_exit(c0a596b0,c76c7920,e3b95d08) at fork_exit+0x7f/frame 0xe3b95cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b95cf4 --- trap 0, eip = 0, esp = 0xe3b95d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc78f7000 sched_switch(c78f7000,0,109,1b5,c140cab4,...) at sched_switch+0x4b9/frame 0xe3b84c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b84c94 ithread_loop(c76c7940,e3b84d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b84ccc fork_exit(c0a596b0,c76c7940,e3b84d08) at fork_exit+0x7f/frame 0xe3b84cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b84cf4 --- trap 0, eip = 0, esp = 0xe3b84d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc78f9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc78e9000 sched_switch(c78e9000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b46c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b46c94 ithread_loop(c76c7960,e3b46d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b46ccc fork_exit(c0a596b0,c76c7960,e3b46d08) at fork_exit+0x7f/frame 0xe3b46cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b46cf4 --- trap 0, eip = 0, esp = 0xe3b46d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc78d8c00 sched_switch(c78d8c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b36c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b36c94 ithread_loop(c76c7970,e3b36d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b36ccc fork_exit(c0a596b0,c76c7970,e3b36d08) at fork_exit+0x7f/frame 0xe3b36cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b36cf4 --- trap 0, eip = 0, esp = 0xe3b36d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc78dbc00 sched_switch(c78dbc00,0,109,1b5,c140cab4,...) at sched_switch+0x4b9/frame 0xe3b26c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b26c94 ithread_loop(c76c7980,e3b26d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b26ccc fork_exit(c0a596b0,c76c7980,e3b26d08) at fork_exit+0x7f/frame 0xe3b26cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b26cf4 --- trap 0, eip = 0, esp = 0xe3b26d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7777300 sched_switch(c7777300,0,109,1b5,c140cab4,...) at sched_switch+0x4b9/frame 0xc7393c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7393c94 ithread_loop(c76c79d0,c7393d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7393ccc fork_exit(c0a596b0,c76c79d0,c7393d08) at fork_exit+0x7f/frame 0xc7393cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7393cf4 --- trap 0, eip = 0, esp = 0xc7393d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7777600 sched_switch(c7777600,0,109,1b5,c1080bfd,...) at sched_switch+0x4b9/frame 0xc738fc60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc738fc94 ithread_loop(c76c79e0,c738fd08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc738fccc fork_exit(c0a596b0,c76c79e0,c738fd08) at fork_exit+0x7f/frame 0xc738fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc738fcf4 --- trap 0, eip = 0, esp = 0xc738fd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7777900 sched_switch(c7777900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7286c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7286c94 ithread_loop(c76c7a00,c7286d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7286ccc fork_exit(c0a596b0,c76c7a00,c7286d08) at fork_exit+0x7f/frame 0xc7286cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7286cf4 --- trap 0, eip = 0, esp = 0xc7286d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7777c00 sched_switch(c7777c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7254c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7254c94 ithread_loop(c76c7a10,c7254d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7254ccc fork_exit(c0a596b0,c76c7a10,c7254d08) at fork_exit+0x7f/frame 0xc7254cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7254cf4 --- trap 0, eip = 0, esp = 0xc7254d40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc7869300 sched_switch(c7869300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc724ec60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc724ec94 ithread_loop(c76c7a30,c724ed08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc724eccc fork_exit(c0a596b0,c76c7a30,c724ed08) at fork_exit+0x7f/frame 0xc724ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724ecf4 --- trap 0, eip = 0, esp = 0xc724ed40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc7715c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc7776300 sched_switch(c7776300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7239c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7239c94 ithread_loop(c76c7ae0,c7239d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7239ccc fork_exit(c0a596b0,c76c7ae0,c7239d08) at fork_exit+0x7f/frame 0xc7239cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7239cf4 --- trap 0, eip = 0, esp = 0xc7239d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc76d2600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc76d2900 sched_switch(c76d2900,0,109,1b5,c1080bfd,...) at sched_switch+0x4b9/frame 0xc7223c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7223c94 ithread_loop(c76c7b10,c7223d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7223ccc fork_exit(c0a596b0,c76c7b10,c7223d08) at fork_exit+0x7f/frame 0xc7223cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7223cf4 --- trap 0, eip = 0, esp = 0xc7223d40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc76d2c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc7715000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc7715300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc7715600 sched_switch(c7715600,0,109,1b5,c1080bfd,...) at sched_switch+0x4b9/frame 0xc7217c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7217c94 ithread_loop(c76c7b50,c7217d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7217ccc fork_exit(c0a596b0,c76c7b50,c7217d08) at fork_exit+0x7f/frame 0xc7217cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7217cf4 --- trap 0, eip = 0, esp = 0xc7217d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc76cd000 sched_switch(c76cd000,0,108,1b0,c7213c50,...) at sched_switch+0x4b9/frame 0xc7213c1c mi_switch(108,0,c10893dd,a44,c1240c08,...) at mi_switch+0x1c9/frame 0xc7213c50 sched_idletd(0,c7213d08,c1080960,3d7,0,...) at sched_idletd+0xf1/frame 0xc7213ccc fork_exit(c0aafee0,0,c7213d08) at fork_exit+0x7f/frame 0xc7213cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7213cf4 --- trap 0, eip = 0, esp = 0xc7213d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc76cd300 sched_switch(c76cd300,0,108,1b0,c10893dd,...) at sched_switch+0x4b9/frame 0xc7210c1c mi_switch(108,0,c10893dd,407,c1240508,...) at mi_switch+0x1c9/frame 0xc7210c50 sched_idletd(0,c7210d08,c1080960,3d7,0,...) at sched_idletd+0x43b/frame 0xc7210ccc fork_exit(c0aafee0,0,c7210d08) at fork_exit+0x7f/frame 0xc7210cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7210cf4 --- trap 0, eip = 0, esp = 0xc7210d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc76cd600 sched_switch(c76cd600,0,108,1b0,c10893dd,...) at sched_switch+0x4b9/frame 0xc720dc1c mi_switch(108,0,c10893dd,407,c123fe08,...) at mi_switch+0x1c9/frame 0xc720dc50 sched_idletd(0,c720dd08,c1080960,3d7,0,...) at sched_idletd+0x43b/frame 0xc720dccc fork_exit(c0aafee0,0,c720dd08) at fork_exit+0x7f/frame 0xc720dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720dcf4 --- trap 0, eip = 0, esp = 0xc720dd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc76cd900 sched_switch(c76cd900,0,108,1b0,c10893dd,...) at sched_switch+0x4b9/frame 0xc720ac1c mi_switch(108,0,c10893dd,407,c123f708,...) at mi_switch+0x1c9/frame 0xc720ac50 sched_idletd(0,c720ad08,c1080960,3d7,0,...) at sched_idletd+0x43b/frame 0xc720accc fork_exit(c0aafee0,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc76cdc00 sched_switch(c76cdc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc720698c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xc72069c0 sleepq_switch(c76cdc00,0,c108cb51,1ab,c7206a38,...) at sleepq_switch+0x1b9/frame 0xc72069f4 sleepq_catch_signals(0,c108cb51,162,288,c76cdc00,...) at sleepq_catch_signals+0x361/frame 0xc7206a3c sleepq_wait_sig(c76cbba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7206a60 _sleep(c76cbba0,c76cbc34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xc7206abc kern_wait6(c76cdc00,7,0,0,c7206b4c,...) at kern_wait6+0x45c/frame 0xc7206b20 sys_wait4(c76cdc00,c7206cc8,8,c10874bc,db,...) at sys_wait4+0x94/frame 0xc7206c40 syscall(c7206d08) at syscall+0x2ed/frame 0xc7206cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7206cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805e3b7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc76d2000 sched_switch(c76d2000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7203ba8 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xc7203bdc sleepq_switch(c76d2000,0,c108cb51,26b,c76d2000,...) at sleepq_switch+0x1b9/frame 0xc7203c10 sleepq_wait(c1401f54,0,c7203c64,1,0,...) at sleepq_wait+0x48/frame 0xc7203c34 _cv_wait(c1401f54,c1401ee0,c10b85b2,18d,0,...) at _cv_wait+0x1f9/frame 0xc7203c78 audit_worker(0,c7203d08,c1080960,3d7,0,...) at audit_worker+0x94/frame 0xc7203ccc fork_exit(c0c9d810,0,c7203d08) at fork_exit+0x7f/frame 0xc7203cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7203cf4 --- trap 0, eip = 0, esp = 0xc7203d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc794dc00 sched_switch(c794dc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3baeb68 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3baeb9c sleepq_switch(c794dc00,0,c108cb51,28e,c794dc00,...) at sleepq_switch+0x1b9/frame 0xe3baebd0 sleepq_timedwait(c1232382,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xe3baebf4 _sleep(c1232382,0,0,c1072c22,fffffc88,...) at _sleep+0x345/frame 0xe3baec50 pause_sbt(c1072c22,fffffc88,2,0,0,...) at pause_sbt+0x86/frame 0xe3baec8c deadlkres(0,e3baed08,c1080960,3d7,0,...) at deadlkres+0x82/frame 0xe3baeccc fork_exit(c0a381c0,0,e3baed08) at fork_exit+0x7f/frame 0xe3baecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3baecf4 --- trap 0, eip = 0, esp = 0xe3baed40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc794e000 sched_switch(c794e000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3babbc0 mi_switch(104,0,c108cb51,1f5,c124f6c0,...) at mi_switch+0x1c9/frame 0xe3babbf4 sleepq_switch(c794e000,0,c108cb51,26b,c786d300,...) at sleepq_switch+0x1b9/frame 0xe3babc28 sleepq_wait(c786d300,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xe3babc4c msleep_spin_sbt(c786d300,c786d318,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xe3babc94 taskqueue_thread_loop(c13f7280,e3babd08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe3babccc fork_exit(c0acf3c0,c13f7280,e3babd08) at fork_exit+0x7f/frame 0xe3babcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3babcf4 --- trap 0, eip = 0, esp = 0xe3babd40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc7869000 sched_switch(c7869000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7251bac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc7251be0 sleepq_switch(c7869000,0,c108cb51,26b,c7869000,...) at sleepq_switch+0x1b9/frame 0xc7251c14 sleepq_wait(c76c6400,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc7251c38 _sleep(c76c6400,c76c6418,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc7251c94 taskqueue_thread_loop(c1401f90,c7251d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7251ccc fork_exit(c0acf3c0,c1401f90,c7251d08) at fork_exit+0x7f/frame 0xc7251cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7251cf4 --- trap 0, eip = 0, esp = 0xc7251d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc7869600 sched_switch(c7869600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc724bbac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc724bbe0 sleepq_switch(c7869600,0,c108cb51,26b,c7869600,...) at sleepq_switch+0x1b9/frame 0xc724bc14 sleepq_wait(c76c6500,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc724bc38 _sleep(c76c6500,c76c6518,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc724bc94 taskqueue_thread_loop(c13fb258,c724bd08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc724bccc fork_exit(c0acf3c0,c13fb258,c724bd08) at fork_exit+0x7f/frame 0xc724bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724bcf4 --- trap 0, eip = 0, esp = 0xc724bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc7869900 sched_switch(c7869900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7248bc0 mi_switch(104,0,c108cb51,1f5,c124f870,...) at mi_switch+0x1c9/frame 0xc7248bf4 sleepq_switch(c7869900,0,c108cb51,26b,c76c6580,...) at sleepq_switch+0x1b9/frame 0xc7248c28 sleepq_wait(c76c6580,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xc7248c4c msleep_spin_sbt(c76c6580,c76c6598,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7248c94 taskqueue_thread_loop(c13f7da0,c7248d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7248ccc fork_exit(c0acf3c0,c13f7da0,c7248d08) at fork_exit+0x7f/frame 0xc7248cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7248cf4 --- trap 0, eip = 0, esp = 0xc7248d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7869c00 sched_switch(c7869c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7245bc0 mi_switch(104,0,c108cb51,1f5,c124f870,...) at mi_switch+0x1c9/frame 0xc7245bf4 sleepq_switch(c7869c00,0,c108cb51,26b,c76c6580,...) at sleepq_switch+0x1b9/frame 0xc7245c28 sleepq_wait(c76c6580,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xc7245c4c msleep_spin_sbt(c76c6580,c76c6598,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7245c94 taskqueue_thread_loop(c13f7da0,c7245d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7245ccc fork_exit(c0acf3c0,c13f7da0,c7245d08) at fork_exit+0x7f/frame 0xc7245cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7245cf4 --- trap 0, eip = 0, esp = 0xc7245d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7715900 sched_switch(c7715900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7242bc0 mi_switch(104,0,c108cb51,1f5,c124f870,...) at mi_switch+0x1c9/frame 0xc7242bf4 sleepq_switch(c7715900,0,c108cb51,26b,c76c6580,...) at sleepq_switch+0x1b9/frame 0xc7242c28 sleepq_wait(c76c6580,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xc7242c4c msleep_spin_sbt(c76c6580,c76c6598,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7242c94 taskqueue_thread_loop(c13f7da0,c7242d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7242ccc fork_exit(c0acf3c0,c13f7da0,c7242d08) at fork_exit+0x7f/frame 0xc7242cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7242cf4 --- trap 0, eip = 0, esp = 0xc7242d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7776000 sched_switch(c7776000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc723cbac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc723cbe0 sleepq_switch(c7776000,0,c108cb51,26b,c7776000,...) at sleepq_switch+0x1b9/frame 0xc723cc14 sleepq_wait(c76c6700,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc723cc38 _sleep(c76c6700,c76c6718,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc723cc94 taskqueue_thread_loop(c13fe1c0,c723cd08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc723cccc fork_exit(c0acf3c0,c13fe1c0,c723cd08) at fork_exit+0x7f/frame 0xc723ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc723ccf4 --- trap 0, eip = 0, esp = 0xc723cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc76d2300 sched_switch(c76d2300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7229bac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc7229be0 sleepq_switch(c76d2300,0,c108cb51,26b,c76d2300,...) at sleepq_switch+0x1b9/frame 0xc7229c14 sleepq_wait(c7714000,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc7229c38 _sleep(c7714000,c7714018,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc7229c94 taskqueue_thread_loop(c124d7c4,c7229d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7229ccc fork_exit(c0acf3c0,c124d7c4,c7229d08) at fork_exit+0x7f/frame 0xc7229cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7229cf4 --- trap 0, eip = 0, esp = 0xc7229d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc13fadd0 sched_switch(c13fadd0,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc1820c0c mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c40 sleepq_switch(c13fadd0,0,c108cb51,28e,c13fadd0,...) at sleepq_switch+0x1b9/frame 0xc1820c74 sleepq_timedwait(c13faae4,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820c98 _sleep(c13faae4,0,54,c10b9775,fffff470,...) at _sleep+0x345/frame 0xc1820cf4 scheduler(0,0,c10ec41c,181e000,1825000,...) at scheduler+0x2b3/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 324 MB: 309 293 277 261 245 229 213 197 181 165 149 133 117 101 85 69 53 37 21 5 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:253 #1 0xc050c1ed in db_fncall (dummy1=0x19, dummy2=0x0, dummy3=0xc1200aec, dummy4=0xf61d1338 "") at ../../../ddb/db_command.c:578 #2 0xc050bee7 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc050fdc4 in db_script_exec (scriptname=0xc13f7b04 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc050bee7 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc050bc00 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc050e440 in db_trap (type=, code=0xf61d1680) at ../../../ddb/db_main.c:231 #7 0xc0ac0138 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0eabcfe in trap (frame=) at ../../../i386/i386/trap.c:720 #9 0xc0e94eac in calltrap () at ../../../i386/i386/exception.s:169 #10 0xc0abf9bd in kdb_enter (why=0xc1086de3 "panic", msg=) at cpufunc.h:71 #11 0xc0a89273 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xc0a8912a in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xc0b2df7d in vgonel (vp=0xcf1e7708) at ../../../kern/vfs_subr.c:2818 #14 0xc0b29f56 in insmntque_stddtr (vp=0xcf1e7708, dtr_arg=0x0) at ../../../kern/vfs_subr.c:2697 #15 0xc0b29883 in insmntque1 (vp=0xcf1e7708, mp=, dtr=0xc0b29f10 , dtr_arg=0x12) at ../../../kern/vfs_subr.c:1165 #16 0xc0b29f08 in insmntque (vp=0xcf1e7708, mp=0xc80d35d8) at ../../../kern/vfs_subr.c:1190 #17 0xca8e7098 in tmpfs_alloc_vp (node=0xcf1c9088, lkflag=) at /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:543 #18 0xca8e246d in tmpfs_lookup (v=0x80000) at /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_vnops.c:190 #19 0xc0ecf554 in VOP_CACHEDLOOKUP_APV (vop=, a=0xf61d1950) at vnode_if.c:197 #20 0xc0b17d20 in vfs_cache_lookup (ap=0xf61d1b64) at vnode_if.h:80 #21 0xc0ecf364 in VOP_LOOKUP_APV (vop=, a=0xf61d19e8) at vnode_if.c:129 #22 0xc0b20b18 in lookup (ndp=0xf61d1b18) at vnode_if.h:54 #23 0xc0b2020d in namei (ndp=0xf61d1b18) at ../../../kern/vfs_lookup.c:292 #24 0xc0b38142 in kern_statat_vnhook (td=0xce111c00, flag=, fd=0x80, path=0x2888e5d8
, pathseg=, hook=) at ../../../kern/vfs_syscalls.c:2321 #25 0xc0b38329 in sys_lstat (td=0xffffff9c, uap=0xf61d1cc8) at ../../../kern/vfs_syscalls.c:2302 #26 0xc0eac9cd in syscall (frame=) at subr_syscall.c:134 #27 0xc0e94f41 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #28 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xc0b2df7d in vgonel (vp=0xcf1e7708) at ../../../kern/vfs_subr.c:2818 2818 VNASSERT(vp->v_object == NULL, vp, (kgdb) l 2813 */ 2814 if (VOP_RECLAIM(vp, td)) 2815 panic("vgone: cannot reclaim"); 2816 if (mp != NULL) 2817 vn_finished_secondary_write(mp); 2818 VNASSERT(vp->v_object == NULL, vp, 2819 ("vop_reclaim left v_object vp=%p, tag=%s", vp, vp->v_tag)); 2820 /* 2821 * Clear the advisory locks and wake up waiting threads. 2822 */ (kgdb) p *vp $1 = {v_tag = 0xca8eb410 "tmpfs", v_op = 0xc11a96b8, v_data = 0x0, v_mount = 0x0, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0x0}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xcf1e7730}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xca8eb410 "tmpfs", lo_flags = 0x5730008, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0xce111c00, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xf, pcs = {0xc0a6b5af, 0xc0b1b333, 0xc0ed2942, 0xc0b3df0a, 0xca8e6f76, 0xca8e246d, 0xc0ecf554, 0xc0b17d20, 0xc0ecf364, 0xc0b20b18, 0xc0b2020d, 0xc0b38142, 0xc0b38329, 0xc0eac9cd, 0xc0e94f41, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc108f101 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, v_vnlock = 0xcf1e773c, v_actfreelist = {tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc1097879 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, bo_ops = 0xc11c2560, bo_object = 0xcd737afc, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xcf1e7708, __bo_vnode = 0xcf1e7708, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xcf1e77f4}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = { tqh_first = 0x0, tqh_last = 0xcf1e7804}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_bsize = 0x1000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xcf1e782c}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x1, v_iflag = 0x80, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0xcf1e77, v_type = VREG} (kgdb) f 16 #16 0xc0b29f08 in insmntque (vp=0xcf1e7708, mp=0xc80d35d8) at ../../../kern/vfs_subr.c:1190 1190 return (insmntque1(vp, mp, insmntque_stddtr, NULL)); (kgdb) p *vp $1 = {v_tag = 0xca8eb410 "tmpfs", v_op = 0xc11a96b8, v_data = 0x0, v_mount = 0x0, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0x0}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xcf1e7730}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xca8eb410 "tmpfs", lo_flags = 0x5730008, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0xce111c00, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xf, pcs = {0xc0a6b5af, 0xc0b1b333, 0xc0ed2942, 0xc0b3df0a, 0xca8e6f76, 0xca8e246d, 0xc0ecf554, 0xc0b17d20, 0xc0ecf364, 0xc0b20b18, 0xc0b2020d, 0xc0b38142, 0xc0b38329, 0xc0eac9cd, 0xc0e94f41, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc108f101 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, v_vnlock = 0xcf1e773c, v_actfreelist = {tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc1097879 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, bo_ops = 0xc11c2560, bo_object = 0xcd737afc, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xcf1e7708, __bo_vnode = 0xcf1e7708, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xcf1e77f4}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = { tqh_first = 0x0, tqh_last = 0xcf1e7804}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_bsize = 0x1000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xcf1e782c}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x1, v_iflag = 0x80, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0xcf1e77, v_type = VREG} (kgdb) p *mp $2 = {mnt_mtx = {lock_object = {lo_name = 0xc107257e "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc757b5f0}, mtx_lock = 0x4}, mnt_gen = 0x46b, mnt_list = {tqe_next = 0xce60f8c4, tqe_prev = 0xc8f1fbc8}, mnt_op = 0xca8ecc44, mnt_vfc = 0xca8eccc0, mnt_vnodecovered = 0xcd286e10, mnt_syncer = 0x0, mnt_ref = 0x9, mnt_nvnodelist = {tqh_first = 0xcf23f168, tqh_last = 0xcf1dee20}, mnt_nvnodelistsize = 0x8, mnt_activevnodelist = { tqh_first = 0xcf23f168, tqh_last = 0xcf23f220}, mnt_activevnodelistsize = 0x1, mnt_writeopcount = 0x1, mnt_kern_flag = 0x1000009, mnt_flag = 0x1000, mnt_opt = 0xd4655160, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x0, mnt_stat = { f_version = 0x20030518, f_type = 0x87, f_flags = 0x1000, f_bsize = 0x1000, f_iosize = 0x1000, f_blocks = 0x4ade94, f_bfree = 0x4ade80, f_bavail = 0x4ade80, f_files = 0x7fffffff, f_ffree = 0x7ffffff6, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x8730ff12, 0x87}}, f_charspare = '\0' , f_fstypename = "tmpfs\000\000\000\000\000\000\000\000\000\000", f_mntfromname = "tmpfs", '\0' , f_mntonname = "/mnt0", '\0' }, mnt_cred = 0xc8167b80, mnt_data = 0xdce57a80, mnt_time = 0x0, mnt_iosize_max = 0x10000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0x305d880b, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x0, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = { lo_name = 0xc107258f "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7580ad8}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = {0xc0a6b5af, 0xc0b1cee7, 0xc0b23490, 0xc0b22278, 0xc0eac9cd, 0xc0e94f41, 0x0 }}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0xc8f1fe94}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xc80d38bc}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/tmpfs/tmpfs_vnops.c =================================================================== --- /usr/src/sys/fs/tmpfs/tmpfs_vnops.c (revision 249985) +++ /usr/src/sys/fs/tmpfs/tmpfs_vnops.c (working copy) @@ -278,8 +278,6 @@ tmpfs_close(struct vop_close_args *v) { struct vnode *vp = v->a_vp; - MPASS(VOP_ISLOCKED(vp)); - /* Update node times. */ tmpfs_update(vp); @@ -439,7 +437,6 @@ tmpfs_setattr(struct vop_setattr_args *v) return error; } -/* --------------------------------------------------------------------- */ static int tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t idx, vm_offset_t offset, size_t tlen, struct uio *uio) @@ -448,12 +445,35 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id int error, rv; VM_OBJECT_WLOCK(tobj); - m = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + + /* + * The kern_sendfile() code calls vn_rdwr() with the page + * soft-busied. Ignore the soft-busy state here. Parallel + * reads of the page content from disk are prevented by + * VPO_BUSY. + * + * Although the tmpfs vnode lock is held here, it is + * nonetheless safe to sleep waiting for a free page. The + * pageout daemon does not need to acquire the tmpfs vnode + * lock to page out tobj's pages because tobj is a OBJT_SWAP + * type object. + */ + m = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY | + VM_ALLOC_IGN_SBUSY); if (m->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &m, 1, 0); + m = vm_page_lookup(tobj, idx); + if (m == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, m->valid, rv); vm_page_lock(m); vm_page_free(m); vm_page_unlock(m); @@ -463,127 +483,37 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id } else vm_page_zero_invalid(m, TRUE); } + vm_page_lock(m); + vm_page_hold(m); + vm_page_wakeup(m); + vm_page_unlock(m); VM_OBJECT_WUNLOCK(tobj); error = uiomove_fromphys(&m, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); vm_page_lock(m); - vm_page_unwire(m, TRUE); + vm_page_unhold(m); + vm_page_deactivate(m); + vm_page_requeue(m); vm_page_unlock(m); - vm_page_wakeup(m); VM_OBJECT_WUNLOCK(tobj); return (error); } -static __inline int -tmpfs_nocacheread_buf(vm_object_t tobj, vm_pindex_t idx, - vm_offset_t offset, size_t tlen, void *buf) -{ - struct uio uio; - struct iovec iov; - - uio.uio_iovcnt = 1; - uio.uio_iov = &iov; - iov.iov_base = buf; - iov.iov_len = tlen; - - uio.uio_offset = 0; - uio.uio_resid = tlen; - uio.uio_rw = UIO_READ; - uio.uio_segflg = UIO_SYSSPACE; - uio.uio_td = curthread; - - return (tmpfs_nocacheread(tobj, idx, offset, tlen, &uio)); -} - static int -tmpfs_mappedread(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) -{ - struct sf_buf *sf; - vm_pindex_t idx; - vm_page_t m; - vm_offset_t offset; - off_t addr; - size_t tlen; - char *ma; - int error; - - addr = uio->uio_offset; - idx = OFF_TO_IDX(addr); - offset = addr & PAGE_MASK; - tlen = MIN(PAGE_SIZE - offset, len); - - VM_OBJECT_WLOCK(vobj); -lookupvpg: - if (((m = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(m, offset, tlen)) { - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_WUNLOCK(vobj); - error = uiomove_fromphys(&m, offset, tlen, uio); - VM_OBJECT_WLOCK(vobj); - vm_page_wakeup(m); - VM_OBJECT_WUNLOCK(vobj); - return (error); - } else if (m != NULL && uio->uio_segflg == UIO_NOCOPY) { - KASSERT(offset == 0, - ("unexpected offset in tmpfs_mappedread for sendfile")); - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_WUNLOCK(vobj); - sched_pin(); - sf = sf_buf_alloc(m, SFB_CPUPRIVATE); - ma = (char *)sf_buf_kva(sf); - error = tmpfs_nocacheread_buf(tobj, idx, 0, tlen, ma); - if (error == 0) { - if (tlen != PAGE_SIZE) - bzero(ma + tlen, PAGE_SIZE - tlen); - uio->uio_offset += tlen; - uio->uio_resid -= tlen; - } - sf_buf_free(sf); - sched_unpin(); - VM_OBJECT_WLOCK(vobj); - if (error == 0) - m->valid = VM_PAGE_BITS_ALL; - vm_page_wakeup(m); - VM_OBJECT_WUNLOCK(vobj); - return (error); - } - VM_OBJECT_WUNLOCK(vobj); - error = tmpfs_nocacheread(tobj, idx, offset, tlen, uio); - - return (error); -} - -static int tmpfs_read(struct vop_read_args *v) { struct vnode *vp = v->a_vp; struct uio *uio = v->a_uio; - struct tmpfs_node *node; vm_object_t uobj; size_t len; int resid; - int error = 0; + vm_pindex_t idx; + vm_offset_t offset; + off_t addr; + size_t tlen; node = VP_TO_TMPFS_NODE(vp); @@ -607,7 +537,11 @@ tmpfs_read(struct vop_read_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedread(vp->v_object, uobj, len, uio); + addr = uio->uio_offset; + idx = OFF_TO_IDX(addr); + offset = addr & PAGE_MASK; + tlen = MIN(PAGE_SIZE - offset, len); + error = tmpfs_nocacheread(uobj, idx, offset, tlen, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -620,10 +554,10 @@ out: /* --------------------------------------------------------------------- */ static int -tmpfs_mappedwrite(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) +tmpfs_mappedwrite(vm_object_t tobj, size_t len, struct uio *uio) { vm_pindex_t idx; - vm_page_t vpg, tpg; + vm_page_t tpg; vm_offset_t offset; off_t addr; size_t tlen; @@ -636,69 +570,46 @@ static int offset = addr & PAGE_MASK; tlen = MIN(PAGE_SIZE - offset, len); - VM_OBJECT_WLOCK(vobj); -lookupvpg: - if (((vpg = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(vpg, offset, tlen)) { - if ((vpg->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(vpg); - vm_page_sleep(vpg, "tmfsmw"); - goto lookupvpg; - } - vm_page_busy(vpg); - vm_page_undirty(vpg); - VM_OBJECT_WUNLOCK(vobj); - error = uiomove_fromphys(&vpg, offset, tlen, uio); - } else { - if (vm_page_is_cached(vobj, idx)) - vm_page_cache_free(vobj, idx, idx + 1); - VM_OBJECT_WUNLOCK(vobj); - vpg = NULL; - } VM_OBJECT_WLOCK(tobj); - tpg = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + tpg = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (tpg->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &tpg, 1, 0); + tpg = vm_page_lookup(tobj, idx); + if (tpg == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, tpg->valid, rv); vm_page_lock(tpg); vm_page_free(tpg); vm_page_unlock(tpg); - error = EIO; - goto out; + VM_OBJECT_WUNLOCK(tobj); + return (EIO); } } else vm_page_zero_invalid(tpg, TRUE); } + vm_page_lock(tpg); + vm_page_hold(tpg); + vm_page_wakeup(tpg); + vm_page_unlock(tpg); VM_OBJECT_WUNLOCK(tobj); - if (vpg == NULL) - error = uiomove_fromphys(&tpg, offset, tlen, uio); - else { - KASSERT(vpg->valid == VM_PAGE_BITS_ALL, ("parts of vpg invalid")); - pmap_copy_page(vpg, tpg); - } + error = uiomove_fromphys(&tpg, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); - if (error == 0) { - KASSERT(tpg->valid == VM_PAGE_BITS_ALL, - ("parts of tpg invalid")); + if (error == 0) vm_page_dirty(tpg); - } vm_page_lock(tpg); - vm_page_unwire(tpg, TRUE); + vm_page_unhold(tpg); + vm_page_deactivate(tpg); + vm_page_requeue(tpg); vm_page_unlock(tpg); - vm_page_wakeup(tpg); -out: VM_OBJECT_WUNLOCK(tobj); - if (vpg != NULL) { - VM_OBJECT_WLOCK(vobj); - vm_page_wakeup(vpg); - VM_OBJECT_WUNLOCK(vobj); - } return (error); } @@ -756,7 +667,7 @@ tmpfs_write(struct vop_write_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedwrite(vp->v_object, uobj, len, uio); + error = tmpfs_mappedwrite(uobj, len, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -1536,8 +1447,6 @@ tmpfs_inactive(struct vop_inactive_args *v) struct tmpfs_node *node; - MPASS(VOP_ISLOCKED(vp)); - node = VP_TO_TMPFS_NODE(vp); if (node->tn_links == 0) @@ -1555,11 +1464,24 @@ tmpfs_reclaim(struct vop_reclaim_args *v) struct tmpfs_mount *tmp; struct tmpfs_node *node; + vm_object_t obj; node = VP_TO_TMPFS_NODE(vp); tmp = VFS_TO_TMPFS(vp->v_mount); - vnode_destroy_vobject(vp); + if (node->tn_type == VREG) { + obj = node->tn_reg.tn_aobj; + if (obj != NULL) { + /* Instead of vnode_destroy_vobject() */ + VM_OBJECT_WLOCK(obj); + VI_LOCK(vp); + vm_object_clear_flag(obj, OBJ_TMPFS); + obj->un_pager.swp.swp_tmpfs = NULL; + VI_UNLOCK(vp); + VM_OBJECT_WUNLOCK(obj); + } + } + vp->v_object = NULL; cache_purge(vp); TMPFS_NODE_LOCK(node); Index: /usr/src/sys/fs/tmpfs/tmpfs_subr.c =================================================================== --- /usr/src/sys/fs/tmpfs/tmpfs_subr.c (revision 249985) +++ /usr/src/sys/fs/tmpfs/tmpfs_subr.c (working copy) @@ -166,6 +166,7 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vty char *target, dev_t rdev, struct tmpfs_node **node) { struct tmpfs_node *nnode; + vm_object_t obj; /* If the root directory of the 'tmp' file system is not yet * allocated, this must be the request to do it. */ @@ -227,9 +228,14 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vty break; case VREG: - nnode->tn_reg.tn_aobj = + obj = nnode->tn_reg.tn_aobj = vm_pager_allocate(OBJT_SWAP, NULL, 0, VM_PROT_DEFAULT, 0, NULL /* XXXKIB - tmpfs needs swap reservation */); + VM_OBJECT_WLOCK(obj); + /* OBJ_TMPFS is set together with the setting of vp->v_object */ + vm_object_set_flag(obj, OBJ_NOSPLIT); + vm_object_clear_flag(obj, OBJ_ONEMAPPING); + VM_OBJECT_WUNLOCK(obj); break; default: @@ -434,9 +440,11 @@ int tmpfs_alloc_vp(struct mount *mp, struct tmpfs_node *node, int lkflag, struct vnode **vpp) { - int error = 0; struct vnode *vp; + vm_object_t object; + int error; + error = 0; loop: TMPFS_NODE_LOCK(node); if ((vp = node->tn_vnode) != NULL) { @@ -506,13 +514,22 @@ loop: /* FALLTHROUGH */ case VLNK: /* FALLTHROUGH */ - case VREG: - /* FALLTHROUGH */ case VSOCK: break; case VFIFO: vp->v_op = &tmpfs_fifoop_entries; break; + case VREG: + object = node->tn_reg.tn_aobj; + VM_OBJECT_WLOCK(object); + VI_LOCK(vp); + KASSERT(vp->v_object == NULL, ("Not NULL v_object in tmpfs")); + vp->v_object = object; + object->un_pager.swp.swp_tmpfs = vp; + vm_object_set_flag(object, OBJ_TMPFS); + VI_UNLOCK(vp); + VM_OBJECT_WUNLOCK(object); + break; case VDIR: MPASS(node->tn_dir.tn_parent != NULL); if (node->tn_dir.tn_parent == node) @@ -523,7 +540,6 @@ loop: panic("tmpfs_alloc_vp: type %p %d", node, (int)node->tn_type); } - vnode_pager_setsize(vp, node->tn_size); error = insmntque(vp, mp); if (error) vp = NULL; @@ -1343,7 +1359,6 @@ retry: TMPFS_UNLOCK(tmp); node->tn_size = newsize; - vnode_pager_setsize(vp, newsize); return (0); } Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 249985) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -505,6 +505,7 @@ void vm_object_deallocate(vm_object_t object) { vm_object_t temp; + struct vnode *vp; while (object != NULL) { VM_OBJECT_WLOCK(object); @@ -527,15 +528,36 @@ vm_object_deallocate(vm_object_t object) VM_OBJECT_WUNLOCK(object); return; } else if (object->ref_count == 1) { + if (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) != 0) { + vp = object->un_pager.swp.swp_tmpfs; + vhold(vp); + VM_OBJECT_WUNLOCK(object); + vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); + vdrop(vp); + VM_OBJECT_WLOCK(object); + if (object->type == OBJT_DEAD) { + VM_OBJECT_WUNLOCK(object); + VOP_UNLOCK(vp, 0); + return; + } else if ((object->flags & OBJ_TMPFS) != 0) { + if (object->ref_count == 1) + VOP_UNSET_TEXT(vp); + VOP_UNLOCK(vp, 0); + } + } if (object->shadow_count == 0 && object->handle == NULL && (object->type == OBJT_DEFAULT || - object->type == OBJT_SWAP)) { + (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) == 0))) { vm_object_set_flag(object, OBJ_ONEMAPPING); } else if ((object->shadow_count == 1) && (object->handle == NULL) && (object->type == OBJT_DEFAULT || object->type == OBJT_SWAP)) { + KASSERT((object->flags & OBJ_TMPFS) == 0, + ("Shadowed tmpfs v_object")); vm_object_t robject; robject = LIST_FIRST(&object->shadow_head); @@ -820,7 +842,12 @@ vm_object_page_clean(vm_object_t object, vm_ooffse boolean_t clearobjflags, eio, res; VM_OBJECT_ASSERT_WLOCKED(object); - KASSERT(object->type == OBJT_VNODE, ("Not a vnode object")); + + /* + * The OBJ_MIGHTBEDIRTY flag is only set for OBJT_VNODE + * objects. The check below prevents the function from + * operating on non-vnode objects. + */ if ((object->flags & OBJ_MIGHTBEDIRTY) == 0 || object->resident_page_count == 0) return (TRUE); Index: /usr/src/sys/vm/vm_object.h =================================================================== --- /usr/src/sys/vm/vm_object.h (revision 249985) +++ /usr/src/sys/vm/vm_object.h (working copy) @@ -154,11 +154,21 @@ struct vm_object { /* * Swap pager * + * swp_tmpfs - back-pointer to the tmpfs vnode, + * if any, which uses the vm object + * as backing store. The handle + * cannot be reused for linking, + * because the vnode can be + * reclaimed and recreated, making + * the handle changed and hash-chain + * invalid. + * * swp_bcount - number of swap 'swblock' metablocks, each * contains up to 16 swapblk assignments. * see vm/swap_pager.h */ struct { + void *swp_tmpfs; int swp_bcount; } swp; } un_pager; @@ -179,6 +189,7 @@ struct vm_object { #define OBJ_COLORED 0x1000 /* pg_color is defined */ #define OBJ_ONEMAPPING 0x2000 /* One USE (a single, non-forked) mapping flag */ #define OBJ_DISCONNECTWNT 0x4000 /* disconnect from vnode wanted */ +#define OBJ_TMPFS 0x8000 #define IDX_TO_OFF(idx) (((vm_ooffset_t)(idx)) << PAGE_SHIFT) #define OFF_TO_IDX(off) ((vm_pindex_t)(((vm_ooffset_t)(off)) >> PAGE_SHIFT)) Index: /usr/src/sys/vm/vm_mmap.c =================================================================== --- /usr/src/sys/vm/vm_mmap.c (revision 249985) +++ /usr/src/sys/vm/vm_mmap.c (working copy) @@ -1284,7 +1284,7 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize error = EINVAL; goto done; } - if (obj->handle != vp) { + if (obj->type == OBJT_VNODE && obj->handle != vp) { vput(vp); vp = (struct vnode *)obj->handle; /* @@ -1333,7 +1333,14 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize objsize = round_page(va.va_size); if (va.va_nlink == 0) flags |= MAP_NOSYNC; - obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, cred); + if (obj->type == OBJT_VNODE) + obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, + cred); + else { + KASSERT(obj->type == OBJT_DEFAULT || obj->type == OBJT_SWAP, + ("wrong object type")); + vm_object_reference(obj); + } if (obj == NULL) { error = ENOMEM; goto done; Index: /usr/src/sys/vm/vnode_pager.c =================================================================== --- /usr/src/sys/vm/vnode_pager.c (revision 249985) +++ /usr/src/sys/vm/vnode_pager.c (working copy) @@ -214,8 +214,7 @@ retry: VM_OBJECT_SLEEP(object, object, PDROP | PVM, "vadead", 0); } - if (vp->v_usecount == 0) - panic("vnode_pager_alloc: no vnode reference"); + KASSERT(vp->v_usecount != 0, ("vnode_pager_alloc: no vnode reference")); if (object == NULL) { /* @@ -381,6 +380,12 @@ vnode_pager_setsize(vp, nsize) return; /* ASSERT_VOP_ELOCKED(vp, "vnode_pager_setsize and not locked vnode"); */ VM_OBJECT_WLOCK(object); + if (object->type == OBJT_DEAD) { + VM_OBJECT_WUNLOCK(object); + return; + } + KASSERT(object->type == OBJT_VNODE, + ("not vnode-backed object %p", object)); if (nsize == object->un_pager.vnp.vnp_size) { /* * Hasn't changed size Index: /usr/src/sys/kern/uipc_syscalls.c =================================================================== --- /usr/src/sys/kern/uipc_syscalls.c (revision 249985) +++ /usr/src/sys/kern/uipc_syscalls.c (working copy) @@ -1902,8 +1902,10 @@ kern_sendfile(struct thread *td, struct sendfile_a struct mbuf *m = NULL; struct sf_buf *sf; struct vm_page *pg; + struct vattr va; off_t off, xfsize, fsbytes = 0, sbytes = 0, rem = 0; int error, hdrlen = 0, mnw = 0; + int bsize; struct sendfile_sync *sfs = NULL; /* @@ -2102,6 +2104,16 @@ retry_space: */ space -= hdrlen; + error = vn_lock(vp, LK_SHARED); + if (error != 0) + goto done; + error = VOP_GETATTR(vp, &va, td->td_ucred); + if (error != 0) { + VOP_UNLOCK(vp, 0); + goto done; + } + bsize = vp->v_mount->mnt_stat.f_iosize; + /* * Loop and construct maximum sized mbuf chain to be bulk * dumped into socket buffer. @@ -2111,7 +2123,6 @@ retry_space: vm_offset_t pgoff; struct mbuf *m0; - VM_OBJECT_WLOCK(obj); /* * Calculate the amount to transfer. * Not to exceed a page, the EOF, @@ -2121,12 +2132,11 @@ retry_space: if (uap->nbytes) rem = (uap->nbytes - fsbytes - loopbytes); else - rem = obj->un_pager.vnp.vnp_size - + rem = va.va_size - uap->offset - fsbytes - loopbytes; xfsize = omin(PAGE_SIZE - pgoff, rem); xfsize = omin(space - loopbytes, xfsize); if (xfsize <= 0) { - VM_OBJECT_WUNLOCK(obj); done = 1; /* all data sent */ break; } @@ -2146,6 +2156,7 @@ retry_space: * if not found or wait and loop if busy. */ pindex = OFF_TO_IDX(off); + VM_OBJECT_WLOCK(obj); pg = vm_page_grab(obj, pindex, VM_ALLOC_NOBUSY | VM_ALLOC_NORMAL | VM_ALLOC_WIRED | VM_ALLOC_RETRY); @@ -2163,7 +2174,6 @@ retry_space: else if (uap->flags & SF_NODISKIO) error = EBUSY; else { - int bsize; ssize_t resid; /* @@ -2175,13 +2185,6 @@ retry_space: /* * Get the page from backing store. - */ - error = vn_lock(vp, LK_SHARED); - if (error != 0) - goto after_read; - bsize = vp->v_mount->mnt_stat.f_iosize; - - /* * XXXMAC: Because we don't have fp->f_cred * here, we pass in NOCRED. This is probably * wrong, but is consistent with our original @@ -2191,8 +2194,6 @@ retry_space: trunc_page(off), UIO_NOCOPY, IO_NODELOCKED | IO_VMIO | ((MAXBSIZE / bsize) << IO_SEQSHIFT), td->td_ucred, NOCRED, &resid, td); - VOP_UNLOCK(vp, 0); - after_read: VM_OBJECT_WLOCK(obj); vm_page_io_finish(pg); if (!error) @@ -2281,6 +2282,8 @@ retry_space: } } + VOP_UNLOCK(vp, 0); + /* Add the buffer chain to the socket buffer. */ if (m != NULL) { int mlen, err; -- Test scenario: tmpfs2.sh