GENERIC HEAD from 2012-02-24 17:50:36 UTC, r232125M, vmcore.294 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r232125M: Sat Feb 25 07:20:20 CET 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531640832 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 116721 free (1361 frags, 14420 blocks, 0.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 116403150 free (2238 frags, 14550114 blocks, 0.0% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 143557 free (4765 frags, 17349 blocks, 0.5% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3803446 free (259990 frags, 442932 blocks, 2.6% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 11041934 free (45854 frags, 1374510 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xe191e500 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xca7a7800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f92f73,2e687361,38323a63,a34,f270f7e8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9614b,c0f96a40,c1274ab8,11c,f270f878,...) at kdb_backtrace+0x2a _witness_debugger(c0f96a40,ca7a7800,c0fc6bda,c7d79610,c0fc686c,...) at _witness_debugger+0x25 witness_checkorder(ca7a7800,9,c0fc6863,11c,0,...) at witness_checkorder+0x86f _sx_xlock(ca7a7800,0,c0fc6863,11c,ca82acb0,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e191e4a0,ca82acb0,f270f9f4,e23f664c,f270f948,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(ca82acb0,f270f9f4,264c,f270f934,f270f938,...) at ufsdirhash_add+0x13 ufs_direnter(cab13c3c,cad7e828,f270f9f4,f270fb84,e191eb20,...) at ufs_direnter+0x7a9 ufs_mkdir(f270fc14,c0fe7f05,0,0,f270fbac,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10ddda0,f270fc14,f270fb84,f270fbac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca6cd8a0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(ca6cd8a0,28404020,0,1c0,f270fd1c,...) at kern_mkdir+0x2e sys_mkdir(ca6cd8a0,f270fcec,c0fe0d8a,c0f9774e,202,...) at sys_mkdir+0x29 syscall(f270fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817fba3, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). lock order reversal: 1st 0xca8d85c8 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xe190b860 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcad179dc ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f92f73,3a632e73,a303632,0,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9614b,c0f96a59,c1274a98,877,f275233c,...) at kdb_backtrace+0x2a _witness_debugger(c0f96a59,cad179dc,c0f85397,c7d795a8,c0f9ea11,...) at _witness_debugger+0x25 witness_checkorder(cad179dc,9,c0f9ea08,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cad179dc,80100,cad17a48,0,0,...) at __lockmgr_args+0x834 ffs_lock(f2752460,60,0,80100,cad17984,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2752460,c7d721e0,c10eedc0,cad17984,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cad17984,80100,c0f9ea08,877,4,...) at _vn_lock+0x78 vget(cad17984,80100,ca8162e0,50,0,...) at vget+0xbb vfs_hash_get(cab1e000,1aad5d,80000,ca8162e0,f27525a4,...) at vfs_hash_get+0xed ffs_vgetf(cab1e000,1aad5d,80000,f27525a4,1,...) at ffs_vgetf+0x49 softdep_sync_buf(ca8d8570,e190b800,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(ca8d8570,1,c1274a88,ca8d8668,c7d75308,...) at ffs_syncvnode+0x24c ffs_truncate(ca8d8570,200,0,880,c7dc4e80,...) at ffs_truncate+0x827 ufs_direnter(ca8d8570,cad17984,f2752918,f2752bc0,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f2752bc0,c10de320,f2752b04,f2752a60,c0de5bd5,...) at ufs_makeinode+0x65d ufs_create(f2752b04,c0fe80cb,0,0,f2752b80,...) at ufs_create+0x30 VOP_CREATE_APV(c10ddda0,f2752b04,f2752bc0,f2752a9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f2752b80,f2752c48,1a4,0,c7dc4e80,...) at vn_open_cred+0x205 vn_open(f2752b80,f2752c48,1a4,ca8397a8,1ff,...) at vn_open+0x3b kern_openat(ca8162e0,ffffff9c,2842d67c,0,602,...) at kern_openat+0x1ec kern_open(ca8162e0,2842d67c,0,601,1b6,...) at kern_open+0x35 sys_open(ca8162e0,f2752cec,c0fe0d8a,c0f978f3,246,...) at sys_open+0x30 syscall(f2752d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28201203, esp = 0xbfbfdc3c, ebp = 0xbfbfdcf8 --- Starting mountd. Feb 25 07:33:54 x4 mountd[1009]: can't delete exports for /dev: Invalid argument mount option is unknown Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xca8d9724 ufs (ufs) @ kern/vfs_mount.c:1249 2nd 0xca82c310 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1835 KDB: stack backtrace: db_trace_self_wrapper(c0f92f73,38313a63,a3533,c0aa873c,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9614b,c0f96a40,c12741f0,72b,f27f49a0,...) at kdb_backtrace+0x2a _witness_debugger(c0f96a40,ca82c310,c0f8a354,c7d79408,c0fc2ce6,...) at _witness_debugger+0x25 witness_checkorder(ca82c310,9,c0fc2cdd,72b,ca82c37c,...) at witness_checkorder+0x86f __lockmgr_args(ca82c310,80400,ca82c37c,0,0,...) at __lockmgr_args+0x834 vop_stdlock(f27f4ac0,4,c0f8d34f,80400,ca82c2b8,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b38a0,f27f4ac0,c12a8040,c10eedc0,ca82c2b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca82c2b8,80400,c0fc2cdd,72b,cab1e5a8,...) at _vn_lock+0x78 softdep_flushworklist(cab1e5a8,f27f4b6c,ca8125c0,5e9,0,...) at softdep_flushworklist+0x47 ffs_sync(cab1e5a8,1,f27f4bc0,51a,c7c31000,...) at ffs_sync+0x32d dounmount(cab1e5a8,8080000,ca8125c0,49c,0,...) at dounmount+0x3f8 sys_unmount(ca8125c0,f27f4cec,c,c,206,...) at sys_unmount+0x421 syscall(f27f4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e800b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xcab13880 syncer (syncer) @ kern/vfs_subr.c:1767 2nd 0xca8da058 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1536 KDB: stack backtrace: db_trace_self_wrapper(c0f92f73,3335313a,c0000a36,246,c7d72998,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9614b,c0f96a40,c1274f00,600,ee31aa5c,...) at kdb_backtrace+0x2a _witness_debugger(c0f96a40,ca8da058,c0f8a354,c7d79408,c0fc5bb9,...) at _witness_debugger+0x25 witness_checkorder(ca8da058,9,c0fc5bb0,600,ca8da0c4,...) at witness_checkorder+0x86f __lockmgr_args(ca8da058,80400,ca8da0c4,0,0,...) at __lockmgr_args+0x834 vop_stdlock(ee31ab7c,c0aa630a,c1274f10,80400,ca8da000,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b38a0,ee31ab7c,ee31ab9c,c10eedc0,ca8da000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca8da000,80400,c0fc5bb0,600,c0f8d34f,...) at _vn_lock+0x78 ffs_sync(cab1e2d4,3,2,dd9,cab1e2d4,...) at ffs_sync+0x3f7 sync_fsync(ee31ac6c,c0fe7a63,cab138ec,ee31ac6c,cab13828,...) at sync_fsync+0x156 VOP_FSYNC_APV(c10cc700,ee31ac6c,c0f9ea08,6e7,c805eb80,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c12a1d74,c12a1d60,3e8,78b,4e20,...) at sync_vnode+0x16b sched_sync(0,ee31ad28,c0f89490,3dc,ca6c1598,...) at sched_sync+0x282 fork_exit(c0afccb0,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- Feb 25 07:34:52 x4 su: pho to root on /dev/pts/1 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 81679 files, 1910831 used, 116403150 free (2238 frags, 14550114 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 81679 files, 1910831 used, 116403150 free (2238 frags, 14550114 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmpFeb 25 07:37:07 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown watchdogd. Starting inetd. Sat Feb 25 07:37:08 CET 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Feb 25 07:37:11 x4 last message repeated 3 times Feb 25 07:39:38 x4 last message repeated 9 times Feb 25 07:46:19 x4 last message repeated 9 times Expensive timeout(9) function: 0xc0a6e490(0xcadfb000) 0.012259195 s Feb 25 07:54:57 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 08:07:44 x4 last message repeated 3 times Feb 25 08:19:33 x4 last message repeated 54 times Feb 25 08:23:19 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 08:35:51 x4 last message repeated 3 times Feb 25 08:48:23 x4 last message repeated 54 times Feb 25 08:52:11 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 09:03:22 x4 last message repeated 3 times Expensive timeout(9) function: 0xc08e5740(0xc8056aa0) 0.017398878 s Feb 25 09:17:57 x4 last message repeated 49 times Feb 25 09:29:39 x4 last message repeated 3 times Expensive timeout(9) function: 0xc0a9c980(0xca8175c0) 0.092026848 s Feb 25 09:40:28 x4 last message repeated 53 times Feb 25 09:44:04 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 09:56:01 x4 last message repeated 3 times Feb 25 10:10:59 x4 last message repeated 54 times Feb 25 10:18:38 x4 su: pho to root on /dev/pts/2 Feb 25 10:19:14 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 10:22:58 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 10:23:11 x4 last message repeated 2 times Feb 25 10:36:34 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 10:36:37 x4 last message repeated 52 times Feb 25 10:46:50 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 12:23:55 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 12:34:37 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 12:34:41 x4 last message repeated 2 times lock order reversal: 1st 0xd333d1b4 newnfs (newnfs) @ kern/vfs_syscalls.c:4181 2nd 0xe195f840 bufwait (bufwait) @ kern/vfs_bio.c:1911 3rd 0xd60f4724 newnfs (newnfs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f92f73,a3736,a3100,c10c2b38,cbb645c0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9614b,c0f96a59,c1272ec0,877,f2c6d418,...) at kdb_backtrace+0x2a _witness_debugger(c0f96a59,d60f4724,c0f7fa33,c7d79e98,c0f9ea11,...) at _witness_debugger+0x25 witness_checkorder(d60f4724,9,c0f9ea08,877,0,...) at witness_checkorder+0x86f __lockmgr_args(d60f4724,80100,d60f4790,0,0,...) at __lockmgr_args+0x834 nfs_lock1(f2c6d538,246,c7d727f8,80100,d60f46cc,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c10b4960,f2c6d538,c7d721e0,c10eedc0,d60f46cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d60f46cc,80100,c0f9ea08,877,4,...) at _vn_lock+0x78 vget(d60f46cc,80100,cbb645c0,50,0,...) at vget+0xbb vfs_hash_get(d23ed000,8212d469,80000,cbb645c0,f2c6d600,...) at vfs_hash_get+0xed nfscl_nget(d23ed000,d333d15c,cad5c680,f2c6d7b4,cbb645c0,...) at nfscl_nget+0x8d nfsrpc_readdirplus(d333d15c,f2c6d998,f2c6d954,cd4a4c00,cbb645c0,...) at nfsrpc_readdirplus+0x137e ncl_readdirplusrpc(d333d15c,f2c6d998,cd4a4c00,cbb645c0,c0f8d34f,...) at ncl_readdirplusrpc+0xec ncl_doio(d333d15c,e195f7e0,cd4a4c00,cbb645c0,0,...) at ncl_doio+0x28d ncl_bioread(d333d15c,f2c6dbec,0,cd4a4c00,f2c6db2c,...) at ncl_bioread+0xc3d nfs_readdir(f2c6dc0c,c0fe7a1e,0,0,d333d15c,...) at nfs_readdir+0x192 VOP_READDIR_APV(c10b4960,f2c6dc0c,c0fa0027,1055,f2c6dc34,...) at VOP_READDIR_APV+0xc5 kern_getdirentries(cbb645c0,5,28495000,1000,f2c6dc60,...) at kern_getdirentries+0x231 sys_getdirentries(cbb645c0,f2c6dcec,c0fe0d8a,c0f976fb,246,...) at sys_getdirentries+0x31 syscall(f2c6dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x28105eff, esp = 0xbfbfe73c, ebp = 0xbfbfe768 --- Feb 25 12:51:41 x4 last message repeated 54 times Feb 25 13:06:12 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown Feb 25 13:06:16 x4 last message repeated 2 times ~KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100003 td 0xc7dc98a0 kdb_enter(c0e03b1e,c0f92f3e,c7b26ba4,c08c9abb,c817f000,...) at kdb_enter+0x3a kdb_break(c817f000,0,c12d66e0,c817f080,c817f058,...) at kdb_break+0x28 uart_intr(c817f000,0,c12d66e0,c7b26be8,0,...) at uart_intr+0x11b intr_event_handle(c7e0ed80,c7b26c10,c7b26c34,0,c7ffae00,...) at intr_event_handle+0x76 intr_execute_handlers(c7e0d0d0,c7b26c10,0,c7b26c50,c0daaf35,...) at intr_execute_handlers+0x49 lapic_handle_intr(3c,c7b26c10) at lapic_handle_intr+0x36 Xapic_isr1() at Xapic_isr1+0x35 --- interrupt, eip = 0xc0da6535, esp = 0xc7b26c50, ebp = 0xc7b26c50 --- acpi_cpu_c1(c7b26c6c,c10f0930,0,301,6600,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b26ca0,c0db47c9,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1138800,2,c7b26ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b26cc4,c0f90fe2,3c0,c7dc98a0,...) at cpu_idle+0x89 sched_idletd(0,c7b26d28,c0f89490,3dc,c7dc7864,...) at sched_idletd+0x263 fork_exit(c0a82df0,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x735a00 curthread = 0xc7dc98a0: pid 11 "idle: cpu0" curpcb = 0xc7b26d80 fpcurthread = none idlethread = 0xc7dc98a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6a26a00 curthread = 0xc7dc95c0: pid 11 "idle: cpu1" curpcb = 0xc7b29d80 fpcurthread = none idlethread = 0xc7dc95c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6a29a00 curthread = 0xc7dc92e0: pid 11 "idle: cpu2" curpcb = 0xc7b2cd80 fpcurthread = none idlethread = 0xc7dc92e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6a2ca00 curthread = 0xc7dc9000: pid 11 "idle: cpu3" curpcb = 0xc7b2fd80 fpcurthread = none idlethread = 0xc7dc9000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 63321 (fts) thread 0xd1997000 (100322) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63319 (fts) thread 0xcf7c72e0 (100477) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63316 (fts) thread 0xcb6102e0 (100431) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63313 (fts) thread 0xcec7bb80 (100315) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63310 (fts) thread 0xd17f32e0 (100546) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63059 (fts) thread 0xcab735c0 (100111) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63053 (fts) thread 0xd17d85c0 (100499) shared lockmgr ufs (ufs) r = 0 (0xcd841df0) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 63044 (mkdir) thread 0xcec122e0 (100225) exclusive lockmgr ufs (ufs) r = 0 (0xd3433c94) locked @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:595 Process 62308 (kinfo) thread 0xd17e08a0 (100505) shared lockmgr ufs (ufs) r = 0 (0xcfbc6b38) locked @ kern/vfs_vnops.c:1388 db:0:alllocks> show lockedvnods Locked vnodes 0xcd841d98: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xd01f9534 ref 0 pages 0 lock type ufs: SHARED (count 7) #0 0xc0a43374 at __lockmgr_args+0x5c4 #1 0xc0ca6571 at ffs_lock+0xa1 #2 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #3 0xc0b09eb8 at _vn_lock+0x78 #4 0xc0afc96b at vget+0xbb #5 0xc0ae5605 at cache_lookup+0x6c5 #6 0xc0ae57ed at vfs_cache_lookup+0xbd #7 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #8 0xcb2c0e44 at null_lookup+0x94 #9 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #10 0xc0aed7cb at lookup+0x6eb #11 0xc0aee7ef at namei+0x6bf #12 0xc0b0182e at kern_statfs+0xbe #13 0xc0b01a6b at sys_statfs+0x3b #14 0xc0dc18a7 at syscall+0x2c7 #15 0xc0daabd1 at Xint0x80_syscall+0x21 ino 25601080, on dev label/tmp 0xd3433c3c: tag ufs, type VDIR usecount 2, writecount 0, refcount 15 mountedhere 0 flags () v_object 0xcea06128 ref 0 pages 0 lock type ufs: EXCL by thread 0xcec122e0 (pid 63044) with exclusive waiters pending with shared waiters pending #0 0xc0a43374 at __lockmgr_args+0x5c4 #1 0xc0ca6571 at ffs_lock+0xa1 #2 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #3 0xcb2c0faf at null_lock+0xcf #4 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #5 0xc0b09eb8 at _vn_lock+0x78 #6 0xc0aed1e6 at lookup+0x106 #7 0xc0aee7ef at namei+0x6bf #8 0xc0aff810 at kern_rmdirat+0x80 #9 0xc0affa17 at kern_rmdir+0x27 #10 0xc0affa42 at sys_rmdir+0x22 #11 0xc0dc18a7 at syscall+0x2c7 #12 0xc0daabd1 at Xint0x80_syscall+0x21 ino 25601093, on dev label/tmp 0xcfbc6ae0: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xd27f6c24 ref 0 pages 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xc0a43374 at __lockmgr_args+0x5c4 #1 0xc0ca6571 at ffs_lock+0xa1 #2 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #3 0xc0b09eb8 at _vn_lock+0x78 #4 0xc0b0a2b1 at vn_vget_ino+0x161 #5 0xc0cae877 at ufs_lookup_ino+0xa77 #6 0xc0caea6a at ufs_lookup+0x2a #7 0xc0de4565 at VOP_CACHEDLOOKUP_APV+0xc5 #8 0xc0ae5816 at vfs_cache_lookup+0xe6 #9 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #10 0xcb2c0e44 at null_lookup+0x94 #11 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #12 0xc0aed7cb at lookup+0x6eb #13 0xc0aee7ef at namei+0x6bf #14 0xc0b0968f at vn_open_cred+0x31f #15 0xc0ae8e9c at vop_stdvptocnp+0x19c #16 0xcb2c11be at null_vptocnp+0xfe #17 0xc0de2a76 at VOP_VPTOCNP_APV+0xd6 ino 25601101, on dev label/tmp 0xd318f15c: tag null, type VDIR usecount 3, writecount 0, refcount 3 mountedhere 0 flags () lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xc0a43374 at __lockmgr_args+0x5c4 #1 0xc0ca6571 at ffs_lock+0xa1 #2 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #3 0xc0b09eb8 at _vn_lock+0x78 #4 0xc0b0a2b1 at vn_vget_ino+0x161 #5 0xc0cae877 at ufs_lookup_ino+0xa77 #6 0xc0caea6a at ufs_lookup+0x2a #7 0xc0de4565 at VOP_CACHEDLOOKUP_APV+0xc5 #8 0xc0ae5816 at vfs_cache_lookup+0xe6 #9 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #10 0xcb2c0e44 at null_lookup+0x94 #11 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #12 0xc0aed7cb at lookup+0x6eb #13 0xc0aee7ef at namei+0x6bf #14 0xc0b0968f at vn_open_cred+0x31f #15 0xc0ae8e9c at vop_stdvptocnp+0x19c #16 0xcb2c11be at null_vptocnp+0xfe #17 0xc0de2a76 at VOP_VPTOCNP_APV+0xd6 vp=0xd318f15c, lowervp=0xcfbc6ae0 0xd2de62b8: tag null, type VDIR usecount 12, writecount 0, refcount 12 mountedhere 0 flags () lock type ufs: EXCL by thread 0xcec122e0 (pid 63044) with exclusive waiters pending with shared waiters pending #0 0xc0a43374 at __lockmgr_args+0x5c4 #1 0xc0ca6571 at ffs_lock+0xa1 #2 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #3 0xcb2c0faf at null_lock+0xcf #4 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #5 0xc0b09eb8 at _vn_lock+0x78 #6 0xc0aed1e6 at lookup+0x106 #7 0xc0aee7ef at namei+0x6bf #8 0xc0aff810 at kern_rmdirat+0x80 #9 0xc0affa17 at kern_rmdir+0x27 #10 0xc0affa42 at sys_rmdir+0x22 #11 0xc0dc18a7 at syscall+0x2c7 #12 0xc0daabd1 at Xint0x80_syscall+0x21 vp=0xd2de62b8, lowervp=0xd3433c3c 0xd378f15c: tag null, type VDIR usecount 21, writecount 0, refcount 21 mountedhere 0 flags () v_object 0xd01f9534 ref 0 pages 0 lock type ufs: SHARED (count 7) #0 0xc0a43374 at __lockmgr_args+0x5c4 #1 0xc0ca6571 at ffs_lock+0xa1 #2 0xc0de4c05 at VOP_LOCK1_APV+0xb5 #3 0xc0b09eb8 at _vn_lock+0x78 #4 0xc0afc96b at vget+0xbb #5 0xc0ae5605 at cache_lookup+0x6c5 #6 0xc0ae57ed at vfs_cache_lookup+0xbd #7 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #8 0xcb2c0e44 at null_lookup+0x94 #9 0xc0de5d85 at VOP_LOOKUP_APV+0xe5 #10 0xc0aed7cb at lookup+0x6eb #11 0xc0aee7ef at namei+0x6bf #12 0xc0b0182e at kern_statfs+0xbe #13 0xc0b01a6b at sys_statfs+0x3b #14 0xc0dc18a7 at syscall+0x2c7 #15 0xc0daabd1 at Xint0x80_syscall+0x21 vp=0xd378f15c, lowervp=0xcd841d98 db:0:lockedvnods> show mount 0xca77bb50 /dev/ad4s1a on / (ufs) 0xca77c000 devfs on /dev (devfs) 0xca77b87c /dev/ad4s1f on /home (ufs) 0xcab1e2d4 /dev/ad4s1d on /usr (ufs) 0xcab1e000 /dev/ad4s1e on /var (ufs) 0xca77cb50 procfs on /proc (procfs) 0xca77b5a8 /dev/label/tmp on /tmp (ufs) 0xcd2ca000 /dev/ad4s2d on /media (ufs) 0xd3cb387c /tmp on /home/pho/stress2/misc/mp1 (nullfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 42514 1203 1200 1001 S nanslp 0xc112bb84 sleep 42437 38187 42437 0 T+ ufs 0xd3433c94 fstat 63321 63031 5993 0 D+ ufs 0xd3433c94 fts 63319 63031 5993 0 D+ ufs 0xd3433c94 fts 63316 63031 5993 0 D+ ufs 0xd3433c94 fts 63313 63031 5993 0 D+ ufs 0xd3433c94 fts 63310 63031 5993 0 D+ ufs 0xd3433c94 fts 63059 63031 5993 0 D+ ufs 0xd3433c94 fts 63053 63031 5993 0 D+ ufs 0xd3433c94 fts 63044 63034 5993 0 D+ ufs 0xcfbc6b38 mkdir 63034 62931 5993 0 S+ wait 0xcec8cb30 mkdir 63031 62926 5993 0 S+ wait 0xd19e1b30 fts 62931 62890 5993 0 S+ wait 0xd17cb2cc mkdir 62926 62890 5993 0 S+ wait 0xd19e6000 fts 62890 62888 5993 0 S+ wait 0xce53f000 run 62888 62647 5993 0 S+ wait 0xd23e0598 run 62647 62595 5993 0 S+ wait 0xd17cc2cc run 62595 62288 5993 0 S+ wait 0xcec94b30 sh 62308 62288 5993 0 D+ ufs 0xd3433c94 kinfo 62307 62288 5993 0 D+ ufs 0xd3433c94 kinfo 62306 62288 5993 0 D+ ufs 0xd3433c94 kinfo 62305 62288 5993 0 D+ ufs 0xd3433c94 kinfo 62304 62288 5993 0 D+ ufs 0xd3433c94 kinfo 62288 5993 5993 0 S+ wait 0xcebf9598 sh 5993 1263 5993 0 S+ wait 0xceb72000 sh 38187 38168 38187 0 S+ wait 0xcb129864 bash 38168 38167 38168 0 S+ pause 0xd23d9324 csh 38167 37775 38167 1001 S+ wait 0xcec96000 su 37775 37330 37775 1001 Ss+ wait 0xcec82b30 bash 37330 31631 31631 1001 S select 0xcb8fc664 sshd 31631 1143 31631 0 Ss select 0xcc417be4 sshd 1520 1 1520 0 Ss+ ttyin 0xc7d97470 getty 1519 1 1519 0 Ss+ ttyin 0xc7d97670 getty 1518 1 1518 0 Ss+ ttyin 0xc7d97870 getty 1517 1 1517 0 Ss+ ttyin 0xc7d97a70 getty 1516 1 1516 0 Ss+ ttyin 0xc7d97c70 getty 1515 1 1515 0 Ss+ ttyin 0xc7d97e70 getty 1514 1 1514 0 Ss+ ttyin 0xc8181070 getty 1513 1 1513 0 Ss+ ttyin 0xc8181270 getty 1512 1 1512 0 Ss+ ttyin 0xc8181470 getty 1495 1 1495 0 Ss select 0xca850024 inetd 1470 1 1470 0 Ss nanslp 0xc112bb84 watchdogd 1263 1244 1263 0 S+ wait 0xcab692cc bash 1244 1243 1244 0 S+ pause 0xca80f058 csh 1243 1223 1243 1001 S+ wait 0xca7cd000 su 1223 1222 1223 1001 Ss+ wait 0xcadf8864 bash 1222 1220 1220 1001 S select 0xca6c0164 sshd 1220 1143 1220 0 Ss select 0xca8360e4 sshd 1204 1200 1200 1001 S piperd 0xca7cc960 awk 1203 1200 1200 1001 S wait 0xcab37864 sh 1202 1199 1202 1001 Ss+ select 0xca77ac64 top 1201 1197 1201 1001 Ss kqread 0xca84fe00 tail 1200 1198 1200 1001 Ss wait 0xca80f864 sh 1199 1191 1191 1001 S select 0xcb0b6264 sshd 1198 1192 1192 1001 S select 0xca77a024 sshd 1197 1193 1193 1001 S select 0xca850ea4 sshd 1193 1143 1193 0 Ss select 0xca6c04a4 sshd 1192 1143 1192 0 Ss select 0xca836924 sshd 1191 1143 1191 0 Ss select 0xca77a1e4 sshd 1154 1 1154 0 Ss nanslp 0xc112bb84 cron 1149 1 1149 25 Ss pause 0xcadf7324 sendmail 1146 1 1146 0 Ss select 0xca6c06a4 sendmail 1143 1 1143 0 Ss select 0xca6bf624 sshd 1112 1 1112 0 Ss select 0xca6c0524 moused 1092 1 1092 0 Ss select 0xca850424 ntpd 1038 1032 1032 0 S (threaded) nfsd 100137 S rpcsvc 0xc8180850 nfsd: service 100136 S rpcsvc 0xc8180510 nfsd: service 100135 S rpcsvc 0xc8180750 nfsd: service 100114 S rpcsvc 0xca76ba90 nfsd: master 1032 1 1032 0 Ss select 0xca850464 nfsd 1030 1026 1026 0 S select 0xca8510e4 nfsuserd 1029 1026 1026 0 S select 0xca6bf4e4 nfsuserd 1028 1026 1026 0 S select 0xca77ae64 nfsuserd 1027 1026 1026 0 S select 0xca6c0324 nfsuserd 1026 1 1026 0 Ss pause 0xcad11058 nfsuserd 1010 1 1010 0 Ss select 0xca6a6da4 mountd 976 1 976 0 Ss select 0xca6bf9a4 rpcbind 961 1 961 0 Ss select 0xca6bfba4 syslogd 838 1 838 0 Ss select 0xca6a6d24 devd 19 0 0 0 DL sdflush 0xc12a8080 [softdepflush] 18 0 0 0 DL vlruwt 0xca6c12cc [vnlru] 17 0 0 0 DL syncer 0xc12a1d74 [syncer] 16 0 0 0 DL psleep 0xc12a1a08 [bufdaemon] 9 0 0 0 DL pgzero 0xc12a9f5c [pagezero] 8 0 0 0 DL psleep 0xc12a9b48 [vmdaemon] 7 0 0 0 DL psleep 0xc12a9b10 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10f0354 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc12a3898 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc819a000 [ctl_thrd] 3 0 0 0 DL - 0xc7ffa03c [fdc0] 2 0 0 0 SL - 0xc808f000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8063d34 [usbus5] 100057 D - 0xc8063d04 [usbus5] 100056 D - 0xc8063cd4 [usbus5] 100055 D - 0xc8063ca4 [usbus5] 100053 D - 0xc8056b5c [usbus4] 100052 D - 0xc8056b2c [usbus4] 100051 D - 0xc8056afc [usbus4] 100050 D - 0xc8056acc [usbus4] 100049 D - 0xc8052b5c [usbus3] 100048 D - 0xc8052b2c [usbus3] 100047 D - 0xc8052afc [usbus3] 100046 D - 0xc8052acc [usbus3] 100045 D - 0xc804ab5c [usbus2] 100044 D - 0xc804ab2c [usbus2] 100043 D - 0xc804aafc [usbus2] 100042 D - 0xc804aacc [usbus2] 100040 D - 0xc8044b5c [usbus1] 100039 D - 0xc8044b2c [usbus1] 100038 D - 0xc8044afc [usbus1] 100037 D - 0xc8044acc [usbus1] 100035 D - 0xc8038b5c [usbus0] 100034 D - 0xc8038b2c [usbus0] 100033 D - 0xc8038afc [usbus0] 100032 D - 0xc8038acc [usbus0] 14 0 0 0 DL - 0xc112a984 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc1128568 [g_down] 100014 D - 0xc1128564 [g_up] 100013 D - 0xc112855c [g_event] 12 0 0 0 WL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100020 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi3: vm] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc7dc7b30 [init] 10 0 0 0 DL audit_wo 0xc12a77c0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100078 D - 0xc8035380 [mca taskq] 100068 D - 0xc112a984 [deadlkres] 100061 D - 0xc80356c0 [fw0_taskq] 100025 D - 0xc7f9de80 [thread taskq] 100023 D - 0xc7f9e040 [acpi_task_2] 100022 D - 0xc7f9e040 [acpi_task_1] 100021 D - 0xc7f9e040 [acpi_task_0] 100019 D - 0xc7f9e080 [ffs_trim taskq] 100018 D - 0xc7f9e0c0 [kqueue taskq] 100016 D - 0xc7dade80 [firmware taskq] 100000 D sched 0xc1128640 [swapper] 62315 62304 5993 0 Z+ kinfo 62316 62308 5993 0 Z+ kinfo 62314 62307 5993 0 Z+ kinfo 62310 62305 5993 0 Z+ kinfo 62311 62306 5993 0 Z+ kinfo 62927 62890 5993 0 Z+ link 63057 63031 5993 0 Z+ fts 63060 63031 5993 0 Z+ fts 63078 63031 5993 0 Z+ fts 63055 63031 5993 0 Z+ fts 63072 63031 5993 0 Z+ fts 62929 62890 5993 0 Z+ lockf 63054 63031 5993 0 Z+ fts 62930 62890 5993 0 Z+ creat 63064 63034 5993 0 Z+ mkdir 63046 63034 5993 0 Z+ mkdir 63065 63034 5993 0 Z+ mkdir 63320 63031 5993 0 Z+ fts 63067 63034 5993 0 Z+ mkdir 63045 63034 5993 0 Z+ mkdir 63066 63034 5993 0 Z+ mkdir 63048 63034 5993 0 Z+ mkdir 63047 63034 5993 0 Z+ mkdir 63315 63031 5993 0 Z+ fts 63058 63031 5993 0 Z+ fts 63311 63031 5993 0 Z+ fts 62935 62890 5993 0 Z+ mkfifo 63317 63031 5993 0 Z+ fts 63314 63031 5993 0 Z+ fts 62933 62890 5993 0 Z+ rename 62934 62890 5993 0 Z+ swap db:0:ps> allt Tracing command sleep pid 42514 tid 100373 td 0xcec8f8a0 sched_switch(cec8f8a0,0,104,1a3,7ed87c16,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cec8f8a0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a9c980,cec8f8a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c112bb84,6c,c0f90477,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c112bb84,0,16c,c0f90477,2711,...) at _sleep+0x34f kern_nanosleep(cec8f8a0,f2bc3c50,f2bc3c58,a,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cec8f8a0,f2bc3cec,c0fe0d8a,c0f98128,246,...) at sys_nanosleep+0x6f syscall(f2bc3d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816e293, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command fstat pid 42437 tid 100128 td 0xcad9e8a0 sched_switch(cad9e8a0,0,104,1a3,1daa297b,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cad9e8a0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200500,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f280e890,e5,cb2c27c0,cb2c27c0,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f280e890,cb2c14ab,246,200500,...) at VOP_LOCK1_APV+0xb5 null_lock(f280e8e0,c12a1abc,c12722b8,200400,d2de62b8,...) at null_lock+0xcf VOP_LOCK1_APV(cb2c27c0,f280e8e0,f280e900,c10eedc0,d2de62b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2de62b8,200400,c0f9d21b,4bb,d48ab800,...) at _vn_lock+0x78 vn_vptocnp_locked(f280e988,c0f9d21b,4ef,c0a64a0e,ca474d98,...) at vn_vptocnp_locked+0x24d vn_fullpath1(d48ab800,f280eab8,3ff,45b,d2de62b8,...) at vn_fullpath1+0x36a vn_fullpath(cad9e8a0,d2de62b8,f280eab8,f280eab4,ffffffff,...) at vn_fullpath+0xb6 export_fd_for_sysctl(1,ffffffff,ffffffff,ffffffff,0,...) at export_fd_for_sysctl+0xc6 sysctl_kern_proc_filedesc(c10be440,f280ec08,1,f280eb90,f280eb90,...) at sysctl_kern_proc_filedesc+0x2e0 sysctl_root(f280eb90,0,c0f8fd88,652,cad9e8a0,...) at sysctl_root+0x20e userland_sysctl(cad9e8a0,f280ebfc,4,0,bfbfcf78,...) at userland_sysctl+0x17a sys___sysctl(cad9e8a0,f280ecec,c0fe0d8a,c0f9784b,297,...) at sys___sysctl+0x94 syscall(f280ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281b2e17, esp = 0xbfbfcefc, ebp = 0xbfbfcf28 --- Tracing command fts pid 63321 tid 100322 td 0xd1997000 sched_switch(d1997000,0,104,1a3,606b8e98,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d1997000,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2b0e878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2b0e878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,d1997000,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f2b0e990,f2b0eb14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f2b0e980,c0f9f710,14b,f2b0eb14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f2b0e980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2b0ea20,c0f9f710,c10eea00,200000,f2b0ead4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2b0ea20,f2b0eb14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2b0ead4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f2b0ead4,d1997000,f2b0ead4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(d1997000,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(d1997000,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(d1997000,28471ef8,0,f2b0ec04,0,...) at kern_lstat+0x36 sys_lstat(d1997000,f2b0ecec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f2b0ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command fts pid 63319 tid 100477 td 0xcf7c72e0 sched_switch(cf7c72e0,0,104,1a3,62255c67,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cf7c72e0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2da8878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2da8878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,cf7c72e0,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f2da8990,f2da8b14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f2da8980,c0f9f710,14b,f2da8b14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f2da8980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2da8a20,c0f9f710,c10eea00,200000,f2da8ad4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2da8a20,f2da8b14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2da8ad4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f2da8ad4,cf7c72e0,f2da8ad4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(cf7c72e0,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(cf7c72e0,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(cf7c72e0,28471ef8,0,f2da8c04,0,...) at kern_lstat+0x36 sys_lstat(cf7c72e0,f2da8cec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f2da8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command fts pid 63316 tid 100431 td 0xcb6102e0 sched_switch(cb6102e0,0,104,1a3,6c47101c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb6102e0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2cd8878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2cd8878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,cb6102e0,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f2cd8990,f2cd8b14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f2cd8980,c0f9f710,14b,f2cd8b14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f2cd8980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2cd8a20,c0f9f710,c10eea00,200000,f2cd8ad4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2cd8a20,f2cd8b14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2cd8ad4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f2cd8ad4,cb6102e0,f2cd8ad4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(cb6102e0,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(cb6102e0,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(cb6102e0,28471ef8,0,f2cd8c04,0,...) at kern_lstat+0x36 sys_lstat(cb6102e0,f2cd8cec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f2cd8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command fts pid 63313 tid 100315 td 0xcec7bb80 sched_switch(cec7bb80,0,104,1a3,6d4a5df6,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cec7bb80,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2adb878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2adb878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,cec7bb80,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f2adb990,f2adbb14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f2adb980,c0f9f710,14b,f2adbb14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f2adb980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2adba20,c0f9f710,c10eea00,200000,f2adbad4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2adba20,f2adbb14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2adbad4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f2adbad4,cec7bb80,f2adbad4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(cec7bb80,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(cec7bb80,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(cec7bb80,28471ef8,0,f2adbc04,0,...) at kern_lstat+0x36 sys_lstat(cec7bb80,f2adbcec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f2adbd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command fts pid 63310 tid 100546 td 0xd17f32e0 sched_switch(d17f32e0,0,104,1a3,6930504e,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d17f32e0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2e7e878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2e7e878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,d17f32e0,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f2e7e990,f2e7eb14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f2e7e980,c0f9f710,14b,f2e7eb14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f2e7e980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2e7ea20,c0f9f710,c10eea00,200000,f2e7ead4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2e7ea20,f2e7eb14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2e7ead4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f2e7ead4,d17f32e0,f2e7ead4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(d17f32e0,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(d17f32e0,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(d17f32e0,28471ef8,0,f2e7ec04,0,...) at kern_lstat+0x36 sys_lstat(d17f32e0,f2e7ecec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f2e7ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command fts pid 63059 tid 100111 td 0xcab735c0 sched_switch(cab735c0,0,104,1a3,cec9c056,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab735c0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f27a2878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f27a2878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,cab735c0,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f27a2990,f27a2b14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f27a2980,c0f9f710,14b,f27a2b14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f27a2980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f27a2a20,c0f9f710,c10eea00,200000,f27a2ad4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f27a2a20,f27a2b14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f27a2ad4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f27a2ad4,cab735c0,f27a2ad4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(cab735c0,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(cab735c0,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(cab735c0,28471ef8,0,f27a2c04,0,...) at kern_lstat+0x36 sys_lstat(cab735c0,f27a2cec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f27a2d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command fts pid 63053 tid 100499 td 0xd17d85c0 sched_switch(d17d85c0,0,104,1a3,c9c5579c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d17d85c0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200100,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2df1878,0,c12a1abc,200100,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2df1878,c7d721e0,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,200100,c0f9ea08,877,0,...) at _vn_lock+0x78 vget(d3433c3c,200100,d17d85c0,28c,0,...) at vget+0xbb cache_lookup(cd841d98,f2df1990,f2df1b14,0,0,...) at cache_lookup+0x6c5 vfs_cache_lookup(f2df1980,c0f9f710,14b,f2df1b14,cd841d98,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10ddda0,f2df1980,161,8000,d378f15c,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2df1a20,c0f9f710,c10eea00,200000,f2df1ad4,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2df1a20,f2df1b14,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2df1ad4,c0f9de18,10e,dc,cd841e5c,...) at lookup+0x6eb namei(f2df1ad4,d17d85c0,f2df1ad4,246,c11481d8,...) at namei+0x6bf kern_statat_vnhook(d17d85c0,200,ffffff9c,28471ef8,0,...) at kern_statat_vnhook+0xbf kern_statat(d17d85c0,200,ffffff9c,28471ef8,0,...) at kern_statat+0x3c kern_lstat(d17d85c0,28471ef8,0,f2df1c04,0,...) at kern_lstat+0x36 sys_lstat(d17d85c0,f2df1cec,c0fe0d8a,c0f97b41,246,...) at sys_lstat+0x2f syscall(f2df1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28194b63, esp = 0xbfbfe5cc, ebp = 0xbfbfe658 --- Tracing command mkdir pid 63044 tid 100225 td 0xcec122e0 sched_switch(cec122e0,0,104,1a3,ec67eca7,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cec122e0,0,c0f94960,268,60,...) at sleepq_switch+0x162 sleepq_wait(cfbc6b38,60,c0f85397,4,0,...) at sleepq_wait+0x63 __lockmgr_args(cfbc6b38,80100,cfbc6ba4,0,0,...) at __lockmgr_args+0xb3f ffs_lock(f2994824,cec12390,c1270a40,80100,cfbc6ae0,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2994824,c7d721e0,c10eedc0,cfbc6ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cfbc6ae0,80100,c0f9ea08,877,4,...) at _vn_lock+0x78 vget(cfbc6ae0,80100,cec122e0,50,0,...) at vget+0xbb vfs_hash_get(ca77b5a8,186a44d,80000,cec122e0,f2994994,...) at vfs_hash_get+0xed ffs_vgetf(ca77b5a8,186a44d,80000,f2994994,0,...) at ffs_vgetf+0x49 ffs_vget(ca77b5a8,186a44d,80000,f2994994,f29949a4,...) at ffs_vget+0x2e ufs_lookup_ino(d3433c3c,f2994a78,f2994bf8,0,f29949e8,...) at ufs_lookup_ino+0x8a3 ufs_lookup(f2994a10,c0fe7ccb,d3433c3c,d3433c3c,f2994bf8,...) at ufs_lookup+0x2a VOP_CACHEDLOOKUP_APV(c10ddda0,f2994a10,f2994bf8,0,0,...) at VOP_CACHEDLOOKUP_APV+0xc5 vfs_cache_lookup(f2994a68,c0f9f710,14b,f2994bf8,d3433c3c,...) at vfs_cache_lookup+0xe6 VOP_LOOKUP_APV(c10ddda0,f2994a68,161,8000,d2de62b8,...) at VOP_LOOKUP_APV+0xe5 null_lookup(f2994b08,c0f9f710,0,80000,f2994bb8,...) at null_lookup+0x94 VOP_LOOKUP_APV(cb2c27c0,f2994b08,c0f9de18,2da,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2994bb8,c0f9de18,10e,dc,d318f220,...) at lookup+0x6eb namei(f2994bb8,0,d318f15c,f2994bbc,bfbf9697,...) at namei+0x6bf kern_rmdirat(cec122e0,ffffff9c,bfbf9697,0,f2994c6c,...) at kern_rmdirat+0x80 kern_rmdir(cec122e0,bfbf9697,0,f2994d1c,c0dc18a7,...) at kern_rmdir+0x27 sys_rmdir(cec122e0,f2994cec,c0fe0d8a,c0fc05f1,246,...) at sys_rmdir+0x22 syscall(f2994d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fbbcb, esp = 0xbfbf922c, ebp = 0xbfbf9668 --- Tracing command mkdir pid 63034 tid 100291 td 0xcb1572e0 sched_switch(cb1572e0,0,104,1a3,5dd7f047,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb1572e0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cec8cb30,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cec8cb30,cec8cbb8,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cb1572e0,f644,f2a93c60,0,0,...) at kern_wait+0x597 sys_wait4(cb1572e0,f2a93cec,c0fe0d8a,c0f976de,216,...) at sys_wait4+0x3b syscall(f2a93d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811266b, esp = 0xbfbfe6fc, ebp = 0xbfbfe718 --- Tracing command fts pid 63031 tid 100377 td 0xcec8f2e0 sched_switch(cec8f2e0,0,104,1a3,475e883c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cec8f2e0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d19e1b30,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(d19e1b30,d19e1bb8,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cec8f2e0,f64d,f2bd0c60,0,0,...) at kern_wait+0x597 sys_wait4(cec8f2e0,f2bd0cec,c0fe0d8a,c0f976de,216,...) at sys_wait4+0x3b syscall(f2bd0d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811166b, esp = 0xbfbfe70c, ebp = 0xbfbfe728 --- Tracing command mkdir pid 62931 tid 100507 td 0xd17e02e0 sched_switch(d17e02e0,0,104,1a3,52a4b0b1,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d17e02e0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d17cb2cc,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(d17cb2cc,d17cb354,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(d17e02e0,f63a,f2e09c60,0,0,...) at kern_wait+0x597 sys_wait4(d17e02e0,f2e09cec,c,c,216,...) at sys_wait4+0x3b syscall(f2e09d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811266b, esp = 0xbfbfe6fc, ebp = 0xbfbfe718 --- Tracing command fts pid 62926 tid 100341 td 0xcec915c0 sched_switch(cec915c0,0,104,1a3,f3abcdd9,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cec915c0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d19e6000,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(d19e6000,d19e6088,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cec915c0,f637,f2b50c60,0,0,...) at kern_wait+0x597 sys_wait4(cec915c0,f2b50cec,c,c,216,...) at sys_wait4+0x3b syscall(f2b50d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811166b, esp = 0xbfbfe70c, ebp = 0xbfbfe728 --- Tracing command run pid 62890 tid 100202 td 0xcb14b5c0 sched_switch(cb14b5c0,0,104,1a3,4ae0a533,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb14b5c0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce53f000,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce53f000,ce53f088,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cb14b5c0,f5ce,f294fc60,0,0,...) at kern_wait+0x597 sys_wait4(cb14b5c0,f294fcec,c0fe0d8a,c0f9813a,216,...) at sys_wait4+0x3b syscall(f294fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811166b, esp = 0xbfbfe09c, ebp = 0xbfbfe0b8 --- Tracing command run pid 62888 tid 100430 td 0xd29b6b80 sched_switch(d29b6b80,0,104,1a3,4ae01285,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d29b6b80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d23e0598,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(d23e0598,d23e0620,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(d29b6b80,f5aa,f2cd5c60,0,0,...) at kern_wait+0x597 sys_wait4(d29b6b80,f2cd5cec,c0fe0d8a,c0f9813a,216,...) at sys_wait4+0x3b syscall(f2cd5d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811166b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command run pid 62647 tid 100502 td 0xcf7c7b80 sched_switch(cf7c7b80,0,104,1a3,4adf5e22,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cf7c7b80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d17cc2cc,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(d17cc2cc,d17cc354,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cf7c7b80,f5a8,f2dfac60,0,0,...) at kern_wait+0x597 sys_wait4(cf7c7b80,f2dfacec,c,c,216,...) at sys_wait4+0x3b syscall(f2dfad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811166b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command sh pid 62595 tid 100308 td 0xcec77b80 sched_switch(cec77b80,0,104,1a3,b1ab7a94,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cec77b80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cec94b30,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cec94b30,cec94bb8,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cec77b80,ffffffff,f2ac6c60,2,0,...) at kern_wait+0x597 sys_wait4(cec77b80,f2ac6cec,c0fe0d8a,c0f97886,216,...) at sys_wait4+0x3b syscall(f2ac6d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command kinfo pid 62308 tid 100505 td 0xd17e08a0 sched_switch(d17e08a0,0,104,1a3,ecdf6b42,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d17e08a0,0,c0f94960,268,60,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,0,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,400400,d3433d00,0,0,...) at __lockmgr_args+0xb3f ffs_lock(f2e0344c,c0a4b8e1,cb2c28f0,400400,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2e0344c,f2e03454,c10eedc0,d3433c3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3433c3c,400400,cb2c12d5,e4,0,...) at _vn_lock+0x78 null_nodeget(d3cb387c,d3433c3c,f2e034d8,8000,d318f15c,...) at null_nodeget+0xa3 null_lookup(f2e03564,c0f9f710,c10eea00,200000,f2e03784,...) at null_lookup+0xc3 VOP_LOOKUP_APV(cb2c27c0,f2e03564,f2e037c4,21e,c0f9de18,...) at VOP_LOOKUP_APV+0xe5 lookup(f2e03784,c0f9de18,fa,dc,c0de1195,...) at lookup+0x6eb namei(f2e03784,c10c2b38,d17e08a0,cfbc6ba4,1,...) at namei+0x6bf vn_open_cred(f2e03784,f2e0388c,0,1,ca77d880,...) at vn_open_cred+0x31f vop_stdvptocnp(f2e0391c,f2e038c8,c0de1195,f2e038d8,f2e03934,...) at vop_stdvptocnp+0x19c null_vptocnp(f2e0391c,c0fe772b,ca77d880,ca77d880,0,...) at null_vptocnp+0xfe VOP_VPTOCNP_APV(cb2c27c0,f2e0391c,c0f9d21b,4bb,cf0ba400,...) at VOP_VPTOCNP_APV+0xd6 vn_vptocnp_locked(f2e03988,c0f9d21b,4ef,c0a64a0e,ca474d98,...) at vn_vptocnp_locked+0x280 vn_fullpath1(cf0ba400,f2e03ab8,3ff,45b,d318f15c,...) at vn_fullpath1+0x36a vn_fullpath(d17e08a0,d318f15c,f2e03ab8,f2e03ab4,ffffffff,...) at vn_fullpath+0xb6 export_fd_for_sysctl(1,ffffffff,ffffffff,ffffffff,0,...) at export_fd_for_sysctl+0xc6 sysctl_kern_proc_filedesc(c10be440,f2e03c08,1,f2e03b90,f2e03b90,...) at sysctl_kern_proc_filedesc+0x2e0 sysctl_root(f2e03b90,0,c0f8fd88,652,d17e08a0,...) at sysctl_root+0x20e userland_sysctl(d17e08a0,f2e03bfc,4,2842f500,bfbfe7d8,...) at userland_sysctl+0x17a sys___sysctl(d17e08a0,f2e03cec,c0fe0d8a,c0f97cb3,297,...) at sys___sysctl+0x94 syscall(f2e03d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a2e17, esp = 0xbfbfe75c, ebp = 0xbfbfe788 --- Tracing command kinfo pid 62307 tid 100292 td 0xcb157000 sched_switch(cb157000,0,104,1a3,8965ccf,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb157000,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200500,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2a96890,e5,cb2c27c0,cb2c27c0,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2a96890,cb2c14ab,246,200500,...) at VOP_LOCK1_APV+0xb5 null_lock(f2a968e0,c12a1abc,c1271bd8,200400,d2de62b8,...) at null_lock+0xcf VOP_LOCK1_APV(cb2c27c0,f2a968e0,f2a96900,c10eedc0,d2de62b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2de62b8,200400,c0f9d21b,4bb,cfa99000,...) at _vn_lock+0x78 vn_vptocnp_locked(f2a96988,c0f9d21b,4ef,c0a64a0e,ca474d98,...) at vn_vptocnp_locked+0x24d vn_fullpath1(cfa99000,f2a96ab8,3ff,45b,d2de62b8,...) at vn_fullpath1+0x36a vn_fullpath(cb157000,d2de62b8,f2a96ab8,f2a96ab4,ffffffff,...) at vn_fullpath+0xb6 export_fd_for_sysctl(1,ffffffff,ffffffff,ffffffff,0,...) at export_fd_for_sysctl+0xc6 sysctl_kern_proc_filedesc(c10be440,f2a96c08,1,f2a96b90,f2a96b90,...) at sysctl_kern_proc_filedesc+0x2e0 sysctl_root(f2a96b90,0,c0f8fd88,652,cb157000,...) at sysctl_root+0x20e userland_sysctl(cb157000,f2a96bfc,4,0,bfbfe7d8,...) at userland_sysctl+0x17a sys___sysctl(cb157000,f2a96cec,c0fe0d8a,c0f9784b,297,...) at sys___sysctl+0x94 syscall(f2a96d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a2e17, esp = 0xbfbfe75c, ebp = 0xbfbfe788 --- Tracing command kinfo pid 62306 tid 100125 td 0xca8125c0 sched_switch(ca8125c0,0,104,1a3,bb033f0,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ca8125c0,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200500,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f27f4890,e5,cb2c27c0,cb2c27c0,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f27f4890,cb2c14ab,246,200500,...) at VOP_LOCK1_APV+0xb5 null_lock(f27f48e0,c12a1abc,c1273338,200400,d2de62b8,...) at null_lock+0xcf VOP_LOCK1_APV(cb2c27c0,f27f48e0,f27f4900,c10eedc0,d2de62b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2de62b8,200400,c0f9d21b,4bb,ceaa6000,...) at _vn_lock+0x78 vn_vptocnp_locked(f27f4988,c0f9d21b,4ef,c0a64a0e,ca474d98,...) at vn_vptocnp_locked+0x24d vn_fullpath1(ceaa6000,f27f4ab8,3ff,45b,d2de62b8,...) at vn_fullpath1+0x36a vn_fullpath(ca8125c0,d2de62b8,f27f4ab8,f27f4ab4,ffffffff,...) at vn_fullpath+0xb6 export_fd_for_sysctl(1,ffffffff,ffffffff,ffffffff,0,...) at export_fd_for_sysctl+0xc6 sysctl_kern_proc_filedesc(c10be440,f27f4c08,1,f27f4b90,f27f4b90,...) at sysctl_kern_proc_filedesc+0x2e0 sysctl_root(f27f4b90,0,c0f8fd88,652,ca8125c0,...) at sysctl_root+0x20e userland_sysctl(ca8125c0,f27f4bfc,4,0,bfbfe7d8,...) at userland_sysctl+0x17a sys___sysctl(ca8125c0,f27f4cec,c0fe0d8a,c0f9784b,297,...) at sys___sysctl+0x94 syscall(f27f4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a2e17, esp = 0xbfbfe75c, ebp = 0xbfbfe788 --- Tracing command kinfo pid 62305 tid 100199 td 0xce30a000 sched_switch(ce30a000,0,104,1a3,5942eae,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ce30a000,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200500,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f292b890,e5,cb2c27c0,cb2c27c0,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f292b890,cb2c14ab,246,200500,...) at VOP_LOCK1_APV+0xb5 null_lock(f292b8e0,c12a1abc,c12716b0,200400,d2de62b8,...) at null_lock+0xcf VOP_LOCK1_APV(cb2c27c0,f292b8e0,f292b900,c10eedc0,d2de62b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2de62b8,200400,c0f9d21b,4bb,cf0b9000,...) at _vn_lock+0x78 vn_vptocnp_locked(f292b988,c0f9d21b,4ef,c0a64a0e,ca474d98,...) at vn_vptocnp_locked+0x24d vn_fullpath1(cf0b9000,f292bab8,3ff,45b,d2de62b8,...) at vn_fullpath1+0x36a vn_fullpath(ce30a000,d2de62b8,f292bab8,f292bab4,ffffffff,...) at vn_fullpath+0xb6 export_fd_for_sysctl(1,ffffffff,ffffffff,ffffffff,0,...) at export_fd_for_sysctl+0xc6 sysctl_kern_proc_filedesc(c10be440,f292bc08,1,f292bb90,f292bb90,...) at sysctl_kern_proc_filedesc+0x2e0 sysctl_root(f292bb90,0,c0f8fd88,652,ce30a000,...) at sysctl_root+0x20e userland_sysctl(ce30a000,f292bbfc,4,0,bfbfe7d8,...) at userland_sysctl+0x17a sys___sysctl(ce30a000,f292bcec,c0fe0d8a,c0f9784b,297,...) at sys___sysctl+0x94 syscall(f292bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a2e17, esp = 0xbfbfe75c, ebp = 0xbfbfe788 --- Tracing command kinfo pid 62304 tid 100444 td 0xceca6000 sched_switch(ceca6000,0,104,1a3,b0a73d4c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ceca6000,0,c0f94960,268,d3433c94,...) at sleepq_switch+0x162 sleepq_wait(d3433c94,60,c0f85397,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d3433c94,200500,d3433d00,0,0,...) at __lockmgr_args+0x4ed ffs_lock(f2cff890,e5,cb2c27c0,cb2c27c0,d3433c3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10ddda0,f2cff890,cb2c14ab,246,200500,...) at VOP_LOCK1_APV+0xb5 null_lock(f2cff8e0,c12a1abc,c12745c8,200400,d2de62b8,...) at null_lock+0xcf VOP_LOCK1_APV(cb2c27c0,f2cff8e0,f2cff900,c10eedc0,d2de62b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2de62b8,200400,c0f9d21b,4bb,cb10bc00,...) at _vn_lock+0x78 vn_vptocnp_locked(f2cff988,c0f9d21b,4ef,c0a64a0e,ca474d98,...) at vn_vptocnp_locked+0x24d vn_fullpath1(cb10bc00,f2cffab8,3ff,45b,d2de62b8,...) at vn_fullpath1+0x36a vn_fullpath(ceca6000,d2de62b8,f2cffab8,f2cffab4,ffffffff,...) at vn_fullpath+0xb6 export_fd_for_sysctl(1,ffffffff,ffffffff,ffffffff,0,...) at export_fd_for_sysctl+0xc6 sysctl_kern_proc_filedesc(c10be440,f2cffc08,1,f2cffb90,f2cffb90,...) at sysctl_kern_proc_filedesc+0x2e0 sysctl_root(f2cffb90,0,c0f8fd88,652,ceca6000,...) at sysctl_root+0x20e userland_sysctl(ceca6000,f2cffbfc,4,0,bfbfe7d8,...) at userland_sysctl+0x17a sys___sysctl(ceca6000,f2cffcec,c0fe0d8a,c0f9784b,297,...) at sys___sysctl+0x94 syscall(f2cffd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a2e17, esp = 0xbfbfe75c, ebp = 0xbfbfe788 --- Tracing command sh pid 62288 tid 100217 td 0xce5465c0 sched_switch(ce5465c0,0,104,1a3,aa0f4ede,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ce5465c0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cebf9598,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cebf9598,cebf9620,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(ce5465c0,ffffffff,f297cc60,2,0,...) at kern_wait+0x597 sys_wait4(ce5465c0,f297ccec,c0fe0d8a,c0f97886,216,...) at sys_wait4+0x3b syscall(f297cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command sh pid 5993 tid 100467 td 0xcecb2b80 sched_switch(cecb2b80,0,104,1a3,f8fddaa4,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cecb2b80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ceb72000,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ceb72000,ceb72088,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cecb2b80,ffffffff,f2d44c60,2,0,...) at kern_wait+0x597 sys_wait4(cecb2b80,f2d44cec,c0fe0d8a,c0f97886,216,...) at sys_wait4+0x3b syscall(f2d44d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfe69c, ebp = 0xbfbfe6b8 --- Tracing command bash pid 38187 tid 100154 td 0xcad9cb80 sched_switch(cad9cb80,0,104,1a3,148e8e54,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cad9cb80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb129864,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb129864,cb1298ec,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cad9cb80,ffffffff,f2871c60,6,0,...) at kern_wait+0x597 sys_wait4(cad9cb80,f2871cec,c0fe0d8a,c0f97796,216,...) at sys_wait4+0x3b syscall(f2871d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d566b, esp = 0xbfbfe78c, ebp = 0xbfbfe7a8 --- Tracing command csh pid 38168 tid 100412 td 0xd23e68a0 sched_switch(d23e68a0,0,104,1a3,16d6b752,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,74,...) at mi_switch+0x1ff sleepq_switch(d23e68a0,0,c0f94960,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d23d9324,74,c0e15dae,100,0,...) at sleepq_wait_sig+0x17 _sleep(d23d9324,d23d9354,174,c0e15dae,0,...) at _sleep+0x385 kern_sigsuspend(d23e68a0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(d23e68a0,f2c7fcec,c0fe0d8a,c0f97796,202,...) at sys_sigsuspend+0x4d syscall(f2c7fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28195ecb, esp = 0xbfbfe5ac, ebp = 0xbfbfe618 --- Tracing command su pid 38167 tid 100302 td 0xcec79000 sched_switch(cec79000,0,104,1a3,69be0ad6,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cec79000,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cec96000,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cec96000,cec96088,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cec79000,9518,f2ab4c60,2,0,...) at kern_wait+0x597 sys_wait4(cec79000,f2ab4cec,c,c,216,...) at sys_wait4+0x3b syscall(f2ab4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2813266b, esp = 0xbfbfe5dc, ebp = 0xbfbfe5f8 --- Tracing command bash pid 37775 tid 100269 td 0xcec0f8a0 sched_switch(cec0f8a0,0,104,1a3,61637886,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cec0f8a0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cec82b30,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cec82b30,cec82bb8,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cec0f8a0,ffffffff,f2a34c60,6,0,...) at kern_wait+0x597 sys_wait4(cec0f8a0,f2a34cec,c0fe0d8a,c0f97796,216,...) at sys_wait4+0x3b syscall(f2a34d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d566b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 37330 tid 100113 td 0xcab73000 sched_switch(cab73000,0,104,1a3,7811c4f4,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab73000,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,cb8fc650,0,c0f8d34f,cab73000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb8fc664,0,f27aaa58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb8fc664,cb8fc650,c0f970b0,6b2,cdfbed90,...) at _cv_wait_sig+0x260 seltdwait(cdfbed90,58,ccf35c80,cab73000,f27aaacc,...) at seltdwait+0xa2 kern_select(cab73000,c,288060b8,288060c0,0,0,20,cab6c000,0) at kern_select+0x655 sys_select(cab73000,f27aacec,c0fe0d8a,c0f979fb,206,...) at sys_select+0x66 syscall(f27aad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 31631 tid 100378 td 0xd1c7a8a0 sched_switch(d1c7a8a0,0,104,1a3,859deedc,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d1c7a8a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,cc417bd0,0,c0f8d34f,d1c7a8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc417be4,0,f2bd3abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc417be4,cc417bd0,c0f970b0,6b2,f2bd3b44,...) at _cv_wait_sig+0x260 seltdwait(cae83a2c,c0f970b0,5af,d1c7a8a0,8,...) at seltdwait+0xa2 sys_poll(d1c7a8a0,f2bd3cec,c0fe0d8a,c0f7f839,202,...) at sys_poll+0x321 syscall(f2bd3d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f3ab, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command getty pid 1520 tid 100115 td 0xcab728a0 sched_switch(cab728a0,0,104,1a3,2a63fb60,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab728a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,cab728a0,cab728a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97470,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97470,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97400,c7d97470,f27b2c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97400,f27b2c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193400,f27b2c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7cee00,f27b2c44,c7dc4e80,0,cab728a0,...) at devfs_read_f+0x7e dofileread(f27b2c44,ffffffff,ffffffff,0,f27b2c20,...) at dofileread+0x9e kern_readv(cab728a0,0,f27b2c44,f27b2c64,1,...) at kern_readv+0x68 sys_read(cab728a0,f27b2cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f27b2d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1519 tid 100120 td 0xcab6d8a0 sched_switch(cab6d8a0,0,104,1a3,2a5f28c2,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab6d8a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,cab6d8a0,cab6d8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97670,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97670,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97600,c7d97670,f27e0c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97600,f27e0c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193500,f27e0c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7ad658,f27e0c44,c7dc4e80,0,cab6d8a0,...) at devfs_read_f+0x7e dofileread(f27e0c44,ffffffff,ffffffff,0,f27e0c20,...) at dofileread+0x9e kern_readv(cab6d8a0,0,f27e0c44,f27e0c64,1,...) at kern_readv+0x68 sys_read(cab6d8a0,f27e0cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f27e0d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1518 tid 100124 td 0xca8128a0 sched_switch(ca8128a0,0,104,1a3,2a798002,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8128a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,ca8128a0,ca8128a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97870,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97870,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97800,c7d97870,f27f1c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97800,f27f1c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193600,f27f1c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7ce968,f27f1c44,c7dc4e80,0,ca8128a0,...) at devfs_read_f+0x7e dofileread(f27f1c44,ffffffff,ffffffff,0,f27f1c20,...) at dofileread+0x9e kern_readv(ca8128a0,0,f27f1c44,f27f1c64,1,...) at kern_readv+0x68 sys_read(ca8128a0,f27f1cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f27f1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1517 tid 100138 td 0xcad9d2e0 sched_switch(cad9d2e0,0,104,1a3,2a89f5bd,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad9d2e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,cad9d2e0,cad9d2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97a70,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97a70,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97a00,c7d97a70,f2834c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97a00,f2834c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075500,f2834c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca839380,f2834c44,c7dc4e80,0,cad9d2e0,...) at devfs_read_f+0x7e dofileread(f2834c44,ffffffff,ffffffff,0,f2834c20,...) at dofileread+0x9e kern_readv(cad9d2e0,0,f2834c44,f2834c64,1,...) at kern_readv+0x68 sys_read(cad9d2e0,f2834cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f2834d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1516 tid 100088 td 0xca817b80 sched_switch(ca817b80,0,104,1a3,2a516efa,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca817b80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,ca817b80,ca817b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97c70,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97c70,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97c00,c7d97c70,f2723c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97c00,f2723c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075600,f2723c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7e05e8,f2723c44,c7dc4e80,0,ca817b80,...) at devfs_read_f+0x7e dofileread(f2723c44,ffffffff,ffffffff,0,f2723c20,...) at dofileread+0x9e kern_readv(ca817b80,0,f2723c44,f2723c64,1,...) at kern_readv+0x68 sys_read(ca817b80,f2723cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f2723d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1515 tid 100186 td 0xcb1662e0 sched_switch(cb1662e0,0,104,1a3,2a818ca6,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1662e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,cb1662e0,cb1662e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97e70,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97e70,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97e00,c7d97e70,f28d6c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97e00,f28d6c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075700,f28d6c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7ce3f0,f28d6c44,c7dc4e80,0,cb1662e0,...) at devfs_read_f+0x7e dofileread(f28d6c44,ffffffff,ffffffff,0,f28d6c20,...) at dofileread+0x9e kern_readv(cb1662e0,0,f28d6c44,f28d6c64,1,...) at kern_readv+0x68 sys_read(cb1662e0,f28d6cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f28d6d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1514 tid 100180 td 0xcb1675c0 sched_switch(cb1675c0,0,104,1a3,2a7e062d,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1675c0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,cb1675c0,cb1675c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8181070,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8181070,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8181000,c8181070,f28bfc44,1,0,...) at tty_wait+0x71 ttydisc_read(c8181000,f28bfc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075800,f28bfc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca839a10,f28bfc44,c7dc4e80,0,cb1675c0,...) at devfs_read_f+0x7e dofileread(f28bfc44,ffffffff,ffffffff,0,f28bfc20,...) at dofileread+0x9e kern_readv(cb1675c0,0,f28bfc44,f28bfc64,1,...) at kern_readv+0x68 sys_read(cb1675c0,f28bfcec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f28bfd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1513 tid 100174 td 0xcab738a0 sched_switch(cab738a0,0,104,1a3,2a7b370c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab738a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,cab738a0,cab738a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8181270,0,c0f997c8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8181270,c112a230,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8181200,c8181270,f28adc44,1,0,...) at tty_wait+0x71 ttydisc_read(c8181200,f28adc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075900,f28adc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7ce6c8,f28adc44,c7dc4e80,0,cab738a0,...) at devfs_read_f+0x7e dofileread(f28adc44,ffffffff,ffffffff,0,f28adc20,...) at dofileread+0x9e kern_readv(cab738a0,0,f28adc44,f28adc64,1,...) at kern_readv+0x68 sys_read(cab738a0,f28adcec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f28add28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1512 tid 100104 td 0xcab412e0 sched_switch(cab412e0,0,104,1a3,34a9e0ba,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab412e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,c8181404,0,c0f8d34f,cab412e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8181470,0,f2773af0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8181470,c8181404,c0f991a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8181400,c8181470,f2773c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8181400,f2773c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7ed4e00,f2773c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7e0c40,f2773c44,c7dc4e80,0,cab412e0,...) at devfs_read_f+0x7e dofileread(f2773c44,ffffffff,ffffffff,0,f2773c20,...) at dofileread+0x9e kern_readv(cab412e0,0,f2773c44,f2773c64,1,...) at kern_readv+0x68 sys_read(cab412e0,f2773cec,c0fe0d8a,c0df4156,246,...) at sys_read+0x4f syscall(f2773d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 1495 tid 100148 td 0xcadb08a0 sched_switch(cadb08a0,0,104,1a3,1f7ca1d3,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb08a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca850010,0,c0f8d34f,cadb08a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca850024,0,f2855a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca850024,ca850010,c0f970b0,6b2,ca7ce620,...) at _cv_wait_sig+0x260 seltdwait(ca7ce620,58,c7dc4e80,cadb08a0,e3,...) at seltdwait+0xa2 kern_select(cadb08a0,8,bfbfdfa0,0,0,0,20,cadf7000,4) at kern_select+0x655 sys_select(cadb08a0,f2855cec,c0fe0d8a,c0f978f3,202,...) at sys_select+0x66 syscall(f2855d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b86d3, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 1470 tid 100171 td 0xcb14cb80 sched_switch(cb14cb80,0,104,1a3,53293d00,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb14cb80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9c980,cb14cb80,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c112bb84,6c,c0f90477,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c112bb84,0,16c,c0f90477,ea61,...) at _sleep+0x34f kern_nanosleep(cb14cb80,f28a4c50,f28a4c58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb14cb80,f28a4cec,c0fe0d8a,c0df4156,206,...) at sys_nanosleep+0x6f syscall(f28a4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819e293, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 1263 tid 100117 td 0xcab722e0 sched_switch(cab722e0,0,104,1a3,6de728ef,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab722e0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cab692cc,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cab692cc,cab69354,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cab722e0,ffffffff,f27d3c60,6,0,...) at kern_wait+0x597 sys_wait4(cab722e0,f27d3cec,c0fe0d8a,c0f97796,216,...) at sys_wait4+0x3b syscall(f27d3d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d566b, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command csh pid 1244 tid 100099 td 0xca816000 sched_switch(ca816000,0,104,1a3,63a4dea3,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,74,...) at mi_switch+0x1ff sleepq_switch(ca816000,0,c0f94960,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca80f058,74,c0e15dae,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca80f058,ca80f088,174,c0e15dae,0,...) at _sleep+0x385 kern_sigsuspend(ca816000,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(ca816000,f275acec,c0fe0d8a,c0f97796,202,...) at sys_sigsuspend+0x4d syscall(f275ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28195ecb, esp = 0xbfbfe58c, ebp = 0xbfbfe5f8 --- Tracing command su pid 1243 tid 100085 td 0xca6cd2e0 sched_switch(ca6cd2e0,0,104,1a3,308c7953,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6cd2e0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7cd000,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7cd000,ca7cd088,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(ca6cd2e0,4dc,f2717c60,2,0,...) at kern_wait+0x597 sys_wait4(ca6cd2e0,f2717cec,c,c,216,...) at sys_wait4+0x3b syscall(f2717d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2813266b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command bash pid 1223 tid 100140 td 0xcadb32e0 sched_switch(cadb32e0,0,104,1a3,24e062ea,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cadb32e0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cadf8864,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cadf8864,cadf88ec,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cadb32e0,ffffffff,f283dc60,6,0,...) at kern_wait+0x597 sys_wait4(cadb32e0,f283dcec,c0fe0d8a,c0f97796,216,...) at sys_wait4+0x3b syscall(f283dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d566b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 1222 tid 100110 td 0xcab40000 sched_switch(cab40000,0,104,1a3,d6a87e20,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab40000,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6c0150,0,c0f8d34f,cab40000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6c0164,0,f278ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6c0164,ca6c0150,c0f970b0,6b2,ca7e0540,...) at _cv_wait_sig+0x260 seltdwait(ca7e0540,58,c7dc4800,cab40000,f278bacc,...) at seltdwait+0xa2 kern_select(cab40000,c,288060b8,288060c0,0,0,20,cab37000,0) at kern_select+0x655 sys_select(cab40000,f278bcec,c0fe0d8a,c0f979fb,206,...) at sys_select+0x66 syscall(f278bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1220 tid 100144 td 0xcadb25c0 sched_switch(cadb25c0,0,104,1a3,1a860e6d,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb25c0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca8360d0,0,c0f8d34f,cadb25c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca8360e4,0,f2849abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca8360e4,ca8360d0,c0f970b0,6b2,f2849b44,...) at _cv_wait_sig+0x260 seltdwait(cac3c02c,c0f970b0,5af,cadb25c0,8,...) at seltdwait+0xa2 sys_poll(cadb25c0,f2849cec,c0fe0d8a,c0f7f839,202,...) at sys_poll+0x321 syscall(f2849d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f3ab, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command awk pid 1204 tid 100106 td 0xcab40b80 sched_switch(cab40b80,0,104,1a3,7eb7d4ac,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cab40b80,0,c0f94960,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7cc960,5c,c0f972df,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7cc960,ca7ccad8,15c,c0f972df,0,...) at _sleep+0x385 pipe_read(cac3fc08,f277bc44,c7dc4780,0,cab40b80,...) at pipe_read+0x417 dofileread(f277bc44,ffffffff,ffffffff,0,f277bc20,...) at dofileread+0x9e kern_readv(cab40b80,0,f277bc44,f277bc64,1,...) at kern_readv+0x68 sys_read(cab40b80,f277bcec,c0fe0d8a,f277bd80,216,...) at sys_read+0x4f syscall(f277bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c8753, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 1203 tid 100107 td 0xcab408a0 sched_switch(cab408a0,0,104,1a3,7ec38e93,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab408a0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cab37864,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cab37864,cab378ec,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(cab408a0,ffffffff,f277fc60,2,0,...) at kern_wait+0x597 sys_wait4(cab408a0,f277fcec,c0fe0d8a,c0f97886,216,...) at sys_wait4+0x3b syscall(f277fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command top pid 1202 tid 100129 td 0xcad9e5c0 sched_switch(cad9e5c0,0,104,1a3,26ad0b51,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad9e5c0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2811a20,c0a4b96a,ca77ac50,0,cad9e5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca77ac64,0,f2811a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca77ac64,ca77ac50,3e9,6b2,ca7ac5b0,...) at _cv_timedwait_sig+0x270 seltdwait(f2811c10,f2811c18,caf9ea80,cad9e5c0,335b1b0a,...) at seltdwait+0x8a kern_select(cad9e5c0,2,bfbfebac,0,0,f2811c5c,20,1,0) at kern_select+0x655 sys_select(cad9e5c0,f2811cec,c0fe0d8a,c0f5d447,246,...) at sys_select+0x66 syscall(f2811d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fd6d3, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command tail pid 1201 tid 100092 td 0xca8175c0 sched_switch(ca8175c0,0,104,1a3,12172585,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,68,...) at mi_switch+0x1ff sleepq_switch(ca8175c0,0,c0f94960,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9c980,ca8175c0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca84fe00,68,c0f8904e,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(ca84fe00,ca84fe00,168,c0f8904e,3e9,...) at _sleep+0x34f kern_kevent(ca8175c0,4,0,1,f2734c44,...) at kern_kevent+0x374 sys_kevent(ca8175c0,f2734cec,c0fe0d8a,c0def423,286,...) at sys_kevent+0x19e syscall(f2734d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x281721ab, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sh pid 1200 tid 100096 td 0xca8168a0 sched_switch(ca8168a0,0,104,1a3,a05dca12,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca8168a0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca80f864,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca80f864,ca80f8ec,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(ca8168a0,ffffffff,f2746c60,2,0,...) at kern_wait+0x597 sys_wait4(ca8168a0,f2746cec,c,c,216,...) at sys_wait4+0x3b syscall(f2746d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfeb1c, ebp = 0xbfbfeb38 --- Tracing command sshd pid 1199 tid 100087 td 0xc8185b80 sched_switch(c8185b80,0,104,1a3,26af54cc,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8185b80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,cb0b6250,0,c0f8d34f,c8185b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb0b6264,0,f271fa58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb0b6264,cb0b6250,c0f970b0,6b2,cac3fab8,...) at _cv_wait_sig+0x260 seltdwait(cac3fab8,58,cad97d00,c8185b80,f271facc,...) at seltdwait+0xa2 kern_select(c8185b80,a,288060b8,288060c0,0,0,20,ca6c2864,0) at kern_select+0x655 sys_select(c8185b80,f271fcec,c0fe0d8a,c0f979fb,206,...) at sys_select+0x66 syscall(f271fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1198 tid 100108 td 0xcab405c0 sched_switch(cab405c0,0,104,1a3,75406000,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab405c0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca77a010,0,c0f8d34f,cab405c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca77a024,0,f2783a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca77a024,ca77a010,c0f970b0,6b2,ca7cea80,...) at _cv_wait_sig+0x260 seltdwait(ca7cea80,58,ca77db00,cab405c0,f2783acc,...) at seltdwait+0xa2 kern_select(cab405c0,c,288060b8,288060c0,0,0,20,cab37598,0) at kern_select+0x655 sys_select(cab405c0,f2783cec,c0fe0d8a,c0f979fb,206,...) at sys_select+0x66 syscall(f2783d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1197 tid 100086 td 0xca6cd000 sched_switch(ca6cd000,0,104,1a3,a9d149ee,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd000,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca850e90,0,c0f8d34f,ca6cd000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca850ea4,0,f271ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca850ea4,ca850e90,c0f970b0,6b2,ca7ce0a8,...) at _cv_wait_sig+0x260 seltdwait(ca7ce0a8,58,ca84f300,ca6cd000,f271bacc,...) at seltdwait+0xa2 kern_select(ca6cd000,c,288060b8,288060c0,0,0,20,ca6c2b30,0) at kern_select+0x655 sys_select(ca6cd000,f271bcec,c0fe0d8a,c0f979fb,206,...) at sys_select+0x66 syscall(f271bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1193 tid 100145 td 0xcadb22e0 sched_switch(cadb22e0,0,104,1a3,77e2db8f,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb22e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6c0490,0,c0f8d34f,cadb22e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6c04a4,0,f284cabc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6c04a4,ca6c0490,c0f970b0,6b2,f284cb44,...) at _cv_wait_sig+0x260 seltdwait(cab56a2c,c0f970b0,5af,cadb22e0,0,...) at seltdwait+0xa2 sys_poll(cadb22e0,f284ccec,c0fe0d8a,c0def423,202,...) at sys_poll+0x321 syscall(f284cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f3ab, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 1192 tid 100139 td 0xcadb35c0 sched_switch(cadb35c0,0,104,1a3,77e02d5d,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb35c0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca836910,0,c0f8d34f,cadb35c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca836924,0,f283aabc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca836924,ca836910,c0f970b0,6b2,f283ab44,...) at _cv_wait_sig+0x260 seltdwait(cab57b2c,c0f970b0,5af,cadb35c0,0,...) at seltdwait+0xa2 sys_poll(cadb35c0,f283acec,c0fe0d8a,c0def423,202,...) at sys_poll+0x321 syscall(f283ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f3ab, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 1191 tid 100089 td 0xc81858a0 sched_switch(c81858a0,0,104,1a3,7b9fab13,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81858a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca77a1d0,0,c0f8d34f,c81858a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca77a1e4,0,f2727abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca77a1e4,ca77a1d0,c0f970b0,6b2,f2727b44,...) at _cv_wait_sig+0x260 seltdwait(c7db212c,c0f970b0,5af,c81858a0,0,...) at seltdwait+0xa2 sys_poll(c81858a0,f2727cec,c,c,202,...) at sys_poll+0x321 syscall(f2727d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f3ab, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command cron pid 1154 tid 100141 td 0xcadb3000 sched_switch(cadb3000,0,104,1a3,f38104c5,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cadb3000,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9c980,cadb3000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c112bb84,6c,c0f90477,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c112bb84,0,16c,c0f90477,ea61,...) at _sleep+0x34f kern_nanosleep(cadb3000,f2840c50,f2840c58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cadb3000,f2840cec,c0fe0d8a,c0f97d54,206,...) at sys_nanosleep+0x6f syscall(f2840d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28190293, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 1149 tid 100147 td 0xcadb0b80 sched_switch(cadb0b80,0,104,1a3,4f3dfb60,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cadb0b80,0,c0f94960,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cadf7324,74,c0e15dae,100,0,...) at sleepq_wait_sig+0x17 _sleep(cadf7324,cadf7354,174,c0e15dae,0,...) at _sleep+0x385 kern_sigsuspend(cadb0b80,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cadb0b80,f2852cec,c0fe0d8a,c0f97796,202,...) at sys_sigsuspend+0x4d syscall(f2852d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28349ecb, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 1146 tid 100143 td 0xcadb28a0 sched_switch(cadb28a0,0,104,1a3,3fb2f9b2,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb28a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2846a20,c0a4b96a,ca6c0690,0,cadb28a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6c06a4,0,f2846a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6c06a4,ca6c0690,1389,6b2,ce312150,...) at _cv_timedwait_sig+0x270 seltdwait(f2846c10,f2846c18,cad97280,cadb28a0,c0a481ad,...) at seltdwait+0x8a kern_select(cadb28a0,5,bfbfc510,0,0,f2846c5c,20,5,0) at kern_select+0x655 sys_select(cadb28a0,f2846cec,c0fe0d8a,c0f97cb3,206,...) at sys_select+0x66 syscall(f2846d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f46d3, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 1143 tid 100095 td 0xca816b80 sched_switch(ca816b80,0,104,1a3,4aa172b9,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca816b80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6bf610,0,c0f8d34f,ca816b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6bf624,0,f2742a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6bf624,ca6bf610,c0f970b0,6b2,cac3fa48,...) at _cv_wait_sig+0x260 seltdwait(cac3fa48,58,ca835500,ca816b80,c7dcb570,...) at seltdwait+0xa2 kern_select(ca816b80,9,2880c0b8,0,0,0,20,ca80fb30,a) at kern_select+0x655 sys_select(ca816b80,f2742cec,c,c,206,...) at sys_select+0x66 syscall(f2742d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 1112 tid 100150 td 0xcadb02e0 sched_switch(cadb02e0,0,104,1a3,333e74a9,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb02e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6c0510,0,c0f8d34f,cadb02e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6c0524,0,f285ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6c0524,ca6c0510,c0f970b0,6b2,cac5c310,...) at _cv_wait_sig+0x260 seltdwait(cac5c310,58,c7dc4e80,cadb02e0,f6,...) at seltdwait+0xa2 kern_select(cadb02e0,400,bfbfea04,0,0,0,20,cad13864,1) at kern_select+0x655 sys_select(cadb02e0,f285bcec,c0fe0d8a,c0df4156,246,...) at sys_select+0x66 syscall(f285bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c56d3, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1092 tid 100149 td 0xcadb05c0 sched_switch(cadb05c0,0,104,1a3,e522a215,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb05c0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca850410,0,c0f8d34f,cadb05c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca850424,0,f2858a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca850424,ca850410,c0f970b0,6b2,ca7adcb0,...) at _cv_wait_sig+0x260 seltdwait(ca7adcb0,58,c7dc4e80,cadb05c0,0,...) at seltdwait+0xa2 kern_select(cadb05c0,1c,bfbfece8,0,0,0,20,cad13b30,0) at kern_select+0x655 sys_select(cadb05c0,f2858cec,c0fe0d8a,f2858d80,202,...) at sys_select+0x66 syscall(f2858d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283736d3, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1038 tid 100137 td 0xcadb38a0 sched_switch(cadb38a0,0,104,1a3,56de5ffa,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb38a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2831be0,c0a4b96a,c800f900,0,cadb38a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c8180850,0,f2831c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c8180850,c800f900,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2831d14,c0a2e4a8,c800f900,f2831d28,c0f89490,...) at svc_run_internal+0x356 svc_thread_start(c800f900,f2831d28,c0f89490,3dc,cab69b30,...) at svc_thread_start+0x10 fork_exit(c0c4c630,c800f900,f2831d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100136 td 0xcadb3b80 sched_switch(cadb3b80,0,104,1a3,cabd3e2e,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cadb3b80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f282ebe0,c0a4b96a,c800f900,0,cadb3b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c8180510,0,f282ec18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c8180510,c800f900,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f282ed14,c0a2e4a8,c800f900,f282ed28,c0f89490,...) at svc_run_internal+0x356 svc_thread_start(c800f900,f282ed28,c0f89490,3dc,cab69b30,...) at svc_thread_start+0x10 fork_exit(c0c4c630,c800f900,f282ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100135 td 0xc81852e0 sched_switch(c81852e0,0,104,1a3,a883859c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81852e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f282bbe0,c0a4b96a,c800f900,0,c81852e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c8180750,0,f282bc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c8180750,c800f900,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f282bd14,c0a2e4a8,c800f900,f282bd28,c0f89490,...) at svc_run_internal+0x356 svc_thread_start(c800f900,f282bd28,c0f89490,3dc,cab69b30,...) at svc_thread_start+0x10 fork_exit(c0c4c630,c800f900,f282bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100114 td 0xcab72b80 sched_switch(cab72b80,0,104,1a3,cc9113f0,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab72b80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27ae498,c0a4b96a,c800f900,0,cab72b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca76ba90,0,f27ae4d0,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca76ba90,c800f900,1388,3b1,f27ae518,...) at _cv_timedwait_sig+0x270 svc_run_internal(cab72d30,14,c0fbe1ba,c0f80d1b,f27ae810,...) at svc_run_internal+0x356 svc_run(c800f900,0,c0f80cf6,19f,0,...) at svc_run+0x7b nfsrvd_nfsd(cab72b80,f27ae810,c,0,0,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(cab72b80,f27aecec,bfbfe870,cab72b80,f27aed1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(cab72b80,f27aecec,c0fe0d8a,c0f97cb3,206,...) at sys_nfssvc+0xeb syscall(f27aed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e8b0b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1032 tid 100102 td 0xcab418a0 sched_switch(cab418a0,0,104,1a3,6d4b3be7,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab418a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca850450,0,c0f8d34f,cab418a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca850464,0,f276ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca850464,ca850450,c0f970b0,6b2,ca7ce230,...) at _cv_wait_sig+0x260 seltdwait(ca7ce230,58,c7dc4e80,cab418a0,cac3eae0,...) at seltdwait+0xa2 kern_select(cab418a0,7,bfbfecb4,0,0,0,20,cab39864,1) at kern_select+0x655 sys_select(cab418a0,f276bcec,c,c,202,...) at sys_select+0x66 syscall(f276bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281926d3, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command nfsuserd pid 1030 tid 100094 td 0xca817000 sched_switch(ca817000,0,104,1a3,346eb442,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca817000,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f273ea20,c0a4b96a,ca8510d0,0,ca817000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca8510e4,0,f273ea58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca8510e4,ca8510d0,7531,6b2,ca7ad738,...) at _cv_timedwait_sig+0x270 seltdwait(f273ec10,f273ec18,c7dc4e80,ca817000,ca7d3828,...) at seltdwait+0x8a kern_select(ca817000,4,bfbfebc4,0,0,f273ec5c,20,1e,0) at kern_select+0x655 sys_select(ca817000,f273ecec,c0fe0d8a,c0f979e4,202,...) at sys_select+0x66 syscall(f273ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1029 tid 100130 td 0xcad9e2e0 sched_switch(cad9e2e0,0,104,1a3,8e438eec,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad9e2e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2814a20,c0a4b96a,ca6bf4d0,0,cad9e2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6bf4e4,0,f2814a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6bf4e4,ca6bf4d0,7531,6b2,ca7ad738,...) at _cv_timedwait_sig+0x270 seltdwait(f2814c10,f2814c18,c7dc4e80,cad9e2e0,cab581d0,...) at seltdwait+0x8a kern_select(cad9e2e0,4,bfbfebc4,0,0,f2814c5c,20,1e,0) at kern_select+0x655 sys_select(cad9e2e0,f2814cec,c0fe0d8a,c0f979e4,202,...) at sys_select+0x66 syscall(f2814d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1028 tid 100131 td 0xcad9e000 sched_switch(cad9e000,0,104,1a3,1286a1af,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad9e000,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2817a20,c0a4b96a,ca77ae50,0,cad9e000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca77ae64,0,f2817a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca77ae64,ca77ae50,7531,6b2,ca7ad738,...) at _cv_timedwait_sig+0x270 seltdwait(f2817c10,f2817c18,c7dc4e80,cad9e000,ca8451d0,...) at seltdwait+0x8a kern_select(cad9e000,4,bfbfebc4,0,0,f2817c5c,20,1e,0) at kern_select+0x655 sys_select(cad9e000,f2817cec,c0fe0d8a,c0f979e4,202,...) at sys_select+0x66 syscall(f2817d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1027 tid 100083 td 0xca6cd8a0 sched_switch(ca6cd8a0,0,104,1a3,346e86ad,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd8a0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f270fa20,c0a4b96a,ca6c0310,0,ca6cd8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6c0324,0,f270fa58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6c0324,ca6c0310,7531,6b2,ca7ad738,...) at _cv_timedwait_sig+0x270 seltdwait(f270fc10,f270fc18,c7dc4e80,ca6cd8a0,ca845000,...) at seltdwait+0x8a kern_select(ca6cd8a0,4,bfbfebc4,0,0,f270fc5c,20,1e,0) at kern_select+0x655 sys_select(ca6cd8a0,f270fcec,c0fe0d8a,c0f979e4,202,...) at sys_select+0x66 syscall(f270fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1026 tid 100133 td 0xcad9d8a0 sched_switch(cad9d8a0,0,104,1a3,6555afeb,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cad9d8a0,0,c0f94960,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cad11058,74,c0e15dae,100,0,...) at sleepq_wait_sig+0x17 _sleep(cad11058,cad11088,174,c0e15dae,0,...) at _sleep+0x385 kern_sigsuspend(cad9d8a0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cad9d8a0,f281dcec,c,c,246,...) at sys_sigsuspend+0x4d syscall(f281dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280e6ecb, esp = 0xbfbfec5c, ebp = 0xbfbfedf8 --- Tracing command mountd pid 1010 tid 100127 td 0xca812000 sched_switch(ca812000,0,104,1a3,a9ecf415,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca812000,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6a6d90,0,c0f8d34f,ca812000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6a6da4,0,f2807a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6a6da4,ca6a6d90,c0f970b0,6b2,ca7ac770,...) at _cv_wait_sig+0x260 seltdwait(ca7ac770,58,c7dc4e80,ca812000,478,...) at seltdwait+0xa2 kern_select(ca812000,a,bfbfed04,0,0,0,20,cad122cc,bfbfed04) at kern_select+0x655 sys_select(ca812000,f2807cec,c0fe0d8a,c0f7ead7,206,...) at sys_select+0x66 syscall(f2807d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa6d3, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 976 tid 100123 td 0xca812b80 sched_switch(ca812b80,0,104,1a3,b51f62b7,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca812b80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27eea84,c0a4b96a,ca6bf990,0,ca812b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6bf9a4,0,f27eeabc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6bf9a4,ca6bf990,7531,6b2,f27eeb74,...) at _cv_timedwait_sig+0x270 seltdwait(f27eec44,f27eec4c,5af,ca812b80,0,...) at seltdwait+0x8a sys_poll(ca812b80,f27eecec,c0fe0d8a,c0f979e4,212,...) at sys_poll+0x321 syscall(f27eed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a3ab, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 961 tid 100080 td 0xca6ce2e0 sched_switch(ca6ce2e0,0,104,1a3,27acadfc,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6ce2e0,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6bfb90,0,c0f8d34f,ca6ce2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6bfba4,0,f2703a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6bfba4,ca6bfb90,c0f970b0,6b2,cac3f0e0,...) at _cv_wait_sig+0x260 seltdwait(cac3f0e0,58,c7dc4e80,ca6ce2e0,0,...) at seltdwait+0xa2 kern_select(ca6ce2e0,9,2847f0ac,0,0,0,20,c8042864,0) at kern_select+0x655 sys_select(ca6ce2e0,f2703cec,c0fe0d8a,c0f97896,246,...) at sys_select+0x66 syscall(f2703d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a96d3, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 838 tid 100082 td 0xca6cdb80 sched_switch(ca6cdb80,0,104,1a3,e244c066,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cdb80,0,c0f94960,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4b96a,ca6a6d10,0,c0f8d34f,ca6cdb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6a6d24,0,f270ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6a6d24,ca6a6d10,c0f970b0,6b2,ca8396c8,...) at _cv_wait_sig+0x260 seltdwait(ca8396c8,58,c7dc4e80,ca6cdb80,c1274af0,...) at seltdwait+0xa2 kern_select(ca6cdb80,5,bfbfe960,0,0,0,20,ca7cd864,46) at kern_select+0x655 sys_select(ca6cdb80,f270bcec,c0fe0d8a,c0def423,206,...) at sys_select+0x66 syscall(f270bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809169b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100077 td 0xca6ceb80 sched_switch(ca6ceb80,0,104,1a3,15f344bb,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,54,...) at mi_switch+0x1ff sleepq_switch(ca6ceb80,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a8080,54,c0fc521d,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a8080,c12a8040,54,c0fc521d,3e8,...) at _sleep+0x36a softdep_flush(0,ee320d28,c0f89490,3dc,ca6c1000,...) at softdep_flush+0x266 fork_exit(c0c9bad0,0,ee320d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee320d60, ebp = 0 --- Tracing command vnlru pid 18 tid 100076 td 0xc805e8a0 sched_switch(c805e8a0,0,104,1a3,f7e85b60,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,60,...) at mi_switch+0x1ff sleepq_switch(c805e8a0,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca6c12cc,60,c0f9f979,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6c12cc,c12a1d34,260,c0f9f979,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31dd28,c0f89490,3dc,ca6c12cc,...) at vnlru_proc+0xe7 fork_exit(c0afd940,0,ee31dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31dd60, ebp = 0 --- Tracing command syncer pid 17 tid 100075 td 0xc805eb80 sched_switch(c805eb80,0,104,1a3,186b9423,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805eb80,0,c0f94960,28b,c805eb80,...) at sleepq_switch+0x162 sleepq_timedwait(c12a1d74,0,ee31ac78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c12a1d74,c12a1d60,3e8,78b,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee31ad28,c0f89490,3dc,ca6c1598,...) at sched_sync+0x595 fork_exit(c0afccb0,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100074 td 0xc8183000 sched_switch(c8183000,0,104,1a3,da82ad1d,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c8183000,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a1a08,54,c0f9c8ad,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a1a08,c12a1a10,54,c0f9c8ad,3e8,...) at _sleep+0x36a buf_daemon(0,ee317d28,c0f89490,3dc,ca6c1864,...) at buf_daemon+0x175 fork_exit(c0ae1470,0,ee317d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee317d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100073 td 0xc81832e0 sched_switch(c81832e0,0,104,1a3,f6d8ed0b,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81832e0,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a9f5c,0,c0fcc2e6,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a9f5c,c12a8a00,0,c0fcc2e6,493e0,...) at _sleep+0x36a vm_pagezero(0,ee314d28,c0f89490,3dc,ca6c1b30,...) at vm_pagezero+0xdc fork_exit(c0ce2f80,0,ee314d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee314d60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100072 td 0xc81835c0 sched_switch(c81835c0,0,104,1a3,2cb2422a,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,74,...) at mi_switch+0x1ff sleepq_switch(c81835c0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a9b48,74,c0f9c8ad,0,0,...) at sleepq_wait+0x63 _sleep(c12a9b48,c12a9b4c,74,c0f9c8ad,0,...) at _sleep+0x39c vm_daemon(0,ee311d28,c0f89490,3dc,ca6c2000,...) at vm_daemon+0x59 fork_exit(c0cdc890,0,ee311d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee311d60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100071 td 0xc81838a0 sched_switch(c81838a0,0,104,1a3,f502e49b,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c81838a0,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a9b10,54,c0f9c8ad,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a9b10,c12a8a00,54,c0f9c8ad,1388,...) at _sleep+0x36a vm_pageout(0,ee30ed28,c0f89490,3dc,c7dc82cc,...) at vm_pageout+0x2c7 fork_exit(c0cdd950,0,ee30ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee30ed60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100070 td 0xc8183b80 sched_switch(c8183b80,0,104,1a3,112d7e60,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8183b80,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10f0354,5c,c0de9c27,0,0,...) at sleepq_wait+0x63 _sleep(c10f0354,c10f0398,5c,c0de9c27,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18bd28,c0f89490,3dc,c7dc8598,...) at xpt_scanner_thread+0x47 fork_exit(c049d6b0,0,ee18bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18bd60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100069 td 0xc8184000 sched_switch(c8184000,0,104,1a3,5b2e42f2,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8184000,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a3898,0,c0fb301f,0,0,...) at sleepq_wait+0x63 _sleep(c12a3898,c12a3860,0,c0fb301f,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee188d28,c0f89490,3dc,c7dc8864,...) at sctp_iterator_thread+0x5c fork_exit(c0b8f310,0,ee188d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee188d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc81845c0 sched_switch(c81845c0,0,104,1a3,feddc22a,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c81845c0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c819a000,5c,c0df4632,0,0,...) at sleepq_wait+0x63 _sleep(c819a000,c819a000,5c,c0df4632,0,...) at _sleep+0x39c ctl_work_thread(c819a000,ee182d28,c0f89490,3dc,c7dc8b30,...) at ctl_work_thread+0x22f6 fork_exit(c04c6ad0,c819a000,ee182d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee182d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc8185000 sched_switch(c8185000,0,104,1a3,fb04d5a3,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8185000,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c7ffa03c,5c,c0f81792,0,0,...) at sleepq_timedwait+0x6b _sleep(c7ffa03c,c7ffa0f0,5c,c0f81792,3e8,...) at _sleep+0x36a fdc_thread(c7ffa000,ee179d28,c0f89490,3dc,c8042000,...) at fdc_thread+0x27d fork_exit(c0d62550,c7ffa000,ee179d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee179d60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80515c0 sched_switch(c80515c0,0,104,1a3,112db744,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c80515c0,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c808f000,6c,c0f81792,100,0,...) at sleepq_wait_sig+0x17 _sleep(c808f000,c8093488,16c,c0f81792,0,...) at _sleep+0x385 fw_bus_probe_thread(c808f000,ee169d28,c0f89490,3dc,c80422cc,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f1180,c808f000,ee169d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee169d60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc805c2e0 sched_switch(c805c2e0,0,104,1a3,fed89ae6,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c2e0,0,c0f94960,268,c805c2e0,...) at sleepq_switch+0x162 sleepq_wait(c8063d34,0,ee152cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063d34,c8063e4c,c0f67e51,74,c8063d3c,...) at _cv_wait+0x260 usb_process(c8063d2c,ee152d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8063d2c,ee152d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee152d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc805c5c0 sched_switch(c805c5c0,0,104,1a3,bcccde87,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c5c0,0,c0f94960,268,c805c5c0,...) at sleepq_switch+0x162 sleepq_wait(c8063d04,0,ee14fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063d04,c8063e4c,c0f67e51,74,c8063d0c,...) at _cv_wait+0x260 usb_process(c8063cfc,ee14fd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8063cfc,ee14fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14fd60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc805c8a0 sched_switch(c805c8a0,0,104,1a3,fe7271f5,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c8a0,0,c0f94960,268,c805c8a0,...) at sleepq_switch+0x162 sleepq_wait(c8063cd4,0,ee14ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063cd4,c8063e4c,c0f67e51,74,c8063cdc,...) at _cv_wait+0x260 usb_process(c8063ccc,ee14cd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8063ccc,ee14cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14cd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc805cb80 sched_switch(c805cb80,0,104,1a3,fe725e9b,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805cb80,0,c0f94960,268,c805cb80,...) at sleepq_switch+0x162 sleepq_wait(c8063ca4,0,ee149cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063ca4,c8063e4c,c0f67e51,74,c8063cac,...) at _cv_wait+0x260 usb_process(c8063c9c,ee149d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8063c9c,ee149d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee149d60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc805e2e0 sched_switch(c805e2e0,0,104,1a3,fe724a14,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805e2e0,0,c0f94960,268,c805e2e0,...) at sleepq_switch+0x162 sleepq_wait(c8056b5c,0,ee140cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056b5c,c8056c74,c0f67e51,74,c8056b64,...) at _cv_wait+0x260 usb_process(c8056b54,ee140d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8056b54,ee140d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee140d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc805e5c0 sched_switch(c805e5c0,0,104,1a3,bccbd3e9,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805e5c0,0,c0f94960,268,c805e5c0,...) at sleepq_switch+0x162 sleepq_wait(c8056b2c,0,ee13dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056b2c,c8056c74,c0f67e51,74,c8056b34,...) at _cv_wait+0x260 usb_process(c8056b24,ee13dd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8056b24,ee13dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13dd60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc804e000 sched_switch(c804e000,0,104,1a3,fe0e467c,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e000,0,c0f94960,268,c804e000,...) at sleepq_switch+0x162 sleepq_wait(c8056afc,0,ee13acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056afc,c8056c74,c0f67e51,74,c8056b04,...) at _cv_wait+0x260 usb_process(c8056af4,ee13ad28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8056af4,ee13ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ad60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc804e2e0 sched_switch(c804e2e0,0,104,1a3,fe0e357f,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e2e0,0,c0f94960,268,c804e2e0,...) at sleepq_switch+0x162 sleepq_wait(c8056acc,0,ee137cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056acc,c8056c74,c0f67e51,74,c8056ad4,...) at _cv_wait+0x260 usb_process(c8056ac4,ee137d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8056ac4,ee137d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee137d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc804e5c0 sched_switch(c804e5c0,0,104,1a3,fe0e1fd5,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e5c0,0,c0f94960,268,c804e5c0,...) at sleepq_switch+0x162 sleepq_wait(c8052b5c,0,ee133cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052b5c,c8052c74,c0f67e51,74,c8052b64,...) at _cv_wait+0x260 usb_process(c8052b54,ee133d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8052b54,ee133d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee133d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc804e8a0 sched_switch(c804e8a0,0,104,1a3,bbb99a94,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e8a0,0,c0f94960,268,c804e8a0,...) at sleepq_switch+0x162 sleepq_wait(c8052b2c,0,ee130cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052b2c,c8052c74,c0f67e51,74,c8052b34,...) at _cv_wait+0x260 usb_process(c8052b24,ee130d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8052b24,ee130d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee130d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc804eb80 sched_switch(c804eb80,0,104,1a3,f848ca95,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804eb80,0,c0f94960,268,c804eb80,...) at sleepq_switch+0x162 sleepq_wait(c8052afc,0,ee12dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052afc,c8052c74,c0f67e51,74,c8052b04,...) at _cv_wait+0x260 usb_process(c8052af4,ee12dd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8052af4,ee12dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12dd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc804f000 sched_switch(c804f000,0,104,1a3,f848b8cc,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f000,0,c0f94960,268,c804f000,...) at sleepq_switch+0x162 sleepq_wait(c8052acc,0,ee12acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052acc,c8052c74,c0f67e51,74,c8052ad4,...) at _cv_wait+0x260 usb_process(c8052ac4,ee12ad28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8052ac4,ee12ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ad60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc804f2e0 sched_switch(c804f2e0,0,104,1a3,f848a65e,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f2e0,0,c0f94960,268,c804f2e0,...) at sleepq_switch+0x162 sleepq_wait(c804ab5c,0,ee126cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804ab5c,c804ac74,c0f67e51,74,c804ab64,...) at _cv_wait+0x260 usb_process(c804ab54,ee126d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c804ab54,ee126d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee126d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc804f5c0 sched_switch(c804f5c0,0,104,1a3,bbb9694d,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f5c0,0,c0f94960,268,c804f5c0,...) at sleepq_switch+0x162 sleepq_wait(c804ab2c,0,ee123cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804ab2c,c804ac74,c0f67e51,74,c804ab34,...) at _cv_wait+0x260 usb_process(c804ab24,ee123d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c804ab24,ee123d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee123d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc804f8a0 sched_switch(c804f8a0,0,104,1a3,f7e50373,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f8a0,0,c0f94960,268,c804f8a0,...) at sleepq_switch+0x162 sleepq_wait(c804aafc,0,ee120cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804aafc,c804ac74,c0f67e51,74,c804ab04,...) at _cv_wait+0x260 usb_process(c804aaf4,ee120d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c804aaf4,ee120d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee120d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc804fb80 sched_switch(c804fb80,0,104,1a3,f7e4f160,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804fb80,0,c0f94960,268,c804fb80,...) at sleepq_switch+0x162 sleepq_wait(c804aacc,0,ee11dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804aacc,c804ac74,c0f67e51,74,c804aad4,...) at _cv_wait+0x260 usb_process(c804aac4,ee11dd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c804aac4,ee11dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11dd60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc803e000 sched_switch(c803e000,0,104,1a3,f7e4dce1,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e000,0,c0f94960,268,c803e000,...) at sleepq_switch+0x162 sleepq_wait(c8044b5c,0,ee116cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044b5c,c8044c74,c0f67e51,74,c8044b64,...) at _cv_wait+0x260 usb_process(c8044b54,ee116d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8044b54,ee116d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee116d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc803e2e0 sched_switch(c803e2e0,0,104,1a3,b9e6e099,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e2e0,0,c0f94960,268,c803e2e0,...) at sleepq_switch+0x162 sleepq_wait(c8044b2c,0,ee113cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044b2c,c8044c74,c0f67e51,74,c8044b34,...) at _cv_wait+0x260 usb_process(c8044b24,ee113d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8044b24,ee113d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee113d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc803e5c0 sched_switch(c803e5c0,0,104,1a3,f781054f,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e5c0,0,c0f94960,268,c803e5c0,...) at sleepq_switch+0x162 sleepq_wait(c8044afc,0,ee110cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044afc,c8044c74,c0f67e51,74,c8044b04,...) at _cv_wait+0x260 usb_process(c8044af4,ee110d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8044af4,ee110d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee110d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc803e8a0 sched_switch(c803e8a0,0,104,1a3,f780f351,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e8a0,0,c0f94960,268,c803e8a0,...) at sleepq_switch+0x162 sleepq_wait(c8044acc,0,ee10dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044acc,c8044c74,c0f67e51,74,c8044ad4,...) at _cv_wait+0x260 usb_process(c8044ac4,ee10dd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8044ac4,ee10dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10dd60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8040000 sched_switch(c8040000,0,104,1a3,f780dc29,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8040000,0,c0f94960,268,c8040000,...) at sleepq_switch+0x162 sleepq_wait(c8038b5c,0,ee106cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038b5c,c8038c74,c0f67e51,74,c8038b64,...) at _cv_wait+0x260 usb_process(c8038b54,ee106d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8038b54,ee106d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee106d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc80402e0 sched_switch(c80402e0,0,104,1a3,b9e6b1e4,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80402e0,0,c0f94960,268,c80402e0,...) at sleepq_switch+0x162 sleepq_wait(c8038b2c,0,ee103cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038b2c,c8038c74,c0f67e51,74,c8038b34,...) at _cv_wait+0x260 usb_process(c8038b24,ee103d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8038b24,ee103d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee103d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc80405c0 sched_switch(c80405c0,0,104,1a3,f71c9f6a,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80405c0,0,c0f94960,268,c80405c0,...) at sleepq_switch+0x162 sleepq_wait(c8038afc,0,ee100cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038afc,c8038c74,c0f67e51,74,c8038b04,...) at _cv_wait+0x260 usb_process(c8038af4,ee100d28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8038af4,ee100d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee100d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc80408a0 sched_switch(c80408a0,0,104,1a3,f71c8c79,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80408a0,0,c0f94960,268,c80408a0,...) at sleepq_switch+0x162 sleepq_wait(c8038acc,0,ee0fdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038acc,c8038c74,c0f67e51,74,c8038ad4,...) at _cv_wait+0x260 usb_process(c8038ac4,ee0fdd28,c0f89490,3dc,c8042598,...) at usb_process+0x1a3 fork_exit(c08fe340,c8038ac4,ee0fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fdd60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7eda5c0 sched_switch(c7eda5c0,0,104,1a3,371a43c3,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda5c0,0,c0f94960,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c112a984,0,c0f81792,2,0,...) at sleepq_timedwait+0x6b _sleep(c112a984,0,0,c0f81792,64) at _sleep+0x36a pause(c0f81792,64,c0f43c10,111,0,...) at pause+0xa0 random_kthread(0,c7b51d28,c0f89490,3dc,c7dc7000,...) at random_kthread+0x1ef fork_exit(c08065e0,0,c7b51d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b51d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7edab80 sched_switch(c7edab80,0,104,1a3,186ce2e7,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7edab80,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1128568,5c,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c1128568,c11284c8,25c,c0f81792,0,...) at _sleep+0x39c g_io_schedule_down(c7edab80,0,c0f832e1,6c,c7b4bd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c7b4bd28,c0f89490,3dc,c7dc72cc,...) at g_down_procbody+0x9d fork_exit(c09ef230,0,c7b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4bd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7edb000 sched_switch(c7edb000,0,104,1a3,18764e5f,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7edb000,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1128564,5c,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c1128564,c11284e8,25c,c0f81792,0,...) at _sleep+0x39c g_io_schedule_up(c7edb000,0,c0f832e1,5f,c7b48d14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c7b48d28,c0f89490,3dc,c7dc72cc,...) at g_up_procbody+0x9d fork_exit(c09ef2d0,0,c7b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b48d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7dca2e0 sched_switch(c7dca2e0,0,104,1a3,f379ef9b,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7dca2e0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c112855c,5c,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c112855c,c112848c,25c,c0f81792,0,...) at _sleep+0x39c g_run_events(c1138800,0,c0f832e1,79,c7b45d14,...) at g_run_events+0x54b g_event_procbody(0,c7b45d28,c0f89490,3dc,c7dc72cc,...) at g_event_procbody+0x90 fork_exit(c09ef370,0,c7b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b45d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc81848a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc8184b80 sched_switch(c8184b80,0,109,1a3,f7183027,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c8184b80,...) at mi_switch+0x1ff ithread_loop(c7e12680,ee17cd28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12680,ee17cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17cd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc80512e0 sched_switch(c80512e0,0,109,1a3,2764231b,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c80512e0,...) at mi_switch+0x1ff ithread_loop(c7e12690,ee16cd28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12690,ee16cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16cd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8051b80 sched_switch(c8051b80,0,109,1a3,e719760a,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c8051b80,...) at mi_switch+0x1ff ithread_loop(c7e126a0,ee160d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e126a0,ee160d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee160d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc805c000 sched_switch(c805c000,0,109,1a3,987bd8e2,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c805c000,...) at mi_switch+0x1ff ithread_loop(c7e126b0,ee158d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e126b0,ee158d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee158d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc805e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8051000 sched_switch(c8051000,0,109,1a3,1c1e4d47,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c8051000,...) at mi_switch+0x1ff ithread_loop(c7e126d0,ee11ad28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e126d0,ee11ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ad60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc803eb80 sched_switch(c803eb80,0,109,1a3,16a5422b,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c803eb80,...) at mi_switch+0x1ff ithread_loop(c7e126e0,ee10ad28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e126e0,ee10ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ad60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8040b80 sched_switch(c8040b80,0,109,1a3,14a006c8,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c8040b80,...) at mi_switch+0x1ff ithread_loop(c7e126f0,ee0fad28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e126f0,ee0fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fad60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7edb2e0 sched_switch(c7edb2e0,0,109,1a3,1873ec30,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7edb2e0,...) at mi_switch+0x1ff ithread_loop(c7e12700,edfa4d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12700,edfa4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa4d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7edb5c0 sched_switch(c7edb5c0,0,109,1a3,315a0550,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7edb5c0,...) at mi_switch+0x1ff ithread_loop(c7e12710,edfa0d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12710,edfa0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa0d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7edb8a0 sched_switch(c7edb8a0,0,109,1a3,e8f0a412,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7edb8a0,...) at mi_switch+0x1ff ithread_loop(c7e12720,c7ba0d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12720,c7ba0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba0d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7edbb80 sched_switch(c7edbb80,0,109,1a3,31c62a14,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7edbb80,...) at mi_switch+0x1ff ithread_loop(c7e12730,c7b6fd28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12730,c7b6fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6fd60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc7fc6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc7fc65c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xc7e13b80 sched_switch(c7e13b80,0,109,1a3,1874d997,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7e13b80,...) at mi_switch+0x1ff ithread_loop(c7e12760,c7b5ad28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e12760,c7b5ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ad60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7dca5c0 sched_switch(c7dca5c0,0,109,1a3,346e0df2,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7dca5c0,...) at mi_switch+0x1ff ithread_loop(c7e127a0,c7b42d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e127a0,c7b42d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b42d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc7dca8a0 sched_switch(c7dca8a0,0,109,1a3,346dae15,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7dca8a0,...) at mi_switch+0x1ff ithread_loop(c7e127b0,c7b3fd28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e127b0,c7b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3fd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dcab80 sched_switch(c7dcab80,0,109,1a3,3719ff00,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7dcab80,...) at mi_switch+0x1ff ithread_loop(c7e127c0,c7b3cd28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e127c0,c7b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e13000 sched_switch(c7e13000,0,109,1a3,3690dfe3,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7e13000,...) at mi_switch+0x1ff ithread_loop(c7e127d0,c7b39d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e127d0,c7b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e132e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc7e135c0 sched_switch(c7e135c0,0,109,1a3,e584c3e2,...) at sched_switch+0x3ec mi_switch(109,0,c0f897b3,554,c7e135c0,...) at mi_switch+0x1ff ithread_loop(c7e127f0,c7b33d28,c0f89490,3dc,c7dc7598,...) at ithread_loop+0x1fb fork_exit(c0a31fd0,c7e127f0,c7b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b33d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dc9000 cpustop_handler(3,13,c7b2fc04,c0dc1ca6,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,0,c12d7064,c7dc7864,...) at ipi_nmi_handler+0x47 trap(c7b2fc10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0da6535, esp = 0xc7b2fc50, ebp = 0xc7b2fc50 --- acpi_cpu_c1(c7b2fc6c,c10f0930,3,301,6600,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b2fca0,c0db47c9,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1139b80,2,c7b2fce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b2fcc4,c0f90fe2,a0b,c7dc9000,...) at cpu_idle+0x89 sched_idletd(0,c7b2fd28,c0f89490,3dc,c7dc7864,...) at sched_idletd+0x263 fork_exit(c0a82df0,0,c7b2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2fd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dc92e0 cpustop_handler(2,13,c7b2cc04,c0dc1ca6,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,1d5ea1c,c0da6535,c7dc7864,...) at ipi_nmi_handler+0x47 trap(c7b2cc10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0da6535, esp = 0xc7b2cc50, ebp = 0xc7b2cc50 --- acpi_cpu_c1(c7b2cc6c,c10f0930,2,301,6600,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b2cca0,c0db47c9,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1139500,2,c7b2cce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b2ccc4,c0f90fe2,a0b,c7dc92e0,...) at cpu_idle+0x89 sched_idletd(0,c7b2cd28,c0f89490,3dc,c7dc7864,...) at sched_idletd+0x263 fork_exit(c0a82df0,0,c7b2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2cd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dc95c0 cpustop_handler(1,13,c7b29c04,c0dc1ca6,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,1982602,c0da6535,c7dc7864,...) at ipi_nmi_handler+0x47 trap(c7b29c10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0da6535, esp = 0xc7b29c50, ebp = 0xc7b29c50 --- acpi_cpu_c1(c7b29c6c,c10f0930,1,301,6600,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b29ca0,c0db47c9,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1138e80,2,c7b29ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b29cc4,c0f90fe2,a0b,c7dc95c0,...) at cpu_idle+0x89 sched_idletd(0,c7b29d28,c0f89490,3dc,c7dc7864,...) at sched_idletd+0x263 fork_exit(c0a82df0,0,c7b29d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b29d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dc98a0 kdb_enter(c0e03b1e,c0f92f3e,c7b26ba4,c08c9abb,c817f000,...) at kdb_enter+0x3a kdb_break(c817f000,0,c12d66e0,c817f080,c817f058,...) at kdb_break+0x28 uart_intr(c817f000,0,c12d66e0,c7b26be8,0,...) at uart_intr+0x11b intr_event_handle(c7e0ed80,c7b26c10,c7b26c34,0,c7ffae00,...) at intr_event_handle+0x76 intr_execute_handlers(c7e0d0d0,c7b26c10,0,c7b26c50,c0daaf35,...) at intr_execute_handlers+0x49 lapic_handle_intr(3c,c7b26c10) at lapic_handle_intr+0x36 Xapic_isr1() at Xapic_isr1+0x35 --- interrupt, eip = 0xc0da6535, esp = 0xc7b26c50, ebp = 0xc7b26c50 --- acpi_cpu_c1(c7b26c6c,c10f0930,0,301,6600,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b26ca0,c0db47c9,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1138800,2,c7b26ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b26cc4,c0f90fe2,3c0,c7dc98a0,...) at cpu_idle+0x89 sched_idletd(0,c7b26d28,c0f89490,3dc,c7dc7864,...) at sched_idletd+0x263 fork_exit(c0a82df0,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dc9b80 sched_switch(c7dc9b80,0,104,1a3,efffdf10,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c7dc9b80,0,c0f94960,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f94960,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7dc7b30,6c,c0f978a7,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7dc7b30,c7dc7bb8,16c,c0f978a7,0,...) at _sleep+0x385 kern_wait(c7dc9b80,ffffffff,c7b22c60,0,0,...) at kern_wait+0x597 sys_wait4(c7dc9b80,c7b22cec,c0fe0d8a,c0f976de,286,...) at sys_wait4+0x3b syscall(c7b22d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806020f, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc7dca000 sched_switch(c7dca000,0,104,1a3,f71abf88,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dca000,0,c0f94960,268,c7dca000,...) at sleepq_switch+0x162 sleepq_wait(c12a77c0,0,c7b1fc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c12a77c0,c12a77a4,c0fbfc37,194,0,...) at _cv_wait+0x260 audit_worker(0,c7b1fd28,c0f89490,3dc,c7dc8000,...) at audit_worker+0x84 fork_exit(c0c5c980,0,c7b1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xca6ce8a0 sched_switch(ca6ce8a0,0,104,1a3,86f58b9,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6ce8a0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c8035380,0,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c8035380,c8035398,0,c0f81792,0,...) at _sleep+0x39c taskqueue_thread_loop(c1309060,ee323d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0080,c1309060,ee323d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee323d60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc81842e0 sched_switch(c81842e0,0,104,1a3,14756e47,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81842e0,0,c0f94960,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c112a984,0,c0f81792,2,0,...) at sleepq_timedwait+0x6b _sleep(c112a984,0,0,c0f81792,bb8) at _sleep+0x36a pause(c0f81792,bb8,124,122,c11286c8,...) at pause+0xa0 deadlkres(0,ee185d28,c0f89490,3dc,c1128640,...) at deadlkres+0x324 fork_exit(c0a11540,0,ee185d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee185d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80518a0 sched_switch(c80518a0,0,104,1a3,318669cc,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80518a0,0,c0f94960,268,c80518a0,...) at sleepq_switch+0x162 sleepq_wait(c80356c0,0,c0f8fc81,c0f81792,0,...) at sleepq_wait+0x63 msleep_spin(c80356c0,c80356d8,c0f81792,0,c0f8d34f,...) at msleep_spin+0x259 taskqueue_thread_loop(c809349c,ee166d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0080,c809349c,ee166d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee166d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fc62e0 sched_switch(c7fc62e0,0,104,1a3,fa836f55,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc62e0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f9de80,0,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c7f9de80,c7f9de98,0,c0f81792,0,...) at _sleep+0x39c taskqueue_thread_loop(c114756c,c7b69d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0080,c114756c,c7b69d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b69d60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc7fc68a0 sched_switch(c7fc68a0,0,104,1a3,11318862,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc68a0,0,c0f94960,268,c7fc68a0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e040,0,c0f8fc81,c0f81792,0,...) at sleepq_wait+0x63 msleep_spin(c7f9e040,c7f9e058,c0f81792,0,c0f8d34f,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f35b8,c7b63d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0080,c10f35b8,c7b63d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b63d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fc6b80 sched_switch(c7fc6b80,0,104,1a3,113179ce,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc6b80,0,c0f94960,268,c7fc6b80,...) at sleepq_switch+0x162 sleepq_wait(c7f9e040,0,c0f8fc81,c0f81792,0,...) at sleepq_wait+0x63 msleep_spin(c7f9e040,c7f9e058,c0f81792,0,c0f8d34f,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f35b8,c7b60d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0080,c10f35b8,c7b60d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b60d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e138a0 sched_switch(c7e138a0,0,104,1a3,11316749,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e138a0,0,c0f94960,268,c7e138a0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e040,0,c0f8fc81,c0f81792,0,...) at sleepq_wait+0x63 msleep_spin(c7f9e040,c7f9e058,c0f81792,0,c0f8d34f,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f35b8,c7b5dd28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0080,c10f35b8,c7b5dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7eda000 sched_switch(c7eda000,0,104,1a3,112deddb,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda000,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e080,0,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c7f9e080,c7f9e098,0,c0f81792,0,...) at _sleep+0x39c taskqueue_thread_loop(c12a7da4,c7b57d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0080,c12a7da4,c7b57d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b57d60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7eda2e0 sched_switch(c7eda2e0,0,104,1a3,112dde95,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda2e0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e0c0,0,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c7f9e0c0,c7f9e0d8,0,c0f81792,0,...) at _sleep+0x39c taskqueue_thread_loop(c1128fb8,c7b54d28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0080,c1128fb8,c7b54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b54d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc7eda8a0 sched_switch(c7eda8a0,0,104,1a3,d5832a92,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda8a0,0,c0f94960,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7dade80,0,c0f81792,0,0,...) at sleepq_wait+0x63 _sleep(c7dade80,c7dade98,0,c0f81792,0,...) at _sleep+0x39c taskqueue_thread_loop(c1145f80,c7b4ed28,c0f89490,3dc,c1128640,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0080,c1145f80,c7b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1128910 sched_switch(c1128910,0,104,1a3,63502af5,...) at sched_switch+0x3ec mi_switch(104,0,c0f94960,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c1128910,0,c0f94960,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1128640,54,c0f918f4,0,0,...) at sleepq_timedwait+0x6b _sleep(c1128640,0,54,c0f918f4,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 303 MB: 288 272 256 240 224 208 192 176 160 144 128 112 96 80 64 48 32 16 Dump complete = 0 db:0:doadump> reset (kgdb) proc 63321 [Switching to thread 187 (Thread 100322)]#0 sched_switch (td=0xd1997000, newtd=0xd17d95c0, flags=0x104) at ../../../kern/sched_ule.c:1860 1860 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xd1997000, newtd=0xd17d95c0, flags=0x104) at ../../../kern/sched_ule.c:1860 #1 0xc0a6561f in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:468 #2 0xc0a9cee2 in sleepq_switch (wchan=0xd3433c94, pri=0x60) at ../../../kern/subr_sleepqueue.c:538 #3 0xc0a9dc13 in sleepq_wait (wchan=0xd3433c94, pri=0x60) at ../../../kern/subr_sleepqueue.c:617 #4 0xc0a4329d in __lockmgr_args (lk=0xd3433c94, flags=0x200100, ilk=0xd3433d00, wmesg=0x0, pri=0x0, timo=0x0, file=0xc0f9ea08 "../../../kern/vfs_subr.c", line=0x877) at ../../../kern/kern_lock.c:219 #5 0xc0ca6571 in ffs_lock (ap=0xf2b0e878) at lockmgr.h:97 #6 0xc0de4c05 in VOP_LOCK1_APV (vop=0xc10ddda0, a=0xf2b0e878) at vnode_if.c:1988 #7 0xc0b09eb8 in _vn_lock (vp=0xd3433c3c, flags=0x200100, file=0xc0f9ea08 "../../../kern/vfs_subr.c", line=0x877) at vnode_if.h:859 #8 0xc0afc96b in vget (vp=0xd3433c3c, flags=0x200100, td=0xd1997000) at ../../../kern/vfs_subr.c:2167 #9 0xc0ae5605 in cache_lookup (dvp=0xcd841d98, vpp=0xf2b0e990, cnp=0xf2b0eb14, tsp=0x0, ticksp=0x0) at ../../../kern/vfs_cache.c:657 #10 0xc0ae57ed in vfs_cache_lookup (ap=0xf2b0e980) at ../../../kern/vfs_cache.c:997 #11 0xc0de5d85 in VOP_LOOKUP_APV (vop=0xc10de320, a=0xf2b0e980) at vnode_if.c:123 #12 0xcb2c0e44 in null_lookup (ap=0xf2b0ea20) at vnode_if.h:54 #13 0xc0de5d85 in VOP_LOOKUP_APV (vop=0xcb2c27c0, a=0xf2b0ea20) at vnode_if.c:123 #14 0xc0aed7cb in lookup (ndp=0xf2b0ead4) at vnode_if.h:54 #15 0xc0aee7ef in namei (ndp=0xf2b0ead4) at ../../../kern/vfs_lookup.c:307 #16 0xc0b0045f in kern_statat_vnhook (td=0xd1997000, flag=0x200, fd=0xffffff9c, path=0x28471ef8
, pathseg=UIO_USERSPACE, sbp=0xf2b0ec04, hook=0) at ../../../kern/vfs_syscalls.c:2433 #17 0xc0b005bc in kern_statat (td=0xd1997000, flag=0x200, fd=0xffffff9c, path=0x28471ef8
, pathseg=UIO_USERSPACE, sbp=0xf2b0ec04) at ../../../kern/vfs_syscalls.c:2414 #18 0xc0b005f6 in kern_lstat (td=0xd1997000, path=0x28471ef8
, pathseg=UIO_USERSPACE, sbp=0xf2b0ec04) at ../../../kern/vfs_syscalls.c:2487 #19 0xc0b0069f in sys_lstat (td=0xd1997000, uap=0xf2b0ecec) at ../../../kern/vfs_syscalls.c:2477 #20 0xc0dc18a7 in syscall (frame=0xf2b0ed28) at subr_syscall.c:135 #21 0xc0daabd1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:266 #22 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 8 #8 0xc0afc96b in vget (vp=0xd3433c3c, flags=0x200100, td=0xd1997000) at ../../../kern/vfs_subr.c:2167 2167 if ((error = vn_lock(vp, flags | LK_INTERLOCK)) != 0) { (kgdb) p *vp $1 = {v_type = VDIR, v_tag = 0xc0f85397 "ufs", v_op = 0xc10ddda0, v_data = 0xcda28b54, v_mount = 0xca77b5a8, v_nmntvnodes = {tqe_next = 0xcfbc6ae0, tqe_prev = 0xcd841dac}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xca47009c}, v_hash = 0x186a445, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xcfaf49d8, tqh_last = 0xd00dd838}, v_cache_dd = 0xd00dd828, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc0f85397 "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc7d795a8}, lk_lock = 0xcec122e6, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xd, pcs = {0xc0a43374, 0xc0ca6571, 0xc0de4c05, 0xcb2c0faf, 0xc0de4c05, 0xc0b09eb8, 0xc0aed1e6, 0xc0aee7ef, 0xc0aff810, 0xc0affa17, 0xc0affa42, 0xc0dc18a7, 0xc0daabd1, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = { lock_object = {lo_name = 0xc0f96c18 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d721e0}, mtx_lock = 0x4}, v_vnlock = 0xd3433c94, v_holdcnt = 0xf, v_usecount = 0x2, v_iflag = 0x0, v_vflag = 0x0, v_writecount = 0x0, v_freelist = {tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_mtx = { lock_object = {lo_name = 0xc0f9f94e "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d77ba8}, mtx_lock = 0x4}, bo_clean = {bv_hd = { tqh_first = 0x0, tqh_last = 0xd3433d48}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xe19d1f40, tqh_last = 0xe19d1f78}, bv_root = 0xe19d1f40, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_ops = 0xc10cafc0, bo_bsize = 0x4000, bo_object = 0xcea06128, bo_synclist = { le_next = 0xcfbc6bd8, le_prev = 0xcd841ed8}, bo_private = 0xd3433c3c, __bo_vnode = 0xd3433c3c}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) p *((struct inode *)vp->v_data) $2 = {i_nextsnap = {tqe_next = 0x0, tqe_prev = 0x0}, i_vnode = 0xd3433c3c, i_ump = 0xca793e00, i_flag = 0x0, i_dev = 0xca769000, i_number = 0x186a445, i_effnlink = 0x3, i_fs = 0xca796800, i_dquot = {0x0, 0x0}, i_count = 0xc, i_endoff = 0x200, i_diroff = 0x0, i_offset = 0x18, i_un = {dirhash = 0x0, snapblklist = 0x0}, i_ea_area = 0x0, i_ea_len = 0x0, i_ea_error = 0x0, i_ea_refs = 0x0, i_mode = 0x41f8, i_nlink = 0x3, i_size = 0x200, i_flags = 0x0, i_gen = 0x2c188b35, i_uid = 0x0, i_gid = 0x0, dinode_u = {din1 = 0xd1bea500, din2 = 0xd1bea500}} (kgdb) f 17 #17 0xc0b005bc in kern_statat (td=0xd1997000, flag=0x200, fd=0xffffff9c, path=0x28471ef8
, pathseg=UIO_USERSPACE, sbp=0xf2b0ec04) at ../../../kern/vfs_syscalls.c:2414 2414 return (kern_statat_vnhook(td, flag, fd, path, pathseg, sbp, NULL)); (kgdb) p *td->td_proc $3 = {p_list = {le_next = 0xcf7bc000, le_prev = 0xcad12000}, p_threads = {tqh_first = 0xd1997000, tqh_last = 0xd1997008}, p_slock = {lock_object = { lo_name = 0xc0f8d636 "process slock", lo_flags = 0xb0000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, p_ucred = 0xca77d880, p_fd = 0xce8c1000, p_fdtol = 0x0, p_stats = 0xd1991600, p_limit = 0xcb103800, p_limco = {c_links = {sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0xcf7bc038}}, c_time = 0x18e6e48, c_arg = 0xd1992598, c_func = 0xc0a57650 , c_lock = 0xd1992620, c_flags = 0x6, c_cpu = 0x0}, p_sigacts = 0xcc997000, p_flag = 0x10000002, p_state = PRS_NORMAL, p_pid = 0xf759, p_hash = {le_next = 0x0, le_prev = 0xc7da4d64}, p_pglist = {le_next = 0xca8112cc, le_prev = 0xd19e1ba0}, p_pptr = 0xd19e1b30, p_sibling = {le_next = 0xca8112cc, le_prev = 0xd19e1bb4}, p_children = {lh_first = 0x0}, p_mtx = {lock_object = { lo_name = 0xc0f8d629 "process lock", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xc7d71340}, mtx_lock = 0x4}, p_ksi = 0xca5ccaf0, p_sigqueue = { sq_signals = {__bits = {0x1, 0x0, 0x0, 0x0}}, sq_kill = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = {tqh_first = 0xcb553b90, tqh_last = 0xcb553b90}, sq_proc = 0xd1992598, sq_flags = 0x1}, p_oppid = 0x0, p_vmspace = 0xce290d98, p_swtick = 0x1307b2e, p_realtimer = {it_interval = {tv_sec = 0x0, tv_usec = 0x0}, it_value = {tv_sec = 0x0, tv_usec = 0x0}}, p_ru = {ru_utime = {tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0x0, ru_ixrss = 0x0, ru_idrss = 0x0, ru_isrss = 0x0, ru_minflt = 0x0, ru_majflt = 0x0, ru_nswap = 0x0, ru_inblock = 0x0, ru_oublock = 0x0, ru_msgsnd = 0x0, ru_msgrcv = 0x0, ru_nsignals = 0x0, ru_nvcsw = 0x0, ru_nivcsw = 0x0}, p_rux = {rux_runtime = 0x2b21f0c9a, rux_uticks = 0x21, rux_sticks = 0x2eb, rux_iticks = 0x0, rux_uu = 0x42943, rux_su = 0x5dff40, rux_tu = 0x622649}, p_crux = {rux_runtime = 0x0, rux_uticks = 0x0, rux_sticks = 0x0, rux_iticks = 0x0, rux_uu = 0x0, rux_su = 0x0, rux_tu = 0x0}, p_profthreads = 0x0, p_exitthreads = 0x0, p_traceflag = 0x0, p_tracevp = 0x0, p_tracecred = 0x0, p_textvp = 0xd38c26cc, p_lock = 0x0, p_sigiolst = {slh_first = 0x0}, p_sigparent = 0x14, p_sig = 0x0, p_code = 0x0, p_stops = 0x0, p_stype = 0x0, p_step = 0x0, p_pfsflags = 0x0, p_nlminfo = 0x0, p_aioinfo = 0x0, p_singlethread = 0x0, p_suspcount = 0x0, p_xthread = 0x0, p_boundary_count = 0x0, p_pendingcnt = 0x1, p_itimers = 0x0, p_procdesc = 0x0, p_magic = 0xbeefface, p_osrel = 0xf4243, p_comm = "fts", '\0' , p_pgrp = 0xca852380, p_sysent = 0xc10e9360, p_args = 0xc7e124c0, p_cpulimit = 0xc8, p_nice = 0x0, p_fibnum = 0x0, p_xstat = 0x0, p_klist = {kl_list = { slh_first = 0x0}, kl_lock = 0xc0a25340 , kl_unlock = 0xc0a25370 , kl_assert_locked = 0xc0a256c0 , kl_assert_unlocked = 0xc0a25690 , kl_lockarg = 0xd1992620}, p_numthreads = 0x1, p_md = {md_ldt = 0x0}, p_itcallout = {c_links = {sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0x0, c_arg = 0x0, c_func = 0, c_lock = 0x0, c_flags = 0x10, c_cpu = 0x0}, p_acflag = 0x1, p_peers = 0x0, p_leader = 0xd1992598, p_emuldata = 0x0, p_label = 0x0, p_sched = 0xd1992864, p_ktr = {stqh_first = 0x0, stqh_last = 0xd199282c}, p_mqnotifier = {lh_first = 0x0}, p_dtrace = 0x0, p_pwait = { cv_description = 0xc0f8df13 "ppwait", cv_waiters = 0x0}, p_dbgwait = {cv_description = 0xc0f8df1a "dbgwait", cv_waiters = 0x0}, p_prev_runtime = 0x0, p_racct = 0x0, p_orphan = {le_next = 0x0, le_prev = 0x0}, p_orphans = {lh_first = 0x0}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/nullfs/null_vnops.c =================================================================== --- /usr/src/sys/fs/nullfs/null_vnops.c (revision 232125) +++ /usr/src/sys/fs/nullfs/null_vnops.c (working copy) @@ -697,12 +697,18 @@ null_inactive(struct vop_inactive_args *ap) static int null_reclaim(struct vop_reclaim_args *ap) { - struct vnode *vp = ap->a_vp; - struct null_node *xp = VTONULL(vp); - struct vnode *lowervp = xp->null_lowervp; + struct vnode *vp; + struct null_node *xp; + struct vnode *lowervp; - if (lowervp) - null_hashrem(xp); + vp = ap->a_vp; + xp = VTONULL(vp); + lowervp = xp->null_lowervp; + + KASSERT(lowervp != NULL && vp->v_vnlock != &vp->v_lock, + ("Reclaiming inclomplete null vnode %p", vp)); + + null_hashrem(xp); /* * Use the interlock to protect the clearing of v_data to * prevent faults in null_lock(). @@ -713,10 +719,7 @@ null_reclaim(struct vop_reclaim_args *ap) vp->v_object = NULL; vp->v_vnlock = &vp->v_lock; VI_UNLOCK(vp); - if (lowervp) - vput(lowervp); - else - panic("null_reclaim: reclaiming a node with no lowervp"); + vput(lowervp); free(xp, M_NULLFSNODE); return (0); Index: /usr/src/sys/fs/nullfs/null_subr.c =================================================================== --- /usr/src/sys/fs/nullfs/null_subr.c (revision 232125) +++ /usr/src/sys/fs/nullfs/null_subr.c (working copy) @@ -169,19 +169,28 @@ null_hashins(mp, xp) } static void -null_insmntque_dtr(struct vnode *vp, void *xp) +null_destroy_proto(struct vnode *vp, void *xp) { - vput(((struct null_node *)xp)->null_lowervp); + VI_LOCK(vp); vp->v_data = NULL; vp->v_vnlock = &vp->v_lock; - free(xp, M_NULLFSNODE); vp->v_op = &dead_vnodeops; + VI_UNLOCK(vp); (void) vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); vgone(vp); vput(vp); + free(xp, M_NULLFSNODE); } +static void +null_insmntque_dtr(struct vnode *vp, void *xp) +{ + + vput(((struct null_node *)xp)->null_lowervp); + null_destroy_proto(vp, xp); +} + /* * Make a new or get existing nullfs node. * Vp is the alias vnode, lowervp is the lower vnode. @@ -211,14 +220,34 @@ null_nodeget(mp, lowervp, vpp) } /* + * The insmntque1() call below requires the exclusive lock on + * the nullfs vnode, and since vnode lock for upper and lower + * vnodes are the same, upgrade the lower vnode lock. + */ + if (VOP_ISLOCKED(lowervp) != LK_EXCLUSIVE) { + vn_lock(lowervp, LK_UPGRADE | LK_RETRY); + if ((lowervp->v_iflag & VI_DOOMED) != 0) { + vput(lowervp); + return (EBADF); + } + + /* + * And recheck the hash, since lower vnode might have + * been unlocked duuring the upgrade. + */ + *vpp = null_hashget(mp, lowervp); + if (*vpp != NULL) { + vrele(lowervp); + return (0); + } + } + + /* * We do not serialize vnode creation, instead we will check for * duplicates later, when adding new vnode to hash. - * * Note that duplicate can only appear in hash if the lowervp is * locked LK_SHARED. - */ - - /* + * * Do the MALLOC before the getnewvnode since doing so afterward * might cause a bogus v_data pointer to get dereferenced * elsewhere if MALLOC should block. @@ -250,9 +279,7 @@ null_nodeget(mp, lowervp, vpp) *vpp = null_hashins(mp, xp); if (*vpp != NULL) { vrele(lowervp); - vp->v_vnlock = &vp->v_lock; - xp->null_lowervp = NULL; - vrele(vp); + null_destroy_proto(vp, xp); return (0); } *vpp = vp; Index: /usr/src/sys/fs/nullfs/null_vfsops.c =================================================================== --- /usr/src/sys/fs/nullfs/null_vfsops.c (revision 232125) +++ /usr/src/sys/fs/nullfs/null_vfsops.c (working copy) @@ -185,7 +185,9 @@ nullfs_mount(struct mount *mp) MNT_IUNLOCK(mp); } MNT_ILOCK(mp); - mp->mnt_kern_flag |= lowerrootvp->v_mount->mnt_kern_flag & MNTK_MPSAFE; + mp->mnt_kern_flag |= lowerrootvp->v_mount->mnt_kern_flag & + (MNTK_MPSAFE | MNTK_EXTENDED_SHARED | MNTK_SHARED_WRITES | + MNTK_LOOKUP_SHARED); MNT_IUNLOCK(mp); mp->mnt_data = xmp; vfs_getnewfsid(mp); @@ -312,6 +314,12 @@ nullfs_vget(mp, ino, flags, vpp) struct vnode **vpp; { int error; + + KASSERT((flags & LK_TYPE_MASK) != 0, + ("nullfs_vget: no lock requested")); + flags &= ~LK_TYPE_MASK; + flags |= LK_EXCLUSIVE; + error = VFS_VGET(MOUNTTONULLMOUNT(mp)->nullm_vfs, ino, flags, vpp); if (error) return (error); -- Test scenario nullfs5.sh 20120225 13:06:14 all: nullfs5.sh run: run time 0+00:10:00, incarnations 1, load 100, verbose 1 13:06:16 Loop #1 rw: run time 0+00:02:00, incarnations 4, load 80, verbose 1 lockf: run time 0+00:02:00, incarnations 20, load 80, verbose 1 mkfifo: run time 0+00:02:00, incarnations 6, load 80, verbose 1 lockf2: run time 0+00:02:00, incarnations 12, load 80, verbose 1 creat: run time 0+00:02:00, incarnations 18, load 80, verbose 1 openat: run time 0+00:02:00, incarnations 5, load 80, verbose 1 mkdir: run time 0+00:02:00, incarnations 14, load 80, verbose 1 fts: run time 0+00:02:00, incarnations 20, load 80, verbose 1 link: run time 0+00:02:00, incarnations 4, load 80, verbose 1 load: 0.00 cmd: fts 63321 [ufs] 6115.25r 0.27u 6.16s 0% 6148k