GENERIC from Thu May 28 16:02:37 2009 +0300, kld 730457d, No vmcore KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-CURRENT #0: Thu May 28 16:39:03 CEST 2009 pho@x4.osted.lan:/var/tmp/deviant2/sys/i386/compile/PHO WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1799.99-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3539943424 (3375 MB) : Trying to mount root from ufs:/dev/ad4s1a WARNING: / was not properly dismounted Entropy harvesting: interrupts ethernet point_to_point kickstart. /etc/rc: WARNING: Use of the early.sh script is deprecated /etc/rc: WARNING: Please use a new-style rc.d script instead /etc/rc: WARNING: See rc(8) for more information GEOM_LABEL: Label ufsid/48f38e3cff1ca3a5 removed. ** /dev/ad4s1e ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? yes SUMMARY INFORMATION BAD SALVAGE? yes BLK(S) MISSING IN BIT MAPS SALVAGE? yes 19784 files, 752930 used, 50024145 free (2489 frags, 6252707 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** GEOM_LABEL: Label for provider ad4s1e is ufsid/48f38e3cff1ca3a5. ***** FILE SYSTEM WAS MODIFIED ***** GEOM_LABEL: Label ufsid/48f38e3c5b611e96 removed. /dev/ad4s1a: 17818 files, 760156 used, 252859 free (3291 frags, 31196 blocks, 0.3% fragmentation) GEOM_LABEL: Label for provider ad4s1a is ufsid/48f38e3c5b611e96. GEOM_LABEL: Label ufsid/48f38e3cff1ca3a5 removed. /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 50024145 frGEOM_LABEee (2489 frags, L: Labe6252707 blocks, l for provider ad4s1e is0.0% fragmentati ufsid/48f3on) 8e3cff1ca3a5. GEOM_LABEL: Label ufsid/48f38e47737647c8 removed. /dev/ad4s1f: 2257798 files, 15937462 used, 6401311 free (213367 frags, 773493 blocks, 1.0% fragmentation) GEOM_LABEL: Label for provider ad4s1f is ufsid/48f38e47737647c8. GEOM_LABEL: Label ufsid/48f38e4956403ff8 removed. /dev/ad4s1d: UNREF FILE I=4592980 OWNER=root MODE=100600 /dev/ad4s1d: SIZE=0 MTIME=May 28 17:00 2009 (CLEARED) /dev/ad4s1d: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/ad4s1d: SUMMARY INFORMATION BAD (SALVAGED) /dev/ad4s1d: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ad4s1d: 896779 files, 44450974 used, 6326101 free (106285 frags, 777477 blocks, 0.2% fragmentation) GEOM_LABEL: Label for provider ad4s1d is ufsid/48f38e4956403ff8. GEOM_LABEL: Label ufsid/48f38e3c5b611e96 removed. GEOM_LABEL: Label ufsid/48f38e3cff1ca3a5 removed. GEOM_LABEL: Label ufsid/48f38e47737647c8 removed. GEOM_LABEL: Label ufsid/48f38e4956403ff8 removed. re0: link state changed to DOWN Starting Network: lo0 re0. add net default: gateway 192.168.1.1 savecore: reboot May 28 23:24:53 x4 savecore: rlock order reversal: eboot 1st 0xdad12330 bufwait (bufwait) @ kern/vfs_bio.c:2566 2nd 0xc7461000 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:275 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e99b2778,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d29d58,c6d2d158,e99b27d4,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c7461000,c0c60e06,c6d2d158,c0c60aac,...) at _witness_debugger+0x25 witness_checkorder(c7461000,9,c0c60aa3,113,0,...) at witness_checkorder+0x839 _sx_xlock(c7461000,0,c0c60aa3,113,c7651828,...) at _sx_xlock+0x85 ufsdirhash_acquire(dad122d0,db5f243c,1c4,db5f2450,e99b28a4,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7651828,e99b28ec,1450,e99b2890,e99b2894,...) at ufsdirhash_add+0x13 ufs_direnter(c778d2b0,c778a158,e99b28ec,e99b2bd4,0,...) at ufs_direnter+0x779 ufs_makeinode(e99b2bd4,c0d3de60,e99b2acc,e99b2a34,c0b7dc75,...) at ufs_makeinode+0x51f ufs_create(e99b2acc,c0c758d5,0,0,e99b2ba8,...) at ufs_create+0x30 VOP_CREATE_APV(c0d3da20,e99b2acc,2,c0c339da,3,...) at VOP_CREATE_APV+0xc5 vn_open_cred(e99b2ba8,e99b2c5c,180,c6d42300,c74384d0,...) at vn_open_cred+0x18e vn_open(e99b2ba8,e99b2c5c,180,c74384d0,c7418d80,...) at vn_open+0x33 kern_openat(c7418d80,ffffff9c,28300000,0,602,...) at kern_openat+0x108 kern_open(c7418d80,28300000,0,601,180,...) at kern_open+0x35 open(c7418d80,e99b2cf8,c,c0c5b7fd,c0d1dd18,...) at open+0x30 syscall(e99b2d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (5, FreeBSD ELF32, open), eip = 0x2817a4f3, esp = 0xbfbfe2dc, ebp = 0xbfbfedf8 --- savecore: writing core to vmcore.160 Additional ABI support: linux. rpc.umntall: 127.0.0.1: RPCPROG_MNT: RPC: Program not registered Starting mountd. Configuring syscons: keymap blanktime. Local package initialization: watchdogd. Thu May 28 23:27:10 CEST 2009 FreeBSD/i386 (x4.osted.lan) (console) login: May 28 23:27:24 x4 su: pho to root on /dev/pts/0 GEOM_LABEL: Label for provider md5a is ufsid/4a1f041e74bd7197. GEOM_LABEL: Label ufsid/4a1f041e74bd7197 removed. lock order reversal: 1st 0xc762a868 ufs (ufs) @ kern/vfs_mount.c:1194 2nd 0xc77c1460 syncer (syncer) @ kern/vfs_subr.c:2198 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e99eda60,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d2d0f0,c6d2d1c0,e99edabc,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c77c1460,c0c484d6,c6d2d1c0,c0c48364,...) at _witness_debugger+0x25 witness_checkorder(c77c1460,9,c0c4835b,896,0,...) at witness_checkorder+0x839 __lockmgr_args(c77c1460,80100,c77c14c8,0,0,...) at __lockmgr_args+0x7a7 vop_stdlock(e99edbc4,c08ee80a,c0c48364,80100,c77c1408,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c0d2e7c0,e99edbc4,c08552c3,c0d562a0,c77c1408,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c77c1408,80100,c0c4835b,896,c0ef62c0,...) at _vn_lock+0x78 vrele(c77c1408,0,c0c47d36,4ef,80,...) at vrele+0x15a dounmount(c76202cc,8000000,c741c6c0,475,74bd7197,...) at dounmount+0x3ce unmount(c741c6c0,e99edcf8,8,e99edd38,c0d1deb0,...) at unmount+0x2df syscall(e99edd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280d91cf, esp = 0xbfbfe17c, ebp = 0xbfbfe248 --- lock order reversal: 1st 0xc762a868 ufs (ufs) @ kern/vfs_mount.c:1194 2nd 0xc780db18 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1195 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e99eda14,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d2d0f0,c6d2d020,e99eda70,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c780db18,c0c304b2,c6d2d020,c0c60282,...) at _witness_debugger+0x25 witness_checkorder(c780db18,9,c0c60279,4ab,c780db80,...) at witness_checkorder+0x839 __lockmgr_args(c780db18,80400,c780db80,0,0,...) at __lockmgr_args+0x7a7 vop_stdlock(e99edb78,c741c764,c0c60282,80400,c780dac0,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c0d1a920,e99edb78,c780d560,c0d562a0,c780dac0,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c780dac0,80400,c0c60279,4ab,c73b0900,...) at _vn_lock+0x78 ffs_flushfiles(c76202cc,0,c741c6c0,c08f04d3,c77c1408,...) at ffs_flushfiles+0x11a ffs_unmount(c76202cc,8000000,c0c47d36,4ef,80,...) at ffs_unmount+0x160 dounmount(c76202cc,8000000,c741c6c0,475,74bd7197,...) at dounmount+0x46d unmount(c741c6c0,e99edcf8,8,e99edd38,c0d1deb0,...) at unmount+0x2df syscall(e99edd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280d91cf, esp = 0xbfbfe17c, ebp = 0xbfbfe248 --- GEOM_LABEL: Label for provider md5a is ufsid/4a1f041e74bd7197. GEOM_LABEL: Label ufsid/4a1f041e74bd7197 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f041e74bd7197. GEOM_LABEL: Label ufsid/4a1f041e74bd7197 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f041e74bd7197. GEOM_LABEL: Label ufsid/4a1f041e74bd7197 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f04321fac228e. GEOM_LABEL: Label ufsid/4a1f04321fac228e removed. lock order reversal: 1st 0xc785ac70 ufs (ufs) @ kern/vfs_subr.c:2093 2nd 0xdae4d088 bufwait (bufwait) @ ufs/ffs/ffs_softdep.c:6150 3rd 0xc7fa5b18 ufs (ufs) @ kern/vfs_subr.c:2093 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e9a780f4,c08a3d15,c0895a5b,c0c414d3,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414d3,c6d29d58,c6d2d0f0,e9a78150,...) at kdb_backtrace+0x29 _witness_debugger(c0c414d3,c7fa5b18,c0c34303,c6d2d0f0,c0c48364,...) at _witness_debugger+0x25 witness_checkorder(c7fa5b18,9,c0c4835b,82d,0,...) at witness_checkorder+0x839 __lockmgr_args(c7fa5b18,80100,c7fa5b80,0,0,...) at __lockmgr_args+0x7a7 ffs_lock(e9a7825c,c08a3abb,c0c47a01,80100,c7fa5ac0,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0d3da20,e9a7825c,c7950524,c0d562a0,c7fa5ac0,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c7fa5ac0,80100,c0c4835b,82d,4,...) at _vn_lock+0x78 vget(c7fa5ac0,80100,c7950480,50,0,...) at vget+0xc9 vfs_hash_get(c7620000,11465,80000,c7950480,e9a783b8,...) at vfs_hash_get+0xed ffs_vgetf(c7620000,11465,80000,e9a783b8,1,...) at ffs_vgetf+0x49 softdep_sync_metadata(c785ac18,0,c0c606ef,131,0,...) at softdep_sync_metadata+0x5ba ffs_syncvnode(c785ac18,1,c7950480,51e,c7950524,...) at ffs_syncvnode+0x3e2 ffs_sync(c7620000,1,c0c497a9,465,c0c497a9,...) at ffs_sync+0x26f vfs_write_suspend(c7620000,e9a787a0,0,4000,c6d63600,...) at vfs_write_suspend+0x122 ffs_snapshot(c7620000,c7f3d420,c0c60279,160,c0c339da,...) at ffs_snapshot+0xcd2 ffs_mount(c7620000,0,c0c47d36,3cf,0,...) at ffs_mount+0x14aa vfs_donmount(c7950480,1211000,e9a78b90,c7fdc380,e,...) at vfs_donmount+0x1011 kernel_mount(c73533e0,1211000,e9a78bd4,84,bfbfead6,...) at kernel_mount+0x84 ffs_cmount(c73533e0,bfbfe1f4,1211000,58,0,...) at ffs_cmount+0x89 mount(c7950480,e9a78cf8,10,c0c5b7fd,c0d1de98,...) at mount+0x1f9 syscall(e9a78d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (21, FreeBSD ELF32, mount), eip = 0x280d71ef, esp = 0xbfbfe1cc, ebp = 0xbfbfe8c8 --- lock order reversal: 1st 0xdae4c3a8 bufwait (bufwait) @ kern/vfs_bio.c:2566 2nd 0xc7c6c31c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2223 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e9aba8a8,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d29d58,c6d2d8a8,e9aba904,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c7c6c31c,c0c5e8f9,c6d2d8a8,c0c5e883,...) at _witness_debugger+0x25 witness_checkorder(c7c6c31c,9,c0c5e87a,8af,0,...) at witness_checkorder+0x839 __lockmgr_args(c7c6c31c,80900,c780c620,0,0,...) at __lockmgr_args+0x7a7 ffs_copyonwrite(c780c560,dae4c348,dae4c348,0,0,...) at ffs_copyonwrite+0x2bd ffs_geom_strategy(c780c654,dae4c348,df,dae4c348,c7fe4d24,...) at ffs_geom_strategy+0xdb bufwrite(dae4c348,0,c0c60279,726,0) at bufwrite+0x159 ffs_bufwrite(dae4c348,c7fda700,100,4000,0,...) at ffs_bufwrite+0x288 ffs_update(c7fe0560,1,c0c606ef,150,0,...) at ffs_update+0x2bc ffs_syncvnode(c7fe0560,1,c0d3da20,e9abab74,c0b7c7b5,...) at ffs_syncvnode+0x48f ffs_fsync(e9abab94,c0c75542,c7fe4c3c,e9abab94,0,...) at ffs_fsync+0x1c VOP_FSYNC_APV(c0d3da20,e9abab94,500800c,0,c7fe0560,...) at VOP_FSYNC_APV+0xc5 ufs_remove(e9abac34,c0c757c8,0,0,c802dc18,...) at ufs_remove+0xd2 VOP_REMOVE_APV(c0d3da20,e9abac34,2,66,bfbfe4d4,...) at VOP_REMOVE_APV+0xf6 kern_unlinkat(c7c936c0,ffffff9c,bfbfe4d4,0,e9abac80,...) at kern_unlinkat+0x152 kern_unlink(c7c936c0,bfbfe4d4,0,e9abad2c,c0b6eb54,...) at kern_unlink+0x27 unlink(c7c936c0,e9abacf8,4,c0c1c788,c0d1dd90,...) at unlink+0x22 syscall(e9abad38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (10, FreeBSD ELF32, unlink), eip = 0x2816ca2f, esp = 0xbfbfe00c, ebp = 0xbfbfe8e8 --- lock order reversal: 1st 0xc7c6c31c snaplk (snaplk) @ kern/vfs_vnops.c:297 2nd 0xc802dc70 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1587 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e9aba820,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d2d8a8,c6d2d0f0,e9aba87c,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c802dc70,c0c34303,c6d2d0f0,c0c5e883,...) at _witness_debugger+0x25 witness_checkorder(c802dc70,9,c0c5e87a,633,0,...) at witness_checkorder+0x839 __lockmgr_args(c802dc70,80000,0,0,0,...) at __lockmgr_args+0x7a7 ffs_snapremove(c802dc18,c7620000,0,c0c497a9,40f,...) at ffs_snapremove+0x11f softdep_releasefile(c7fe4c3c,e9abaa04,2,c7c93764,c802dc18,...) at softdep_releasefile+0x3b ufs_inactive(e9abaa48,c0c754fb,c802dcd8,c802dcd8,c802dc18,...) at ufs_inactive+0x1bf VOP_INACTIVE_APV(c0d3da20,e9abaa48,c0c4835b,92e,c0d56260,...) at VOP_INACTIVE_APV+0xc5 vinactive(c0d3da20,e9abaa7c,c0c4835b,8b4,c802dc18,...) at vinactive+0xb1 vput(c802dc18,e9abaab8,c0c497a9,129,200000,...) at vput+0x203 vn_close(c802dc18,1,c7723d00,c7c936c0,0,...) at vn_close+0x112 vn_closefile(c7725888,c7c936c0,3,0,c7725888,...) at vn_closefile+0xe9 _fdrop(c7725888,c7c936c0,e9abab84,c08a3b5c,0,c7c93764,c0ec82d8,c0d266d4,c0c36077,c782aa2c,6d0,c0c3606e,e9ababac,c086bc40,c782aa2c,8,c0c3606e,6d0) at _fdrop+0x43 closef(c7725888,c7c936c0,6d0,6cd,c7c93764,...) at closef+0x290 fdfree(c7c936c0,0,c0c36935,104,66,...) at fdfree+0x3ea exit1(c7c936c0,0,e9abad2c,c0b6eb54,c7c936c0,...) at exit1+0x533 sys_exit(c7c936c0,e9abacf8,4,c0c41d68,c0d1dcb8,...) at sys_exit+0x1d syscall(e9abad38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (1, FreeBSD ELF32, sys_exit), eip = 0x2812a063, esp = 0xbfbfdf9c, ebp = 0xbfbfdfa8 --- GEOM_LABEL: Label for provider md5a is ufsid/4a1f04321fac228e. GEOM_LABEL: Label ufsid/4a1f04321fac228e removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043bbc623aee. GEOM_LABEL: Label ufsid/4a1f043bbc623aee removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043bbc623aee. GEOM_LABEL: Label ufsid/4a1f043bbc623aee removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043cc19d8b56. GEOM_LABEL: Label ufsid/4a1f043cc19d8b56 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043cc19d8b56. GEOM_LABEL: Label ufsid/4a1f043cc19d8b56 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043dd7e12eb9. GEOM_LABEL: Label ufsid/4a1f043dd7e12eb9 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043dd7e12eb9. GEOM_LABEL: Label ufsid/4a1f043dd7e12eb9 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043d9d3955e1. GEOM_LABEL: Label ufsid/4a1f043d9d3955e1 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043d9d3955e1. GEOM_LABEL: Label ufsid/4a1f043d9d3955e1 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043e9642ee2b. GEOM_LABEL: Label ufsid/4a1f043e9642ee2b removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043e9642ee2b. GEOM_LABEL: Label ufsid/4a1f043e9642ee2b removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043f150dc31c. GEOM_LABEL: Label ufsid/4a1f043f150dc31c removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f043f150dc31c. GEOM_LABEL: Label ufsid/4a1f043f150dc31c removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f0440db0faaf5. GEOM_LABEL: Label ufsid/4a1f0440db0faaf5 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f0440db0faaf5. GEOM_LABEL: Label ufsid/4a1f0440db0faaf5 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f044191fe334d. GEOM_LABEL: Label ufsid/4a1f044191fe334d removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f044191fe334d. GEOM_LABEL: Label ufsid/4a1f044191fe334d removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f04423cc7201e. GEOM_LABEL: Label ufsid/4a1f04423cc7201e removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f04423cc7201e. GEOM_LABEL: Label ufsid/4a1f04423cc7201e removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f04420a9cd8e4. GEOM_LABEL: Label ufsid/4a1f04420a9cd8e4 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f04420a9cd8e4. GEOM_LABEL: Label ufsid/4a1f04420a9cd8e4 removed. GEOM_LABEL: Label for provider md5a is ufsid/4a1f0443cd2e20ac. GEOM_LABEL: Label ufsid/4a1f0443cd2e20ac removed. May 28 23:54:16 x4 kernel: pid 4315 (rw), uid 0 inumber 1926 on /mnt: filesystem full May 28 23:54:17 x4 kernel: pid 4307 (rw), uid 0 inumber 8 on /mnt: filesystem full May 28 23:54:19 x4 kernel: pid 4304 (rw), uid 0 inumber 642 on /mnt: filesystem full lock order reversal: 1st 0xc74c3a2c filedesc structure (filedesc structure) @ kern/kern_descrip.c:1088 2nd 0xc778b308 ufs (ufs) @ kern/vfs_subr.c:4101 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e9a9ca30,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d29fc8,c6d2d0f0,e9a9ca8c,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c778b308,c0c34303,c6d2d0f0,c0c48364,...) at _witness_debugger+0x25 witness_checkorder(c778b308,9,c0c4835b,1005,c778b370,...) at witness_checkorder+0x839 __lockmgr_args(c778b308,80400,c778b370,0,0,...) at __lockmgr_args+0x7a7 ffs_lock(e9a9cb98,c,0,80400,c778b2b0,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0d3da20,e9a9cb98,e9a9cba0,c0d562a0,c778b2b0,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c778b2b0,80400,c0c4835b,1005,e9a9cbf4,...) at _vn_lock+0x78 vfs_knllock(c778b2b0,0,c0c36523,68c,c7d5e000,...) at vfs_knllock+0x29 knlist_remove_kq(0,e9a9cc14,c08eb4b9,c7d8001c,c7d5e000,...) at knlist_remove_kq+0xad knlist_remove(c7d8001c,c7d5e000,0,e9a9cc40,c0834875,...) at knlist_remove+0x1b filt_vfsdetach(c7d5e000,0,c0c36523,75c,3,...) at filt_vfsdetach+0x39 knote_fdclose(c7c94d80,3,c0c3606e,440,c74c3a2c,...) at knote_fdclose+0xf5 kern_close(c7c94d80,3,e9a9cd2c,c0b6eb54,c7c94d80,...) at kern_close+0xd2 close(c7c94d80,e9a9ccf8,4,c0c1c788,c0d1dd30,...) at close+0x1a syscall(e9a9cd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (6, FreeBSD ELF32, close), eip = 0x28178ef3, esp = 0xbfbfeb0c, ebp = 0xbfbfeb18 --- May 29 00:00:19 x4 kernel: pid 4990 (rw), uid 0 inumber 8 on /mnt: filesystem full May 29 00:00:20 x4 kernel: pid 4976 (rw), uid 0 inumber 641 on /mnt: filesystem full May 29 00:04:17 x4 kernel: pid 5434 (rw), uid 0 inumber 1287 on /mnt: filesystem full May 29 00:04:18 x4 kernel: pid 5426 (rw), uid 0 inumber 6 on /mnt: filesystem full May 29 00:04:21 x4 kernel: pid 5423 (rw), uid 0 inumber 642 on /mnt: filesystem full May 29 00:12:19 x4 kernel: pid 6270 (rw), uid 0 inumber 647 on /mnt: filesystem full May 29 00:12:21 x4 kernel: pid 6280 (rw), uid 0 inumber 648 on /mnt: filesystem full May 29 00:12:22 x4 kernel: pid 6273 (rw), uid 0 inumber 641 on /mnt: filesystem full GEOM_LABEL: Label for provider md5a is ufsid/4a1f0443cd2e20ac. GEOM_LABEL: Label ufsid/4a1f0443cd2e20ac removed. May 29 00:17:56 x4 su: pho to root on /dev/pts/2 fifo_close: no v_fifoinfo 0xc85672b0 Expensive timeout(9) function: 0xc085f660(0xc7da97ec) 0.021344776 s fifo_close: no v_fifoinfo 0xc8ae7810 fifo_close: no v_fifoinfo 0xc9d32408 fifo_close: no v_fifoinfo 0xc8693810 fifo_close: no v_fifoinfo 0xc879e6b8 fifo_close: no v_fifoinfo 0xc82d1968 fifo_close: no v_fifoinfo 0xc87d5158 fifo_close: no v_fifoinfo 0xc8734408 fifo_close: no v_fifoinfo 0xc926a408 fifo_close: no v_fifoinfo 0xc87ed2b0 fifo_close: no v_fifoinfo 0xc940cac0 fifo_close: no v_fifoinfo 0xc9d2e158 fifo_close: no v_fifoinfo 0xc9220408 fifo_close: no v_fifoinfo 0xc9319560 fifo_close: no v_fifoinfo 0xc8709d70 fifo_close: no v_fifoinfo 0xc9613408 fifo_close: no v_fifoinfo 0xc949cd70 vp = 0xc8737968, unref'ed lowervp deadc0de deadc0de deadc0de c7d9a4e0 deadc0de deadc0de deadc0de c0d2c9e0 May 29 03:02:34 x4 kernel: pid 73015 (link), uid 0, was killed: exceeded maximum CPU limit May 29 03:03:05 x4 last message repeated 31 times May 29 03:05:06 x4 last message repeated 120 times May 29 03:15:07 x4 last message repeated 597 times May 29 03:25:08 x4 last message repeated 598 times May 29 03:35:09 x4 last message repeated 597 times May 29 03:45:09 x4 last message repeated 596 times Expensive timeout(9) function: 0xc09cdbd0(0) 0.034435953 s May 29 03:55:08 x4 last message repeated 596 times May 29 04:05:09 x4 last message repeated 597 times May 29 04:15:09 x4 last message repeated 596 times May 29 04:25:09 x4 last message repeated 597 times May 29 04:35:09 x4 last message repeated 596 times May 29 04:45:09 x4 last message repeated 597 times May 29 04:55:09 x4 last message repeated 596 times May 29 05:05:10 x4 last message repeated 597 times May 29 05:15:09 x4 last message repeated 596 times May 29 05:25:10 x4 last message repeated 597 times May 29 05:35:10 x4 last message repeated 596 times May 29 05:45:10 x4 last message repeated 597 times May 29 05:55:10 x4 last message repeated 596 times May 29 06:05:09 x4 last message repeated 596 times May 29 06:15:10 x4 last message repeated 597 times May 29 06:25:10 x4 last message repeated 596 times May 29 06:35:10 x4 last message repeated 597 times May 29 06:45:10 x4 last message repeated 596 times May 29 06:55:10 x4 last message repeated 597 times May 29 07:05:10 x4 last message repeated 596 times May 29 07:15:11 x4 last message repeated 597 times May 29 07:25:10 x4 last message repeated 596 times May 29 07:35:11 x4 last message repeated 597 times May 29 07:45:11 x4 last message repeated 596 times May 29 07:55:11 x4 last message repeated 597 times May 29 08:05:11 x4 last message repeated 596 times May 29 08:15:10 x4 last message repeated 596 times May 29 08:25:11 x4 last message repeated 597 times lock order reversal: 1st 0xc0d89570 proctree (proctree) @ kern/kern_ktrace.c:718 2nd 0xc8169460 ufs (ufs) @ kern/vfs_subr.c:2198 KDB: stack backtrace: db_trace_self_wrapper(c0c3e603,e9e9c9cc,c08a3d15,c0895a5b,c0c414ba,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0895a5b,c0c414ba,c6d26068,c6d2d0f0,e9e9ca28,...) at kdb_backtrace+0x29 _witness_debugger(c0c414ba,c8169460,c0c34303,c6d2d0f0,c0c48364,...) at _witness_debugger+0x25 witness_checkorder(c8169460,9,c0c4835b,896,0,...) at witness_checkorder+0x839 __lockmgr_args(c8169460,80100,c81694c8,0,0,...) at __lockmgr_args+0x7a7 ffs_lock(e9e9cb34,c08a3abb,c0c48364,80100,c8169408,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0d3da20,e9e9cb34,c08552c3,c0d562a0,c8169408,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c8169408,80100,c0c4835b,896,4,...) at _vn_lock+0x78 vrele(c8169408,0,c0c37c63,36b,c8112874,...) at vrele+0x15a ktrops(3fe,0,c0c37c63,384,1,...) at ktrops+0x28d ktrsetchildren(3fe,0,c0c37c63,300,0,...) at ktrsetchildren+0x5c ktrace(c74d4d80,e9e9ccf8,10,c0c426d0,c0d1e0d8,...) at ktrace+0x622 syscall(e9e9cd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (45, FreeBSD ELF32, ktrace), eip = 0x280d80ef, esp = 0xbfbfea4c, ebp = 0xbfbfeaf8 --- ~KDB: enter: Line break on console [thread pid 11 tid 100005 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc6d776c0 kdb_enter(c0bdf57f,c0c1e881,c6a99bd8,c6ff0a80,0,...) at kdb_enter+0x3a uart_intr(c6ff0a00,c6d776c0,c6d5bcd0,c6d72e80,4,...) at uart_intr+0x11c intr_event_handle(c6d72e80,c6a99c30,c0f115cc,1f4,c70f7a00,...) at intr_event_handle+0x5c intr_execute_handlers(c6d5bcd0,c6a99c30,1,c6a99c70,c0b52114,...) at intr_execute_handlers+0x49 lapic_handle_intr(30,c6a99c30) at lapic_handle_intr+0x4c Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0xc0b46705, esp = 0xc6a99c70, ebp = 0xc6a99c70 --- acpi_cpu_c1(0,ffffffff,c6a99cd8,1,c0886431,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(c6a99cb4,c0b5d67b,0,c6a99cf8,c08866fe,...) at acpi_cpu_idle+0x11c cpu_idle_acpi(0,c6a99cf8,c08866fe,0,c6a99cd8,...) at cpu_idle_acpi+0x1b cpu_idle(0,c6a99cd8,c0c3cef2,3af,c6d776c0,...) at cpu_idle+0x1b sched_idletd(0,c6a99d38,c0c36b2a,335,c6d75a90,...) at sched_idletd+0x21e fork_exit(c08864e0,0,c6a99d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6a99d70, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 curthread = 0xc6d77480: pid 11 "idle: cpu0" curpcb = 0xc6a9cd90 fpcurthread = none idlethread = 0xc6d77480: pid 11 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 curthread = 0xc6d776c0: pid 11 "idle: cpu1" curpcb = 0xc6a99d90 fpcurthread = none idlethread = 0xc6d776c0: pid 11 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 curthread = 0xc8117b40: pid 73015 "link" curpcb = 0xe9ccfd90 fpcurthread = none idlethread = 0xc6d77900: pid 11 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 curthread = 0xc6d77b40: pid 11 "idle: cpu3" curpcb = 0xc6a93d90 fpcurthread = none idlethread = 0xc6d77b40: pid 11 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 7849 (sshd) thread 0xc79d3480 (100224) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc77fd844) locked @ kern/uipc_sockbuf.c:148 Process 1332 (sshd) thread 0xc74886c0 (100097) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc77fe6b8) locked @ kern/uipc_sockbuf.c:148 Process 1331 (sshd) thread 0xc7c93900 (100174) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7664e74) locked @ kern/uipc_sockbuf.c:148 Process 1330 (sshd) thread 0xc7c93480 (100176) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc77dd9d0) locked @ kern/uipc_sockbuf.c:148 Process 1209 (sshd) thread 0xc77acb40 (100162) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7828844) locked @ kern/uipc_sockbuf.c:148 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc73c4b30 /dev/ad4s1a on / (ufs) 0xc73c5000 devfs on /dev (devfs) 0xc7620598 /dev/ad4s1e on /tmp (ufs) 0xc7626000 /dev/ad4s1f on /usr (ufs) 0xc7625b30 /dev/ad4s1d on /var (ufs) 0xc73c4864 procfs on /proc (procfs) 0xc8139b30 /tmp on /usr/home/pho/stress2/misc/mp1 (nullfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 55181 1342 1337 1001 S nanslp 0xc0d89c04 sleep 73015 1 6935 0 R+ CPU 2 link 11416 10871 11416 0 S+ ttyin 0xc7860a70 bash 10871 9952 10871 0 S+ pause 0xc7da9d8c csh 9952 7963 9952 1001 S+ wait 0xc79d2d34 su 7963 7961 7963 1001 Ss+ wait 0xc7da7d34 bash 7961 7849 7849 1001 S select 0xc7db7724 sshd 7849 1078 7849 0 Ss sbwait 0xc77fd870 sshd 1343 1337 1337 1001 S piperd 0xc74b4c00 awk 1342 1337 1337 1001 S wait 0xc7c6e7ec sh 1341 1339 1341 1001 Ss+ select 0xc7d7e0a4 top 1340 1338 1340 1001 Ss kqread 0xc73a9480 tail 1339 1332 1332 1001 S select 0xc78f8964 sshd 1338 1331 1331 1001 S select 0xc7d6c0a4 sshd 1337 1336 1337 1001 Ss wait 0xc7c6d7ec sh 1336 1330 1330 1001 S select 0xc796cb64 sshd 1332 1078 1332 0 Ss sbwait 0xc77fe6e4 sshd 1331 1078 1331 0 Ss sbwait 0xc7664ea0 sshd 1330 1078 1330 0 Ss sbwait 0xc77dd9fc sshd 1221 1217 1221 0 S+ ttyin 0xc7c4b470 bash 1217 1216 1217 0 S+ pause 0xc779ed8c csh 1216 1212 1216 1001 S+ wait 0xc7881000 su 1212 1211 1212 1001 Ss+ wait 0xc77a8548 bash 1211 1209 1209 1001 S select 0xc796dda4 sshd 1209 1078 1209 0 Ss sbwait 0xc7828870 sshd 1164 1 1164 0 Ss+ ttyin 0xc70f7870 getty 1163 1 1163 0 Ss+ ttyin 0xc70f7470 getty 1162 1 1162 0 Ss+ ttyin 0xc70f7070 getty 1161 1 1161 0 Ss+ ttyin 0xc6fcde70 getty 1160 1 1160 0 Ss+ ttyin 0xc6fcdc70 getty 1159 1 1159 0 Ss+ ttyin 0xc6fcd670 getty 1158 1 1158 0 Ss+ ttyin 0xc6fcd870 getty 1157 1 1157 0 Ss+ ttyin 0xc6fcda70 getty 1156 1 1156 0 Ss+ ttyin 0xc6fcd270 getty 1130 1 1130 0 Ss select 0xc7b19064 inetd 1106 1 1106 0 Ss nanslp 0xc0d89c04 watchdogd 1097 1 1097 0 Ss nanslp 0xc0d89c04 cron 1091 1 1091 25 Ss pause 0xc74852fc sendmail 1085 1 1085 0 Ss select 0xc7a337e4 sendmail 1078 1 1078 0 Ss select 0xc7a33a24 sshd 1041 1 1041 0 Ss select 0xc796dc64 ntpd 922 1 922 0 Ss rpcsvc 0xc7a1b6d0 NLM: master 916 1 916 0 Ss select 0xc796c124 rpc.statd 910 909 909 0 S (threaded) nfsd 100136 S rpcsvc 0xc7a1b5d0 nfsd: service 100135 S rpcsvc 0xc7a1b1d0 nfsd: service 100134 S rpcsvc 0xc7a1b650 nfsd: service 100094 S rpcsvc 0xc7b190d0 nfsd: master 909 1 909 0 Ss select 0xc77e8a64 nfsd 907 1 907 0 Ss select 0xc796d424 mountd 824 1 824 0 Ss select 0xc7989424 rpcbind 794 1 794 0 Ss select 0xc72619e4 syslogd 599 1 599 0 Ss select 0xc7458ba4 devd 44 0 0 0 RL [flowcleaner] 43 0 0 0 SL sdflush 0xc0f01ca0 [softdepflush] 42 0 0 0 SL vlruwt 0xc73402a4 [vnlru] 41 0 0 0 SL syncer 0xc0ef64d4 [syncer] 40 0 0 0 SL psleep 0xc0ef6208 [bufdaemon] 39 0 0 0 SL pgzero 0xc0f028d4 [pagezero] 38 0 0 0 SL psleep 0xc0f024fc [vmdaemon] 9 0 0 0 SL psleep 0xc0f024c4 [pagedaemon] 37 0 0 0 SL wmsg 0xc6fddd0c [usbus5] 36 0 0 0 SL wmsg 0xc6fddcdc [usbus5] 35 0 0 0 SL wmsg 0xc6fddcac [usbus5] 34 0 0 0 SL wmsg 0xc6fddc7c [usbus5] 33 0 0 0 SL wmsg 0xc6fd7b5c [usbus4] 32 0 0 0 SL wmsg 0xc6fd7b2c [usbus4] 31 0 0 0 SL wmsg 0xc6fd7afc [usbus4] 30 0 0 0 SL wmsg 0xc6fd7acc [usbus4] 29 0 0 0 SL wmsg 0xc6fceb5c [usbus3] 28 0 0 0 SL wmsg 0xc6fceb2c [usbus3] 27 0 0 0 SL wmsg 0xc6fceafc [usbus3] 26 0 0 0 SL wmsg 0xc6fceacc [usbus3] 25 0 0 0 SL wmsg 0xc6fcab5c [usbus2] 24 0 0 0 SL wmsg 0xc6fcab2c [usbus2] 23 0 0 0 SL wmsg 0xc6fcaafc [usbus2] 22 0 0 0 SL wmsg 0xc6fcaacc [usbus2] 21 0 0 0 SL wmsg 0xc6fc4b5c [usbus1] 20 0 0 0 SL wmsg 0xc6fc4b2c [usbus1] 19 0 0 0 SL wmsg 0xc6fc4afc [usbus1] 18 0 0 0 SL wmsg 0xc6fc4acc [usbus1] 17 0 0 0 SL wmsg 0xc6fbfb5c [usbus0] 16 0 0 0 SL wmsg 0xc6fbfb2c [usbus0] 15 0 0 0 SL wmsg 0xc6fbfafc [usbus0] 14 0 0 0 SL wmsg 0xc6fbfacc [usbus0] 8 0 0 0 SL waiting_ 0xc0ef83bc [sctp_iterator] 7 0 0 0 SL - 0xc6fcd43c [fdc0] 6 0 0 0 SL - 0xc6ffc000 [fw0_probe] 5 0 0 0 SL ccb_scan 0xc0d56a54 [xpt_thrd] 13 0 0 0 SL - 0xc0d89a64 [yarrow] 4 0 0 0 SL - 0xc0d877e4 [g_down] 3 0 0 0 SL - 0xc0d877e0 [g_up] 2 0 0 0 SL - 0xc0d877d8 [g_event] 12 0 0 0 WL (threaded) intr 100042 I [irq12: psm0] 100041 I [irq1: atkbd0] 100039 I [swi0: uart] 100036 I [irq20: fwohci0] 100035 I [irq14: ata0] 100034 I [irq19: ehci0] 100033 I [irq18: ohci2 ohci4] 100032 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: atapci0] 100029 I [irq256: hdac0] 100028 I [irq9: acpi0] 100023 I [swi6: task queue] 100022 I [swi6: Giant taskq] 100020 I [swi5: +] 100019 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi3: vm] 100007 I [swi1: net] 11 0 0 0 RL (threaded) idle 100006 Run CPU 0 [idle: cpu0] 100005 Run CPU 1 [idle: cpu1] 100004 CanRun [idle: cpu2] 100003 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc6d75d34 [init] 10 0 0 0 SL audit_wo 0xc0f01640 [audit] 0 0 0 0 SLs (threaded) kernel 100037 D - 0xc6fd5400 [fw0_taskq] 100027 D - 0xc6f27e00 [kqueue taskq] 100026 D - 0xc6f27e40 [acpi_task_2] 100025 D - 0xc6f27e40 [acpi_task_1] 100024 D - 0xc6f27e40 [acpi_task_0] 100021 D - 0xc6f280c0 [thread taskq] 100016 D - 0xc6d5db80 [firmware taskq] 100000 D sched 0xc0d878a0 [swapper] db:0:ps> allt Tracing command sleep pid 55181 tid 100485 td 0xc7d4f240 sched_switch(c7d4f240,0,104,18c,efb49e59,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c7d4f240,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(2711,c089a3f0,c7d4f240,0,100,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c0d89c04,5c,c0c3c4d1,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0d89c04,0,15c,c0c3c4d1,2711,...) at _sleep+0x30e kern_nanosleep(c7d4f240,e9fa4c64,e9fa4c6c,a,0,...) at kern_nanosleep+0xc1 nanosleep(c7d4f240,e9fa4cf8,8,e9fa4d38,c0d1f320,...) at nanosleep+0x6f syscall(e9fa4d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28156a2f, esp = 0xbfbfecbc, ebp = 0xbfbfecf8 --- Tracing command link pid 73015 tid 100296 td 0xc8117b40 cpustop_handler(4,e9ccfa28,c0b6ee5d,e9ccf9b8,c0854b04,...) at cpustop_handler+0x32 ipi_nmi_handler(e9ccf9b8,c0854b04,c0d89cb0,4,c81127ec,...) at ipi_nmi_handler+0x2f trap(e9ccfa34) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc7d97831, esp = 0xe9ccfa74, ebp = 0xe9ccfa90 --- null_checkvp(c8737968,c7d993a1,212,c0ec4868,80100,...) at null_checkvp+0xb1 null_lock(e9ccfafc,df,c0c48364,80100,c8737968,...) at null_lock+0x41 VOP_LOCK1_APV(c7d9a640,e9ccfafc,c08552c3,c0d562a0,c8737968,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c8737968,80100,c0c4835b,896,0,...) at _vn_lock+0x78 vrele(c8737968,ffffffdf,c0c49650,63e,0,...) at vrele+0x15a kern_linkat(c8117b40,ffffff9c,ffffff9c,bfbfe5e4,bfbfe664,...) at kern_linkat+0x339 kern_link(c8117b40,bfbfe5e4,bfbfe664,0,e9ccfd2c,...) at kern_link+0x3e link(c8117b40,e9ccfcf8,8,c0be3950,c0d1dd78,...) at link+0x29 syscall(e9ccfd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (9, FreeBSD ELF32, link), eip = 0x280ea2cf, esp = 0xbfbfe5ac, ebp = 0xbfbfe6e8 --- Tracing command bash pid 11416 tid 100233 td 0xc7f13d80 sched_switch(c7f13d80,0,104,18c,32ddb444,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7f13d80,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7860a04,0,c0c39b13,c7f13d80,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7860a70,0,e9bbbb0c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7860a70,c7860a04,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c7860a00,c7860a70,e9bbbc58,1,0,...) at tty_wait+0x71 ttydisc_read(c7860a00,e9bbbc58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c7dab800,e9bbbc58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7974310,e9bbbc58,c7f39500,0,c7f13d80,...) at devfs_read_f+0x7e dofileread(e9bbbc58,ffffffff,ffffffff,0,c7974310,...) at dofileread+0x96 kern_readv(c7f13d80,0,e9bbbc58,e9bbbc78,1,...) at kern_readv+0x58 read(c7f13d80,e9bbbcf8,c,c0c41d68,c0d1dce8,...) at read+0x4f syscall(e9bbbd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28337f33, esp = 0xbfbfe63c, ebp = 0xbfbfe668 --- Tracing command csh pid 10871 tid 100194 td 0xc7c95d80 sched_switch(c7c95d80,0,104,18c,7320b29c,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,68,...) at mi_switch+0x200 sleepq_switch(c7c95d80,0,c0c3f610,189,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7da9d8c,68,c0bea58c,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7da9d8c,c7da9dbc,168,c0bea58c,0,...) at _sleep+0x344 kern_sigsuspend(c7c95d80,0,0,0,0,...) at kern_sigsuspend+0xe4 sigsuspend(c7c95d80,e9b1bcf8,4,c0c41d68,c0d1fc98,...) at sigsuspend+0x4d syscall(e9b1bd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28178f4b, esp = 0xbfbfe5dc, ebp = 0xbfbfe648 --- Tracing command su pid 9952 tid 100243 td 0xc7dcc6c0 sched_switch(c7dcc6c0,0,104,18c,df1a34f2,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c7dcc6c0,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c79d2d34,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c79d2d34,c79d2dbc,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c7dcc6c0,2a77,e9bd9c74,2,0,...) at kern_wait+0xac6 wait4(c7dcc6c0,e9bd9cf8,10,e9bd9d38,c0d1dd48,...) at wait4+0x3b syscall(e9bd9d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2811bedb, esp = 0xbfbfe62c, ebp = 0xbfbfe648 --- Tracing command bash pid 7963 tid 100196 td 0xc7f16480 sched_switch(c7f16480,0,104,18c,dbb34c2b,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c7f16480,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7da7d34,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7da7d34,c7da7dbc,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c7f16480,ffffffff,e9b22c74,6,0,...) at kern_wait+0xac6 wait4(c7f16480,e9b22cf8,10,c0c41d68,c0d1dd48,...) at wait4+0x3b syscall(e9b22d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282acedb, esp = 0xbfbfe9dc, ebp = 0xbfbfe9f8 --- Tracing command sshd pid 7961 tid 100122 td 0xc77ac240 sched_switch(c77ac240,0,104,18c,32e08391,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77ac240,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7db7710,0,c0c39b13,c77ac240,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7db7724,0,e99fca80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7db7724,c7db7710,c0c418d8,5c4,c7974af0,...) at _cv_wait_sig+0x240 seltdwait(c7974af0,58,c7e8e100,c77ac240,c0c577dd,...) at seltdwait+0xa2 kern_select(c77ac240,a,286030b8,286030dc,0,0,66,280fc6f8) at kern_select+0x4c4 select(c77ac240,e99fccf8,14,c0c1d6c6,c0d1e558,...) at select+0x5e syscall(e99fcd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283c4eb3, esp = 0xbfbfde5c, ebp = 0xbfbfdea8 --- Tracing command sshd pid 7849 tid 100224 td 0xc79d3480 sched_switch(c79d3480,0,104,18c,ba4d591d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,58,...) at mi_switch+0x200 sleepq_switch(c79d3480,0,c0c3f610,189,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c77fd870,58,c0c4532d,100,0,...) at sleepq_wait_sig+0x17 _sleep(c77fd870,c77fd830,158,c0c4532d,0) at _sleep+0x344 sbwait(c77fd810,4,c0c453e2,5c4,c77fd830,...) at sbwait+0x76 soreceive_generic(c77fd7bc,0,e9ba0c58,0,0,...) at soreceive_generic+0x3f0 soreceive(c77fd7bc,0,e9ba0c58,0,0,...) at soreceive+0x38 soo_read(c796e2d8,e9ba0c58,c7f38600,0,c79d3480,...) at soo_read+0x3a dofileread(e9ba0c58,ffffffff,ffffffff,0,c796e2d8,...) at dofileread+0x96 kern_readv(c79d3480,5,e9ba0c58,e9ba0c78,1,...) at kern_readv+0x58 read(c79d3480,e9ba0cf8,c,c0c5b7fd,c0d1dce8,...) at read+0x4f syscall(e9ba0d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x283c4f33, esp = 0xbfbfde4c, ebp = 0xbfbfde88 --- Tracing command awk pid 1343 tid 100111 td 0xc741b000 sched_switch(c741b000,0,104,18c,ef28f878,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,4c,...) at mi_switch+0x200 sleepq_switch(c741b000,0,c0c3f610,189,4c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c74b4c00,4c,c0c41ab0,100,0,...) at sleepq_wait_sig+0x17 _sleep(c74b4c00,c74b4d68,14c,c0c41ab0,0,...) at _sleep+0x344 pipe_read(c74bd968,e99aec58,c73b0900,0,c741b000,...) at pipe_read+0x3f7 dofileread(e99aec58,ffffffff,ffffffff,0,c74bd968,...) at dofileread+0x96 kern_readv(c741b000,0,e99aec58,e99aec78,1,...) at kern_readv+0x58 read(c741b000,e99aecf8,c,c741b000,c0d1dce8,...) at read+0x4f syscall(e99aed38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x281acf33, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sh pid 1342 tid 100166 td 0xc7c94b40 sched_switch(c7c94b40,0,104,18c,ef39a131,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c7c94b40,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7c6e7ec,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c6e7ec,c7c6e874,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c7c94b40,ffffffff,e9a9fc74,2,0,...) at kern_wait+0xac6 wait4(c7c94b40,e9a9fcf8,10,c0c41e6d,c0d1dd48,...) at wait4+0x3b syscall(e9a9fd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815aedb, esp = 0xbfbfe95c, ebp = 0xbfbfe978 --- Tracing command top pid 1341 tid 100173 td 0xc7c93b40 sched_switch(c7c93b40,0,104,18c,4b9e2139,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7c93b40,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9ab4a50,c0854e9a,c7d7e090,0,c7c93b40,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7d7e0a4,0,e9ab4a80,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d7e0a4,c7d7e090,3e9,5c4,c78149a0,...) at _cv_timedwait_sig+0x250 seltdwait(e9ab4c2c,e9ab4c34,c7720300,c7c93b40,35324830,...) at seltdwait+0x8a kern_select(c7c93b40,2,bfbfebec,0,0,e9ab4c70,1,0) at kern_select+0x4c4 select(c7c93b40,e9ab4cf8,14,c0c1d6c6,c0d1e558,...) at select+0x5e syscall(e9ab4d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x281e1eb3, esp = 0xbfbfeb8c, ebp = 0xbfbfece8 --- Tracing command tail pid 1340 tid 100165 td 0xc7c94d80 sched_switch(c7c94d80,0,104,18c,96b74f12,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,58,...) at mi_switch+0x200 sleepq_switch(c7c94d80,0,c0c3f610,189,58,...) at sleepq_switch+0x15f sleepq_catch_signals(3e9,c089a3f0,c7c94d80,3,100,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c73a9480,58,c0c367dc,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c73a9480,c73a9480,158,c0c367dc,3e9,...) at _sleep+0x30e kern_kevent(c7c94d80,4,0,1,e9a9cc58,...) at kern_kevent+0x357 kevent(c7c94d80,e9a9ccf8,18,c0bd601f,c0d1fea8,...) at kevent+0x19b syscall(e9a9cd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (363, FreeBSD ELF32, kevent), eip = 0x2815ac1b, esp = 0xbfbfeb6c, ebp = 0xbfbfec18 --- Tracing command sshd pid 1339 tid 100119 td 0xc741c240 sched_switch(c741c240,0,104,18c,4b9f745e,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c741c240,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c78f8950,0,c0c39b13,c741c240,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c78f8964,0,e99f3a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c78f8964,c78f8950,c0c418d8,5c4,c7438498,...) at _cv_wait_sig+0x240 seltdwait(c7438498,58,c7827000,c741c240,c0c577dd,...) at seltdwait+0xa2 kern_select(c741c240,a,286030b8,286030dc,0,0,66,280fc6f8) at kern_select+0x4c4 select(c741c240,e99f3cf8,14,c0c1d6c6,c0d1e558,...) at select+0x5e syscall(e99f3d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283c4eb3, esp = 0xbfbfde5c, ebp = 0xbfbfdea8 --- Tracing command sshd pid 1338 tid 100171 td 0xc7c94000 sched_switch(c7c94000,0,104,18c,7b8bb65a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7c94000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7d6c090,0,c0c39b13,c7c94000,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7d6c0a4,0,e9aaea80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d6c0a4,c7d6c090,c0c418d8,5c4,c74bdd20,...) at _cv_wait_sig+0x240 seltdwait(c74bdd20,58,c74c3900,c7c94000,c0c577dd,...) at seltdwait+0xa2 kern_select(c7c94000,c,286030b8,286030dc,0,0,66,280fc6f8) at kern_select+0x4c4 select(c7c94000,e9aaecf8,14,c0c1d6c6,c0d1e558,...) at select+0x5e syscall(e9aaed38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283c4eb3, esp = 0xbfbfde5c, ebp = 0xbfbfdea8 --- Tracing command sh pid 1337 tid 100172 td 0xc7c93d80 sched_switch(c7c93d80,0,104,18c,8f55a95a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c7c93d80,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7c6d7ec,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c6d7ec,c7c6d874,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c7c93d80,ffffffff,e9ab1c74,2,0,...) at kern_wait+0xac6 wait4(c7c93d80,e9ab1cf8,10,e9ab1d38,c0d1dd48,...) at wait4+0x3b syscall(e9ab1d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815aedb, esp = 0xbfbfeb5c, ebp = 0xbfbfeb78 --- Tracing command sshd pid 1336 tid 100148 td 0xc7952000 sched_switch(c7952000,0,104,18c,8c239d2a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7952000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c796cb50,0,c0c39b13,c7952000,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c796cb64,0,e9a69a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c796cb64,c796cb50,c0c418d8,5c4,c7814ab8,...) at _cv_wait_sig+0x240 seltdwait(c7814ab8,58,c7c6ce00,c7952000,c0c577dd,...) at seltdwait+0xa2 kern_select(c7952000,c,286030b8,286030dc,0,0,66,280fc6f8) at kern_select+0x4c4 select(c7952000,e9a69cf8,14,c0c1d6c6,c0d1e558,...) at select+0x5e syscall(e9a69d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283c4eb3, esp = 0xbfbfde5c, ebp = 0xbfbfdea8 --- Tracing command sshd pid 1332 tid 100097 td 0xc74886c0 sched_switch(c74886c0,0,104,18c,4dba77f4,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,58,...) at mi_switch+0x200 sleepq_switch(c74886c0,0,c0c3f610,189,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c77fe6e4,58,c0c4532d,100,0,...) at sleepq_wait_sig+0x17 _sleep(c77fe6e4,c77fe6a4,158,c0c4532d,0) at _sleep+0x344 sbwait(c77fe684,4,c0c453e2,5c4,c77fe6a4,...) at sbwait+0x76 soreceive_generic(c77fe630,0,e995dc58,0,0,...) at soreceive_generic+0x3f0 soreceive(c77fe630,0,e995dc58,0,0,...) at soreceive+0x38 soo_read(c7814850,e995dc58,c743ed00,0,c74886c0,...) at soo_read+0x3a dofileread(e995dc58,ffffffff,ffffffff,0,c7814850,...) at dofileread+0x96 kern_readv(c74886c0,5,e995dc58,e995dc78,1,...) at kern_readv+0x58 read(c74886c0,e995dcf8,c,e995dd38,c0d1dce8,...) at read+0x4f syscall(e995dd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x283c4f33, esp = 0xbfbfde4c, ebp = 0xbfbfde88 --- Tracing command sshd pid 1331 tid 100174 td 0xc7c93900 sched_switch(c7c93900,0,104,18c,4cf4793c,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,58,...) at mi_switch+0x200 sleepq_switch(c7c93900,0,c0c3f610,189,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7664ea0,58,c0c4532d,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7664ea0,c7664e60,158,c0c4532d,0) at _sleep+0x344 sbwait(c7664e40,4,c0c453e2,5c4,c7664e60,...) at sbwait+0x76 soreceive_generic(c7664dec,0,e9ab7c58,0,0,...) at soreceive_generic+0x3f0 soreceive(c7664dec,0,e9ab7c58,0,0,...) at soreceive+0x38 soo_read(c77be1c0,e9ab7c58,c7821c00,0,c7c93900,...) at soo_read+0x3a dofileread(e9ab7c58,ffffffff,ffffffff,0,c77be1c0,...) at dofileread+0x96 kern_readv(c7c93900,5,e9ab7c58,e9ab7c78,1,...) at kern_readv+0x58 read(c7c93900,e9ab7cf8,c,c0bd601f,c0d1dce8,...) at read+0x4f syscall(e9ab7d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x283c4f33, esp = 0xbfbfde4c, ebp = 0xbfbfde88 --- Tracing command sshd pid 1330 tid 100176 td 0xc7c93480 sched_switch(c7c93480,0,104,18c,4c09a73a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,58,...) at mi_switch+0x200 sleepq_switch(c7c93480,0,c0c3f610,189,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c77dd9fc,58,c0c4532d,100,0,...) at sleepq_wait_sig+0x17 _sleep(c77dd9fc,c77dd9bc,158,c0c4532d,0) at _sleep+0x344 sbwait(c77dd99c,4,c0c453e2,5c4,c77dd9bc,...) at sbwait+0x76 soreceive_generic(c77dd948,0,e9abdc58,0,0,...) at soreceive_generic+0x3f0 soreceive(c77dd948,0,e9abdc58,0,0,...) at soreceive+0x38 soo_read(c7420af0,e9abdc58,c74c1000,0,c7c93480,...) at soo_read+0x3a dofileread(e9abdc58,ffffffff,ffffffff,0,c7420af0,...) at dofileread+0x96 kern_readv(c7c93480,5,e9abdc58,e9abdc78,1,...) at kern_readv+0x58 read(c7c93480,e9abdcf8,c,c0bd601f,c0d1dce8,...) at read+0x4f syscall(e9abdd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x283c4f33, esp = 0xbfbfde4c, ebp = 0xbfbfde88 --- Tracing command bash pid 1221 tid 100104 td 0xc741b240 sched_switch(c741b240,0,104,18c,19c3a168,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c741b240,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7c4b404,0,c0c39b13,c741b240,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7c4b470,0,e9979b0c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c4b470,c7c4b404,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c7c4b400,c7c4b470,e9979c58,1,0,...) at tty_wait+0x71 ttydisc_read(c7c4b400,e9979c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c7c6b600,e9979c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7438ce8,e9979c58,c7390800,0,c741b240,...) at devfs_read_f+0x7e dofileread(e9979c58,ffffffff,ffffffff,0,c7438ce8,...) at dofileread+0x96 kern_readv(c741b240,0,e9979c58,e9979c78,1,...) at kern_readv+0x58 read(c741b240,e9979cf8,c,c0c41d68,c0d1dce8,...) at read+0x4f syscall(e9979d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28337f33, esp = 0xbfbfe65c, ebp = 0xbfbfe688 --- Tracing command csh pid 1217 tid 100160 td 0xc77a1d80 sched_switch(c77a1d80,0,104,18c,d404bb62,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,68,...) at mi_switch+0x200 sleepq_switch(c77a1d80,0,c0c3f610,189,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c779ed8c,68,c0bea58c,100,0,...) at sleepq_wait_sig+0x17 _sleep(c779ed8c,c779edbc,168,c0bea58c,0,...) at _sleep+0x344 kern_sigsuspend(c77a1d80,0,0,0,0,...) at kern_sigsuspend+0xe4 sigsuspend(c77a1d80,e9a8dcf8,4,c0c41d68,c0d1fc98,...) at sigsuspend+0x4d syscall(e9a8dd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x28178f4b, esp = 0xbfbfe60c, ebp = 0xbfbfe678 --- Tracing command su pid 1216 tid 100144 td 0xc7952900 sched_switch(c7952900,0,104,18c,7fc326b4,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c7952900,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7881000,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7881000,c7881088,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c7952900,4c1,e9a5dc74,2,0,...) at kern_wait+0xac6 wait4(c7952900,e9a5dcf8,10,e9a5dd38,c0d1dd48,...) at wait4+0x3b syscall(e9a5dd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2811bedb, esp = 0xbfbfe64c, ebp = 0xbfbfe668 --- Tracing command bash pid 1212 tid 100127 td 0xc77ab6c0 sched_switch(c77ab6c0,0,104,18c,5fffbfdb,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c77ab6c0,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c77a8548,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c77a8548,c77a85d0,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c77ab6c0,ffffffff,e9a0cc74,6,0,...) at kern_wait+0xac6 wait4(c77ab6c0,e9a0ccf8,10,c0c41d68,c0d1dd48,...) at wait4+0x3b syscall(e9a0cd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282acedb, esp = 0xbfbfe9dc, ebp = 0xbfbfe9f8 --- Tracing command sshd pid 1211 tid 100163 td 0xc77ac900 sched_switch(c77ac900,0,104,18c,19c4d2cf,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77ac900,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c796dd90,0,c0c39b13,c77ac900,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c796dda4,0,e9a96a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c796dda4,c796dd90,c0c418d8,5c4,c7725bd0,...) at _cv_wait_sig+0x240 seltdwait(c7725bd0,58,c738ec00,c77ac900,c0c577dd,...) at seltdwait+0xa2 kern_select(c77ac900,a,286030b8,286030dc,0,0,66,280fc6f8) at kern_select+0x4c4 select(c77ac900,e9a96cf8,14,c0c1d6c6,c0d1e558,...) at select+0x5e syscall(e9a96d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283c4eb3, esp = 0xbfbfde5c, ebp = 0xbfbfdea8 --- Tracing command sshd pid 1209 tid 100162 td 0xc77acb40 sched_switch(c77acb40,0,104,18c,c2f00c14,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,58,...) at mi_switch+0x200 sleepq_switch(c77acb40,0,c0c3f610,189,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7828870,58,c0c4532d,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7828870,c7828830,158,c0c4532d,0) at _sleep+0x344 sbwait(c7828810,4,c0c453e2,5c4,c7828830,...) at sbwait+0x76 soreceive_generic(c78287bc,0,e9a93c58,0,0,...) at soreceive_generic+0x3f0 soreceive(c78287bc,0,e9a93c58,0,0,...) at soreceive+0x38 soo_read(c7420cb0,e9a93c58,c7c6ba00,0,c77acb40,...) at soo_read+0x3a dofileread(e9a93c58,ffffffff,ffffffff,0,c7420cb0,...) at dofileread+0x96 kern_readv(c77acb40,5,e9a93c58,e9a93c78,1,...) at kern_readv+0x58 read(c77acb40,e9a93cf8,c,c0c5b7fd,c0d1dce8,...) at read+0x4f syscall(e9a93d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x283c4f33, esp = 0xbfbfde4c, ebp = 0xbfbfde88 --- Tracing command getty pid 1164 tid 100159 td 0xc77a4000 sched_switch(c77a4000,0,104,18c,ab51eb0b,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77a4000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77a4000,c77a4000,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c70f7870,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c70f7870,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c70f7800,c70f7870,e9a8ac58,1,0,...) at tty_wait+0x71 ttydisc_read(c70f7800,e9a8ac58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c7108000,e9a8ac58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c77252d8,e9a8ac58,c6d42300,0,c77a4000,...) at devfs_read_f+0x7e dofileread(e9a8ac58,ffffffff,ffffffff,0,c77252d8,...) at dofileread+0x96 kern_readv(c77a4000,0,e9a8ac58,e9a8ac78,1,...) at kern_readv+0x58 read(c77a4000,e9a8acf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a8ad38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1163 tid 100158 td 0xc77a4240 sched_switch(c77a4240,0,104,18c,ab5c326a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77a4240,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77a4240,c77a4240,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c70f7470,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c70f7470,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c70f7400,c70f7470,e9a87c58,1,0,...) at tty_wait+0x71 ttydisc_read(c70f7400,e9a87c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c7108100,e9a87c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c74b93f0,e9a87c58,c6d42300,0,c77a4240,...) at devfs_read_f+0x7e dofileread(e9a87c58,ffffffff,ffffffff,0,c74b93f0,...) at dofileread+0x96 kern_readv(c77a4240,0,e9a87c58,e9a87c78,1,...) at kern_readv+0x58 read(c77a4240,e9a87cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a87d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1162 tid 100157 td 0xc77a4480 sched_switch(c77a4480,0,104,18c,ab528291,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77a4480,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77a4480,c77a4480,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c70f7070,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c70f7070,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c70f7000,c70f7070,e9a84c58,1,0,...) at tty_wait+0x71 ttydisc_read(c70f7000,e9a84c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c7108200,e9a84c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c74b9658,e9a84c58,c6d42300,0,c77a4480,...) at devfs_read_f+0x7e dofileread(e9a84c58,ffffffff,ffffffff,0,c74b9658,...) at dofileread+0x96 kern_readv(c77a4480,0,e9a84c58,e9a84c78,1,...) at kern_readv+0x58 read(c77a4480,e9a84cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a84d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1161 tid 100156 td 0xc77a46c0 sched_switch(c77a46c0,0,104,18c,ab57a3f7,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77a46c0,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77a46c0,c77a46c0,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6fcde70,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6fcde70,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c6fcde00,c6fcde70,e9a81c58,1,0,...) at tty_wait+0x71 ttydisc_read(c6fcde00,e9a81c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c7108300,e9a81c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7420bd0,e9a81c58,c6d42300,0,c77a46c0,...) at devfs_read_f+0x7e dofileread(e9a81c58,ffffffff,ffffffff,0,c7420bd0,...) at dofileread+0x96 kern_readv(c77a46c0,0,e9a81c58,e9a81c78,1,...) at kern_readv+0x58 read(c77a46c0,e9a81cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a81d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1160 tid 100132 td 0xc77a5b40 sched_switch(c77a5b40,0,104,18c,ab4da2d8,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77a5b40,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77a5b40,c77a5b40,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6fcdc70,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6fcdc70,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c6fcdc00,c6fcdc70,e9a1ec58,1,0,...) at tty_wait+0x71 ttydisc_read(c6fcdc00,e9a1ec58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c6fefc00,e9a1ec58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c74b94d0,e9a1ec58,c6d42300,0,c77a5b40,...) at devfs_read_f+0x7e dofileread(e9a1ec58,ffffffff,ffffffff,0,c74b94d0,...) at dofileread+0x96 kern_readv(c77a5b40,0,e9a1ec58,e9a1ec78,1,...) at kern_readv+0x58 read(c77a5b40,e9a1ecf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a1ed38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1159 tid 100130 td 0xc77ab000 sched_switch(c77ab000,0,104,18c,ab4ffdde,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77ab000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77ab000,c77ab000,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6fcd670,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6fcd670,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c6fcd600,c6fcd670,e9a18c58,1,0,...) at tty_wait+0x71 ttydisc_read(c6fcd600,e9a18c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c6fefe00,e9a18c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7725578,e9a18c58,c6d42300,0,c77ab000,...) at devfs_read_f+0x7e dofileread(e9a18c58,ffffffff,ffffffff,0,c7725578,...) at dofileread+0x96 kern_readv(c77ab000,0,e9a18c58,e9a18c78,1,...) at kern_readv+0x58 read(c77ab000,e9a18cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a18d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1158 tid 100128 td 0xc77ab480 sched_switch(c77ab480,0,104,18c,ab378ba5,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77ab480,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c77ab480,c77ab480,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6fcd870,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6fcd870,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c6fcd800,c6fcd870,e9a12c58,1,0,...) at tty_wait+0x71 ttydisc_read(c6fcd800,e9a12c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c6ff0000,e9a12c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7438118,e9a12c58,c6d42300,0,c77ab480,...) at devfs_read_f+0x7e dofileread(e9a12c58,ffffffff,ffffffff,0,c7438118,...) at dofileread+0x96 kern_readv(c77ab480,0,e9a12c58,e9a12c78,1,...) at kern_readv+0x58 read(c77ab480,e9a12cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a12d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1157 tid 100090 td 0xc74b0b40 sched_switch(c74b0b40,0,104,18c,ab5ec56e,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c74b0b40,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,c74b0b40,c74b0b40,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6fcda70,0,c0c43bc2,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6fcda70,c0d893b0,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c6fcda00,c6fcda70,e9941c58,1,0,...) at tty_wait+0x71 ttydisc_read(c6fcda00,e9941c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c6ff0200,e9941c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7438038,e9941c58,c6d42300,0,c74b0b40,...) at devfs_read_f+0x7e dofileread(e9941c58,ffffffff,ffffffff,0,c7438038,...) at dofileread+0x96 kern_readv(c74b0b40,0,e9941c58,e9941c78,1,...) at kern_readv+0x58 read(c74b0b40,e9941cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9941d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedcc, ebp = 0xbfbfedf8 --- Tracing command getty pid 1156 tid 100140 td 0xc748bb40 sched_switch(c748bb40,0,104,18c,7ab94e9d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c748bb40,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c6fcd204,0,c0c39b13,c748bb40,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6fcd270,0,e9a51b0c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6fcd270,c6fcd204,c0c43579,4d4,0,...) at _cv_wait_sig+0x240 tty_wait(c6fcd200,c6fcd270,e9a51c58,1,0,...) at tty_wait+0x71 ttydisc_read(c6fcd200,e9a51c58,0,9e,0,...) at ttydisc_read+0x22c ttydev_read(c6d82300,e9a51c58,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7420658,e9a51c58,c6d42300,0,c748bb40,...) at devfs_read_f+0x7e dofileread(e9a51c58,ffffffff,ffffffff,0,c7420658,...) at dofileread+0x96 kern_readv(c748bb40,0,e9a51c58,e9a51c78,1,...) at kern_readv+0x58 read(c748bb40,e9a51cf8,c,c0c51a79,c0d1dce8,...) at read+0x4f syscall(e9a51d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28188f33, esp = 0xbfbfedbc, ebp = 0xbfbfede8 --- Tracing command inetd pid 1130 tid 100145 td 0xc79526c0 sched_switch(c79526c0,0,104,18c,7802893d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c79526c0,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7b19050,0,c0c39b13,c79526c0,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7b19064,0,e9a60a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7b19064,c7b19050,c0c418d8,5c4,c74387a8,...) at _cv_wait_sig+0x240 seltdwait(c74387a8,58,c6d42300,c79526c0,4,...) at seltdwait+0xa2 kern_select(c79526c0,6,bfbfdfe0,0,0,0,66,281af9c0) at kern_select+0x4c4 select(c79526c0,e9a60cf8,14,c0c41ee1,c0d1e558,...) at select+0x5e syscall(e9a60d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819ceb3, esp = 0xbfbfdf9c, ebp = 0xbfbfee28 --- Tracing command watchdogd pid 1106 tid 100124 td 0xc77abd80 sched_switch(c77abd80,0,104,18c,c4a0e2d3,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c77abd80,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(ea61,c089a3f0,c77abd80,0,100,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c0d89c04,5c,c0c3c4d1,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0d89c04,0,15c,c0c3c4d1,ea61,...) at _sleep+0x30e kern_nanosleep(c77abd80,e9a03c64,e9a03c6c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c77abd80,e9a03cf8,8,c0c51a79,c0d1f320,...) at nanosleep+0x6f syscall(e9a03d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28180a2f, esp = 0xbfbfecec, ebp = 0xbfbfed18 --- Tracing command cron pid 1097 tid 100129 td 0xc77ab240 sched_switch(c77ab240,0,104,18c,207052a1,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c77ab240,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(ea61,c089a3f0,c77ab240,0,100,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c0d89c04,5c,c0c3c4d1,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0d89c04,0,15c,c0c3c4d1,ea61,...) at _sleep+0x30e kern_nanosleep(c77ab240,e9a15c64,e9a15c6c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c77ab240,e9a15cf8,8,c0c41fd2,c0d1f320,...) at nanosleep+0x6f syscall(e9a15d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28173a2f, esp = 0xbfbfec8c, ebp = 0xbfbfecb8 --- Tracing command sendmail pid 1091 tid 100099 td 0xc7488240 sched_switch(c7488240,0,104,18c,949a293e,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,68,...) at mi_switch+0x200 sleepq_switch(c7488240,0,c0c3f610,189,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c74852fc,68,c0bea58c,100,0,...) at sleepq_wait_sig+0x17 _sleep(c74852fc,c748532c,168,c0bea58c,0,...) at _sleep+0x344 kern_sigsuspend(c7488240,0,0,0,0,...) at kern_sigsuspend+0xe4 sigsuspend(c7488240,e9965cf8,4,c0c41d68,c0d1fc98,...) at sigsuspend+0x4d syscall(e9965d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x2832bf4b, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 1085 tid 100080 td 0xc74b1900 sched_switch(c74b1900,0,104,18c,7acef829,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c74b1900,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9919a50,c0854e9a,c7a337d0,0,c74b1900,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7a337e4,0,e9919a80,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7a337e4,c7a337d0,1389,5c4,c77257e0,...) at _cv_timedwait_sig+0x250 seltdwait(e9919c2c,e9919c34,c743fc00,c74b1900,c6c16000,...) at seltdwait+0x8a kern_select(c74b1900,5,bfbfc520,0,0,e9919c70,5,0) at kern_select+0x4c4 select(c74b1900,e9919cf8,14,c0c422a8,c0d1e558,...) at select+0x5e syscall(e9919d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283cbeb3, esp = 0xbfbfc48c, ebp = 0xbfbfcfb8 --- Tracing command sshd pid 1078 tid 100077 td 0xc732a240 sched_switch(c732a240,0,104,18c,b92c6e2a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732a240,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7a33a10,0,c0c39b13,c732a240,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7a33a24,0,e9908a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7a33a24,c7a33a10,c0c418d8,5c4,c7725508,...) at _cv_wait_sig+0x240 seltdwait(c7725508,58,c743f300,c732a240,c0a924be,...) at seltdwait+0xa2 kern_select(c732a240,9,286090b0,0,0,0,c732a240,e9908c98) at kern_select+0x4c4 select(c732a240,e9908cf8,14,e9908d38,c0d1e558,...) at select+0x5e syscall(e9908d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283c4eb3, esp = 0xbfbfdf1c, ebp = 0xbfbfee38 --- Tracing command ntpd pid 1041 tid 100108 td 0xc74b0000 sched_switch(c74b0000,0,104,18c,8247d489,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c74b0000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c796dc50,0,c0c39b13,c74b0000,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c796dc64,0,e9988a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c796dc64,c796dc50,c0c418d8,5c4,c7725118,...) at _cv_wait_sig+0x240 seltdwait(c7725118,58,c6d42300,c74b0000,0,...) at seltdwait+0xa2 kern_select(c74b0000,1b,bfbfed28,0,0,0,e9988c98,246) at kern_select+0x4c4 select(c74b0000,e9988cf8,14,c74b0000,c0d1e558,...) at select+0x5e syscall(e9988d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2834ceb3, esp = 0xbfbfecfc, ebp = 0xbfbfedc8 --- Tracing command rpc.lockd pid 922 tid 100120 td 0xc77ac6c0 sched_switch(c77ac6c0,0,104,18c,4b7bbc81,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77ac6c0,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e99f6a04,c0854e9a,c6f4b880,0,c77ac6c0,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7a1b6d0,0,e99f6a34,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7a1b6d0,c6f4b880,1388,3a5,c77e1600,...) at _cv_timedwait_sig+0x250 svc_run_internal(c77ac824,14,c0c5cd8c,c0c5c551,e99f6b8c,...) at svc_run_internal+0x356 svc_run(c6f4b880,0,4,c0a35470,e99f6b8c,...) at svc_run+0x7f nlm_syscall(c77ac6c0,e99f6cf8,10,c0c426d0,c0d1eb10,...) at nlm_syscall+0x6a9 syscall(e99f6d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (154, FreeBSD ELF32, nlm_syscall), eip = 0x280f9b8b, esp = 0xbfbfed5c, ebp = 0xbfbfee28 --- Tracing command rpc.statd pid 916 tid 100078 td 0xc748b480 sched_switch(c748b480,0,104,18c,ce575b4,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c748b480,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9911a50,c0854e9a,c796c110,0,c748b480,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c796c124,0,e9911a80,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c796c124,c796c110,7531,5c4,c7421e70,...) at _cv_timedwait_sig+0x250 seltdwait(e9911c2c,e9911c34,c6d42300,c748b480,c0a924be,...) at seltdwait+0x8a kern_select(c748b480,8,bfbfed44,0,0,e9911c70,1e,0) at kern_select+0x4c4 select(c748b480,e9911cf8,14,c0c41fd2,c0d1e558,...) at select+0x5e syscall(e9911d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28181eb3, esp = 0xbfbfec9c, ebp = 0xbfbfedd8 --- Tracing command nfsd pid 910 tid 100136 td 0xc7418000 sched_switch(c7418000,0,104,18c,7e852f98,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7418000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9a2abf8,c0854e9a,c70f5e00,0,c7418000,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7a1b5d0,0,e9a2ac28,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7a1b5d0,c70f5e00,1388,3a5,0,...) at _cv_timedwait_sig+0x250 svc_run_internal(e9a2ad24,c083b618,c70f5e00,e9a2ad38,c0c36b2a,...) at svc_run_internal+0x356 svc_thread_start(c70f5e00,e9a2ad38,c0c36b2a,335,c74ae2a4,...) at svc_thread_start+0x10 fork_exit(c0a43000,c70f5e00,e9a2ad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 910 tid 100135 td 0xc7418240 sched_switch(c7418240,0,104,18c,990f1f92,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7418240,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9a27bf8,c0854e9a,c70f5e00,0,c7418240,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7a1b1d0,0,e9a27c28,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7a1b1d0,c70f5e00,1388,3a5,8244489,...) at _cv_timedwait_sig+0x250 svc_run_internal(e9a27d24,c083b618,c70f5e00,e9a27d38,c0c36b2a,...) at svc_run_internal+0x356 svc_thread_start(c70f5e00,e9a27d38,c0c36b2a,335,c74ae2a4,...) at svc_thread_start+0x10 fork_exit(c0a43000,c70f5e00,e9a27d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 910 tid 100134 td 0xc7418480 sched_switch(c7418480,0,104,18c,6cbec34f,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7418480,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9a24bf8,c0854e9a,c70f5e00,0,c7418480,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7a1b650,0,e9a24c28,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7a1b650,c70f5e00,1388,3a5,ffff4884,...) at _cv_timedwait_sig+0x250 svc_run_internal(e9a24d24,c083b618,c70f5e00,e9a24d38,c0c36b2a,...) at svc_run_internal+0x356 svc_thread_start(c70f5e00,e9a24d38,c0c36b2a,335,c74ae2a4,...) at svc_thread_start+0x10 fork_exit(c0a43000,c70f5e00,e9a24d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 910 tid 100094 td 0xc74b0480 sched_switch(c74b0480,0,104,18c,6c35760f,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c74b0480,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9951ae8,c0854e9a,c70f5e00,0,c74b0480,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7b190d0,0,e9951b18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7b190d0,c70f5e00,1388,3a5,e9951b60,...) at _cv_timedwait_sig+0x250 svc_run_internal(c74b05e4,14,c0c5cd8c,c0c5ba38,e9951c3c,...) at svc_run_internal+0x356 svc_run(c70f5e00,0,c0c5bd3c,1fb,0,...) at svc_run+0x7f nfssvc_nfsd(bfbfe8c0,e9951c3c,c,c6d42300,e9951c50,...) at nfssvc_nfsd+0xad nfssvc_nfsserver(c74b0480,e9951cf8,bfbfe8c0,c74b0480,c74ae2a4,...) at nfssvc_nfsserver+0x21c nfssvc(c74b0480,e9951cf8,8,c0c422a8,c0d1eb28,...) at nfssvc+0x77 syscall(e9951d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280d9b6b, esp = 0xbfbfe87c, ebp = 0xbfbfeae8 --- Tracing command nfsd pid 909 tid 100133 td 0xc77a5000 sched_switch(c77a5000,0,104,18c,73f90380,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c77a5000,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c77e8a50,0,c0c39b13,c77a5000,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c77e8a64,0,e9a21a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c77e8a64,c77e8a50,c0c418d8,5c4,c7420070,...) at _cv_wait_sig+0x240 seltdwait(c7420070,58,c6d42300,c77a5000,c0a924be,...) at seltdwait+0xa2 kern_select(c77a5000,5,bfbfecf0,0,0,0,c77a5000,e9a21c98) at kern_select+0x4c4 select(c77a5000,e9a21cf8,14,e9a21d38,c0d1e558,...) at select+0x5e syscall(e9a21d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28178eb3, esp = 0xbfbfeaec, ebp = 0xbfbfee28 --- Tracing command mountd pid 907 tid 100112 td 0xc7418d80 sched_switch(c7418d80,0,104,18c,6e95fcac,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7418d80,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c796d410,0,c0c39b13,c7418d80,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c796d424,0,e99b2a80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c796d424,c796d410,c0c418d8,5c4,c74208c0,...) at _cv_wait_sig+0x240 seltdwait(c74208c0,58,c6d42300,c7418d80,c7418e24,...) at seltdwait+0xa2 kern_select(c7418d80,9,bfbfed8c,0,0,0,66,2819f9c0) at kern_select+0x4c4 select(c7418d80,e99b2cf8,14,c0c5b7fd,c0d1e558,...) at select+0x5e syscall(e99b2d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2818ceb3, esp = 0xbfbfed5c, ebp = 0xbfbfee28 --- Tracing command rpcbind pid 824 tid 100083 td 0xc74b1480 sched_switch(c74b1480,0,104,18c,255568be,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c74b1480,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9925aa8,c0854e9a,c7989410,0,c74b1480,...) at sleepq_catch_signals+0xb6 sleepq_timedwait_sig(c7989424,0,e9925ad8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7989424,c7989410,7531,5c4,e9925b8c,...) at _cv_timedwait_sig+0x250 seltdwait(e9925c5c,e9925c64,4d4,c74b1480,e9925b5c,...) at seltdwait+0x8a poll(c74b1480,e9925cf8,c,c0c41fd2,c0d1f038,...) at poll+0x2f9 syscall(e9925d38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (209, FreeBSD ELF32, poll), eip = 0x2813a1af, esp = 0xbfbfcc0c, ebp = 0xbfbfedd8 --- Tracing command syslogd pid 794 tid 100109 td 0xc741c900 sched_switch(c741c900,0,104,18c,971f018a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c741c900,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c72619d0,0,c0c39b13,c741c900,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c72619e4,0,e998ba80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72619e4,c72619d0,c0c418d8,5c4,c7421310,...) at _cv_wait_sig+0x240 seltdwait(c7421310,58,c6d42300,c741c900,3,...) at seltdwait+0xa2 kern_select(c741c900,9,282290ac,0,0,0,66,0) at kern_select+0x4c4 select(c741c900,e998bcf8,14,c0bd601f,c0d1e558,...) at select+0x5e syscall(e998bd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2818beb3, esp = 0xbfbfde7c, ebp = 0xbfbfee28 --- Tracing command devd pid 599 tid 100089 td 0xc74b0d80 sched_switch(c74b0d80,0,104,18c,b9d697b1,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c74b0d80,0,c0c3f610,189,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0854e9a,c7458b90,0,c0c39b13,c74b0d80,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c7458ba4,0,e993da80,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7458ba4,c7458b90,c0c418d8,5c4,c74bd428,...) at _cv_wait_sig+0x240 seltdwait(c74bd428,58,c6d42300,c74b0d80,3,...) at seltdwait+0xa2 kern_select(c74b0d80,6,bfbfe9b0,0,0,0,66,10) at kern_select+0x4c4 select(c74b0d80,e993dcf8,14,c0bd601f,c0d1e558,...) at select+0x5e syscall(e993dd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x8088b73, esp = 0xbfbfe97c, ebp = 0xbfbfee58 --- Tracing command flowcleaner pid 44 tid 100075 td 0xc732a480 sched_switch(c732a480,0,100,187,99acb91e,...) at sched_switch+0x437 mi_switch(100,0,c0c3cef2,989,1,...) at mi_switch+0x200 sched_bind(c732a480,2,c0c4a009,416,0,...) at sched_bind+0x8a flowtable_cleaner(0,e7715d38,c0c36b2a,335,c7327d34,...) at flowtable_cleaner+0x8f fork_exit(c09056d0,0,e7715d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7715d70, ebp = 0 --- Tracing command softdepflush pid 43 tid 100074 td 0xc732a6c0 sched_switch(c732a6c0,0,104,18c,8cf2657f,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,44,...) at mi_switch+0x200 sleepq_switch(c732a6c0,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0f01ca0,44,c0c5fc22,0,0,...) at sleepq_timedwait+0x6b _sleep(c0f01ca0,c0f01c44,44,c0c5fc22,3e8,...) at _sleep+0x329 softdep_flush(0,e7712d38,c0c36b2a,335,c7340000,...) at softdep_flush+0x2b0 fork_exit(c0a6f310,0,e7712d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7712d70, ebp = 0 --- Tracing command vnlru pid 42 tid 100073 td 0xc732a900 sched_switch(c732a900,0,104,18c,a7f012a9,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,50,...) at mi_switch+0x200 sleepq_switch(c732a900,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c73402a4,50,c0c492c5,0,0,...) at sleepq_timedwait+0x6b _sleep(c73402a4,c0ef6494,250,c0c492c5,3e8,...) at _sleep+0x329 vnlru_proc(0,e770fd38,c0c36b2a,335,c73402a4,...) at vnlru_proc+0xe7 fork_exit(c08f12b0,0,e770fd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe770fd70, ebp = 0 --- Tracing command syncer pid 41 tid 100072 td 0xc732ab40 sched_switch(c732ab40,0,104,18c,8538687c,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732ab40,0,c0c3f610,26a,c732ab40,...) at sleepq_switch+0x15f sleepq_timedwait(c0ef64d4,0,e770cc88,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c0ef64d4,c0ef64c0,3e8,6d6,4e20,...) at _cv_timedwait+0x250 sched_sync(0,e770cd38,c0c36b2a,335,c7340548,...) at sched_sync+0x502 fork_exit(c08f0720,0,e770cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe770cd70, ebp = 0 --- Tracing command bufdaemon pid 40 tid 100071 td 0xc732ad80 sched_switch(c732ad80,0,104,18c,88398534,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,44,...) at mi_switch+0x200 sleepq_switch(c732ad80,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0ef6208,44,c0c46a58,0,0,...) at sleepq_timedwait+0x6b _sleep(c0ef6208,c0ef620c,44,c0c46a58,3e8,...) at _sleep+0x329 buf_daemon(0,e7709d38,c0c36b2a,335,c73407ec,...) at buf_daemon+0x138 fork_exit(c08d97e0,0,e7709d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7709d70, ebp = 0 --- Tracing command pagezero pid 39 tid 100070 td 0xc732c000 sched_switch(c732c000,0,104,18c,8188323d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732c000,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0f028d4,0,c0c64e19,0,0,...) at sleepq_timedwait+0x6b _sleep(c0f028d4,c0f02490,0,c0c64e19,493e0,...) at _sleep+0x329 vm_pagezero(0,e7706d38,c0c36b2a,335,c7340a90,...) at vm_pagezero+0xdc fork_exit(c0aaa6f0,0,e7706d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7706d70, ebp = 0 --- Tracing command vmdaemon pid 38 tid 100069 td 0xc732c240 sched_switch(c732c240,0,104,18c,df926eb6,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,68,...) at mi_switch+0x200 sleepq_switch(c732c240,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c0f024fc,68,c0c46a58,0,0,...) at sleepq_wait+0x63 _sleep(c0f024fc,c0f02500,68,c0c46a58,0,...) at _sleep+0x35b vm_daemon(0,e7703d38,c0c36b2a,335,c7340d34,...) at vm_daemon+0x59 fork_exit(c0aa4b90,0,e7703d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7703d70, ebp = 0 --- Tracing command pagedaemon pid 9 tid 100068 td 0xc732c480 sched_switch(c732c480,0,104,18c,b55fd172,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,44,...) at mi_switch+0x200 sleepq_switch(c732c480,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0f024c4,44,c0c46a58,0,0,...) at sleepq_timedwait+0x6b _sleep(c0f024c4,c0f02490,44,c0c46a58,1388,...) at _sleep+0x329 vm_pageout(0,e7700d38,c0c36b2a,335,c7341000,...) at vm_pageout+0x2bb fork_exit(c0aa5a30,0,e7700d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7700d70, ebp = 0 --- Tracing command usbus5 pid 37 tid 100067 td 0xc732c6c0 sched_switch(c732c6c0,0,104,18c,14130b1a,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732c6c0,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fddd0c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fddd0c,c6fdddac,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e769dcf8,c079c7db,c6fddd0c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fddd0c,c6fdddac,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fddd04,e769dd38,c0c36b2a,335,c73412a4,...) at usb2_process+0x18b fork_exit(c079c650,c6fddd04,e769dd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe769dd70, ebp = 0 --- Tracing command usbus5 pid 36 tid 100066 td 0xc732c900 sched_switch(c732c900,0,104,18c,c39d372e,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732c900,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fddcdc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fddcdc,c6fdddac,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e769acf8,c079c7db,c6fddcdc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fddcdc,c6fdddac,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fddcd4,e769ad38,c0c36b2a,335,c7341548,...) at usb2_process+0x18b fork_exit(c079c650,c6fddcd4,e769ad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe769ad70, ebp = 0 --- Tracing command usbus5 pid 35 tid 100065 td 0xc732cb40 sched_switch(c732cb40,0,104,18c,13ad0adb,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732cb40,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fddcac,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fddcac,c6fdddac,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7697cf8,c079c7db,c6fddcac,...) at usb2_msleep+0x58 usb2_cv_wait(c6fddcac,c6fdddac,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fddca4,e7697d38,c0c36b2a,335,c7326000,...) at usb2_process+0x18b fork_exit(c079c650,c6fddca4,e7697d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7697d70, ebp = 0 --- Tracing command usbus5 pid 34 tid 100064 td 0xc732cd80 sched_switch(c732cd80,0,104,18c,13acfb51,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c732cd80,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fddc7c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fddc7c,c6fdddac,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7694cf8,c079c7db,c6fddc7c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fddc7c,c6fdddac,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fddc74,e7694d38,c0c36b2a,335,c73262a4,...) at usb2_process+0x18b fork_exit(c079c650,c6fddc74,e7694d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7694d70, ebp = 0 --- Tracing command usbus4 pid 33 tid 100063 td 0xc70ea240 sched_switch(c70ea240,0,104,18c,13acebe4,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70ea240,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fd7b5c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fd7b5c,c6fd7bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7691cf8,c079c7db,c6fd7b5c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fd7b5c,c6fd7bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fd7b54,e7691d38,c0c36b2a,335,c7326548,...) at usb2_process+0x18b fork_exit(c079c650,c6fd7b54,e7691d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7691d70, ebp = 0 --- Tracing command usbus4 pid 32 tid 100062 td 0xc70ea480 sched_switch(c70ea480,0,104,18c,ba469635,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70ea480,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fd7b2c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fd7b2c,c6fd7bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e768ecf8,c079c7db,c6fd7b2c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fd7b2c,c6fd7bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fd7b24,e768ed38,c0c36b2a,335,c73267ec,...) at usb2_process+0x18b fork_exit(c079c650,c6fd7b24,e768ed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe768ed70, ebp = 0 --- Tracing command usbus4 pid 31 tid 100061 td 0xc70ea6c0 sched_switch(c70ea6c0,0,104,18c,1348946c,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70ea6c0,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fd7afc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fd7afc,c6fd7bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e768bcf8,c079c7db,c6fd7afc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fd7afc,c6fd7bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fd7af4,e768bd38,c0c36b2a,335,c7326a90,...) at usb2_process+0x18b fork_exit(c079c650,c6fd7af4,e768bd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe768bd70, ebp = 0 --- Tracing command usbus4 pid 30 tid 100060 td 0xc70ea900 sched_switch(c70ea900,0,104,18c,13488539,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70ea900,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fd7acc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fd7acc,c6fd7bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7688cf8,c079c7db,c6fd7acc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fd7acc,c6fd7bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fd7ac4,e7688d38,c0c36b2a,335,c7326d34,...) at usb2_process+0x18b fork_exit(c079c650,c6fd7ac4,e7688d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7688d70, ebp = 0 --- Tracing command usbus3 pid 29 tid 100059 td 0xc70eab40 sched_switch(c70eab40,0,104,18c,134876c3,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70eab40,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fceb5c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fceb5c,c6fcebfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7685cf8,c079c7db,c6fceb5c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fceb5c,c6fcebfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fceb54,e7685d38,c0c36b2a,335,c7327000,...) at usb2_process+0x18b fork_exit(c079c650,c6fceb54,e7685d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7685d70, ebp = 0 --- Tracing command usbus3 pid 28 tid 100058 td 0xc70ead80 sched_switch(c70ead80,0,104,18c,b5570fcf,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70ead80,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fceb2c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fceb2c,c6fcebfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7682cf8,c079c7db,c6fceb2c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fceb2c,c6fcebfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fceb24,e7682d38,c0c36b2a,335,c73272a4,...) at usb2_process+0x18b fork_exit(c079c650,c6fceb24,e7682d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7682d70, ebp = 0 --- Tracing command usbus3 pid 27 tid 100057 td 0xc7324000 sched_switch(c7324000,0,104,18c,12e55d49,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7324000,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fceafc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fceafc,c6fcebfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e767fcf8,c079c7db,c6fceafc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fceafc,c6fcebfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fceaf4,e767fd38,c0c36b2a,335,c7327548,...) at usb2_process+0x18b fork_exit(c079c650,c6fceaf4,e767fd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe767fd70, ebp = 0 --- Tracing command usbus3 pid 26 tid 100056 td 0xc7324240 sched_switch(c7324240,0,104,18c,12e54dff,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7324240,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fceacc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fceacc,c6fcebfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e767ccf8,c079c7db,c6fceacc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fceacc,c6fcebfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fceac4,e767cd38,c0c36b2a,335,c73277ec,...) at usb2_process+0x18b fork_exit(c079c650,c6fceac4,e767cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe767cd70, ebp = 0 --- Tracing command usbus2 pid 25 tid 100055 td 0xc7324480 sched_switch(c7324480,0,104,18c,12e53eb2,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7324480,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fcab5c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fcab5c,c6fcabfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7679cf8,c079c7db,c6fcab5c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fcab5c,c6fcabfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fcab54,e7679d38,c0c36b2a,335,c6e9c7ec,...) at usb2_process+0x18b fork_exit(c079c650,c6fcab54,e7679d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7679d70, ebp = 0 --- Tracing command usbus2 pid 24 tid 100054 td 0xc73246c0 sched_switch(c73246c0,0,104,18c,b2df5466,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c73246c0,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fcab2c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fcab2c,c6fcabfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7676cf8,c079c7db,c6fcab2c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fcab2c,c6fcabfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fcab24,e7676d38,c0c36b2a,335,c6e9ca90,...) at usb2_process+0x18b fork_exit(c079c650,c6fcab24,e7676d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7676d70, ebp = 0 --- Tracing command usbus2 pid 23 tid 100053 td 0xc7324900 sched_switch(c7324900,0,104,18c,1281fcdc,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7324900,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fcaafc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fcaafc,c6fcabfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7673cf8,c079c7db,c6fcaafc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fcaafc,c6fcabfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fcaaf4,e7673d38,c0c36b2a,335,c6e9cd34,...) at usb2_process+0x18b fork_exit(c079c650,c6fcaaf4,e7673d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7673d70, ebp = 0 --- Tracing command usbus2 pid 22 tid 100052 td 0xc7324b40 sched_switch(c7324b40,0,104,18c,1281ecc2,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7324b40,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fcaacc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fcaacc,c6fcabfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7670cf8,c079c7db,c6fcaacc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fcaacc,c6fcabfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fcaac4,e7670d38,c0c36b2a,335,c7312000,...) at usb2_process+0x18b fork_exit(c079c650,c6fcaac4,e7670d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7670d70, ebp = 0 --- Tracing command usbus1 pid 21 tid 100051 td 0xc7324d80 sched_switch(c7324d80,0,104,18c,1281dbee,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c7324d80,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fc4b5c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fc4b5c,c6fc4bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e766dcf8,c079c7db,c6fc4b5c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fc4b5c,c6fc4bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fc4b54,e766dd38,c0c36b2a,335,c73122a4,...) at usb2_process+0x18b fork_exit(c079c650,c6fc4b54,e766dd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe766dd70, ebp = 0 --- Tracing command usbus1 pid 20 tid 100050 td 0xc6f646c0 sched_switch(c6f646c0,0,104,18c,af399082,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6f646c0,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fc4b2c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fc4b2c,c6fc4bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e766acf8,c079c7db,c6fc4b2c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fc4b2c,c6fc4bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fc4b24,e766ad38,c0c36b2a,335,c7312548,...) at usb2_process+0x18b fork_exit(c079c650,c6fc4b24,e766ad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe766ad70, ebp = 0 --- Tracing command usbus1 pid 19 tid 100049 td 0xc6f64900 sched_switch(c6f64900,0,104,18c,12180898,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6f64900,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fc4afc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fc4afc,c6fc4bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7667cf8,c079c7db,c6fc4afc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fc4afc,c6fc4bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fc4af4,e7667d38,c0c36b2a,335,c73127ec,...) at usb2_process+0x18b fork_exit(c079c650,c6fc4af4,e7667d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7667d70, ebp = 0 --- Tracing command usbus1 pid 18 tid 100048 td 0xc6f64b40 sched_switch(c6f64b40,0,104,18c,14806b5d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6f64b40,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fc4acc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fc4acc,c6fc4bfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7664cf8,c079c7db,c6fc4acc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fc4acc,c6fc4bfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fc4ac4,e7664d38,c0c36b2a,335,c7312a90,...) at usb2_process+0x18b fork_exit(c079c650,c6fc4ac4,e7664d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7664d70, ebp = 0 --- Tracing command usbus0 pid 17 tid 100047 td 0xc6f64d80 sched_switch(c6f64d80,0,104,18c,14805a59,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6f64d80,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fbfb5c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fbfb5c,c6fbfbfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7661cf8,c079c7db,c6fbfb5c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fbfb5c,c6fbfbfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fbfb54,e7661d38,c0c36b2a,335,c7312d34,...) at usb2_process+0x18b fork_exit(c079c650,c6fbfb54,e7661d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7661d70, ebp = 0 --- Tracing command usbus0 pid 16 tid 100046 td 0xc70e9000 sched_switch(c70e9000,0,104,18c,bf3c9ce0,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70e9000,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fbfb2c,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fbfb2c,c6fbfbfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e765ecf8,c079c7db,c6fbfb2c,...) at usb2_msleep+0x58 usb2_cv_wait(c6fbfb2c,c6fbfbfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fbfb24,e765ed38,c0c36b2a,335,c6d762a4,...) at usb2_process+0x18b fork_exit(c079c650,c6fbfb24,e765ed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe765ed70, ebp = 0 --- Tracing command usbus0 pid 15 tid 100045 td 0xc70e9240 sched_switch(c70e9240,0,104,18c,141d3a3d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70e9240,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fbfafc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fbfafc,c6fbfbfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e765bcf8,c079c7db,c6fbfafc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fbfafc,c6fbfbfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fbfaf4,e765bd38,c0c36b2a,335,c6d76548,...) at usb2_process+0x18b fork_exit(c079c650,c6fbfaf4,e765bd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe765bd70, ebp = 0 --- Tracing command usbus0 pid 14 tid 100044 td 0xc70e9480 sched_switch(c70e9480,0,104,18c,141d2a26,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70e9480,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6fbfacc,0,c0c2a61e,0,0,...) at sleepq_wait+0x63 _sleep(c6fbfacc,c6fbfbfc,0,c0c2a61e,0,...) at _sleep+0x35b usb2_msleep(c0c2a61e,0,e7658cf8,c079c7db,c6fbfacc,...) at usb2_msleep+0x58 usb2_cv_wait(c6fbfacc,c6fbfbfc,c0c2a57d,51,c0d8db80,...) at usb2_cv_wait+0x23 usb2_process(c6fbfac4,e7658d38,c0c36b2a,335,c6d767ec,...) at usb2_process+0x18b fork_exit(c079c650,c6fbfac4,e7658d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7658d70, ebp = 0 --- Tracing command sctp_iterator pid 8 tid 100043 td 0xc70e96c0 sched_switch(c70e96c0,0,104,18c,6f1506ce,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c70e96c0,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c0ef83bc,0,c0c53179,0,0,...) at sleepq_wait+0x63 _sleep(c0ef83bc,c0ef82d0,0,c0c53179,0,...) at _sleep+0x35b sctp_iterator_thread(0,e7655d38,c0c36b2a,335,c6d76a90,...) at sctp_iterator_thread+0x60 fork_exit(c096c840,0,e7655d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7655d70, ebp = 0 --- Tracing command fdc0 pid 7 tid 100040 td 0xc70e9d80 sched_switch(c70e9d80,0,104,18c,474f4da5,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,4c,...) at mi_switch+0x200 sleepq_switch(c70e9d80,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c6fcd43c,4c,c0c313a9,0,0,...) at sleepq_timedwait+0x6b _sleep(c6fcd43c,c6fcd4f0,4c,c0c313a9,3e8,...) at _sleep+0x329 fdc_thread(c6fcd400,e7649d38,c0c36b2a,335,c6d76d34,...) at fdc_thread+0x2be fork_exit(c0b27c60,c6fcd400,e7649d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7649d70, ebp = 0 --- Tracing command fw0_probe pid 6 tid 100038 td 0xc6f4dd80 sched_switch(c6f4dd80,0,104,18c,3a207fcc,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c6f4dd80,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6ffc000,5c,c0c313a9,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6ffc000,c7000488,15c,c0c313a9,0,...) at _sleep+0x344 fw_bus_probe_thread(c6ffc000,e7639d38,c0c36b2a,335,c6e9c000,...) at fw_bus_probe_thread+0xa08 fork_exit(c063d3e0,c6ffc000,e7639d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7639d70, ebp = 0 --- Tracing command xpt_thrd pid 5 tid 100018 td 0xc6f4db40 sched_switch(c6f4db40,0,104,18c,14181193,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,4c,...) at mi_switch+0x200 sleepq_switch(c6f4db40,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c0d56a54,4c,c0bd1cf8,0,0,...) at sleepq_wait+0x63 _sleep(c0d56a54,c0d56a6c,4c,c0bd1cf8,0,...) at _sleep+0x35b xpt_scanner_thread(0,c6ac1d38,c0c36b2a,335,c6e9c2a4,...) at xpt_scanner_thread+0x41 fork_exit(c047c1c0,0,c6ac1d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ac1d70, ebp = 0 --- Tracing command yarrow pid 13 tid 100017 td 0xc6d79240 sched_switch(c6d79240,0,104,18c,a568d0d1,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6d79240,0,c0c3f610,26a,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0d89a64,0,c0c313a9,2,0,...) at sleepq_timedwait+0x6b _sleep(c0d89a64,0,0,c0c313a9,64,...) at _sleep+0x329 pause(c0c313a9,64,c0c17de9,111,0,...) at pause+0x47 random_kthread(0,c6abed38,c0c36b2a,335,c6e9c548,...) at random_kthread+0x1ef fork_exit(c07155f0,0,c6abed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6abed70, ebp = 0 --- Tracing command g_down pid 4 tid 100015 td 0xc6d796c0 sched_switch(c6d796c0,0,104,18c,a7a9a7e0,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,4c,...) at mi_switch+0x200 sleepq_switch(c6d796c0,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0d877e4,4c,c0c313a9,0,0,...) at sleepq_timedwait+0x6b _sleep(c0d877e4,c0d87748,24c,c0c313a9,64,...) at _sleep+0x329 g_io_schedule_down(c6d796c0,0,c0c32a71,74,0,...) at g_io_schedule_down+0x6b g_down_procbody(0,c6ab8d38,c0c36b2a,335,c6d75000,...) at g_down_procbody+0x8d fork_exit(c08032a0,0,c6ab8d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ab8d70, ebp = 0 --- Tracing command g_up pid 3 tid 100014 td 0xc6d79900 sched_switch(c6d79900,0,104,18c,a7c5195c,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,4c,...) at mi_switch+0x200 sleepq_switch(c6d79900,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0d877e0,4c,c0c313a9,0,0,...) at sleepq_timedwait+0x6b _sleep(c0d877e0,c0d87768,24c,c0c313a9,64,...) at _sleep+0x329 g_io_schedule_up(c6d79900,0,c0c32a71,5d,0,...) at g_io_schedule_up+0x133 g_up_procbody(0,c6ab5d38,c0c36b2a,335,c6d752a4,...) at g_up_procbody+0x8d fork_exit(c0803330,0,c6ab5d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ab5d70, ebp = 0 --- Tracing command g_event pid 2 tid 100013 td 0xc6d79b40 sched_switch(c6d79b40,0,104,18c,a584521b,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,4c,...) at mi_switch+0x200 sleepq_switch(c6d79b40,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0d877d8,4c,c0c313a9,0,0,...) at sleepq_timedwait+0x6b _sleep(c0d877d8,0,4c,c0c313a9,64,...) at _sleep+0x329 g_event_procbody(0,c6ab2d38,c0c36b2a,335,c6d75548,...) at g_event_procbody+0xcb fork_exit(c08033c0,0,c6ab2d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ab2d70, ebp = 0 --- Tracing command intr pid 12 tid 100042 td 0xc70e9900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc70e9b40 sched_switch(c70e9b40,0,109,18c,14132ff0,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6d73170,...) at mi_switch+0x200 ithread_loop(c70eb330,e764cd38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c70eb330,e764cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe764cd70, ebp = 0 --- Tracing command intr pid 12 tid 100039 td 0xc70ea000 sched_switch(c70ea000,0,109,18c,7ab93a67,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6ff7770,...) at mi_switch+0x200 ithread_loop(c70df760,e763cd38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c70df760,e763cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe763cd70, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc6f62240 sched_switch(c6f62240,0,109,18c,11a55f25,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbc1f0,...) at mi_switch+0x200 ithread_loop(c6ff8910,e7630d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6ff8910,e7630d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7630d70, ebp = 0 --- Tracing command intr pid 12 tid 100035 td 0xc6f62480 sched_switch(c6f62480,0,109,18c,1ee23dff,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbc4f0,...) at mi_switch+0x200 ithread_loop(c6ff8180,e7628d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6ff8180,e7628d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7628d70, ebp = 0 --- Tracing command intr pid 12 tid 100034 td 0xc6f626c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xc6f62900 sched_switch(c6f62900,0,109,18c,41fe6397,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbc2f0,...) at mi_switch+0x200 ithread_loop(c6fa5440,e7616d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6fa5440,e7616d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7616d70, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xc6f62b40 sched_switch(c6f62b40,0,109,18c,417a8d61,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbc370,...) at mi_switch+0x200 ithread_loop(c6fa5680,e7612d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6fa5680,e7612d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7612d70, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc6f62d80 sched_switch(c6f62d80,0,109,18c,6b8651a4,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbc3f0,...) at mi_switch+0x200 ithread_loop(c6fa5170,e760ed38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6fa5170,e760ed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe760ed70, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc6f64000 sched_switch(c6f64000,0,109,18c,ae80520d,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbc0f0,...) at mi_switch+0x200 ithread_loop(c6f8f460,e72ebd38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6f8f460,e72ebd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe72ebd70, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc6f64240 sched_switch(c6f64240,0,109,18c,2dca655d,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6f78670,...) at mi_switch+0x200 ithread_loop(c6f89630,c6b12d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6f89630,c6b12d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b12d70, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc6f64480 sched_switch(c6f64480,0,109,18c,1414231d,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6d72c70,...) at mi_switch+0x200 ithread_loop(c6f4c400,c6b05d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6f4c400,c6b05d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b05d70, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc6f4d000 sched_switch(c6f4d000,0,109,18c,468bd7a3,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6f4b570,...) at mi_switch+0x200 ithread_loop(c6f4a8b0,c6ad0d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6f4a8b0,c6ad0d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ad0d70, ebp = 0 --- Tracing command intr pid 12 tid 100022 td 0xc6f4d240 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xc6f4d6c0 sched_switch(c6f4d6c0,0,109,18c,565dcbad,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6f4b670,...) at mi_switch+0x200 ithread_loop(c6f4a8e0,c6ac7d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6f4a8e0,c6ac7d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ac7d70, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc6f4d900 sched_switch(c6f4d900,0,109,18c,3c4c4433,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6f4b6f0,...) at mi_switch+0x200 ithread_loop(c6f4a8f0,c6ac4d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6f4a8f0,c6ac4d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ac4d70, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc6d79d80 sched_switch(c6d79d80,0,109,18c,b94d5a03,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbbc70,...) at mi_switch+0x200 ithread_loop(c6d741d0,c6aafd38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6d741d0,c6aafd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6aafd70, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc6dbd000 sched_switch(c6dbd000,0,109,18c,33d68bc,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbbcf0,...) at mi_switch+0x200 ithread_loop(c6d741e0,c6aacd38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6d741e0,c6aacd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6aacd70, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc6dbd240 sched_switch(c6dbd240,0,109,18c,a7c51b16,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbbd70,...) at mi_switch+0x200 ithread_loop(c6d741f0,c6aa9d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6d741f0,c6aa9d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6aa9d70, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc6dbd480 sched_switch(c6dbd480,0,109,18c,ad8459c4,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbbdf0,...) at mi_switch+0x200 ithread_loop(c6d74200,c6aa6d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6d74200,c6aa6d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6aa6d70, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc6d77000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc6d77240 sched_switch(c6d77240,0,109,18c,48f9d46a,...) at sched_switch+0x437 mi_switch(109,0,c0c36da9,4e3,c6dbbef0,...) at mi_switch+0x200 ithread_loop(c6d74220,c6aa0d38,c0c36b2a,335,c6d757ec,...) at ithread_loop+0x1f6 fork_exit(c083e430,c6d74220,c6aa0d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6aa0d70, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc6d77480 cpustop_handler(1,c6a9cc24,c0b6ee5d,c0870868,adc4ddc1,...) at cpustop_handler+0x32 ipi_nmi_handler(c0870868,adc4ddc1,7ffef056,369e99,c6d75a90,...) at ipi_nmi_handler+0x2f trap(c6a9cc30) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0b46705, esp = 0xc6a9cc70, ebp = 0xc6a9cc70 --- acpi_cpu_c1(0,ffffffff,c6a9ccd8,0,c0886431,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(c6a9ccb4,c0b5d67b,1,c6a9ccf8,c08866fe,...) at acpi_cpu_idle+0x11c cpu_idle_acpi(1,c6a9ccf8,c08866fe,1,c6a9ccd8,...) at cpu_idle_acpi+0x1b cpu_idle(1,c6a9ccd8,c0c3cef2,3af,c6d77480,...) at cpu_idle+0x1b sched_idletd(0,c6a9cd38,c0c36b2a,335,c6d75a90,...) at sched_idletd+0x21e fork_exit(c08864e0,0,c6a9cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6a9cd70, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc6d776c0 kdb_enter(c0bdf57f,c0c1e881,c6a99bd8,c6ff0a80,0,...) at kdb_enter+0x3a uart_intr(c6ff0a00,c6d776c0,c6d5bcd0,c6d72e80,4,...) at uart_intr+0x11c intr_event_handle(c6d72e80,c6a99c30,c0f115cc,1f4,c70f7a00,...) at intr_event_handle+0x5c intr_execute_handlers(c6d5bcd0,c6a99c30,1,c6a99c70,c0b52114,...) at intr_execute_handlers+0x49 lapic_handle_intr(30,c6a99c30) at lapic_handle_intr+0x4c Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0xc0b46705, esp = 0xc6a99c70, ebp = 0xc6a99c70 --- acpi_cpu_c1(0,ffffffff,c6a99cd8,1,c0886431,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(c6a99cb4,c0b5d67b,0,c6a99cf8,c08866fe,...) at acpi_cpu_idle+0x11c cpu_idle_acpi(0,c6a99cf8,c08866fe,0,c6a99cd8,...) at cpu_idle_acpi+0x1b cpu_idle(0,c6a99cd8,c0c3cef2,3af,c6d776c0,...) at cpu_idle+0x1b sched_idletd(0,c6a99d38,c0c36b2a,335,c6d75a90,...) at sched_idletd+0x21e fork_exit(c08864e0,0,c6a99d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6a99d70, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc6d77900 sched_switch(c6d77900,0,108,187,49643609,...) at sched_switch+0x437 mi_switch(108,0,c0c3cef2,3ad,c6d77900,...) at mi_switch+0x200 sched_idletd(0,c6a96d38,c0c36b2a,335,c6d75a90,...) at sched_idletd+0x16c fork_exit(c08864e0,0,c6a96d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6a96d70, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc6d77b40 cpustop_handler(8,c6a93c24,c0b6ee5d,c6a93bb4,c0854b04,...) at cpustop_handler+0x32 ipi_nmi_handler(c6a93bb4,c0854b04,c0d89ce8,4,c6d75a90,...) at ipi_nmi_handler+0x2f trap(c6a93c30) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0b46705, esp = 0xc6a93c70, ebp = 0xc6a93c70 --- acpi_cpu_c1(0,ffffffff,c6a93cd8,3,c0886431,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(c6a93cb4,c0b5d67b,0,c6a93cf8,c08866fe,...) at acpi_cpu_idle+0x11c cpu_idle_acpi(0,c6a93cf8,c08866fe,0,c6a93cd8,...) at cpu_idle_acpi+0x1b cpu_idle(0,c6a93cd8,c0c3cef2,3af,c6d77b40,...) at cpu_idle+0x1b sched_idletd(0,c6a93d38,c0c36b2a,335,c6d75a90,...) at sched_idletd+0x21e fork_exit(c08864e0,0,c6a93d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6a93d70, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc6d77d80 sched_switch(c6d77d80,0,104,18c,baa5fa81,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,5c,...) at mi_switch+0x200 sleepq_switch(c6d77d80,0,c0c3f610,189,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0c3f610,159,0,100,100,...) at sleepq_catch_signals+0xb6 sleepq_wait_sig(c6d75d34,5c,c0c41e8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6d75d34,c6d75dbc,15c,c0c41e8e,0,...) at _sleep+0x344 kern_wait(c6d77d80,ffffffff,c6a8fc74,0,0,...) at kern_wait+0xac6 wait4(c6d77d80,c6a8fcf8,10,c0c41ca9,c0d1dd48,...) at wait4+0x3b syscall(c6a8fd38) at syscall+0x2b4 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054c5f, esp = 0xbfbfe90c, ebp = 0xbfbfe928 --- Tracing command audit pid 10 tid 100001 td 0xc6d79000 sched_switch(c6d79000,0,104,18c,1415b828,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6d79000,0,c0c3f610,247,c6d79000,...) at sleepq_switch+0x15f sleepq_wait(c0f01640,0,c6a8cc9c,1,0,...) at sleepq_wait+0x63 _cv_wait(c0f01640,c0f01624,c0c5db38,194,0,...) at _cv_wait+0x240 audit_worker(0,c6a8cd38,c0c36b2a,335,c6d76000,...) at audit_worker+0x84 fork_exit(c0a52a30,0,c6a8cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6a8cd70, ebp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xc6f62000 sched_switch(c6f62000,0,104,18c,a3380ce7,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6f62000,0,c0c3f610,247,c6f62000,...) at sleepq_switch+0x15f sleepq_wait(c6fd5400,0,c0c3be6e,c0c313a9,0,...) at sleepq_wait+0x63 msleep_spin(c6fd5400,c6fd541c,c0c313a9,0,c0c39b13,...) at msleep_spin+0x21d taskqueue_thread_loop(c700049c,e7636d38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0x8e fork_exit(c089cc20,c700049c,e7636d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7636d70, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc6dbd6c0 sched_switch(c6dbd6c0,0,104,18c,148bda93,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6dbd6c0,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6f27e00,0,c0c313a9,0,0,...) at sleepq_wait+0x63 _sleep(c6f27e00,c6f27e1c,0,c0c313a9,0,...) at _sleep+0x35b taskqueue_thread_loop(c0d88164,c6adcd38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0xb4 fork_exit(c089cc20,c0d88164,c6adcd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6adcd70, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc6dbd900 sched_switch(c6dbd900,0,104,18c,148bc973,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6dbd900,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6f27e40,0,c0c313a9,0,0,...) at sleepq_wait+0x63 _sleep(c6f27e40,c6f27e5c,0,c0c313a9,0,...) at _sleep+0x35b taskqueue_thread_loop(c0d59704,c6ad9d38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0xb4 fork_exit(c089cc20,c0d59704,c6ad9d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ad9d70, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc6dbdb40 sched_switch(c6dbdb40,0,104,18c,148bb88d,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6dbdb40,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6f27e40,0,c0c313a9,0,0,...) at sleepq_wait+0x63 _sleep(c6f27e40,c6f27e5c,0,c0c313a9,0,...) at _sleep+0x35b taskqueue_thread_loop(c0d59704,c6ad6d38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0xb4 fork_exit(c089cc20,c0d59704,c6ad6d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ad6d70, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc6dbdd80 sched_switch(c6dbdd80,0,104,18c,148ba637,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6dbdd80,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6f27e40,0,c0c313a9,0,0,...) at sleepq_wait+0x63 _sleep(c6f27e40,c6f27e5c,0,c0c313a9,0,...) at _sleep+0x35b taskqueue_thread_loop(c0d59704,c6ad3d38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0xb4 fork_exit(c089cc20,c0d59704,c6ad3d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6ad3d70, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc6f4d480 sched_switch(c6f4d480,0,104,18c,3c4e673e,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6f4d480,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6f280c0,0,c0c313a9,0,0,...) at sleepq_wait+0x63 _sleep(c6f280c0,c6f280dc,0,c0c313a9,0,...) at _sleep+0x35b taskqueue_thread_loop(c0d9c568,c6acad38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0xb4 fork_exit(c089cc20,c0d9c568,c6acad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6acad70, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc6d79480 sched_switch(c6d79480,0,104,18c,428281c3,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,0,...) at mi_switch+0x200 sleepq_switch(c6d79480,0,c0c3f610,247,0,...) at sleepq_switch+0x15f sleepq_wait(c6d5db80,0,c0c313a9,0,0,...) at sleepq_wait+0x63 _sleep(c6d5db80,c6d5db9c,0,c0c313a9,0,...) at _sleep+0x35b taskqueue_thread_loop(c0d9b0a0,c6abbd38,c0c36b2a,335,c0d878a0,...) at taskqueue_thread_loop+0xb4 fork_exit(c089cc20,c0d9b0a0,c6abbd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6abbd70, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc0d87b50 sched_switch(c0d87b50,0,104,18c,8674678f,...) at sched_switch+0x437 mi_switch(104,0,c0c3f610,1d2,44,...) at mi_switch+0x200 sleepq_switch(c0d87b50,0,c0c3f610,26a,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0d878a0,44,c0c3d767,0,0,...) at sleepq_timedwait+0x6b _sleep(c0d878a0,0,44,c0c3d767,2710,...) at _sleep+0x329 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x23e mi_startup() at mi_startup+0x96 begin() at begin+0x2c db:0:allt> call doadump Dumping 3455 MB (2 chunks) chunk 0: 1MB (159 pages) ... ok chunk 1: 3455MB (884432 pages) 3439 3423 3407 3391 3375 3359 3343 3327 3311 3295 3279 3263 3247 3231 3215 3199 3183 3167 3151 3135 3119 3103 3087 3071 3055 3039 3023 3007 2991 2975 2959 2943 2927 2911 2895 2879 2863 2847 2831 2815 2799 2783 2767 2751 2735 2719 2703 2687 2671 2655 2639 2623 2607 2591 2575 2559 2543 2527 2511 2495 2479 2463 2447 2431 2415 2399 2383 2367 2351 2335 2319 2303 2287 2271 2255 2239 2223 2207 2191 2175 2159 2143 2127 2111 2095 2079 2063 2047 2031 2015 1999 1983 1967 1951 1935 1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 1759 1743 1727 1711 1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 1519 1503 1487 1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 1279 1263 1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 1039 1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767 751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 ... ok Dump complete = 0xf db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) l *null_checkvp+0xb1 0xc7bc3831 is in null_checkvp (/var/tmp/deviant2/sys/modules/nullfs/../../fs/nullfs/null_subr.c:317). 312 if (vrefcnt(a->null_lowervp) < 1) { 313 int i; u_long *p; 314 printf("vp = %p, unref'ed lowervp\n", (void *)vp); 315 for (p = (u_long *) a, i = 0; i < 8; i++) 316 printf(" %lx", p[i]); 317 printf("\n"); 318 /* wait for debugger */ 319 while (null_checkvp_barrier) /*WAIT*/ ; 320 panic ("null with unref'ed lowervp"); 321 }; (kgdb) l *null_lock+0x41 0xc7bc4e81 is in null_lock (/var/tmp/deviant2/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:530). 525 /* 526 * If we're still active we must ask the lower layer to 527 * lock as ffs has special lock considerations in it's 528 * vop lock. 529 */ 530 if (nn != NULL && (lvp = NULLVPTOLOWERVP(vp)) != NULL) { 531 VI_LOCK_FLAGS(lvp, MTX_DUPOK); 532 VI_UNLOCK(vp); 533 /* 534 * We have to hold the vnode here to solve a potential (kgdb) git diff master..HEAD diff --git a/sys/fs/nullfs/null_vnops.c b/sys/fs/nullfs/null_vnops.c index 3434deb..52f90b1 100644 --- a/sys/fs/nullfs/null_vnops.c +++ b/sys/fs/nullfs/null_vnops.c @@ -714,6 +714,52 @@ null_vptofh(struct vop_vptofh_args *ap) return VOP_VPTOFH(lvp, ap->a_fhp); } +static int +null_vptocnp(struct vop_vptocnp_args *ap) +{ + struct vnode *vp = ap->a_vp; + struct vnode **dvp = ap->a_vpp; + struct vnode *lvp, *ldvp; + int error, locked; + + if (vp->v_type == VDIR) + return (vop_stdvptocnp(ap)); + + locked = VOP_ISLOCKED(vp); + lvp = NULLVPTOLOWERVP(vp); + vhold(lvp); + VOP_UNLOCK(vp, 0); /* vp is held by vn_vptocnp_locked that called us */ + ldvp = lvp; + error = vn_vptocnp(&ldvp, ap->a_buf, ap->a_buflen); + vdrop(lvp); + if (error != 0) { + vn_lock(vp, locked | LK_RETRY); + return (ENOENT); + } + + /* + * Exclusive lock is required by insmntque1 call in + * null_nodeget() + */ + error = vn_lock(ldvp, LK_EXCLUSIVE); + if (error != 0) { + vn_lock(vp, locked | LK_RETRY); + vdrop(ldvp); + return (ENOENT); + } + vref(ldvp); + vdrop(ldvp); + error = null_nodeget(vp->v_mount, ldvp, dvp); + if (error == 0) { + vhold(*dvp); + vput(*dvp); + } else + vput(ldvp); + + vn_lock(vp, locked | LK_RETRY); + return (error); +} + /* * Global vfs data structures */ @@ -734,6 +780,6 @@ struct vop_vector null_vnodeops = { .vop_setattr = null_setattr, .vop_strategy = VOP_EOPNOTSUPP, .vop_unlock = null_unlock, - .vop_vptocnp = vop_stdvptocnp, + .vop_vptocnp = null_vptocnp, .vop_vptofh = null_vptofh, }; diff --git a/sys/fs/pseudofs/pseudofs_vnops.c b/sys/fs/pseudofs/pseudofs_vnops.c index 3f1be4c..7cd9ca4 100644 --- a/sys/fs/pseudofs/pseudofs_vnops.c +++ b/sys/fs/pseudofs/pseudofs_vnops.c @@ -827,7 +827,7 @@ pfs_readlink(struct vop_readlink_args *va) struct proc *proc = NULL; char buf[PATH_MAX]; struct sbuf sb; - int error; + int error, locked; PFS_TRACE(("%s", pn->pn_name)); pfs_assert_not_owned(pn); @@ -849,6 +849,9 @@ pfs_readlink(struct vop_readlink_args *va) _PHOLD(proc); PROC_UNLOCK(proc); } + vhold(vn); + locked = VOP_ISLOCKED(vn); + VOP_UNLOCK(vn, 0); /* sbuf_new() can't fail with a static buffer */ sbuf_new(&sb, buf, sizeof buf, 0); @@ -857,6 +860,8 @@ pfs_readlink(struct vop_readlink_args *va) if (proc != NULL) PRELE(proc); + vn_lock(vn, locked | LK_RETRY); + vdrop(vn); if (error) { sbuf_delete(&sb); diff --git a/sys/kern/vfs_cache.c b/sys/kern/vfs_cache.c index 01c5e4c..cdfb308 100644 --- a/sys/kern/vfs_cache.c +++ b/sys/kern/vfs_cache.c @@ -206,7 +206,7 @@ SYSCTL_OPAQUE(_vfs_cache, OID_AUTO, nchstats, CTLFLAG_RD | CTLFLAG_MPSAFE, static void cache_zap(struct namecache *ncp); -static int vn_vptocnp(struct vnode **vp, char **bp, char *buf, u_int *buflen); +static int vn_vptocnp_locked(struct vnode **vp, char *buf, u_int *buflen); static int vn_fullpath1(struct thread *td, struct vnode *vp, struct vnode *rdir, char *buf, char **retbuf, u_int buflen); @@ -1036,12 +1036,55 @@ vn_fullpath_global(struct thread *td, struct vnode *vn, return (error); } +int +vn_vptocnp(struct vnode **vp, char *buf, u_int *buflen) +{ + int error; + + CACHE_RLOCK(); + error = vn_vptocnp_locked(vp, buf, buflen); + if (error == 0) { + /* + * vn_vptocnp_locked() dropped hold acquired by + * VOP_VPTOCNP immediately after locking the + * cache. Since we are going to drop the cache rlock, + * re-hold the result. + */ + vhold(*vp); + CACHE_RUNLOCK(); + } + return (error); +} + static int -vn_vptocnp(struct vnode **vp, char **bp, char *buf, u_int *buflen) +vn_vptocnp_locked(struct vnode **vp, char *buf, u_int *buflen) { struct vnode *dvp; + struct namecache *ncp; int error, vfslocked; + TAILQ_FOREACH(ncp, &((*vp)->v_cache_dst), nc_dst) { + if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) + break; + } + if (ncp != NULL) { + if (*buflen < ncp->nc_nlen) { + CACHE_RUNLOCK(); + numfullpathfail4++; + error = ENOMEM; + SDT_PROBE(vfs, namecache, fullpath, return, error, + startvp, NULL, 0, 0); + return (error); + } + *buflen -= ncp->nc_nlen; + memcpy(buf + *buflen, ncp->nc_name, ncp->nc_nlen); + SDT_PROBE(vfs, namecache, fullpath, hit, ncp->nc_dvp, + ncp->nc_name, vp, 0, 0); + *vp = ncp->nc_dvp; + return (0); + } + SDT_PROBE(vfs, namecache, fullpath, miss, vp, 0, 0, 0, 0); + vhold(*vp); CACHE_RUNLOCK(); vfslocked = VFS_LOCK_GIANT((*vp)->v_mount); @@ -1052,16 +1095,21 @@ vn_vptocnp(struct vnode **vp, char **bp, char *buf, u_int *buflen) VFS_UNLOCK_GIANT(vfslocked); if (error) { numfullpathfail2++; + SDT_PROBE(vfs, namecache, fullpath, return, error, startvp, + NULL, 0, 0); return (error); } - *bp = buf + *buflen; + *vp = dvp; CACHE_RLOCK(); if ((*vp)->v_iflag & VI_DOOMED) { /* forced unmount */ CACHE_RUNLOCK(); vdrop(*vp); - return (ENOENT); + error = ENOENT; + SDT_PROBE(vfs, namecache, fullpath, return, error, startvp, + NULL, 0, 0); + return (error); } vdrop(*vp); @@ -1075,59 +1123,26 @@ static int vn_fullpath1(struct thread *td, struct vnode *vp, struct vnode *rdir, char *buf, char **retbuf, u_int buflen) { - char *bp; - int error, i, slash_prefixed; - struct namecache *ncp; + int error, slash_prefixed; #ifdef KDTRACE_HOOKS struct vnode *startvp = vp; #endif buflen--; - bp = buf + buflen; - *bp = '\0'; + buf[buflen] = '\0'; error = 0; slash_prefixed = 0; SDT_PROBE(vfs, namecache, fullpath, entry, vp, 0, 0, 0, 0); - CACHE_RLOCK(); numfullpathcalls++; + CACHE_RLOCK(); if (vp->v_type != VDIR) { - ncp = TAILQ_FIRST(&vp->v_cache_dst); - if (ncp != NULL) { - buflen -= ncp->nc_nlen; - for (i = ncp->nc_nlen - 1; i >= 0 && bp != buf; i--) - *--bp = ncp->nc_name[i]; - if (bp == buf) { - numfullpathfail4++; - CACHE_RUNLOCK(); - error = ENOMEM; - SDT_PROBE(vfs, namecache, fullpath, return, - error, startvp, NULL, 0, 0); - return (error); - } - SDT_PROBE(vfs, namecache, fullpath, hit, ncp->nc_dvp, - ncp->nc_name, vp, 0, 0); - vp = ncp->nc_dvp; - } else { - SDT_PROBE(vfs, namecache, fullpath, miss, vp, 0, 0, - 0, 0); - error = vn_vptocnp(&vp, &bp, buf, &buflen); - if (error) { - SDT_PROBE(vfs, namecache, fullpath, return, - error, startvp, NULL, 0, 0); - return (error); - } - } - if (buflen <= 0) { - numfullpathfail4++; - CACHE_RUNLOCK(); - error = ENOMEM; - SDT_PROBE(vfs, namecache, fullpath, return, error, - startvp, NULL, 0, 0); + error = vn_vptocnp_locked(&vp, buf, &buflen); + if (error) return (error); - } - *--bp = '/'; - buflen--; + if (buflen == 0) + return (ENOMEM); + buf[--buflen] = '/'; slash_prefixed = 1; } while (vp != rdir && vp != rootvnode) { @@ -1141,64 +1156,39 @@ vn_fullpath1(struct thread *td, struct vnode *vp, struct vnode *rdir, continue; } if (vp->v_type != VDIR) { - numfullpathfail1++; CACHE_RUNLOCK(); + numfullpathfail1++; error = ENOTDIR; break; } - TAILQ_FOREACH(ncp, &vp->v_cache_dst, nc_dst) - if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) - break; - if (ncp != NULL) { - buflen -= ncp->nc_nlen; - for (i = ncp->nc_nlen - 1; i >= 0 && bp != buf; i--) - *--bp = ncp->nc_name[i]; - if (bp == buf) { - numfullpathfail4++; - CACHE_RUNLOCK(); - error = ENOMEM; - break; - } - SDT_PROBE(vfs, namecache, fullpath, hit, ncp->nc_dvp, - ncp->nc_name, vp, 0, 0); - vp = ncp->nc_dvp; - } else { - SDT_PROBE(vfs, namecache, fullpath, miss, vp, 0, 0, - 0, 0); - error = vn_vptocnp(&vp, &bp, buf, &buflen); - if (error) - break; - } - if (buflen <= 0) { - numfullpathfail4++; - CACHE_RUNLOCK(); + error = vn_vptocnp_locked(&vp, buf, &buflen); + if (error) + break; + if (buflen == 0) { error = ENOMEM; break; } - *--bp = '/'; - buflen--; + buf[--buflen] = '/'; slash_prefixed = 1; } - if (error) { - SDT_PROBE(vfs, namecache, fullpath, return, error, startvp, - NULL, 0, 0); + if (error) return (error); - } if (!slash_prefixed) { - if (bp == buf) { - numfullpathfail4++; + if (buflen == 0) { CACHE_RUNLOCK(); + numfullpathfail4++; SDT_PROBE(vfs, namecache, fullpath, return, 0, - startvp, bp, 0, 0); + startvp, fullpath, 0, 0); return (ENOMEM); - } else - *--bp = '/'; + } + buf[--buflen] = '/'; } numfullpathfound++; CACHE_RUNLOCK(); - SDT_PROBE(vfs, namecache, fullpath, return, 0, startvp, bp, 0, 0); - *retbuf = bp; + SDT_PROBE(vfs, namecache, fullpath, return, 0, startvp, buf + *buflen, + 0, 0); + *retbuf = buf + buflen; return (0); } diff --git a/sys/sys/vnode.h b/sys/sys/vnode.h index 0a3d1dc..d8054fa 100644 --- a/sys/sys/vnode.h +++ b/sys/sys/vnode.h @@ -598,6 +598,7 @@ int insmntque1(struct vnode *vp, struct mount *mp, int insmntque(struct vnode *vp, struct mount *mp); u_quad_t init_va_filerev(void); int speedup_syncer(void); +int vn_vptocnp(struct vnode **vp, char *buf, u_int *buflen); #define textvp_fullpath(p, rb, rfb) \ vn_fullpath(FIRST_THREAD_IN_PROC(p), (p)->p_textvp, rb, rfb) int vn_fullpath(struct thread *td, struct vnode *vn,