GENERIC from Wed Oct 20 01:29:21 2010 +0300, softdep_insmntque a4ade72, vmcore.15 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #0 r214053+a4ade72: Wed Oct 20 07:36:18 CEST 2010 pho@x4.osted.lan:/var/tmp/deviant2/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3536277504 (3372 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 817517 free (845 frags, 102084 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 936009 free (369 frags, 116955 blocks, 0.0% fragmentation) /dev/ad4s1g: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1g: clean, 117584778 free (434 frags, 14698043 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 6617319 free (38351 frags, 822371 blocks, 0.4% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 21108801 free (8897 frags, 2637488 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.7 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting mountd. Starting nfsd. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc7ce4310 ufs (ufs) @ kern/vfs_subr.c:2111 2nd 0xdad15120 bufwait (bufwait) @ ufs/ffs/ffs_softdep.c:11332 3rd 0xc81b7880 ufs (ufs) @ kern/vfs_subr.c:2111 KDB: stack backtrace: db_trace_self_wrapper(c0ce808f,2e706564,31313a63,d323333,c0ce000a,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f3f9b,c0ceb2ad,c6d40168,c6d437d8,e9886890,...) at kdb_backtrace+0x2a _witness_debugger(c0ceb2ad,c81b7880,c0cdcc1b,c6d437d8,c0cf25f3,...) at _witness_debugger+0x25 witness_checkorder(c81b7880,9,c0cf25ea,83f,0,...) at witness_checkorder+0x839 __lockmgr_args(c81b7880,80100,c81b78ec,0,0,...) at __lockmgr_args+0x814 ffs_lock(e98869b4,c0904acb,c0cf1969,80100,c81b7828,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9060,e98869b4,109,c0e13ee0,c81b7828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c81b7828,80100,c0cf25ea,83f,4,...) at _vn_lock+0x78 vget(c81b7828,80100,c83872d0,50,0,...) at vget+0xbb vfs_hash_get(c7fa92d4,6d400,80000,c83872d0,e9886b08,...) at vfs_hash_get+0xed ffs_vgetf(c7fa92d4,6d400,80000,e9886b08,1,...) at ffs_vgetf+0x49 softdep_sync_metadata(c7ce42b8,0,c0d0f244,144,0,...) at softdep_sync_metadata+0x683 ffs_syncvnode(c7ce42b8,1,c83872d0,555,c0cf25ea,...) at ffs_syncvnode+0x3e2 ffs_sync(c7fa92d4,1,c0cf1caa,4fd,80,...) at ffs_sync+0x26f dounmount(c7fa92d4,8000000,c83872d0,482,5b85c5ea,...) at dounmount+0x447 unmount(c83872d0,e9886cec,281760f5,1,0,...) at unmount+0x310 syscallenter(c83872d0,e9886ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e9886d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dbadf, esp = 0xbfbfe66c, ebp = 0xbfbfe738 --- lock order reversal: 1st 0xc7ce4724 ufs (ufs) @ kern/vfs_mount.c:1208 2nd 0xc7ce4b38 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1598 KDB: stack backtrace: db_trace_self_wrapper(c0ce808f,35313a63,a0d3839,c0c65300,e98869a8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f3f9b,c0ceb294,c6d437d8,c6d436a0,e9886a04,...) at kdb_backtrace+0x2a _witness_debugger(c0ceb294,c7ce4b38,c0cd882c,c6d436a0,c0d0c3a5,...) at _witness_debugger+0x25 witness_checkorder(c7ce4b38,9,c0d0c39c,63e,c7ce4ba4,...) at witness_checkorder+0x839 __lockmgr_args(c7ce4b38,80400,c7ce4ba4,0,0,...) at __lockmgr_args+0x814 vop_stdlock(e9886b24,c0ce325f,df,80400,c7ce4ae0,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c0dd1600,e9886b24,0,c0e13ee0,c7ce4ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c7ce4ae0,80400,c0d0c39c,63e,c7fa92d4,...) at _vn_lock+0x78 softdep_flushworklist(c7fa92d4,e9886bd0,c83872d0,563,c0cf25ea,...) at softdep_flushworklist+0x47 ffs_sync(c7fa92d4,1,c0cf1caa,4fd,80,...) at ffs_sync+0x2fd dounmount(c7fa92d4,8000000,c83872d0,482,5b85c5ea,...) at dounmount+0x447 unmount(c83872d0,e9886cec,281760f5,1,0,...) at unmount+0x310 syscallenter(c83872d0,e9886ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e9886d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dbadf, esp = 0xbfbfe66c, ebp = 0xbfbfe738 --- ** /dev/ad4s1g ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 23461 files, 729203 used, 117584778 free (434 frags, 14698043 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** usage: kill [-s signal_name] pid ... kill -l [exit_status] kill -signal_name pid ... kill -signal_number pid ... fsck -y /tmp. Starting default moused. Starting inetd. Wed Oct 20 07:50:14 CEST 2010 FreeBSD/i386 (x4.osted.lan) (console) login: Oct 20 10:05:52 x4 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xdad6b660 bufwait (bufwait) @ kern/vfs_bio.c:2659 2nd 0xc7c47c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:283 KDB: stack backtrace: db_trace_self_wrapper(c0ce808f,2e687361,38323a63,a0d33,a7b,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f3f9b,c0ceb294,c6d40168,c6d43840,e97627e8,...) at kdb_backtrace+0x2a _witness_debugger(c0ceb294,c7c47c00,c0d0fa24,c6d43840,c0d0f6b6,...) at _witness_debugger+0x25 witness_checkorder(c7c47c00,9,c0d0f6ad,11b,0,...) at witness_checkorder+0x839 _sx_xlock(c7c47c00,0,c0d0f6ad,11b,c7fcc7b4,...) at _sx_xlock+0x85 ufsdirhash_acquire(dad6b600,dc3d0018,1e8,dc3d0028,e97628b8,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7fcc7b4,e9762914,28,e97628a4,e97628a8,...) at ufsdirhash_add+0x13 ufs_direnter(c8418414,c8418000,e9762914,e9762ba4,0,...) at ufs_direnter+0x749 ufs_makeinode(e9762ba4,c0df95a0,e9762b00,e9762a5c,c0c215a5,...) at ufs_makeinode+0x5c5 ufs_create(e9762b00,c0d25fa7,0,0,e9762b78,...) at ufs_create+0x30 VOP_CREATE_APV(c0df9060,e9762b00,e9762ba4,e9762a98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(e9762b78,e9762c2c,1a0,0,c879e080,...) at vn_open_cred+0x205 vn_open(e9762b78,e9762c2c,1a0,c7c5cc08,0,...) at vn_open+0x3b kern_openat(c7cd22d0,ffffff9c,bfbfe838,0,602,...) at kern_openat+0x128 kern_open(c7cd22d0,bfbfe838,0,601,1b0,...) at kern_open+0x35 open(c7cd22d0,e9762cec,bfbfe838,1,0,...) at open+0x30 syscallenter(c7cd22d0,e9762ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e9762d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x28172093, esp = 0xbfbfd1fc, ebp = 0xbfbfd218 --- panic: worklist_insert: 0xc888a100 jnewblk(0x8109) already on list cpuid = 3 KDB: enter: panic [ thread pid 20 tid 100074 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> show mount 0xc7c16b50 /dev/ad4s1a on / (ufs) 0xc7c17000 devfs on /dev (devfs) 0xc7fa95a8 /dev/ad4s1f on /home (ufs) 0xc7fa9000 /dev/ad4s1d on /usr (ufs) 0xc7c17b50 /dev/ad4s1e on /var (ufs) 0xc7c1787c /dev/ad4s1g on /tmp (ufs) 0xc7c172d4 /dev/md5a on /mnt (ufs) More info: show mount db> show mount 0xc7c172d4 0xc7c172d4 /dev/md5a on /mnt (ufs) mnt_flag = SOFTDEP, LOCAL mnt_kern_flag = SOFTDEP, EXTENDED_SHARED, MPSAFE, LOOKUP_SHARED, 0x00000100 mnt_opt = fstype, fspath, from, errmsg mnt_stat = { version=537068824 type=6 flags=0x0000000000201000 bsize=2048 iosize=16384 blocks=506483 bfree=502370 bavail=461852 files=141310 ffree=141307 syncwrites=0 asyncwrites=0 syncreads=0 asyncreads=0 namemax=255 owner=0 fsid=[1287563017, -485743746] } mnt_cred = { uid=0 ruid=0 } mnt_ref = 29 mnt_gen = 1 mnt_nvnodelistsize = 18 mnt_writeopcount = 9 mnt_noasync = 1 mnt_maxsymlinklen = 120 mnt_iosize_max = 131072 mnt_hashseed = 3144510808 mnt_secondary_writes = 1 mnt_secondary_accwrites = 29293 mnt_gjprovider = NULL vnode 0xc884f570: tag ufs, type VDIR usecount 12, writecount 0, refcount 14 mountedhere 0 flags (VV_ROOT) v_object 0xc883a088 ref 0 pages 1 lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0955a0b at vget+0xbb #5 0xc0b0ab16 at ffs_sync+0x216 #6 0xc095758f at sync_fsync+0x18f #7 0xc0c1e075 at VOP_FSYNC_APV+0xc5 #8 0xc0954c7b at sync_vnode+0x16b #9 0xc0954fd2 at sched_sync+0x282 #10 0xc0892338 at fork_exit+0xb8 #11 0xc0bebcd4 at fork_trampoline+0x8 ino 2, on dev md5a vnode 0xc8414570: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b09da9 at ffs_vgetf+0x189 #2 0xc0b0a1ce at ffs_vget+0x2e #3 0xc0af940a at softdep_journal_lookup+0xda #4 0xc0af9503 at softdep_mount+0xe3 #5 0xc0b0d9e6 at ffs_mount+0x2446 #6 0xc094ae4d at vfs_donmount+0xb2d #7 0xc094bba4 at nmount+0x84 #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 4, on dev md5a vnode 0xc8418414: tag syncer, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type syncer: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc09424f5 at vop_stdlock+0x65 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0954c52 at sync_vnode+0x142 #5 0xc0954fd2 at sched_sync+0x282 #6 0xc0892338 at fork_exit+0xb8 #7 0xc0bebcd4 at fork_trampoline+0x8 vnode 0xc92ae570: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) v_object 0xc9208c38 ref 0 pages 0 lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0955a0b at vget+0xbb #5 0xc0945e4d at vfs_hash_get+0xed #6 0xc0b09c69 at ffs_vgetf+0x49 #7 0xc0b0a1ce at ffs_vget+0x2e #8 0xc0b1759b at ufs_lookup_ino+0x89b #9 0xc0b1794a at ufs_lookup+0x2a #10 0xc0c1ec45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc093fca6 at vfs_cache_lookup+0xd6 #12 0xc0c21755 at VOP_LOOKUP_APV+0xe5 #13 0xc094718b at lookup+0x67b #14 0xc0947ff2 at namei+0x592 #15 0xc0959214 at kern_unlinkat+0x54 #16 0xc095946f at kern_unlink+0x2f #17 0xc09594a2 at unlink+0x22 ino 8, on dev md5a vnode 0xc942d984: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) v_object 0xc9087660 ref 0 pages 0 lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0955a0b at vget+0xbb #5 0xc0945e4d at vfs_hash_get+0xed #6 0xc0b09c69 at ffs_vgetf+0x49 #7 0xc0b0a1ce at ffs_vget+0x2e #8 0xc0b1759b at ufs_lookup_ino+0x89b #9 0xc0b1794a at ufs_lookup+0x2a #10 0xc0c1ec45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc093fca6 at vfs_cache_lookup+0xd6 #12 0xc0c21755 at VOP_LOOKUP_APV+0xe5 #13 0xc094718b at lookup+0x67b #14 0xc0947ff2 at namei+0x592 #15 0xc0959214 at kern_unlinkat+0x54 #16 0xc095946f at kern_unlink+0x2f #17 0xc09594a2 at unlink+0x22 ino 10, on dev md5a vnode 0xc942bae0: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) v_object 0xc8826880 ref 0 pages 0 lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0955a0b at vget+0xbb #5 0xc0945e4d at vfs_hash_get+0xed #6 0xc0b09c69 at ffs_vgetf+0x49 #7 0xc0b0a1ce at ffs_vget+0x2e #8 0xc0b1759b at ufs_lookup_ino+0x89b #9 0xc0b1794a at ufs_lookup+0x2a #10 0xc0c1ec45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc093fca6 at vfs_cache_lookup+0xd6 #12 0xc0c21755 at VOP_LOOKUP_APV+0xe5 #13 0xc094718b at lookup+0x67b #14 0xc0947ff2 at namei+0x592 #15 0xc0959214 at kern_unlinkat+0x54 #16 0xc095946f at kern_unlink+0x2f #17 0xc09594a2 at unlink+0x22 ino 13, on dev md5a vnode 0xc883f000: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) v_object 0xc920ce58 ref 0 pages 0 lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0955a0b at vget+0xbb #5 0xc0945e4d at vfs_hash_get+0xed #6 0xc0b09c69 at ffs_vgetf+0x49 #7 0xc0b0a1ce at ffs_vget+0x2e #8 0xc0b1759b at ufs_lookup_ino+0x89b #9 0xc0b1794a at ufs_lookup+0x2a #10 0xc0c1ec45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc093fca6 at vfs_cache_lookup+0xd6 #12 0xc0c21755 at VOP_LOOKUP_APV+0xe5 #13 0xc094718b at lookup+0x67b #14 0xc0947ff2 at namei+0x592 #15 0xc0959214 at kern_unlinkat+0x54 #16 0xc095946f at kern_unlink+0x2f #17 0xc09594a2 at unlink+0x22 ino 19, on dev md5a vnode 0xc84142b8: tag ufs, type VREG usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) v_object 0xc92085d8 ref 0 pages 0 lock type ufs: UNLOCKED #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0955a0b at vget+0xbb #5 0xc0945e4d at vfs_hash_get+0xed #6 0xc0b09c69 at ffs_vgetf+0x49 #7 0xc0b0a1ce at ffs_vget+0x2e #8 0xc0b1759b at ufs_lookup_ino+0x89b #9 0xc0b1794a at ufs_lookup+0x2a #10 0xc0c1ec45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc093fca6 at vfs_cache_lookup+0xd6 #12 0xc0c21755 at VOP_LOOKUP_APV+0xe5 #13 0xc094718b at lookup+0x67b #14 0xc0947ff2 at namei+0x592 #15 0xc0959214 at kern_unlinkat+0x54 #16 0xc095946f at kern_unlink+0x2f #17 0xc09594a2 at unlink+0x22 ino 21, on dev md5a vnode 0xc942a2b8: tag ufs, type VREG usecount 1, writecount 1, refcount 46 mountedhere 0 flags () v_object 0xc9087d48 ref 0 pages 176 lock type ufs: EXCL by thread 0xc8292870 (pid 6808) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 5, on dev md5a vnode 0xc942c6cc: tag ufs, type VREG usecount 1, writecount 1, refcount 50 mountedhere 0 flags () v_object 0xc920cbb0 ref 0 pages 192 lock type ufs: EXCL by thread 0xc80d35a0 (pid 6809) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 6, on dev md5a vnode 0xc92af15c: tag ufs, type VREG usecount 1, writecount 1, refcount 43 mountedhere 0 flags () v_object 0xc883dee0 ref 0 pages 164 lock type ufs: EXCL by thread 0xc8386b40 (pid 6810) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 9, on dev md5a vnode 0xc884eae0: tag ufs, type VREG usecount 1, writecount 1, refcount 41 mountedhere 0 flags () v_object 0xc8825bb0 ref 0 pages 156 lock type ufs: EXCL by thread 0xc83885a0 (pid 6812) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 11, on dev md5a vnode 0xc8415984: tag ufs, type VREG usecount 1, writecount 1, refcount 42 mountedhere 0 flags () v_object 0xc883d110 ref 0 pages 160 lock type ufs: EXCL by thread 0xc7cd1b40 (pid 6813) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 12, on dev md5a vnode 0xc7d03414: tag ufs, type VREG usecount 1, writecount 1, refcount 52 mountedhere 0 flags () v_object 0xc7ced4c8 ref 0 pages 200 lock type ufs: EXCL by thread 0xc7c7f870 (pid 6814) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 14, on dev md5a vnode 0xc8417000: tag ufs, type VREG usecount 1, writecount 1, refcount 44 mountedhere 0 flags () v_object 0xc9086440 ref 0 pages 168 lock type ufs: EXCL by thread 0xc7c7f000 (pid 6815) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 15, on dev md5a vnode 0xc9433000: tag ufs, type VREG usecount 1, writecount 1, refcount 49 mountedhere 0 flags () v_object 0xc9086a18 ref 0 pages 188 lock type ufs: EXCL by thread 0xc92125a0 (pid 6816) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 17, on dev md5a vnode 0xc942e000: tag ufs, type VREG usecount 1, writecount 1, refcount 56 mountedhere 0 flags () v_object 0xc883b3b8 ref 0 pages 216 lock type ufs: EXCL by thread 0xc90e5870 (pid 6817) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 18, on dev md5a vnode 0xc8416ae0: tag ufs, type VREG usecount 1, writecount 1, refcount 55 mountedhere 0 flags () v_object 0xc9086e58 ref 0 pages 212 lock type ufs: EXCL by thread 0xc8385000 (pid 6811) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 20, on dev md5a db> run pho db:0:pho> bt Tracing pid 20 tid 100074 td 0xc7161000 kdb_enter(c0ce4ad6,c0ce4ad6,c0d0c450,e7537b1c,3,...) at kdb_enter+0x3a panic(c0d0c450,c888a100,c0d0e420,8109,0,...) at panic+0x134 worklist_insert(6bf,0,1,0,0,...) at worklist_insert+0x73 indir_trunc(fffffff4,ffffffff,c8a1c500,c8cba400,c8a76200,...) at indir_trunc+0x4c7 handle_workitem_indirblk(4,c0ce325f,df,c8cba400,c8cba400,...) at handle_workitem_indirblk+0x67 handle_workitem_freeblocks(0,e7537c74,2,5dd,8,...) at handle_workitem_freeblocks+0x95 process_worklist_item(c0fc2018,0,c0d0c39c,569,c7161000,...) at process_worklist_item+0x21c softdep_process_worklist(c7c172d4,0,c0d0c39c,4db,3e8,...) at softdep_process_worklist+0x8c softdep_flush(0,e7537d28,c0cdfcac,349,c7bf42a8,...) at softdep_flush+0x2a0 fork_exit(c0b03680,0,e7537d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7537d60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x610a00 curthread = 0xc80d35a0: pid 6809 "suj5" curpcb = 0xe97ecd80 fpcurthread = none idlethread = 0xc6d9b000: tid 100006 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5cf5a00 curthread = 0xc6d9b2d0: pid 11 "idle: cpu1" curpcb = 0xc6b20d80 fpcurthread = none idlethread = 0xc6d9b2d0: tid 100005 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5cf8a00 curthread = 0xc71615a0: pid 18 "syncer" curpcb = 0xe7531d80 fpcurthread = none idlethread = 0xc6d9b5a0: tid 100004 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5cfba00 curthread = 0xc7161000: pid 20 "softdepflush" curpcb = 0xe7537d80 fpcurthread = none idlethread = 0xc6d9b870: tid 100003 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 6817 (suj5) thread 0xc90e5870 (100199) exclusive lockmgr ufs (ufs) r = 0 (0xc942e058) locked @ kern/vfs_vnops.c:612 Process 6816 (suj5) thread 0xc92125a0 (100210) exclusive lockmgr ufs (ufs) r = 0 (0xc9433058) locked @ kern/vfs_vnops.c:612 Process 6815 (suj5) thread 0xc7c7f000 (100116) exclusive lockmgr bufwait (bufwait) r = 0 (0xdad32380) locked @ kern/vfs_bio.c:1912 exclusive lockmgr ufs (ufs) r = 0 (0xc8417058) locked @ kern/vfs_vnops.c:612 Process 6814 (suj5) thread 0xc7c7f870 (100101) exclusive lockmgr ufs (ufs) r = 0 (0xc7d0346c) locked @ kern/vfs_vnops.c:612 Process 6813 (suj5) thread 0xc7cd1b40 (100094) exclusive lockmgr ufs (ufs) r = 0 (0xc84159dc) locked @ kern/vfs_vnops.c:612 Process 6812 (suj5) thread 0xc83885a0 (100166) exclusive lockmgr ufs (ufs) r = 0 (0xc884eb38) locked @ kern/vfs_vnops.c:612 Process 6811 (suj5) thread 0xc8385000 (100188) exclusive lockmgr ufs (ufs) r = 0 (0xc8416b38) locked @ kern/vfs_vnops.c:612 Process 6810 (suj5) thread 0xc8386b40 (100153) exclusive lockmgr ufs (ufs) r = 0 (0xc92af1b4) locked @ kern/vfs_vnops.c:612 Process 6809 (suj5) thread 0xc80d35a0 (100112) exclusive sleep mutex bufobj interlock (bufobj interlock) r = 0 (0xc942c7c4) locked @ kern/vfs_bio.c:1496 exclusive lockmgr bufwait (bufwait) r = 0 (0xdaf52e60) locked @ kern/vfs_bio.c:2659 exclusive lockmgr ufs (ufs) r = 0 (0xc942c724) locked @ kern/vfs_vnops.c:612 Process 6808 (suj5) thread 0xc8292870 (100129) exclusive lockmgr ufs (ufs) r = 0 (0xc942a310) locked @ kern/vfs_vnops.c:612 Process 1764 (sshd) thread 0xc7c55870 (100108) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc82c4228) locked @ kern/uipc_sockbuf.c:148 Process 18 (syncer) thread 0xc71615a0 (100072) exclusive sleep mutex struct mount mtx (struct mount mtx) r = 0 (0xc7c16b50) locked @ kern/vfs_mount.c:1701 exclusive lockmgr syncer (syncer) r = 0 (0xc7ce49dc) locked @ kern/vfs_subr.c:1721 Process 3 (g_up) thread 0xc6eb8000 (100014) exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc0fc2018) locked @ ufs/ffs/ffs_softdep.c:8894 db:0:alllocks> show lockedvnods Locked vnodes 0xc7ce4984: tag syncer, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type syncer: EXCL by thread 0xc71615a0 (pid 18) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc09424f5 at vop_stdlock+0x65 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0954c52 at sync_vnode+0x142 #5 0xc0954fd2 at sched_sync+0x282 #6 0xc0892338 at fork_exit+0xb8 #7 0xc0bebcd4 at fork_trampoline+0x8 0xc942a2b8: tag ufs, type VREG usecount 1, writecount 1, refcount 46 mountedhere 0 flags () v_object 0xc9087d48 ref 0 pages 176 lock type ufs: EXCL by thread 0xc8292870 (pid 6808) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 5, on dev md5a 0xc942c6cc: tag ufs, type VREG usecount 1, writecount 1, refcount 50 mountedhere 0 flags () v_object 0xc920cbb0 ref 0 pages 192 lock type ufs: EXCL by thread 0xc80d35a0 (pid 6809) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 6, on dev md5a 0xc92af15c: tag ufs, type VREG usecount 1, writecount 1, refcount 43 mountedhere 0 flags () v_object 0xc883dee0 ref 0 pages 164 lock type ufs: EXCL by thread 0xc8386b40 (pid 6810) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 9, on dev md5a 0xc884eae0: tag ufs, type VREG usecount 1, writecount 1, refcount 41 mountedhere 0 flags () v_object 0xc8825bb0 ref 0 pages 156 lock type ufs: EXCL by thread 0xc83885a0 (pid 6812) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 11, on dev md5a 0xc8415984: tag ufs, type VREG usecount 1, writecount 1, refcount 42 mountedhere 0 flags () v_object 0xc883d110 ref 0 pages 160 lock type ufs: EXCL by thread 0xc7cd1b40 (pid 6813) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 12, on dev md5a 0xc7d03414: tag ufs, type VREG usecount 1, writecount 1, refcount 52 mountedhere 0 flags () v_object 0xc7ced4c8 ref 0 pages 200 lock type ufs: EXCL by thread 0xc7c7f870 (pid 6814) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 14, on dev md5a 0xc8417000: tag ufs, type VREG usecount 1, writecount 1, refcount 44 mountedhere 0 flags () v_object 0xc9086440 ref 0 pages 168 lock type ufs: EXCL by thread 0xc7c7f000 (pid 6815) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 15, on dev md5a 0xc9433000: tag ufs, type VREG usecount 1, writecount 1, refcount 49 mountedhere 0 flags () v_object 0xc9086a18 ref 0 pages 188 lock type ufs: EXCL by thread 0xc92125a0 (pid 6816) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 17, on dev md5a 0xc942e000: tag ufs, type VREG usecount 1, writecount 1, refcount 56 mountedhere 0 flags () v_object 0xc883b3b8 ref 0 pages 216 lock type ufs: EXCL by thread 0xc90e5870 (pid 6817) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 18, on dev md5a 0xc8416ae0: tag ufs, type VREG usecount 1, writecount 1, refcount 55 mountedhere 0 flags () v_object 0xc9086e58 ref 0 pages 212 lock type ufs: EXCL by thread 0xc8385000 (pid 6811) #0 0xc08a548e at __lockmgr_args+0xbfe #1 0xc0b0f5c1 at ffs_lock+0xa1 #2 0xc0c205d5 at VOP_LOCK1_APV+0xb5 #3 0xc0961778 at _vn_lock+0x78 #4 0xc0962ae6 at vn_write+0x156 #5 0xc0907455 at dofilewrite+0x95 #6 0xc0908bf8 at kern_writev+0x58 #7 0xc0908d0f at write+0x4f #8 0xc08fd373 at syscallenter+0x263 #9 0xc0c046bf at syscall+0x4f #10 0xc0bebcc1 at Xint0x80_syscall+0x21 ino 20, on dev md5a db:0:lockedvnods> show mount 0xc7c16b50 /dev/ad4s1a on / (ufs) 0xc7c17000 devfs on /dev (devfs) 0xc7fa95a8 /dev/ad4s1f on /home (ufs) 0xc7fa9000 /dev/ad4s1d on /usr (ufs) 0xc7c17b50 /dev/ad4s1e on /var (ufs) 0xc7c1787c /dev/ad4s1g on /tmp (ufs) 0xc7c172d4 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 6817 6417 6416 1001 R+ suj5 6816 6417 6416 1001 R+ suj5 6815 6417 6416 1001 RL+ suj5 6814 6417 6416 1001 R+ suj5 6813 6417 6416 1001 R+ suj5 6812 6417 6416 1001 R+ suj5 6811 6417 6416 1001 R+ suj5 6810 6417 6416 1001 R+ suj5 6809 6417 6416 1001 R+ CPU 0 suj5 6808 6417 6416 1001 R+ suj5 6417 6416 6416 1001 S+ wait 0xc8ea22a8 suj5 6416 6415 6416 1001 S+ wait 0xc828e000 bash 6415 6392 1781 0 S+ wait 0xc837c550 su 6409 0 0 0 DL mdwait 0xc8819000 [md5] 6392 1781 1781 0 S+ wait 0xc8cef2a8 sh 1781 1777 1781 0 S+ wait 0xc828f2a8 sh 1777 1773 1777 0 S+ wait 0xc7cca000 bash 1773 1772 1773 0 S+ pause 0xc837c850 csh 1772 1767 1772 1001 S+ wait 0xc7c53aa0 su 1767 1766 1767 1001 Ss+ wait 0xc7c8a000 bash 1766 1764 1764 1001 S select 0xc7c19ea4 sshd 1764 1359 1764 0 Ss sbwait 0xc82c4254 sshd 1527 1 1527 0 Ss+ ttyin 0xc6ec3a70 getty 1526 1 1526 0 Ss+ ttyin 0xc6ec3c70 getty 1525 1 1525 0 Ss+ ttyin 0xc6ec3e70 getty 1524 1 1524 0 Ss+ ttyin 0xc7170070 getty 1523 1 1523 0 Ss+ ttyin 0xc7170270 getty 1522 1 1522 0 Ss+ ttyin 0xc7170470 getty 1521 1 1521 0 Ss+ ttyin 0xc6ec2670 getty 1520 1 1520 0 Ss+ ttyin 0xc6ec2070 getty 1519 1 1519 0 Ss+ ttyin 0xc6ec2270 getty 1488 1 1488 0 Ss select 0xc7c19de4 inetd 1462 1 1462 0 Ss select 0xc72ef824 moused 1378 1 1378 0 Ss nanslp 0xc0e49744 cron 1371 1 1371 25 Ss pause 0xc828f058 sendmail 1367 1 1367 0 Ss select 0xc7c19ca4 sendmail 1359 1 1359 0 Ss select 0xc7bc38a4 sshd 1314 1 1314 0 Ss select 0xc7bc3864 ntpd 1176 1175 1175 0 S (threaded) nfsd 100138 S rpcsvc 0xc7d07690 nfsd: service 100137 S rpcsvc 0xc7d076d0 nfsd: service 100136 S rpcsvc 0xc7d07710 nfsd: service 100085 S rpcsvc 0xc6f60d10 nfsd: master 1175 1 1175 0 Ss select 0xc7c9a724 nfsd 1166 1 1166 0 Ss select 0xc72ef6a4 mountd 1069 1 1069 0 Ss select 0xc72ef864 rpcbind 1036 1 1036 0 Ss select 0xc72efc64 syslogd 835 1 835 0 Ss select 0xc7c9a024 devd 21 0 0 0 DL flowclea 0xc0fb68a8 [flowcleaner] 20 0 0 0 RL CPU 3 [softdepflush] 19 0 0 0 DL vlruwt 0xc7bf4550 [vnlru] 18 0 0 0 RL CPU 2 [syncer] 17 0 0 0 RL [bufdaemon] 16 0 0 0 DL pgzero 0xc0fc3edc [pagezero] 15 0 0 0 DL psleep 0xc0fc3ad0 [vmdaemon] 9 0 0 0 DL psleep 0xc0fc3a98 [pagedaemon] 8 0 0 0 DL ccb_scan 0xc0e153d4 [xpt_thrd] 7 0 0 0 DL waiting_ 0xc0fb80d8 [sctp_iterator] 6 0 0 0 DL - 0xc705603c [fdc0] 5 0 0 0 SL - 0xc7059000 [fw0_probe] 14 0 0 0 DL (threaded) [usb] 100056 D - 0xc7034d34 [usbus5] 100055 D - 0xc7034d04 [usbus5] 100054 D - 0xc7034cd4 [usbus5] 100053 D - 0xc7034ca4 [usbus5] 100051 D - 0xc702db5c [usbus4] 100050 D - 0xc702db2c [usbus4] 100049 D - 0xc702dafc [usbus4] 100048 D - 0xc702dacc [usbus4] 100047 D - 0xc7026b5c [usbus3] 100046 D - 0xc7026b2c [usbus3] 100045 D - 0xc7026afc [usbus3] 100044 D - 0xc7026acc [usbus3] 100043 D - 0xc701db5c [usbus2] 100042 D - 0xc701db2c [usbus2] 100041 D - 0xc701dafc [usbus2] 100040 D - 0xc701dacc [usbus2] 100038 D - 0xc7017b5c [usbus1] 100037 D - 0xc7017b2c [usbus1] 100036 D - 0xc7017afc [usbus1] 100035 D - 0xc7017acc [usbus1] 100033 D - 0xc7007b5c [usbus0] 100032 D - 0xc7007b2c [usbus0] 100031 D - 0xc7007afc [usbus0] 100030 D - 0xc7007acc [usbus0] 13 0 0 0 DL - 0xc0e49584 [yarrow] 4 0 0 0 DL - 0xc0e47244 [g_down] 3 0 0 0 DL - 0xc0e47240 [g_up] 2 0 0 0 DL - 0xc0e47238 [g_event] 12 0 0 0 RL (threaded) [intr] 100064 I [irq12: psm0] 100063 I [irq1: atkbd0] 100061 I [swi0: uart] 100058 I [irq20: fwohci0] 100057 I [irq14: ata0] 100052 I [irq19: ehci0] 100039 I [irq18: ohci2 ohci4] 100034 I [irq17: ohci1 ohci3] 100029 I [irq16: ohci0] 100028 I [irq22: atapci0] 100027 I [irq9: acpi0] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100019 I [swi2: cambio] 100018 I [swi6: task queue] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 RunQ [swi4: clock] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu0] 100005 CanRun [idle: cpu1] 100004 CanRun [idle: cpu2] 100003 CanRun [idle: cpu3] 1 0 1 0 SLs wait 0xc6d99d48 [init] 10 0 0 0 DL audit_wo 0xc0fc1880 [audit] 0 0 0 0 RLs (threaded) [kernel] 100065 RunQ [deadlkres] 100059 D - 0xc6eabb40 [fw0_taskq] 100025 D - 0xc6eabc80 [thread taskq] 100023 D - 0xc6eabd00 [kqueue taskq] 100022 D - 0xc6eabd40 [acpi_task_2] 100021 D - 0xc6eabd40 [acpi_task_1] 100020 D - 0xc6eabd40 [acpi_task_0] 100016 D - 0xc6eabdc0 [firmware taskq] 100000 D sched 0xc0e47320 [swapper] db:0:ps> allt Tracing command suj5 pid 6817 tid 100199 td 0xc90e5870 sched_switch(c90e5870,0,104,191,d0886947,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4f,...) at mi_switch+0x200 sleepq_switch(c90e5870,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c942e12c,4f,c0cefed8,0,0,...) at sleepq_wait+0x63 _sleep(c942e12c,c942e0f8,4f,c0cefed8,0,...) at _sleep+0x372 bufobj_wwait(c942e0f8,3,0,136,0,...) at bufobj_wwait+0x73 ffs_syncvnode(c942e000,1,c0d0c39c,9c2,c942e000,...) at ffs_syncvnode+0x3b4 softdep_prealloc(c942e000,1,daeb2d60,e993d8c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c942e000,d1000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e993db94,c0d25edd,c942e000,0,c942e000,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e993db94,c942e000,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c82a10,e993dc28,c860ac80,0,c90e5870,...) at vn_write+0x1ca dofilewrite(e993dc28,ffffffff,ffffffff,0,c7c82a10,...) at dofilewrite+0x95 kern_writev(c90e5870,3,e993dc28,e993dc48,1,...) at kern_writev+0x58 write(c90e5870,e993dcec,e993dd28,c0ce9b0f,0,...) at write+0x4f syscallenter(c90e5870,e993dce4,e993dce4,0,c0e4d1c0,...) at syscallenter+0x263 syscall(e993dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6816 tid 100210 td 0xc92125a0 sched_switch(c92125a0,0,104,191,d08a3ba4,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c92125a0,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c9433000,1,c0d0f244,163,c0f887b8,...) at ffs_update+0x172 ffs_syncvnode(c9433000,1,c0d0c39c,9c2,c9433000,...) at ffs_syncvnode+0x48f softdep_prealloc(c9433000,1,c6d437d8,c,0,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c9433000,b8000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e9991b94,c0d25edd,c9433000,0,c9433000,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e9991b94,c9433000,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c80c7bd0,e9991c28,c860ac80,0,c92125a0,...) at vn_write+0x1ca dofilewrite(e9991c28,ffffffff,ffffffff,0,c80c7bd0,...) at dofilewrite+0x95 kern_writev(c92125a0,3,e9991c28,e9991c48,1,...) at kern_writev+0x58 write(c92125a0,e9991cec,c08e18bc,c0e4d870,0,...) at write+0x4f syscallenter(c92125a0,e9991ce4,e9991cc0,c08e3248,c0e4d840,...) at syscallenter+0x263 syscall(e9991d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6815 tid 100116 td 0xc7c7f000 sched_switch(c7c7f000,0,104,191,d08aba7e,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c7c7f000,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(dad32320,4c,c0cf022a,0,0,...) at sleepq_wait+0x63 _sleep(dad32320,c6d56254,4c,c0cf022a,0,...) at _sleep+0x372 bwait(dad32320,4c,c0cf022a,dad32320,e981951c,...) at bwait+0x6f bufwait(dad32320,dad32320,df,dad32320,dbb04020,...) at bufwait+0x48 bufwrite(dad32320,0,c0d0ec9e,756,dad32320) at bufwrite+0x165 ffs_bufwrite(dad32320,0,c0d0c39c,b3a,c0d0c3a5,...) at ffs_bufwrite+0x290 softdep_process_journal(1f19,0,c7c7f000,daf2aa80,c9259d98,...) at softdep_process_journal+0x6e8 jwait(c0fc2018,0,c0d0c39c,1f19,0,...) at jwait+0x27 softdep_disk_io_initiation(daf2aa80,c3d7cfa8,0,daf2aa80,c8417000,...) at softdep_disk_io_initiation+0x19f1 ffs_geom_strategy(c9259e90,daf2aa80,e98197a0,3,c7c7f000,...) at ffs_geom_strategy+0x14f ufs_strategy(e98197dc,c0d25ca2,c7c7f000,daf2aa80,4,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c0df9060,e98197dc,c0cefe8a,c0e13f40,c8417000,...) at VOP_STRATEGY_APV+0xe5 bufstrategy(c84170f8,daf2aa80,3a6,daf2aae0,daf2aa80,...) at bufstrategy+0x61 bufwrite(daf2aa80,daf2aae0,e9819878,c0b0f225,daf2aa80,...) at bufwrite+0x159 bawrite(daf2aa80,0,c0d0f244,ff,0,...) at bawrite+0x5c ffs_syncvnode(c8417000,1,c0d0c39c,9c2,c8417000,...) at ffs_syncvnode+0x2a5 softdep_prealloc(c8417000,1,daf2aae0,e98198c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c8417000,a1000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e9819b94,c0d25edd,c8417000,0,c8417000,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e9819b94,c8417000,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c9ee70,e9819c28,c860ac80,0,c7c7f000,...) at vn_write+0x1ca dofilewrite(e9819c28,ffffffff,ffffffff,0,c7c9ee70,...) at dofilewrite+0x95 kern_writev(c7c7f000,3,e9819c28,e9819c48,1,...) at kern_writev+0x58 write(c7c7f000,e9819cec,e9819d28,c0ce9b0f,0,...) at write+0x4f syscallenter(c7c7f000,e9819ce4,e9819ce4,0,c0e4dec0,...) at syscallenter+0x263 syscall(e9819d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6814 tid 100101 td 0xc7c7f870 sched_switch(c7c7f870,0,104,191,d087cb67,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c7c7f870,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c7d03414,1,c0d0f244,163,0,...) at ffs_update+0x172 ffs_syncvnode(c7d03414,1,c0d0c39c,9c2,c7d03414,...) at ffs_syncvnode+0x48f softdep_prealloc(c7d03414,1,dae332c0,e978e8c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c7d03414,c1000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e978eb94,c0d25edd,c7d03414,0,c7d03414,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e978eb94,c7d03414,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c9e6c8,e978ec28,c860ac80,0,c7c7f870,...) at vn_write+0x1ca dofilewrite(e978ec28,ffffffff,ffffffff,0,c7c9e6c8,...) at dofilewrite+0x95 kern_writev(c7c7f870,3,e978ec28,e978ec48,1,...) at kern_writev+0x58 write(c7c7f870,e978ecec,e978ed28,c0ce9b0f,0,...) at write+0x4f syscallenter(c7c7f870,e978ece4,e978ece4,0,c0e4d840,...) at syscallenter+0x263 syscall(e978ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6813 tid 100094 td 0xc7cd1b40 sched_switch(c7cd1b40,0,104,191,d08b5be4,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c7cd1b40,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c8415984,1,c0d0f244,163,c0f88028,...) at ffs_update+0x172 ffs_syncvnode(c8415984,1,c0d0c39c,9c2,c8415984,...) at ffs_syncvnode+0x48f softdep_prealloc(c8415984,1,dad41dc0,e97728c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c8415984,9a000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e9772b94,c0d25edd,c8415984,0,c8415984,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e9772b94,c8415984,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c884da48,e9772c28,c860ac80,0,c7cd1b40,...) at vn_write+0x1ca dofilewrite(e9772c28,ffffffff,ffffffff,0,c884da48,...) at dofilewrite+0x95 kern_writev(c7cd1b40,3,e9772c28,e9772c48,1,...) at kern_writev+0x58 write(c7cd1b40,e9772cec,c08e18bc,c0e4d870,0,...) at write+0x4f syscallenter(c7cd1b40,e9772ce4,e9772cc0,c08e3248,c0e4d840,...) at syscallenter+0x263 syscall(e9772d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6812 tid 100166 td 0xc83885a0 sched_switch(c83885a0,0,104,191,d08c5e8d,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c83885a0,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c884eae0,1,c0d0f244,163,c0f888c0,...) at ffs_update+0x172 ffs_syncvnode(c884eae0,1,c0d0c39c,9c2,c884eae0,...) at ffs_syncvnode+0x48f softdep_prealloc(c884eae0,1,0,62fa6a06,1354e2b0,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c884eae0,96000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e98b9b94,c0d25edd,c884eae0,0,c884eae0,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e98b9b94,c884eae0,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7cf9000,e98b9c28,c860ac80,0,c83885a0,...) at vn_write+0x1ca dofilewrite(e98b9c28,ffffffff,ffffffff,0,c7cf9000,...) at dofilewrite+0x95 kern_writev(c83885a0,3,e98b9c28,e98b9c48,1,...) at kern_writev+0x58 write(c83885a0,e98b9cec,c08e18bc,c0e4def0,0,...) at write+0x4f syscallenter(c83885a0,e98b9ce4,e98b9cc0,c08e3248,c0e4dec0,...) at syscallenter+0x263 syscall(e98b9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6811 tid 100188 td 0xc8385000 sched_switch(c8385000,0,104,191,d08b3af1,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c8385000,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c8416ae0,1,c0d0f244,163,0,...) at ffs_update+0x172 ffs_syncvnode(c8416ae0,1,c0d0c39c,9c2,c8416ae0,...) at ffs_syncvnode+0x48f softdep_prealloc(c8416ae0,1,dad984a0,e991c8c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c8416ae0,ce000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e991cb94,c0d25edd,c8416ae0,0,c8416ae0,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e991cb94,c8416ae0,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c80c7578,e991cc28,c860ac80,0,c8385000,...) at vn_write+0x1ca dofilewrite(e991cc28,ffffffff,ffffffff,0,c80c7578,...) at dofilewrite+0x95 kern_writev(c8385000,3,e991cc28,e991cc48,1,...) at kern_writev+0x58 write(c8385000,e991ccec,e991cd28,c0ce9b0f,0,...) at write+0x4f syscallenter(c8385000,e991cce4,e991cce4,0,c0e4d1c0,...) at syscallenter+0x263 syscall(e991cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6810 tid 100153 td 0xc8386b40 sched_switch(c8386b40,0,104,191,d08a2392,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c8386b40,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c92af15c,1,c0d0f244,163,c0f88290,...) at ffs_update+0x172 ffs_syncvnode(c92af15c,1,c0d0c39c,9c2,c92af15c,...) at ffs_syncvnode+0x48f softdep_prealloc(c92af15c,1,daf57920,e98928c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c92af15c,9e000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e9892b94,c0d25edd,c92af15c,0,c92af15c,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e9892b94,c92af15c,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c5baf0,e9892c28,c860ac80,0,c8386b40,...) at vn_write+0x1ca dofilewrite(e9892c28,ffffffff,ffffffff,0,c7c5baf0,...) at dofilewrite+0x95 kern_writev(c8386b40,3,e9892c28,e9892c48,1,...) at kern_writev+0x58 write(c8386b40,e9892cec,c08e18bc,c0e4e570,0,...) at write+0x4f syscallenter(c8386b40,e9892ce4,e9892cc0,c08e3248,c0e4e540,...) at syscallenter+0x263 syscall(e9892d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6809 tid 100112 td 0xc80d35a0 cpustop_handler(1,e97ecbe4,c0c047d6,c0d22c63,ec,...) at cpustop_handler+0x34 ipi_nmi_handler(c0d22c63,ec,0,c08bcb15,c80cc7f8,...) at ipi_nmi_handler+0x2f trap(e97ecbf0) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08bcb15, esp = 0xe97ecc30, ebp = 0xe97ecc54 --- panic(c0ce9b57,c0ccb54f,2,c0ccb54f,c0ce66a7,...) at panic+0x35 syscallret(c80d35a0,0,e97ecce4,0,c0e4dec0,...) at syscallret+0xa4 syscall(e97ecd28) at syscall+0x11b Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4096), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6808 tid 100129 td 0xc8292870 sched_switch(c8292870,0,104,191,d0875721,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c8292870,0,c0ce92d6,268,50,...) at sleepq_switch+0x15f sleepq_wait(daea3800,50,c0cdddf4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(daea3800,81900,c9259e90,c0cdddf4,50,...) at __lockmgr_args+0xb1f getblk(c9259d98,e0,0,4000,0,...) at getblk+0x167 breadn(c9259d98,e0,0,4000,0,...) at breadn+0x44 bread(c9259d98,e0,0,4000,0,...) at bread+0x4c ffs_update(c942a2b8,1,c0d0f244,163,0,...) at ffs_update+0x172 ffs_syncvnode(c942a2b8,1,c0d0c39c,9c2,c942a2b8,...) at ffs_syncvnode+0x48f softdep_prealloc(c942a2b8,1,dafb03c0,e98428c4,c0904acb,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c942a2b8,a9000,0,1000,c860ac80,...) at ffs_balloc_ufs2+0xaa ffs_write(e9842b94,c0d25edd,c942a2b8,0,c942a2b8,...) at ffs_write+0x2ad VOP_WRITE_APV(c0df9060,e9842b94,c942a2b8,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c829f6c8,e9842c28,c860ac80,0,c8292870,...) at vn_write+0x1ca dofilewrite(e9842c28,ffffffff,ffffffff,0,c829f6c8,...) at dofilewrite+0x95 kern_writev(c8292870,3,e9842c28,e9842c48,1,...) at kern_writev+0x58 write(c8292870,e9842cec,c08e18ad,c0e4d3f8,0,...) at write+0x4f syscallenter(c8292870,e9842ce4,e9842cc0,c08e3248,c0e4d1c0,...) at syscallenter+0x263 syscall(e9842d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj5 pid 6417 tid 100178 td 0xc8ea52d0 sched_switch(c8ea52d0,0,104,191,b6d9aff6,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c8ea52d0,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8ea22a8,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8ea22a8,c8ea2330,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c8ea52d0,ffffffff,e98fec44,0,0,...) at kern_wait+0xb66 wait4(c8ea52d0,e98fecec,bfbfd220,1,0,...) at wait4+0x3b syscallenter(c8ea52d0,e98fece4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e98fed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280efdeb, esp = 0xbfbfd1fc, ebp = 0xbfbfd218 --- Tracing command bash pid 6416 tid 100128 td 0xc8292b40 sched_switch(c8292b40,0,104,191,8738c0f7,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c8292b40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c828e000,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c828e000,c828e088,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c8292b40,ffffffff,e983fc44,0,0,...) at kern_wait+0xb66 wait4(c8292b40,e983fcec,2836aa8c,1,0,...) at wait4+0x3b syscallenter(c8292b40,e983fce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e983fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c2deb, esp = 0xbfbfe42c, ebp = 0xbfbfe448 --- Tracing command su pid 6415 tid 100164 td 0xc8388b40 sched_switch(c8388b40,0,104,191,867af6e2,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c8388b40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c837c550,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c837c550,c837c5d8,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c8388b40,1910,e98b3c44,2,0,...) at kern_wait+0xb66 wait4(c8388b40,e98b3cec,281cba8c,1,0,...) at wait4+0x3b syscallenter(c8388b40,e98b3ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e98b3d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28123deb, esp = 0xbfbfe36c, ebp = 0xbfbfe388 --- Tracing command md5 pid 6409 tid 100126 td 0xc82942d0 sched_switch(c82942d0,0,104,191,d08eac62,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c82942d0,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c8819000,4c,c0cb682d,0,0,...) at sleepq_wait+0x63 _sleep(c8819000,c8819020,24c,c0cb682d,0,...) at _sleep+0x372 md_kthread(c8819000,e9839d28,c0cdfcac,349,c828e550,...) at md_kthread+0x115 fork_exit(c06d6920,c8819000,e9839d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe9839d60, ebp = 0 --- Tracing command sh pid 6392 tid 100189 td 0xc8297b40 sched_switch(c8297b40,0,104,191,8561f616,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c8297b40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8cef2a8,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8cef2a8,c8cef330,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c8297b40,ffffffff,e991fc44,2,0,...) at kern_wait+0xb66 wait4(c8297b40,e991fcec,e991fd28,c0ce9b0f,0,...) at wait4+0x3b syscallenter(c8297b40,e991fce4,e991fce4,0,0,...) at syscallenter+0x263 syscall(e991fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28162deb, esp = 0xbfbfe87c, ebp = 0xbfbfe898 --- Tracing command sh pid 1781 tid 100121 td 0xc82972d0 sched_switch(c82972d0,0,104,191,68829a07,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c82972d0,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c828f2a8,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c828f2a8,c828f330,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c82972d0,ffffffff,e982ac44,2,0,...) at kern_wait+0xb66 wait4(c82972d0,e982acec,e982ad28,c0ce9b0f,0,...) at wait4+0x3b syscallenter(c82972d0,e982ace4,e982ace4,0,0,...) at syscallenter+0x263 syscall(e982ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28162deb, esp = 0xbfbfe68c, ebp = 0xbfbfe6a8 --- Tracing command bash pid 1777 tid 100086 td 0xc7cd2870 sched_switch(c7cd2870,0,104,191,1a30a2c2,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7cd2870,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7cca000,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7cca000,c7cca088,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c7cd2870,ffffffff,e9752c44,6,0,...) at kern_wait+0xb66 wait4(c7cd2870,e9752cec,e9752d28,c0ce9b0f,0,...) at wait4+0x3b syscallenter(c7cd2870,e9752ce4,e9752ce4,0,0,...) at syscallenter+0x263 syscall(e9752d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c2deb, esp = 0xbfbfe7cc, ebp = 0xbfbfe7e8 --- Tracing command csh pid 1773 tid 100161 td 0xc838a000 sched_switch(c838a000,0,104,191,5fa25d0d,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,68,...) at mi_switch+0x200 sleepq_switch(c838a000,0,c0ce92d6,1a7,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c837c850,68,c0c953f3,100,0,...) at sleepq_wait_sig+0x17 _sleep(c837c850,c837c880,168,c0c953f3,0,...) at _sleep+0x35c kern_sigsuspend(c838a000,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c838a000,e98aacec,e98aad28,c0ce9b0f,0,...) at sigsuspend+0x4d syscallenter(c838a000,e98aace4,e98aace4,0,0,...) at syscallenter+0x263 syscall(e98aad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c87b, esp = 0xbfbfe5dc, ebp = 0xbfbfe648 --- Tracing command su pid 1772 tid 100107 td 0xc7c55b40 sched_switch(c7c55b40,0,104,191,141c4fbd,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7c55b40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c53aa0,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c53aa0,c7c53b28,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c7c55b40,6ed,e97c3c44,2,0,...) at kern_wait+0xb66 wait4(c7c55b40,e97c3cec,281cba8c,1,0,...) at wait4+0x3b syscallenter(c7c55b40,e97c3ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e97c3d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28123deb, esp = 0xbfbfe60c, ebp = 0xbfbfe628 --- Tracing command bash pid 1767 tid 100100 td 0xc7c7fb40 sched_switch(c7c7fb40,0,104,191,1c4e9d08,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7c7fb40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c8a000,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c8a000,c7c8a088,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c7c7fb40,ffffffff,e978ac44,6,0,...) at kern_wait+0xb66 wait4(c7c7fb40,e978acec,e978ad28,c0ce9b0f,0,...) at wait4+0x3b syscallenter(c7c7fb40,e978ace4,e978ace4,0,0,...) at syscallenter+0x263 syscall(e978ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c2deb, esp = 0xbfbfe9bc, ebp = 0xbfbfe9d8 --- Tracing command sshd pid 1766 tid 100169 td 0xc8385870 sched_switch(c8385870,0,104,191,87739123,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c8385870,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c7c19e90,0,c0ce325f,c8385870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c19ea4,0,e98c5a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c19ea4,c7c19e90,c0ceb69b,627,c80c78c0,...) at _cv_wait_sig+0x243 seltdwait(c80c78c0,58,c8807380,c8385870,246,...) at seltdwait+0xa2 kern_select(c8385870,a,288060b8,288060dc,0,0,20,c837f7f8,c837f7f8) at kern_select+0x504 select(c8385870,e98c5cec,e98c5d28,c0ce9b0f,0,...) at select+0x66 syscallenter(c8385870,e98c5ce4,e98c5ce4,0,e98c5ca4,...) at syscallenter+0x263 syscall(e98c5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284b01f3, esp = 0xbfbfe1bc, ebp = 0xbfbfe208 --- Tracing command sshd pid 1764 tid 100108 td 0xc7c55870 sched_switch(c7c55870,0,104,191,ee68d1fb,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,58,...) at mi_switch+0x200 sleepq_switch(c7c55870,0,c0ce92d6,1a7,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c82c4254,58,c0ceefce,100,0,...) at sleepq_wait_sig+0x17 _sleep(c82c4254,c82c4214,158,c0ceefce,0) at _sleep+0x35c sbwait(c82c41f0,4,c0cef09d,5c9,c82c4214,...) at sbwait+0x76 soreceive_generic(c82c419c,0,e97c7c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c82c419c,0,e97c7c28,0,0,0) at soreceive+0x38 soo_read(c7c5c540,e97c7c28,c87f6680,0,c7c55870,...) at soo_read+0x4e dofileread(e97c7c28,ffffffff,ffffffff,0,c7c5c540,...) at dofileread+0x9e kern_readv(c7c55870,5,e97c7c28,e97c7c48,1,...) at kern_readv+0x58 read(c7c55870,e97c7cec,e97c7d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c7c55870,e97c7ce4,e97c7ce4,0,0,...) at syscallenter+0x263 syscall(e97c7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284b0273, esp = 0xbfbfdd8c, ebp = 0xbfbfddc8 --- Tracing command getty pid 1527 tid 100117 td 0xc80d2b40 sched_switch(c80d2b40,0,104,191,6067c3c8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80d2b40,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c80d2b40,c80d2b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ec3a70,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ec3a70,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6ec3a00,c6ec3a70,e981cc28,1,0,...) at tty_wait+0x71 ttydisc_read(c6ec3a00,e981cc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2800,e981cc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c9e508,e981cc28,c6d7be80,0,c80d2b40,...) at devfs_read_f+0x7e dofileread(e981cc28,ffffffff,ffffffff,0,c7c9e508,...) at dofileread+0x9e kern_readv(c80d2b40,0,e981cc28,e981cc48,1,...) at kern_readv+0x58 read(c80d2b40,e981ccec,e981cd28,c0ce9b0f,0,...) at read+0x4f syscallenter(c80d2b40,e981cce4,e981cce4,0,0,...) at syscallenter+0x263 syscall(e981cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1526 tid 100139 td 0xc80d3870 sched_switch(c80d3870,0,104,191,607c3cab,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80d3870,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c80d3870,c80d3870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ec3c70,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ec3c70,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6ec3c00,c6ec3c70,e9867c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6ec3c00,e9867c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2900,e9867c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c80c7620,e9867c28,c6d7be80,0,c80d3870,...) at devfs_read_f+0x7e dofileread(e9867c28,ffffffff,ffffffff,0,c80c7620,...) at dofileread+0x9e kern_readv(c80d3870,0,e9867c28,e9867c48,1,...) at kern_readv+0x58 read(c80d3870,e9867cec,e9867d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c80d3870,e9867ce4,e9867ce4,0,0,...) at syscallenter+0x263 syscall(e9867d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1525 tid 100160 td 0xc838a2d0 sched_switch(c838a2d0,0,104,191,608c7f0f,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c838a2d0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c838a2d0,c838a2d0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ec3e70,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ec3e70,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6ec3e00,c6ec3e70,e98a7c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6ec3e00,e98a7c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2a00,e98a7c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5c000,e98a7c28,c6d7be80,0,c838a2d0,...) at devfs_read_f+0x7e dofileread(e98a7c28,ffffffff,ffffffff,0,c7c5c000,...) at dofileread+0x9e kern_readv(c838a2d0,0,e98a7c28,e98a7c48,1,...) at kern_readv+0x58 read(c838a2d0,e98a7cec,e98a7d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c838a2d0,e98a7ce4,e98a7ce4,0,0,...) at syscallenter+0x263 syscall(e98a7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1524 tid 100145 td 0xc838d000 sched_switch(c838d000,0,104,191,603c0012,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c838d000,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c838d000,c838d000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7170070,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7170070,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7170000,c7170070,e987ac28,1,0,...) at tty_wait+0x71 ttydisc_read(c7170000,e987ac28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2b00,e987ac28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c9e738,e987ac28,c6d7be80,0,c838d000,...) at devfs_read_f+0x7e dofileread(e987ac28,ffffffff,ffffffff,0,c7c9e738,...) at dofileread+0x9e kern_readv(c838d000,0,e987ac28,e987ac48,1,...) at kern_readv+0x58 read(c838d000,e987acec,e987ad28,c0ce9b0f,0,...) at read+0x4f syscallenter(c838d000,e987ace4,e987ace4,0,0,...) at syscallenter+0x263 syscall(e987ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1523 tid 100150 td 0xc838b870 sched_switch(c838b870,0,104,191,608f6759,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c838b870,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c838b870,c838b870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7170270,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7170270,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7170200,c7170270,e9889c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7170200,e9889c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2c00,e9889c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c80c70e0,e9889c28,c6d7be80,0,c838b870,...) at devfs_read_f+0x7e dofileread(e9889c28,ffffffff,ffffffff,0,c80c70e0,...) at dofileread+0x9e kern_readv(c838b870,0,e9889c28,e9889c48,1,...) at kern_readv+0x58 read(c838b870,e9889cec,e9889d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c838b870,e9889ce4,e9889ce4,0,0,...) at syscallenter+0x263 syscall(e9889d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1522 tid 100134 td 0xc80cdb40 sched_switch(c80cdb40,0,104,191,601d669a,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80cdb40,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c80cdb40,c80cdb40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7170470,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7170470,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7170400,c7170470,e9854c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7170400,e9854c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2d00,e9854c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5cab8,e9854c28,c6d7be80,0,c80cdb40,...) at devfs_read_f+0x7e dofileread(e9854c28,ffffffff,ffffffff,0,c7c5cab8,...) at dofileread+0x9e kern_readv(c80cdb40,0,e9854c28,e9854c48,1,...) at kern_readv+0x58 read(c80cdb40,e9854cec,e9854d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c80cdb40,e9854ce4,e9854ce4,0,0,...) at syscallenter+0x263 syscall(e9854d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1521 tid 100146 td 0xc8387870 sched_switch(c8387870,0,104,191,60776a66,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c8387870,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c8387870,c8387870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ec2670,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ec2670,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6ec2600,c6ec2670,e987dc28,1,0,...) at tty_wait+0x71 ttydisc_read(c6ec2600,e987dc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2e00,e987dc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5bdc8,e987dc28,c6d7be80,0,c8387870,...) at devfs_read_f+0x7e dofileread(e987dc28,ffffffff,ffffffff,0,c7c5bdc8,...) at dofileread+0x9e kern_readv(c8387870,0,e987dc28,e987dc48,1,...) at kern_readv+0x58 read(c8387870,e987dcec,e987dd28,c0ce9b0f,0,...) at read+0x4f syscallenter(c8387870,e987dce4,e987dce4,0,0,...) at syscallenter+0x263 syscall(e987dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1520 tid 100131 td 0xc80d25a0 sched_switch(c80d25a0,0,104,191,60937469,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80d25a0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,c80d25a0,c80d25a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ec2070,0,c0ceda10,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ec2070,c0e48eb0,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6ec2000,c6ec2070,e9848c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6ec2000,e9848c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c715e000,e9848c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5cb98,e9848c28,c6d7be80,0,c80d25a0,...) at devfs_read_f+0x7e dofileread(e9848c28,ffffffff,ffffffff,0,c7c5cb98,...) at dofileread+0x9e kern_readv(c80d25a0,0,e9848c28,e9848c48,1,...) at kern_readv+0x58 read(c80d25a0,e9848cec,e9848d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c80d25a0,e9848ce4,e9848ce4,0,0,...) at syscallenter+0x263 syscall(e9848d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1519 tid 100114 td 0xc7c7f2d0 sched_switch(c7c7f2d0,0,104,191,14b659b8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7c7f2d0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c6ec2204,0,c0ce325f,c7c7f2d0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ec2270,0,e9812ad8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ec2270,c6ec2204,c0ced3ae,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6ec2200,c6ec2270,e9812c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6ec2200,e9812c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6de2c00,e9812c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5c3f0,e9812c28,c6d7be80,0,c7c7f2d0,...) at devfs_read_f+0x7e dofileread(e9812c28,ffffffff,ffffffff,0,c7c5c3f0,...) at dofileread+0x9e kern_readv(c7c7f2d0,0,e9812c28,e9812c48,1,...) at kern_readv+0x58 read(c7c7f2d0,e9812cec,e9812d28,c0ce9b0f,0,...) at read+0x4f syscallenter(c7c7f2d0,e9812ce4,e9812ce4,0,0,...) at syscallenter+0x263 syscall(e9812d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command inetd pid 1488 tid 100118 td 0xc80d2870 sched_switch(c80d2870,0,104,191,52db14f4,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80d2870,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c7c19dd0,0,c0ce325f,c80d2870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c19de4,0,e9820a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c19de4,c7c19dd0,c0ceb69b,627,c7cf9690,...) at _cv_wait_sig+0x243 seltdwait(c7cf9690,58,c6d7be80,c80d2870,c0ce325f,...) at seltdwait+0xa2 kern_select(c80d2870,6,bfbfdfc0,0,0,0,20,c80c9d48,c80c9d48) at kern_select+0x504 select(c80d2870,e9820cec,e9820d28,c0ce9b0f,0,...) at select+0x66 syscallenter(c80d2870,e9820ce4,e9820ce4,0,0,...) at syscallenter+0x263 syscall(e9820d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281aa1f3, esp = 0xbfbfdf7c, ebp = 0xbfbfee08 --- Tracing command moused pid 1462 tid 100143 td 0xc7ccb000 sched_switch(c7ccb000,0,104,191,47e52922,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7ccb000,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c72ef810,0,c0ce325f,c7ccb000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72ef824,0,e9874a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72ef824,c72ef810,c0ceb69b,627,c7cf9a80,...) at _cv_wait_sig+0x243 seltdwait(c7cf9a80,58,c6d7be80,c7ccb000,0,...) at seltdwait+0xa2 kern_select(c7ccb000,6,bfbfea24,0,0,0,20,c83827f8,c83827f8) at kern_select+0x504 select(c7ccb000,e9874cec,e9874d28,c0ce9b0f,0,...) at select+0x66 syscallenter(c7ccb000,e9874ce4,e9874ce4,0,0,...) at syscallenter+0x263 syscall(e9874d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281b21f3, esp = 0xbfbfe9bc, ebp = 0xbfbfeb48 --- Tracing command cron pid 1378 tid 100093 td 0xc7c802d0 sched_switch(c7c802d0,0,104,191,3189efd2,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7c802d0,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(ea61,c08f9e90,c7c802d0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e49744,5c,c0ce5d54,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e49744,0,15c,c0ce5d54,ea61,...) at _sleep+0x328 kern_nanosleep(c7c802d0,e976ec34,e976ec3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c7c802d0,e976ecec,e976ed28,c0ce9b0f,0,...) at nanosleep+0x6f syscallenter(c7c802d0,e976ece4,e976ece4,0,0,...) at syscallenter+0x263 syscall(e976ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28184543, esp = 0xbfbfec6c, ebp = 0xbfbfec98 --- Tracing command sendmail pid 1371 tid 100122 td 0xc8297000 sched_switch(c8297000,0,104,191,cdf5015f,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,68,...) at mi_switch+0x200 sleepq_switch(c8297000,0,c0ce92d6,1a7,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c828f058,68,c0c953f3,100,0,...) at sleepq_wait_sig+0x17 _sleep(c828f058,c828f088,168,c0c953f3,0,...) at _sleep+0x35c kern_sigsuspend(c8297000,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c8297000,e982dcec,e982dd28,c0ce9b0f,0,...) at sigsuspend+0x4d syscallenter(c8297000,e982dce4,e982dce4,0,0,...) at syscallenter+0x263 syscall(e982dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2833787b, esp = 0xbfbfcfbc, ebp = 0xbfbfcfe8 --- Tracing command sendmail pid 1367 tid 100099 td 0xc7cd1000 sched_switch(c7cd1000,0,104,191,bc9bf48a,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cd1000,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9786a14,c08acdca,c7c19c90,0,c7cd1000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7c19ca4,0,e9786a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7c19ca4,c7c19c90,1389,627,c7c5b8f8,...) at _cv_timedwait_sig+0x252 seltdwait(e9786bf8,e9786c00,c7c18880,c7cd1000,c15aea94,...) at seltdwait+0x8a kern_select(c7cd1000,5,bfbfc530,0,0,e9786c40,20,5,0) at kern_select+0x504 select(c7cd1000,e9786cec,e9786d28,c0ce9b0f,0,...) at select+0x66 syscallenter(c7cd1000,e9786ce4,e9786ce4,0,246,...) at syscallenter+0x263 syscall(e9786d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283e01f3, esp = 0xbfbfc49c, ebp = 0xbfbfcfc8 --- Tracing command sshd pid 1359 tid 100130 td 0xc82925a0 sched_switch(c82925a0,0,104,191,e8460b86,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c82925a0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c7bc3890,0,c0ce325f,c82925a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7bc38a4,0,e9845a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7bc38a4,c7bc3890,c0ceb69b,627,c7c5cd90,...) at _cv_wait_sig+0x243 seltdwait(c7c5cd90,58,c7c18e00,c82925a0,c0d11f5e,...) at seltdwait+0xa2 kern_select(c82925a0,5,2880c0b0,0,0,0,20,c80ccaa0,c80ccaa0) at kern_select+0x504 select(c82925a0,e9845cec,2880d070,1,0,...) at select+0x66 syscallenter(c82925a0,e9845ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e9845d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284b01f3, esp = 0xbfbfe27c, ebp = 0xbfbfee18 --- Tracing command ntpd pid 1314 tid 100091 td 0xc7c805a0 sched_switch(c7c805a0,0,104,191,bdabea2d,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7c805a0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c7bc3850,0,c0ce325f,c7c805a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7bc3864,0,e9766a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7bc3864,c7bc3850,c0ceb69b,627,c7cf9d58,...) at _cv_wait_sig+0x243 seltdwait(c7cf9d58,58,c6d7be80,c7c805a0,0,...) at seltdwait+0xa2 kern_select(c7c805a0,1c,bfbfed08,0,0,0,20,c7c8a7f8,c7c8a7f8) at kern_select+0x504 select(c7c805a0,e9766cec,e9766d80,e9766c88,0,...) at select+0x66 syscallenter(c7c805a0,e9766ce4,c0c04bd6,fffffffe,246,...) at syscallenter+0x263 syscall(e9766d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283581f3, esp = 0xbfbfecdc, ebp = 0xbfbfeda8 --- Tracing command nfsd pid 1176 tid 100138 td 0xc80d3b40 sched_switch(c80d3b40,0,104,191,15dd18ed,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80d3b40,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9862be0,c08acdca,c6fe5c80,0,c80d3b40,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d07690,0,e9862c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d07690,c6fe5c80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(e9862d14,c0892338,c6fe5c80,e9862d28,c0cdfcac,...) at svc_run_internal+0x356 svc_thread_start(c6fe5c80,e9862d28,c0cdfcac,349,c7cca2a8,...) at svc_thread_start+0x10 fork_exit(c0abbda0,c6fe5c80,e9862d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 1176 tid 100137 td 0xc8292000 sched_switch(c8292000,0,104,191,15dcaef8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c8292000,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e985fbe0,c08acdca,c6fe5c80,0,c8292000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d076d0,0,e985fc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d076d0,c6fe5c80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(e985fd14,c0892338,c6fe5c80,e985fd28,c0cdfcac,...) at svc_run_internal+0x356 svc_thread_start(c6fe5c80,e985fd28,c0cdfcac,349,c7cca2a8,...) at svc_thread_start+0x10 fork_exit(c0abbda0,c6fe5c80,e985fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 1176 tid 100136 td 0xc82922d0 sched_switch(c82922d0,0,104,191,158a75a0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c82922d0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e985cbe0,c08acdca,c6fe5c80,0,c82922d0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d07710,0,e985cc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d07710,c6fe5c80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(e985cd14,c0892338,c6fe5c80,e985cd28,c0cdfcac,...) at svc_run_internal+0x356 svc_thread_start(c6fe5c80,e985cd28,c0cdfcac,349,c7cca2a8,...) at svc_thread_start+0x10 fork_exit(c0abbda0,c6fe5c80,e985cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 1176 tid 100085 td 0xc7cd2b40 sched_switch(c7cd2b40,0,104,191,15dcec6a,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cd2b40,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e974eab0,c08acdca,c6fe5c80,0,c7cd2b40,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c6f60d10,0,e974eae8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c6f60d10,c6fe5c80,1388,3b1,c80d3b40,...) at _cv_timedwait_sig+0x252 svc_run_internal(c7cd2ce8,14,c0d09584,c0d0804a,e974ec0c,...) at svc_run_internal+0x356 svc_run(c6fe5c80,0,c0d08325,1c2,0,...) at svc_run+0x7b nfssvc_nfsd(bfbfe8a0,e974ec0c,c,c6d7be80,e974ec20,...) at nfssvc_nfsd+0xad nfssvc_nfsserver(c7cd2b40,e974ecec,c7cca2a8,0,c7cd2b40,...) at nfssvc_nfsserver+0x24f nfssvc(c7cd2b40,e974ecec,e974ed28,c0ce9b0f,0,...) at nfssvc+0x83 syscallenter(c7cd2b40,e974ece4,e974ece4,0,0,...) at syscallenter+0x263 syscall(e974ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280dc47b, esp = 0xbfbfe85c, ebp = 0xbfbfeac8 --- Tracing command nfsd pid 1175 tid 100087 td 0xc7c80b40 sched_switch(c7c80b40,0,104,191,17c11bf4,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7c80b40,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c7c9a710,0,c0ce325f,c7c80b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c9a724,0,e9756a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c9a724,c7c9a710,c0ceb69b,627,c80c7658,...) at _cv_wait_sig+0x243 seltdwait(c80c7658,58,c6d7be80,c7c80b40,c0d11f5e,...) at seltdwait+0xa2 kern_select(c7c80b40,5,bfbfecd0,0,0,0,20,c7c8ad48,c7c8ad48) at kern_select+0x504 select(c7c80b40,e9756cec,bfbffff4,1,0,...) at select+0x66 syscallenter(c7c80b40,e9756ce4,c0c04f1d,c0e48eb0,0,...) at syscallenter+0x263 syscall(e9756d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281841f3, esp = 0xbfbfeacc, ebp = 0xbfbfee08 --- Tracing command mountd pid 1166 tid 100078 td 0xc7c81b40 sched_switch(c7c81b40,0,104,191,85246552,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7c81b40,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c72ef690,0,c0ce325f,c7c81b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72ef6a4,0,e9732a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72ef6a4,c72ef690,c0ceb69b,627,c80c7888,...) at _cv_wait_sig+0x243 seltdwait(c80c7888,58,c6d7be80,c7c81b40,c0f893b0,...) at seltdwait+0xa2 kern_select(c7c81b40,9,bfbfed5c,0,0,0,20,c6f7baa0,c6f7baa0) at kern_select+0x504 select(c7c81b40,e9732cec,e9732d28,c0ce9b0f,0,...) at select+0x66 syscallenter(c7c81b40,e9732ce4,e9732ce4,0,246,...) at syscallenter+0x263 syscall(e9732d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819a1f3, esp = 0xbfbfed2c, ebp = 0xbfbfedf8 --- Tracing command rpcbind pid 1069 tid 100098 td 0xc7cd12d0 sched_switch(c7cd12d0,0,104,191,f20e3be4,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cd12d0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9782a6c,c08acdca,c72ef850,0,c7cd12d0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c72ef864,0,e9782aa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c72ef864,c72ef850,7531,627,e9782b5c,...) at _cv_timedwait_sig+0x252 seltdwait(e9782c2c,e9782c34,535,c7cd12d0,e9782b2c,...) at seltdwait+0x8a poll(c7cd12d0,e9782cec,e9782d28,c0ce9b0f,0,...) at poll+0x300 syscallenter(c7cd12d0,e9782ce4,e9782ce4,0,0,...) at syscallenter+0x263 syscall(e9782d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x2814007b, esp = 0xbfbfcbcc, ebp = 0xbfbfed98 --- Tracing command syslogd pid 1036 tid 100084 td 0xc7cd3000 sched_switch(c7cd3000,0,104,191,972e3a5a,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cd3000,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c72efc50,0,c0ce325f,c7cd3000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72efc64,0,e974aa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72efc64,c72efc50,c0ceb69b,627,c80c7118,...) at _cv_wait_sig+0x243 seltdwait(c80c7118,58,c6d7be80,c7cd3000,0,...) at seltdwait+0xa2 kern_select(c7cd3000,9,2847f0ac,0,0,0,20,c7cca550,c7cca550) at kern_select+0x504 select(c7cd3000,e974acec,e974ad28,c0ce9b0f,0,...) at select+0x66 syscallenter(c7cd3000,e974ace4,e974ace4,0,246,...) at syscallenter+0x263 syscall(e974ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281991f3, esp = 0xbfbfe2bc, ebp = 0xbfbfee08 --- Tracing command devd pid 835 tid 100097 td 0xc7cd15a0 sched_switch(c7cd15a0,0,104,191,84b2b0d6,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cd15a0,0,c0ce92d6,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdca,c7c9a010,0,c0ce325f,c7cd15a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c9a024,0,e977ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c9a024,c7c9a010,c0ceb69b,627,c7c5b348,...) at _cv_wait_sig+0x243 seltdwait(c7c5b348,58,c6d7be80,c7cd15a0,3,...) at seltdwait+0xa2 kern_select(c7cd15a0,6,bfbfe980,0,0,0,20,c7cc8000,c7cc8000) at kern_select+0x504 select(c7cd15a0,e977ecec,e977ed28,c0ce9b0f,0,...) at select+0x66 syscallenter(c7cd15a0,e977ece4,e977ece4,0,ec,...) at syscallenter+0x263 syscall(e977ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x808b793, esp = 0xbfbfe94c, ebp = 0xbfbfee28 --- Tracing command flowcleaner pid 21 tid 100075 td 0xc704eb40 sched_switch(c704eb40,0,104,191,cc3e03ba,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704eb40,0,c0ce92d6,28b,c704eb40,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb68a8,0,e753acac,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c0fb68a8,c0fb68b0,4e20,620,c704eb40,...) at _cv_timedwait+0x252 flowtable_cleaner(0,e753ad28,c0cdfcac,349,c7bf4000,...) at flowtable_cleaner+0x1ae fork_exit(c096be40,0,e753ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe753ad60, ebp = 0 --- Tracing command softdepflush pid 20 tid 100074 td 0xc7161000 kdb_enter(c0ce4ad6,c0ce4ad6,c0d0c450,e7537b1c,3,...) at kdb_enter+0x3a panic(c0d0c450,c888a100,c0d0e420,8109,0,...) at panic+0x134 worklist_insert(6bf,0,1,0,0,...) at worklist_insert+0x73 indir_trunc(fffffff4,ffffffff,c8a1c500,c8cba400,c8a76200,...) at indir_trunc+0x4c7 handle_workitem_indirblk(4,c0ce325f,df,c8cba400,c8cba400,...) at handle_workitem_indirblk+0x67 handle_workitem_freeblocks(0,e7537c74,2,5dd,8,...) at handle_workitem_freeblocks+0x95 process_worklist_item(c0fc2018,0,c0d0c39c,569,c7161000,...) at process_worklist_item+0x21c softdep_process_worklist(c7c172d4,0,c0d0c39c,4db,3e8,...) at softdep_process_worklist+0x8c softdep_flush(0,e7537d28,c0cdfcac,349,c7bf42a8,...) at softdep_flush+0x2a0 fork_exit(c0b03680,0,e7537d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7537d60, ebp = 0 --- Tracing command vnlru pid 19 tid 100073 td 0xc71612d0 sched_switch(c71612d0,0,104,191,cd8bcb62,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,50,...) at mi_switch+0x200 sleepq_switch(c71612d0,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c7bf4550,50,c0cf3562,0,0,...) at sleepq_timedwait+0x6b _sleep(c7bf4550,c0fb6678,250,c0cf3562,3e8,...) at _sleep+0x342 vnlru_proc(0,e7534d28,c0cdfcac,349,c7bf4550,...) at vnlru_proc+0xe7 fork_exit(c0956560,0,e7534d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7534d60, ebp = 0 --- Tracing command syncer pid 18 tid 100072 td 0xc71615a0 cpustop_handler(4,e7531b30,c0c047d6,c0d22c63,ec,...) at cpustop_handler+0x34 ipi_nmi_handler(c0d22c63,ec,0,c08bcb10,c7bf47f8,...) at ipi_nmi_handler+0x2f trap(e7531b3c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08bcb15, esp = 0xe7531b7c, ebp = 0xe7531ba0 --- panic(c0d0ecbc,286,e7531bd4,c08acd43,c9259e90,...) at panic+0x35 ffs_bufwrite(dadc4da0,dadc4da0,e7531c14,c094265d,dadc4da0,...) at ffs_bufwrite+0x3e bawrite(dadc4da0,0,c0cf17ab,286,0,...) at bawrite+0x5c vop_stdfsync(e7531c6c,e7531c24,0,c0dd1600,e7531c6c,...) at vop_stdfsync+0x14d devfs_fsync(e7531c6c,c0d25536,c9259e5c,e7531c6c,c9259d98,...) at devfs_fsync+0x7c VOP_FSYNC_APV(c0dd1600,e7531c6c,c0cf25ea,6b9,c71615a0,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c0fb66b8,c0fb66a4,3e8,6e8,4e20,...) at sync_vnode+0x16b sched_sync(0,e7531d28,c0cdfcac,349,c7bf47f8,...) at sched_sync+0x282 fork_exit(c0954d50,0,e7531d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7531d60, ebp = 0 --- Tracing command bufdaemon pid 17 tid 100071 td 0xc7161870 sched_switch(c7161870,0,104,191,d08a0610,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,44,...) at mi_switch+0x200 sleepq_switch(c7161870,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb6348,44,c0cf0885,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fb6348,c0fb6350,44,c0cf0885,3e8,...) at _sleep+0x342 buf_daemon(0,e752ed28,c0cdfcac,349,c7bf4aa0,...) at buf_daemon+0x16e fork_exit(c093c290,0,e752ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe752ed60, ebp = 0 --- Tracing command pagezero pid 16 tid 100070 td 0xc7161b40 sched_switch(c7161b40,0,104,191,4f9fd02c,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7161b40,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc3edc,0,c0d14a02,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc3edc,c0fc2980,0,c0d14a02,493e0,...) at _sleep+0x342 vm_pagezero(0,e752bd28,c0cdfcac,349,c7bf4d48,...) at vm_pagezero+0xdc fork_exit(c0b49a10,0,e752bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe752bd60, ebp = 0 --- Tracing command vmdaemon pid 15 tid 100069 td 0xc7162000 sched_switch(c7162000,0,104,191,97477767,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,68,...) at mi_switch+0x200 sleepq_switch(c7162000,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0fc3ad0,68,c0cf0885,0,0,...) at sleepq_wait+0x63 _sleep(c0fc3ad0,c0fc3ad4,68,c0cf0885,0,...) at _sleep+0x372 vm_daemon(0,e7528d28,c0cdfcac,349,c6d9a2a8,...) at vm_daemon+0x59 fork_exit(c0b43890,0,e7528d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7528d60, ebp = 0 --- Tracing command pagedaemon pid 9 tid 100068 td 0xc71622d0 sched_switch(c71622d0,0,104,191,ca6ecd53,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,44,...) at mi_switch+0x200 sleepq_switch(c71622d0,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc3a98,44,c0cf0885,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc3a98,c0fc2980,44,c0cf0885,1388,...) at _sleep+0x342 vm_pageout(0,e7525d28,c0cdfcac,349,c6d9a550,...) at vm_pageout+0x2c7 fork_exit(c0b44900,0,e7525d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7525d60, ebp = 0 --- Tracing command xpt_thrd pid 8 tid 100067 td 0xc71625a0 sched_switch(c71625a0,0,104,191,92466e8a,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c71625a0,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e153d4,4c,c0c7b80d,0,0,...) at sleepq_wait+0x63 _sleep(c0e153d4,c0e15418,4c,c0c7b80d,0,...) at _sleep+0x372 xpt_scanner_thread(0,e7522d28,c0cdfcac,349,c6d9a7f8,...) at xpt_scanner_thread+0x47 fork_exit(c0485c70,0,e7522d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7522d60, ebp = 0 --- Tracing command sctp_iterator pid 7 tid 100066 td 0xc7162870 sched_switch(c7162870,0,104,191,f71b39ef,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7162870,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0fb80d8,0,c0cff380,0,0,...) at sleepq_wait+0x63 _sleep(c0fb80d8,c0fb80a0,0,c0cff380,0,...) at _sleep+0x372 sctp_iterator_thread(0,e751fd28,c0cdfcac,349,c6d9aaa0,...) at sctp_iterator_thread+0x5c fork_exit(c09e5eb0,0,e751fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe751fd60, ebp = 0 --- Tracing command fdc0 pid 6 tid 100062 td 0xc70245a0 sched_switch(c70245a0,0,104,191,6827af30,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c70245a0,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c705603c,4c,c0cd98ed,0,0,...) at sleepq_timedwait+0x6b _sleep(c705603c,c70560f0,4c,c0cd98ed,3e8,...) at _sleep+0x342 fdc_thread(c7056000,e7513d28,c0cdfcac,349,c6d9ad48,...) at fdc_thread+0x27d fork_exit(c0bc8590,c7056000,e7513d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7513d60, ebp = 0 --- Tracing command fw0_probe pid 5 tid 100060 td 0xc7024b40 sched_switch(c7024b40,0,104,191,99b5a917,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7024b40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7059000,5c,c0cd98ed,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7059000,c705d488,15c,c0cd98ed,0,...) at _sleep+0x35c fw_bus_probe_thread(c7059000,e7503d28,c0cdfcac,349,c6f7b000,...) at fw_bus_probe_thread+0xa08 fork_exit(c067b970,c7059000,e7503d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7503d60, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc704c870 sched_switch(c704c870,0,104,191,8761e0d9,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704c870,0,c0ce92d6,268,c704c870,...) at sleepq_switch+0x15f sleepq_wait(c7034d34,0,e74f0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034d34,c7034dd4,c0cd2114,6c,c7034d3c,...) at _cv_wait+0x243 usb_process(c7034d2c,e74f0d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7034d2c,e74f0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74f0d60, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc704cb40 sched_switch(c704cb40,0,104,191,226b2922,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704cb40,0,c0ce92d6,268,c704cb40,...) at sleepq_switch+0x15f sleepq_wait(c7034d04,0,e74edcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034d04,c7034dd4,c0cd2114,6c,c7034d0c,...) at _cv_wait+0x243 usb_process(c7034cfc,e74edd28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7034cfc,e74edd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74edd60, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xc704e000 sched_switch(c704e000,0,104,191,86fa250a,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704e000,0,c0ce92d6,268,c704e000,...) at sleepq_switch+0x15f sleepq_wait(c7034cd4,0,e74eacac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034cd4,c7034dd4,c0cd2114,6c,c7034cdc,...) at _cv_wait+0x243 usb_process(c7034ccc,e74ead28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7034ccc,e74ead28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74ead60, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc704e2d0 sched_switch(c704e2d0,0,104,191,86fa1490,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704e2d0,0,c0ce92d6,268,c704e2d0,...) at sleepq_switch+0x15f sleepq_wait(c7034ca4,0,e74e7cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034ca4,c7034dd4,c0cd2114,6c,c7034cac,...) at _cv_wait+0x243 usb_process(c7034c9c,e74e7d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7034c9c,e74e7d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74e7d60, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc7022000 sched_switch(c7022000,0,104,191,86f9fe5b,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7022000,0,c0ce92d6,268,c7022000,...) at sleepq_switch+0x15f sleepq_wait(c702db5c,0,e74decac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702db5c,c702dbfc,c0cd2114,6c,c702db64,...) at _cv_wait+0x243 usb_process(c702db54,e74ded28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c702db54,e74ded28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74ded60, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc70222d0 sched_switch(c70222d0,0,104,191,19d5b8f1,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70222d0,0,c0ce92d6,268,c70222d0,...) at sleepq_switch+0x15f sleepq_wait(c702db2c,0,e74dbcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702db2c,c702dbfc,c0cd2114,6c,c702db34,...) at _cv_wait+0x243 usb_process(c702db24,e74dbd28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c702db24,e74dbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74dbd60, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc70225a0 sched_switch(c70225a0,0,104,191,86945426,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70225a0,0,c0ce92d6,268,c70225a0,...) at sleepq_switch+0x15f sleepq_wait(c702dafc,0,e74d8cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702dafc,c702dbfc,c0cd2114,6c,c702db04,...) at _cv_wait+0x243 usb_process(c702daf4,e74d8d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c702daf4,e74d8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74d8d60, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc7022870 sched_switch(c7022870,0,104,191,86943f51,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7022870,0,c0ce92d6,268,c7022870,...) at sleepq_switch+0x15f sleepq_wait(c702dacc,0,e74d5cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702dacc,c702dbfc,c0cd2114,6c,c702dad4,...) at _cv_wait+0x243 usb_process(c702dac4,e74d5d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c702dac4,e74d5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74d5d60, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc7022b40 sched_switch(c7022b40,0,104,191,86942622,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7022b40,0,c0ce92d6,268,c7022b40,...) at sleepq_switch+0x15f sleepq_wait(c7026b5c,0,e74d1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026b5c,c7026bfc,c0cd2114,6c,c7026b64,...) at _cv_wait+0x243 usb_process(c7026b54,e74d1d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7026b54,e74d1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74d1d60, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc7023000 sched_switch(c7023000,0,104,191,161486de,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7023000,0,c0ce92d6,268,c7023000,...) at sleepq_switch+0x15f sleepq_wait(c7026b2c,0,e74cecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026b2c,c7026bfc,c0cd2114,6c,c7026b34,...) at _cv_wait+0x243 usb_process(c7026b24,e74ced28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7026b24,e74ced28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74ced60, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc70232d0 sched_switch(c70232d0,0,104,191,80b20eb5,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70232d0,0,c0ce92d6,268,c70232d0,...) at sleepq_switch+0x15f sleepq_wait(c7026afc,0,e74cbcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026afc,c7026bfc,c0cd2114,6c,c7026b04,...) at _cv_wait+0x243 usb_process(c7026af4,e74cbd28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7026af4,e74cbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74cbd60, ebp = 0 --- Tracing command usb pid 14 tid 100044 td 0xc70235a0 sched_switch(c70235a0,0,104,191,80b1fba6,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70235a0,0,c0ce92d6,268,c70235a0,...) at sleepq_switch+0x15f sleepq_wait(c7026acc,0,e74c8cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026acc,c7026bfc,c0cd2114,6c,c7026ad4,...) at _cv_wait+0x243 usb_process(c7026ac4,e74c8d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7026ac4,e74c8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74c8d60, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc7023870 sched_switch(c7023870,0,104,191,80b1e7a5,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7023870,0,c0ce92d6,268,c7023870,...) at sleepq_switch+0x15f sleepq_wait(c701db5c,0,e74c4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701db5c,c701dbfc,c0cd2114,6c,c701db64,...) at _cv_wait+0x243 usb_process(c701db54,e74c4d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c701db54,e74c4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74c4d60, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc7023b40 sched_switch(c7023b40,0,104,191,150174ac,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7023b40,0,c0ce92d6,268,c7023b40,...) at sleepq_switch+0x15f sleepq_wait(c701db2c,0,e74c1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701db2c,c701dbfc,c0cd2114,6c,c701db34,...) at _cv_wait+0x243 usb_process(c701db24,e74c1d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c701db24,e74c1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74c1d60, ebp = 0 --- Tracing command usb pid 14 tid 100041 td 0xc7024000 sched_switch(c7024000,0,104,191,804c4c15,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7024000,0,c0ce92d6,268,c7024000,...) at sleepq_switch+0x15f sleepq_wait(c701dafc,0,e74becac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701dafc,c701dbfc,c0cd2114,6c,c701db04,...) at _cv_wait+0x243 usb_process(c701daf4,e74bed28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c701daf4,e74bed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74bed60, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc7013000 sched_switch(c7013000,0,104,191,804c36e6,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7013000,0,c0ce92d6,268,c7013000,...) at sleepq_switch+0x15f sleepq_wait(c701dacc,0,e74bbcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701dacc,c701dbfc,c0cd2114,6c,c701dad4,...) at _cv_wait+0x243 usb_process(c701dac4,e74bbd28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c701dac4,e74bbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74bbd60, ebp = 0 --- Tracing command usb pid 14 tid 100038 td 0xc70135a0 sched_switch(c70135a0,0,104,191,804c23d9,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70135a0,0,c0ce92d6,268,c70135a0,...) at sleepq_switch+0x15f sleepq_wait(c7017b5c,0,e74b4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017b5c,c7017bfc,c0cd2114,6c,c7017b64,...) at _cv_wait+0x243 usb_process(c7017b54,e74b4d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7017b54,e74b4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74b4d60, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc7013870 sched_switch(c7013870,0,104,191,13ef457e,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7013870,0,c0ce92d6,268,c7013870,...) at sleepq_switch+0x15f sleepq_wait(c7017b2c,0,e74b1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017b2c,c7017bfc,c0cd2114,6c,c7017b34,...) at _cv_wait+0x243 usb_process(c7017b24,e74b1d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7017b24,e74b1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74b1d60, ebp = 0 --- Tracing command usb pid 14 tid 100036 td 0xc7013b40 sched_switch(c7013b40,0,104,191,7fe6f9fe,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7013b40,0,c0ce92d6,268,c7013b40,...) at sleepq_switch+0x15f sleepq_wait(c7017afc,0,e74aecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017afc,c7017bfc,c0cd2114,6c,c7017b04,...) at _cv_wait+0x243 usb_process(c7017af4,e74aed28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7017af4,e74aed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74aed60, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc7015000 sched_switch(c7015000,0,104,191,7fe6e70e,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7015000,0,c0ce92d6,268,c7015000,...) at sleepq_switch+0x15f sleepq_wait(c7017acc,0,e74abcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017acc,c7017bfc,c0cd2114,6c,c7017ad4,...) at _cv_wait+0x243 usb_process(c7017ac4,e74abd28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7017ac4,e74abd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74abd60, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc70155a0 sched_switch(c70155a0,0,104,191,7fe6d1c5,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70155a0,0,c0ce92d6,268,c70155a0,...) at sleepq_switch+0x15f sleepq_wait(c7007b5c,0,e74a4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007b5c,c7007bfc,c0cd2114,6c,c7007b64,...) at _cv_wait+0x243 usb_process(c7007b54,e74a4d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7007b54,e74a4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74a4d60, ebp = 0 --- Tracing command usb pid 14 tid 100032 td 0xc7015870 sched_switch(c7015870,0,104,191,11c9aba0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7015870,0,c0ce92d6,268,c7015870,...) at sleepq_switch+0x15f sleepq_wait(c7007b2c,0,e74a1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007b2c,c7007bfc,c0cd2114,6c,c7007b34,...) at _cv_wait+0x243 usb_process(c7007b24,e74a1d28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7007b24,e74a1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74a1d60, ebp = 0 --- Tracing command usb pid 14 tid 100031 td 0xc7015b40 sched_switch(c7015b40,0,104,191,7f7a59cf,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7015b40,0,c0ce92d6,268,c7015b40,...) at sleepq_switch+0x15f sleepq_wait(c7007afc,0,e749ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007afc,c7007bfc,c0cd2114,6c,c7007b04,...) at _cv_wait+0x243 usb_process(c7007af4,e749ed28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7007af4,e749ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe749ed60, ebp = 0 --- Tracing command usb pid 14 tid 100030 td 0xc6eb82d0 sched_switch(c6eb82d0,0,104,191,7f7a4530,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6eb82d0,0,c0ce92d6,268,c6eb82d0,...) at sleepq_switch+0x15f sleepq_wait(c7007acc,0,e749bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007acc,c7007bfc,c0cd2114,6c,c7007ad4,...) at _cv_wait+0x243 usb_process(c7007ac4,e749bd28,c0cdfcac,349,c6f7b2a8,...) at usb_process+0x193 fork_exit(c07e7390,c7007ac4,e749bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe749bd60, ebp = 0 --- Tracing command yarrow pid 13 tid 100017 td 0xc6eb75a0 sched_switch(c6eb75a0,0,104,191,cbef7856,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6eb75a0,0,c0ce92d6,28b,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0e49584,0,c0cd98ed,2,0,...) at sleepq_timedwait+0x6b _sleep(c0e49584,0,0,c0cd98ed,64,...) at _sleep+0x342 pause(c0cd98ed,64,c0cc5a37,111,0,...) at pause+0x47 random_kthread(0,c6b45d28,c0cdfcac,349,c6f7b550,...) at random_kthread+0x1ef fork_exit(c0758ed0,0,c6b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b45d60, ebp = 0 --- Tracing command g_down pid 4 tid 100015 td 0xc6eb7b40 sched_switch(c6eb7b40,0,104,191,d08c5610,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c6eb7b40,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e47244,4c,c0cd98ed,0,0,...) at sleepq_wait+0x63 _sleep(c0e47244,c0e471a8,24c,c0cd98ed,0,...) at _sleep+0x372 g_io_schedule_down(c6eb7b40,0,c0cdb04a,74,0,...) at g_io_schedule_down+0x5b g_down_procbody(0,c6b3fd28,c0cdfcac,349,c6d99000,...) at g_down_procbody+0x8d fork_exit(c0856730,0,c6b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b3fd60, ebp = 0 --- Tracing command g_up pid 3 tid 100014 td 0xc6eb8000 sched_switch(c6eb8000,0,104,191,d091ab97,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c6eb8000,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e47240,4c,c0cd98ed,0,0,...) at sleepq_wait+0x63 _sleep(c0e47240,c0e471c8,24c,c0cd98ed,0,...) at _sleep+0x372 g_io_schedule_up(c6eb8000,0,c0cdb04a,5d,0,...) at g_io_schedule_up+0x134 g_up_procbody(0,c6b3cd28,c0cdfcac,349,c6d992a8,...) at g_up_procbody+0x8d fork_exit(c08567c0,0,c6b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b3cd60, ebp = 0 --- Tracing command g_event pid 2 tid 100013 td 0xc6da12d0 sched_switch(c6da12d0,0,104,191,cd8c1348,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c6da12d0,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0e47238,4c,c0cd98ed,0,0,...) at sleepq_timedwait+0x6b _sleep(c0e47238,0,4c,c0cd98ed,64,...) at _sleep+0x342 g_event_procbody(0,c6b39d28,c0cdfcac,349,c6d99550,...) at g_event_procbody+0xcb fork_exit(c0856850,0,c6b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100064 td 0xc7164000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100063 td 0xc70242d0 sched_switch(c70242d0,0,109,191,7f76686a,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0ef0,...) at mi_switch+0x200 ithread_loop(c6de85d0,e7516d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de85d0,e7516d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7516d60, ebp = 0 --- Tracing command intr pid 12 tid 100061 td 0xc7024870 sched_switch(c7024870,0,109,191,14b619e2,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de1470,...) at mi_switch+0x200 ithread_loop(c6de82c0,e7506d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de82c0,e7506d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7506d60, ebp = 0 --- Tracing command intr pid 12 tid 100058 td 0xc704c2d0 sched_switch(c704c2d0,0,109,191,7ef3b732,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0570,...) at mi_switch+0x200 ithread_loop(c6de83a0,e74fad28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de83a0,e74fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74fad60, ebp = 0 --- Tracing command intr pid 12 tid 100057 td 0xc704c5a0 sched_switch(c704c5a0,0,109,191,8cb02be3,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0870,...) at mi_switch+0x200 ithread_loop(c6de83f0,e74f6d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de83f0,e74f6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74f6d60, ebp = 0 --- Tracing command intr pid 12 tid 100052 td 0xc704e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xc70132d0 sched_switch(c70132d0,0,109,191,a4f3e804,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0670,...) at mi_switch+0x200 ithread_loop(c6de8650,e74b8d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de8650,e74b8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74b8d60, ebp = 0 --- Tracing command intr pid 12 tid 100034 td 0xc70152d0 sched_switch(c70152d0,0,109,191,9f0cd266,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de06f0,...) at mi_switch+0x200 ithread_loop(c6de8080,e74a8d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de8080,e74a8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74a8d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc6eb85a0 sched_switch(c6eb85a0,0,109,191,9d3ab0de,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0770,...) at mi_switch+0x200 ithread_loop(c6de86c0,e7498d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de86c0,e7498d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7498d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc6eb8870 sched_switch(c6eb8870,0,109,191,bcbd68e8,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0470,...) at mi_switch+0x200 ithread_loop(c6de80d0,e7389d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de80d0,e7389d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7389d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc6eb8b40 sched_switch(c6eb8b40,0,109,191,7f770d66,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0af0,...) at mi_switch+0x200 ithread_loop(c6de8630,c6b8ad28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de8630,c6b8ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b8ad60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc6fa3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc6fa35a0 sched_switch(c6fa35a0,0,109,191,92436b8b,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6fa20f0,...) at mi_switch+0x200 ithread_loop(c6de8770,c6b5ad28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de8770,c6b5ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5ad60, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc6eb7000 sched_switch(c6eb7000,0,109,191,95d5d9d2,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6fa2170,...) at mi_switch+0x200 ithread_loop(c6de8780,c6b4bd28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de8780,c6b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b4bd60, ebp = 0 --- Tracing command intr pid 12 tid 100018 td 0xc6eb72d0 sched_switch(c6eb72d0,0,109,191,ce031c61,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0070,...) at mi_switch+0x200 ithread_loop(c6de8790,c6b48d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de8790,c6b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b48d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc6da15a0 sched_switch(c6da15a0,0,109,191,cd8b36eb,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de00f0,...) at mi_switch+0x200 ithread_loop(c6de87a0,c6b36d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de87a0,c6b36d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b36d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc6da1870 sched_switch(c6da1870,0,109,191,d2e884fc,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0170,...) at mi_switch+0x200 ithread_loop(c6de87b0,c6b33d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de87b0,c6b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b33d60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc6da1b40 sched_switch(c6da1b40,0,109,191,cadc8e4e,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de01f0,...) at mi_switch+0x200 ithread_loop(c6de87c0,c6b30d28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de87c0,c6b30d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b30d60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc6de9000 sched_switch(c6de9000,0,109,191,d1d5d981,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de0270,...) at mi_switch+0x200 ithread_loop(c6de87d0,c6b2dd28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de87d0,c6b2dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b2dd60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc6de92d0 sched_switch(c6de92d0,0,109,191,74a1c80b,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff2b,52d,c6de02f0,...) at mi_switch+0x200 ithread_loop(c6de87e0,c6b2ad28,c0cdfcac,349,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0895330,c6de87e0,c6b2ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b2ad60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc6de95a0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc6d9b000 sched_switch(c6d9b000,0,108,18c,d08f8fd9,...) at sched_switch+0x3bc mi_switch(108,0,c0ce66a7,9fe,c6d9b000,...) at mi_switch+0x200 sched_idletd(0,c6b23d28,c0cdfcac,349,c6d99aa0,...) at sched_idletd+0x2bf fork_exit(c08e22f0,0,c6b23d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b23d60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc6d9b2d0 cpustop_handler(2,c6b20b90,c0c047d6,c0c0ed7e,f14d68e6,...) at cpustop_handler+0x34 ipi_nmi_handler(c0c0ed7e,f14d68e6,7ffed3a8,17f80,c6d99aa0,...) at ipi_nmi_handler+0x2f trap(c6b20b9c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08c355b, esp = 0xc6b20bdc, ebp = 0xc6b20bf0 --- runq_choose_from(c0e4da78,33,c0ce66a7,4b2,c6d9b574,...) at runq_choose_from+0x8b tdq_choose(c0e4d840,4,c0ce66a7,8b1,1,...) at tdq_choose+0x4e sched_choose(c6b20c70,c08e318f,c0e4d840,14,c0ce66a7,...) at sched_choose+0x4b choosethread(c0e4d840,14,c0ce66a7,720,c0e4d840,...) at choosethread+0x8 sched_switch(c6d9b2d0,0,108,18c,d51895ef,...) at sched_switch+0x36f mi_switch(108,0,c0ce66a7,3aa,c6d9b2d0,...) at mi_switch+0x200 sched_idletd(0,c6b20d28,c0cdfcac,349,c6d99aa0,...) at sched_idletd+0x19f fork_exit(c08e22f0,0,c6b20d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b20d60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc6d9b5a0 sched_switch(c6d9b5a0,0,108,18c,d07e2f5e,...) at sched_switch+0x3bc mi_switch(108,0,c0ce66a7,3aa,c6d9b5a0,...) at mi_switch+0x200 sched_idletd(0,c6b1dd28,c0cdfcac,349,c6d99aa0,...) at sched_idletd+0x19f fork_exit(c08e22f0,0,c6b1dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b1dd60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc6d9b870 sched_switch(c6d9b870,0,108,18c,d0880ac4,...) at sched_switch+0x3bc mi_switch(108,0,c0ce66a7,3aa,c6d9b870,...) at mi_switch+0x200 sched_idletd(0,c6b1ad28,c0cdfcac,349,c6d99aa0,...) at sched_idletd+0x19f fork_exit(c08e22f0,0,c6b1ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b1ad60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc6d9bb40 sched_switch(c6d9bb40,0,104,191,1ec85b38,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6d9bb40,0,c0ce92d6,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce92d6,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6d99d48,5c,c0cebc35,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6d99d48,c6d99dd0,15c,c0cebc35,0,...) at _sleep+0x35c kern_wait(c6d9bb40,ffffffff,c6b16c44,0,0,...) at kern_wait+0xb66 wait4(c6d9bb40,c6b16cec,c6b16d28,c0ce9b0f,0,...) at wait4+0x3b syscallenter(c6d9bb40,c6b16ce4,c6b16ce4,0,0,...) at syscallenter+0x263 syscall(c6b16d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054cd3, esp = 0xbfbfe8dc, ebp = 0xbfbfe8f8 --- Tracing command audit pid 10 tid 100001 td 0xc6da1000 sched_switch(c6da1000,0,104,191,7f77c01c,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6da1000,0,c0ce92d6,268,c6da1000,...) at sleepq_switch+0x15f sleepq_wait(c0fc1880,0,c6b13c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c0fc1880,c0fc1864,c0d0a2eb,194,0,...) at _cv_wait+0x243 audit_worker(0,c6b13d28,c0cdfcac,349,c6d9a000,...) at audit_worker+0x84 fork_exit(c0acbf30,0,c6b13d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b13d60, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc7162b40 sched_switch(c7162b40,0,104,191,910bcfbd,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7162b40,0,c0ce92d6,28b,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0e49584,0,c0cdde53,2,0,...) at sleepq_timedwait+0x6b _sleep(c0e49584,0,0,c0cdde53,bb8,...) at _sleep+0x342 pause(c0cdde53,bb8,120,11e,c0e473a8,...) at pause+0x47 deadlkres(0,e751cd28,c0cdfcac,349,c0e47320,...) at deadlkres+0x302 fork_exit(c0877130,0,e751cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe751cd60, ebp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xc704c000 sched_switch(c704c000,0,104,191,cc7e287b,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704c000,0,c0ce92d6,268,c6de9000,...) at sleepq_switch+0x15f sleepq_wait(c6eabb40,0,c0ce568c,c0cd98ed,0,...) at sleepq_wait+0x63 msleep_spin(c6eabb40,c6eabb5c,c0cd98ed,0,c0ce325f,...) at msleep_spin+0x21d taskqueue_thread_loop(c705d49c,e7500d28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcfb0,c705d49c,e7500d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7500d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc6fa32d0 sched_switch(c6fa32d0,0,104,191,30c8f144,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6fa32d0,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabc80,0,c0cd98ed,0,0,...) at sleepq_wait+0x63 _sleep(c6eabc80,c6eabc9c,0,c0cd98ed,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e5bee8,c6b5dd28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fcfb0,c0e5bee8,c6b5dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc6fa3870 sched_switch(c6fa3870,0,104,191,876d6ea5,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6fa3870,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabd00,0,c0cd98ed,0,0,...) at sleepq_wait+0x63 _sleep(c6eabd00,c6eabd1c,0,c0cd98ed,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e47c78,c6b57d28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fcfb0,c0e47c78,c6b57d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b57d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc6fa3b40 sched_switch(c6fa3b40,0,104,191,876d5ac8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6fa3b40,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabd40,0,c0ce568c,c0cd98ed,0,...) at sleepq_wait+0x63 msleep_spin(c6eabd40,c6eabd5c,c0cd98ed,0,c0ce325f,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e182a0,c6b54d28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcfb0,c0e182a0,c6b54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b54d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc6de9870 sched_switch(c6de9870,0,104,191,876d4a95,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6de9870,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabd40,0,c0ce568c,c0cd98ed,0,...) at sleepq_wait+0x63 msleep_spin(c6eabd40,c6eabd5c,c0cd98ed,0,c0ce325f,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e182a0,c6b51d28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcfb0,c0e182a0,c6b51d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b51d60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc6de9b40 sched_switch(c6de9b40,0,104,191,876d3889,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6de9b40,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabd40,0,c0ce568c,c0cd98ed,0,...) at sleepq_wait+0x63 msleep_spin(c6eabd40,c6eabd5c,c0cd98ed,0,c0ce325f,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e182a0,c6b4ed28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcfb0,c0e182a0,c6b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc6eb7870 sched_switch(c6eb7870,0,104,191,9b2c019d,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6eb7870,0,c0ce92d6,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabdc0,0,c0cd98ed,0,0,...) at sleepq_wait+0x63 _sleep(c6eabdc0,c6eabddc,0,c0cd98ed,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e5a960,c6b42d28,c0cdfcac,349,c0e47320,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fcfb0,c0e5a960,c6b42d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b42d60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc0e475d0 sched_switch(c0e475d0,0,104,191,b2f296ca,...) at sched_switch+0x3bc mi_switch(104,0,c0ce92d6,1f3,44,...) at mi_switch+0x200 sleepq_switch(c0e475d0,0,c0ce92d6,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0e47320,44,c0ce6fbb,0,0,...) at sleepq_timedwait+0x6b _sleep(c0e47320,0,44,c0ce6fbb,2710,...) at _sleep+0x342 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x23e mi_startup() at mi_startup+0x96 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3439 MB Dumping 164 MB: 149 133 117 101 85 69 53 37 21 5 Dump complete = 0xf db:0:doadump> reset cpu_reset: Restarting BSP timeout stopping cpus cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 doadump () at pcpu.h:231 #1 0xc04d5b19 in db_fncall (dummy1=0xc7c172d4, dummy2=0x0, dummy3=0xffffffff, dummy4=0xe75377c0 "ÔwSç") at ../../../ddb/db_command.c:548 #2 0xc04d5f4f in db_command (last_cmdp=0xc0e1647c, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:445 #3 0xc04d6004 in db_command_script (command=0xc0e17388 "call doadump") at ../../../ddb/db_command.c:516 #4 0xc04da250 in db_script_exec (scriptname=0xc0e16ce0 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc04da2e1 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc0fe51a0, modif=0xe75378f8 "") at ../../../ddb/db_script.c:375 #6 0xc04d5f11 in db_command (last_cmdp=0xc0e1647c, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:445 #7 0xc04d606a in db_command_loop () at ../../../ddb/db_command.c:498 #8 0xc04d7f8d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc08efbee in kdb_trap (type=0x3, code=0x0, tf=0xe7537a9c) at ../../../kern/subr_kdb.c:546 #10 0xc0c04e0b in trap (frame=0xe7537a9c) at ../../../i386/i386/trap.c:732 #11 0xc0bebc5c in calltrap () at ../../../i386/i386/exception.s:168 #12 0xc08efdba in kdb_enter (why=0xc0ce4ad6 "panic", msg=0xc0ce4ad6 "panic") at cpufunc.h:71 #13 0xc08bcc14 in panic (fmt=0xc0d0c450 "worklist_insert: %p %s(0x%X) already on list") at ../../../kern/kern_shutdown.c:574 #14 0xc0af5543 in worklist_insert (head=0xe7537c00, item=0xc888a100, locked=0xc147d2c5) at ../../../ufs/ffs/ffs_softdep.c:945 #15 0xc0afc3a7 in indir_trunc (freework=0xc8a1c500, dbn=0x7200, lbn=0xfffffffffffffff4) at ../../../ufs/ffs/ffs_softdep.c:6182 #16 0xc0afcad7 in handle_workitem_indirblk (freework=0xc8a1c500) at ../../../ufs/ffs/ffs_softdep.c:5919 #17 0xc0afcb85 in handle_workitem_freeblocks (freeblks=0xc8cba400, flags=Variable "flags" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:5984 #18 0xc0afce3c in process_worklist_item (mp=0xc7c172d4, flags=Variable "flags" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:1516 #19 0xc0b0335c in softdep_process_worklist (mp=0xc7c172d4, full=0x0) at ../../../ufs/ffs/ffs_softdep.c:1360 #20 0xc0b03920 in softdep_flush () at ../../../ufs/ffs/ffs_softdep.c:1238 #21 0xc0892338 in fork_exit (callout=0xc0b03680 , arg=0x0, frame=0xe7537d28) at ../../../kern/kern_fork.c:849 #22 0xc0bebcd4 in fork_trampoline () at ../../../i386/i386/exception.s:275 (kgdb) f 14 #14 0xc0af5543 in worklist_insert (head=0xe7537c00, item=0xc888a100, locked=0xc147d2c5) at ../../../ufs/ffs/ffs_softdep.c:945 945 panic("worklist_insert: %p %s(0x%X) already on list", (kgdb) l 940 { 941 942 if (locked) 943 mtx_assert(&lk, MA_OWNED); 944 if (item->wk_state & ONWORKLIST) 945 panic("worklist_insert: %p %s(0x%X) already on list", 946 item, TYPENAME(item->wk_type), item->wk_state); 947 item->wk_state |= ONWORKLIST; 948 LIST_INSERT_HEAD(head, item, wk_list); 949 } (kgdb) p *item $1 = {wk_list = {le_next = 0xc88a4500, le_prev = 0xe7537c08}, wk_mp = 0xc7c172d4, wk_type = 0x13, wk_state = 0x8109, wk_stack_rem = {depth = 0x9, pcs = {0xc0af5c39, 0xc0afc16c, 0xc0afcad7, 0xc0afcb85, 0xc0afce3c, 0xc0b0335c, 0xc0b03920, 0xc0892338, 0xc0bebcd4, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}} (kgdb) l *0xc0af5c39 0xc0af5c39 is in worklist_remove (../../../ufs/ffs/ffs_softdep.c:965). 960 panic("worklist_remove: %p %s(0x%X) not on list", 961 item, TYPENAME(item->wk_type), item->wk_state); 962 item->wk_state &= ~ONWORKLIST; 963 LIST_REMOVE(item, wk_list); 964 stack_save(&item->wk_stack_rem); 965 } 966 #endif /* DEBUG */ 967 968 /* 969 * Merge two jsegdeps keeping only the oldest one as newer references (kgdb) l *0xc0afc16c 0xc0afc16c is in indir_trunc (../../../ufs/ffs/ffs_softdep.c:6149). 6144 cnt = 0; 6145 LIST_FOREACH_SAFE(wk, &wkhd, wk_list, wkn) { 6146 if (wk->wk_type != D_JNEWBLK) 6147 continue; 6148 WORKLIST_REMOVE_UNLOCKED(wk); 6149 jnewblk = WK_JNEWBLK(wk); 6150 if (jnewblk->jn_lbn > 0) 6151 i = (jnewblk->jn_lbn - -lbn) / lbnadd; 6152 else 6153 i = (jnewblk->jn_lbn - (lbn + level)) / lbnadd; (kgdb) l *0xc0afcad7 0xc0afcad7 is in handle_workitem_indirblk (../../../ufs/ffs/ffs_softdep.c:5921). 5916 if (freework->fw_off == NINDIR(fs)) 5917 freework_freeblock(freework); 5918 else 5919 indir_trunc(freework, fsbtodb(fs, freework->fw_blkno), 5920 freework->fw_lbn); 5921 } 5922 5923 /* 5924 * Called when a freework structure attached to a cg buf is written. The 5925 * ref on either the parent or the freeblks structure is released and (kgdb) l *0xc0afcb85 0xc0afcb85 is in handle_workitem_freeblocks (../../../ufs/ffs/ffs_softdep.c:5984). 5979 ("handle_workitem_freeblocks: Unknown type %s", 5980 TYPENAME(wk->wk_type))); 5981 WORKLIST_REMOVE_UNLOCKED(wk); 5982 freework = WK_FREEWORK(wk); 5983 if (freework->fw_lbn <= -NDADDR) 5984 handle_workitem_indirblk(freework); 5985 else 5986 freework_freeblock(freework); 5987 } 5988 ACQUIRE_LOCK(&lk); (kgdb) l *0xc0afce3c 0xc0afce3c is in process_worklist_item (../../../ufs/ffs/ffs_softdep.c:1516). 1511 vput(vp); 1512 break; 1513 1514 case D_FREEBLKS: 1515 /* releasing blocks and/or fragments from a file */ 1516 handle_workitem_freeblocks(WK_FREEBLKS(wk), flags & LK_NOWAIT); 1517 break; 1518 1519 case D_FREEFRAG: 1520 /* releasing a fragment when replaced as a file grows */ (kgdb) l *0xc0b0335c 0xc0b0335c is in softdep_process_worklist (../../../ufs/ffs/ffs_softdep.c:1360). 1355 ACQUIRE_LOCK(&lk); 1356 loopcount = 1; 1357 starttime = time_second; 1358 softdep_process_journal(mp, full?MNT_WAIT:0); 1359 while (ump->softdep_on_worklist > 0) { 1360 if ((cnt = process_worklist_item(mp, LK_NOWAIT)) == -1) 1361 break; 1362 else 1363 matchcnt += cnt; 1364 /* (kgdb) l *0xc0b03920 0xc0b03920 is in softdep_flush (../../../ufs/ffs/ffs_softdep.c:1238). 1233 if ((mp->mnt_flag & MNT_SOFTDEP) == 0) 1234 continue; 1235 if (vfs_busy(mp, MBF_NOWAIT | MBF_MNTLSTLOCK)) 1236 continue; 1237 vfslocked = VFS_LOCK_GIANT(mp); 1238 progress += softdep_process_worklist(mp, 0); 1239 ump = VFSTOUFS(mp); 1240 remaining += ump->softdep_on_worklist - 1241 ump->softdep_on_worklist_inprogress; 1242 VFS_UNLOCK_GIANT(vfslocked); (kgdb) l *0xc0892338 0xc0892338 is in fork_exit (../../../kern/kern_fork.c:855). 850 851 /* 852 * Check if a kernel thread misbehaved and returned from its main 853 * function. 854 */ 855 if (p->p_flag & P_KTHREAD) { 856 printf("Kernel thread \"%s\" (pid %d) exited prematurely.\n", 857 td->td_name, p->p_pid); 858 kproc_exit(0); 859 } (kgdb) l *0xc0bebcd4 0xc0bebcd4 is at ../../../i386/i386/exception.s:276. 271 ENTRY(fork_trampoline) 272 pushl %esp /* trapframe pointer */ 273 pushl %ebx /* arg1 */ 274 pushl %esi /* function */ 275 call fork_exit 276 addl $12,%esp 277 /* cut from syscall */ 278 279 /* 280 * Return via doreti to handle ASTs. (kgdb) git diff master diff --git a/sys/ufs/ffs/ffs_inode.c b/sys/ufs/ffs/ffs_inode.c index ffbe16e..ba2813d 100644 --- a/sys/ufs/ffs/ffs_inode.c +++ b/sys/ufs/ffs/ffs_inode.c @@ -582,9 +582,7 @@ ffs_indirtrunc(ip, lbn, dbn, lastbn, level, countp) * block to be kept. -1 indicates the entire * block so we need not calculate the index. */ - factor = 1; - for (i = SINGLE; i < level; i++) - factor *= NINDIR(fs); + factor = lbn_offset(fs, level); last = lastbn; if (lastbn > 0) last /= factor; diff --git a/sys/ufs/ffs/ffs_softdep.c b/sys/ufs/ffs/ffs_softdep.c index ca4ea0b..427828c 100644 --- a/sys/ufs/ffs/ffs_softdep.c +++ b/sys/ufs/ffs/ffs_softdep.c @@ -961,6 +961,7 @@ worklist_remove(item, locked) item, TYPENAME(item->wk_type), item->wk_state); item->wk_state &= ~ONWORKLIST; LIST_REMOVE(item, wk_list); + stack_save(&item->wk_stack_rem); } #endif /* DEBUG */ @@ -2270,7 +2271,6 @@ journal_mount(mp, fs, cred) int error; int i; - mp->mnt_kern_flag |= MNTK_SUJ; error = softdep_journal_lookup(mp, &vp); if (error != 0) { printf("Failed to find journal. Use tunefs to create one\n"); @@ -2295,20 +2295,26 @@ journal_mount(mp, fs, cred) } jblocks->jb_low = jblocks->jb_free / 3; /* Reserve 33%. */ jblocks->jb_min = jblocks->jb_free / 10; /* Suspend at 10%. */ - /* - * Only validate the journal contents if the filesystem is clean, - * otherwise we write the logs but they'll never be used. If the - * filesystem was still dirty when we mounted it the journal is - * invalid and a new journal can only be valid if it starts from a - * clean mount. - */ - if (fs->fs_clean) { - DIP_SET(ip, i_modrev, fs->fs_mtime); - ip->i_flags |= IN_MODIFIED; - ffs_update(vp, 1); - } VFSTOUFS(mp)->softdep_jblocks = jblocks; out: + if (error == 0) { + MNT_ILOCK(mp); + mp->mnt_kern_flag |= MNTK_SUJ; + MNT_IUNLOCK(mp); + /* + * Only validate the journal contents if the + * filesystem is clean, otherwise we write the logs + * but they'll never be used. If the filesystem was + * still dirty when we mounted it the journal is + * invalid and a new journal can only be valid if it + * starts from a clean mount. + */ + if (fs->fs_clean) { + DIP_SET(ip, i_modrev, fs->fs_mtime); + ip->i_flags |= IN_MODIFIED; + ffs_update(vp, 1); + } + } vput(vp); return (error); } @@ -5265,7 +5271,7 @@ softdep_setup_freeblocks(ip, length, flags) if (delay) WORKLIST_INSERT(&bp->b_dep, &freeblks->fb_list); else if (needj) - freeblks->fb_state |= DEPCOMPLETE | COMPLETE; + freeblks->fb_state |= COMPLETE; /* * Because the file length has been truncated to zero, any * pending block allocation dependency structures associated @@ -5327,8 +5333,9 @@ restart: if (inodedep_lookup(mp, ip->i_number, 0, &inodedep) != 0) (void) free_inodedep(inodedep); - if (delay) { + if (delay || needj) freeblks->fb_state |= DEPCOMPLETE; + if (delay) { /* * If the inode with zeroed block pointers is now on disk * we can start freeing blocks. Add freeblks to the worklist @@ -5339,6 +5346,8 @@ restart: if ((freeblks->fb_state & ALLCOMPLETE) == ALLCOMPLETE) add_to_worklist(&freeblks->fb_list, 1); } + if (needj && LIST_EMPTY(&freeblks->fb_jfreeblkhd)) + needj = 0; FREE_LOCK(&lk); /* @@ -5488,7 +5497,7 @@ cancel_allocdirect(adphead, adp, freeblks, delay) newblk = (struct newblk *)adp; /* * If the journal hasn't been written the jnewblk must be passed - * to the call to ffs_freeblk that reclaims the space. We accomplish + * to the call to ffs_blkfree that reclaims the space. We accomplish * this by linking the journal dependency into the freework to be * freed when freework_freeblock() is called. If the journal has * been written we can simply reclaim the journal space when the @@ -6016,11 +6025,11 @@ handle_complete_freeblocks(freeblks) vput(vp); } -#ifdef INVARIANTS - if (freeblks->fb_chkcnt != 0 && - ((fs->fs_flags & FS_UNCLEAN) == 0 || (flags & LK_NOWAIT) != 0)) - printf("handle_workitem_freeblocks: block count\n"); -#endif /* INVARIANTS */ + KASSERT(freeblks->fb_chkcnt == 0 || + ((fs->fs_flags & FS_UNCLEAN) != 0 && (flags & LK_NOWAIT) == 0), + ("handle_workitem_freeblocks: inode %ju block count %jd\n", + (uintmax_t)freeblks->fb_previousinum, + (intmax_t)freeblks->fb_chkcnt)); ACQUIRE_LOCK(&lk); /* @@ -6075,9 +6084,7 @@ indir_trunc(freework, dbn, lbn) fs_pendingblocks = 0; freedeps = 0; needj = UFSTOVFS(ump)->mnt_kern_flag & MNTK_SUJ; - lbnadd = 1; - for (i = level; i > 0; i--) - lbnadd *= NINDIR(fs); + lbnadd = lbn_offset(fs, level); /* * Get buffer of block pointers to be freed. This routine is not * called until the zero'ed inode has been written, so it is safe @@ -6136,20 +6143,17 @@ indir_trunc(freework, dbn, lbn) */ cnt = 0; LIST_FOREACH_SAFE(wk, &wkhd, wk_list, wkn) { - struct workhead freewk; if (wk->wk_type != D_JNEWBLK) continue; WORKLIST_REMOVE_UNLOCKED(wk); - LIST_INIT(&freewk); - WORKLIST_INSERT_UNLOCKED(&freewk, wk); jnewblk = WK_JNEWBLK(wk); if (jnewblk->jn_lbn > 0) i = (jnewblk->jn_lbn - -lbn) / lbnadd; else - i = (jnewblk->jn_lbn - (lbn + 1)) / lbnadd; + i = (jnewblk->jn_lbn - (lbn + level)) / lbnadd; KASSERT(i >= 0 && i < NINDIR(fs), - ("indir_trunc: Index out of range %d parent %jd lbn %jd", - i, lbn, jnewblk->jn_lbn)); + ("indir_trunc: Index out of range %d parent %jd lbn %jd level %d", + i, lbn, jnewblk->jn_lbn, level)); /* Clear the pointer so it isn't found below. */ if (ufs1fmt) { nb = bap1[i]; @@ -6161,8 +6165,25 @@ indir_trunc(freework, dbn, lbn) KASSERT(nb == jnewblk->jn_blkno, ("indir_trunc: Block mismatch %jd != %jd", nb, jnewblk->jn_blkno)); - ffs_blkfree(ump, fs, freeblks->fb_devvp, jnewblk->jn_blkno, - fs->fs_bsize, freeblks->fb_previousinum, &freewk); + if (level != 0) { + ufs_lbn_t nlbn; + + nlbn = (lbn + 1) - (i * lbnadd); + nfreework = newfreework(freeblks, freework, + nlbn, nb, fs->fs_frag, 0); + WORKLIST_INSERT_UNLOCKED(&nfreework->fw_jwork, + &jnewblk->jn_list); + freedeps++; + indir_trunc(nfreework, fsbtodb(fs, nb), nlbn); + } else { + struct workhead freewk; + + LIST_INIT(&freewk); + WORKLIST_INSERT_UNLOCKED(&freewk, wk); + ffs_blkfree(ump, fs, freeblks->fb_devvp, + jnewblk->jn_blkno, fs->fs_bsize, + freeblks->fb_previousinum, &freewk); + } cnt++; } ACQUIRE_LOCK(&lk); @@ -6772,7 +6793,8 @@ cancel_diradd(dap, dirrem, jremref, dotremref, dotdotremref) mkdir->md_jaddref = NULL; if (mkdir->md_state & MKDIR_PARENT) { if (cancel_jaddref(jaddref, NULL, - &dirrem->dm_jwork) == 0) { + &dirrem->dm_jwork) == 0 && + dotdotremref != NULL) { free_jremref(dotdotremref); dotdotremref = NULL; } diff --git a/sys/ufs/ffs/fs.h b/sys/ufs/ffs/fs.h index 42c4cfe..ba98ed3 100644 --- a/sys/ufs/ffs/fs.h +++ b/sys/ufs/ffs/fs.h @@ -607,6 +607,11 @@ struct cg { : (fragroundup(fs, blkoff(fs, (size))))) /* + * Number of indirects in a filesystem block. + */ +#define NINDIR(fs) ((fs)->fs_nindir) + +/* * Indirect lbns are aligned on NDADDR addresses where single indirects * are the negated address of the lowest lbn reachable, double indirects * are this lbn - 1 and triple indirects are this lbn - 2. This yields @@ -631,6 +636,17 @@ lbn_level(ufs_lbn_t lbn) } return (-1); } + +static inline ufs_lbn_t +lbn_offset(struct fs *fs, int level) +{ + ufs_lbn_t res; + + for (res = 1; level > 0; level--) + res *= NINDIR(fs); + return (res); +} + /* * Number of inodes in a secondary storage block/fragment. */ @@ -638,11 +654,6 @@ lbn_level(ufs_lbn_t lbn) #define INOPF(fs) ((fs)->fs_inopb >> (fs)->fs_fragshift) /* - * Number of indirects in a filesystem block. - */ -#define NINDIR(fs) ((fs)->fs_nindir) - -/* * Softdep journal record format. */ diff --git a/sys/ufs/ffs/softdep.h b/sys/ufs/ffs/softdep.h index f584e91..b71cf84 100644 --- a/sys/ufs/ffs/softdep.h +++ b/sys/ufs/ffs/softdep.h @@ -164,11 +164,13 @@ * worklist is needed in the structure, then a wk_data field must be added * and the macros below changed to use it. */ +#include struct worklist { LIST_ENTRY(worklist) wk_list; /* list of work requests */ struct mount *wk_mp; /* Mount we live in */ unsigned int wk_type:8, /* type of request */ wk_state:24; /* state flags */ + struct stack wk_stack_rem; }; #define WK_DATA(wk) ((void *)(wk)) #define WK_PAGEDEP(wk) ((struct pagedep *)(wk)) -- Test scenario s5.sh (suj5.sh - read)