GENERIC from Thu Nov 4 23:17:12 2010 +0200, r214777+softdep_insmntque 0a06f39, vmcore.19 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #0 r214777+0a06f39: Fri Nov 5 02:04:45 CET 2010 pho@x4.osted.lan:/var/tmp/deviant2/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3536277504 (3372 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 872677 free (949 frags, 108966 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 855498 free (442 frags, 106882 blocks, 0.0% fragmentation) /dev/ad4s1g: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1g: clean, 117584945 free (449 frags, 14698062 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 4259860 free (27860 frags, 529000 blocks, 0.3% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 20442439 free (13791 frags, 2553581 blocks, 0.1% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.7 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting mountd. Starting nfsd. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc7cd19dc ufs (ufs) @ kern/vfs_subr.c:2111 2nd 0xdad15ae0 bufwait (bufwait) @ ufs/ffs/ffs_softdep.c:11339 3rd 0xc809bb38 ufs (ufs) @ kern/vfs_subr.c:2111 KDB: stack backtrace: db_trace_self_wrapper(c0ceb04d,2e706564,31313a63,d393333,c090000a,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f531b,c0cee26b,c6d40168,c6d437d8,e973a890,...) at kdb_backtrace+0x2a _witness_debugger(c0cee26b,c809bb38,c0cdfb8e,c6d437d8,c0cf55aa,...) at _witness_debugger+0x25 witness_checkorder(c809bb38,9,c0cf55a1,83f,0,...) at witness_checkorder+0x839 __lockmgr_args(c809bb38,80100,c809bba4,0,0,...) at __lockmgr_args+0x814 ffs_lock(e973a9b4,c0905e4b,c0cf4920,80100,c809bae0,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0dfc400,e973a9b4,109,c0e17280,c809bae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c809bae0,80100,c0cf55a1,83f,4,...) at _vn_lock+0x78 vget(c809bae0,80100,c7c58000,50,0,...) at vget+0xbb vfs_hash_get(c7f912d4,1c8c400,80000,c7c58000,e973ab08,...) at vfs_hash_get+0xed ffs_vgetf(c7f912d4,1c8c400,80000,e973ab08,1,...) at ffs_vgetf+0x49 softdep_sync_metadata(c7cd1984,0,c0d1240d,144,0,...) at softdep_sync_metadata+0x6b9 ffs_syncvnode(c7cd1984,1,c7c58000,555,c0cf55a1,...) at ffs_syncvnode+0x3e2 ffs_sync(c7f912d4,1,c0cf4c61,4fd,80,...) at ffs_sync+0x26f dounmount(c7f912d4,8000000,c7c58000,482,5b85c5ea,...) at dounmount+0x447 unmount(c7c58000,e973acec,281760f5,1,0,...) at unmount+0x310 syscallenter(c7c58000,e973ace4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e973ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dbadf, esp = 0xbfbfe66c, ebp = 0xbfbfe738 --- lock order reversal: 1st 0xc7d50724 ufs (ufs) @ kern/vfs_mount.c:1208 2nd 0xc7cd2724 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1604 KDB: stack backtrace: db_trace_self_wrapper(c0ceb04d,36313a63,a0d3430,c0c67f00,e973a9a8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f531b,c0cee252,c6d437d8,c6d436a0,e973aa04,...) at kdb_backtrace+0x2a _witness_debugger(c0cee252,c7cd2724,c0cdb705,c6d436a0,c0d0f542,...) at _witness_debugger+0x25 witness_checkorder(c7cd2724,9,c0d0f539,644,c7cd2790,...) at witness_checkorder+0x839 __lockmgr_args(c7cd2724,80400,c7cd2790,0,0,...) at __lockmgr_args+0x814 vop_stdlock(e973ab24,c0ce6225,df,80400,c7cd26cc,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c0dd48a0,e973ab24,0,c0e17280,c7cd26cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c7cd26cc,80400,c0d0f539,644,c7f912d4,...) at _vn_lock+0x78 softdep_flushworklist(c7f912d4,e973abd0,c7c58000,563,c0cf55a1,...) at softdep_flushworklist+0x47 ffs_sync(c7f912d4,1,c0cf4c61,4fd,80,...) at ffs_sync+0x2fd dounmount(c7f912d4,8000000,c7c58000,482,5b85c5ea,...) at dounmount+0x447 unmount(c7c58000,e973acec,281760f5,1,0,...) at unmount+0x310 syscallenter(c7c58000,e973ace4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e973ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dbadf, esp = 0xbfbfe66c, ebp = 0xbfbfe738 --- ** /dev/ad4s1g ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 23473 files, 729036 used, 117584945 free (449 frags, 14698062 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** usage: kill [-s signal_name] pid ... kill -l [exit_status] kill -signal_name pid ... kill -signal_number pid ... fsck -y /tmp. Starting default moused. Starting inetd. Fri Nov 5 08:16:31 CET 2010 FreeBSD/i386 (x4.osted.lan) (console) login: Nov 5 08:17:40 x4 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xdad80a00 bufwait (bufwait) @ kern/vfs_bio.c:2659 2nd 0xc83bc400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0ceb04d,2e687361,38323a63,a0d34,a7b,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f531b,c0cee252,c6d40168,c6d43840,e980e7e8,...) at kdb_backtrace+0x2a _witness_debugger(c0cee252,c83bc400,c0d12bed,c6d43840,c0d1287f,...) at _witness_debugger+0x25 witness_checkorder(c83bc400,9,c0d12876,11c,0,...) at witness_checkorder+0x839 _sx_xlock(c83bc400,0,c0d12876,11c,c8758984,...) at _sx_xlock+0x85 ufsdirhash_acquire(dad809a0,dc714018,1e8,dc714028,e980e8b8,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c8758984,e980e914,28,e980e8a4,e980e8a8,...) at ufsdirhash_add+0x13 ufs_direnter(c876d984,c87462b8,e980e914,e980eba4,0,...) at ufs_direnter+0x749 ufs_makeinode(e980eba4,c0dfc940,e980eb00,e980ea5c,c0c240f5,...) at ufs_makeinode+0x5c5 ufs_create(e980eb00,c0d2919f,0,0,e980eb78,...) at ufs_create+0x30 VOP_CREATE_APV(c0dfc400,e980eb00,e980eba4,e980ea98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(e980eb78,e980ec2c,1a0,0,c6d7b600,...) at vn_open_cred+0x205 vn_open(e980eb78,e980ec2c,1a0,c7c787a8,0,...) at vn_open+0x3b kern_openat(c80c2000,ffffff9c,bfbfe838,0,602,...) at kern_openat+0x128 kern_open(c80c2000,bfbfe838,0,601,1b0,...) at kern_open+0x35 open(c80c2000,e980ecec,bfbfe838,1,0,...) at open+0x30 syscallenter(c80c2000,e980ece4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e980ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x28172093, esp = 0xbfbfd1fc, ebp = 0xbfbfd218 --- panic: worklist_remove: 0xc88fdb00 jnewblk(0x109) not on list cpuid = 2 KDB: enter: panic [ thread pid 20 tid 100074 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 20 tid 100074 td 0xc7161000 kdb_enter(c0ce7a94,c0ce7a94,c0d0f617,e7537a70,2,...) at kdb_enter+0x3a panic(c0d0f617,c88fdb00,c0d115e9,109,c88fdb00,...) at panic+0x134 worklist_remove(c0fc5118,0,c0d0f539,2202,0,...) at worklist_remove+0x70 softdep_setup_blkfree(c955087c,dada8b80,24dc8,0,8,...) at softdep_setup_blkfree+0x65 ffs_blkfree(c8a1f000,c9602000,c95ca570,24dc8,0,...) at ffs_blkfree+0x6fd indir_trunc(fffffff4,ffffffff,c8b78600,c9153b00,c8a1f000,...) at indir_trunc+0x552 handle_workitem_indirblk(4,c0ce6225,df,c9153b00,c9153b00,...) at handle_workitem_indirblk+0x76 handle_workitem_freeblocks(0,e7537c74,2,5e3,1e0,...) at handle_workitem_freeblocks+0x97 process_worklist_item(c0fc5118,0,c0d0f539,551,c7161000,...) at process_worklist_item+0x21c softdep_process_worklist(c955087c,0,c0d0f539,4e1,3e8,...) at softdep_process_worklist+0x8c softdep_flush(0,e7537d28,c0ce2c72,33b,c7bf42a8,...) at softdep_flush+0x2a0 fork_exit(c0b05d70,0,e7537d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7537d60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x60d680 curthread = 0xc6de95a0: pid 12 "swi4: clock" curpcb = 0xc6b27d80 fpcurthread = none idlethread = 0xc6d9b000: tid 100006 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5cf2680 curthread = 0xc6eaeb40: pid 3 "g_up" curpcb = 0xc6b3fd80 fpcurthread = none idlethread = 0xc6d9b2d0: tid 100005 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5cf5680 curthread = 0xc7161000: pid 20 "softdepflush" curpcb = 0xe7537d80 fpcurthread = none idlethread = 0xc6d9b5a0: tid 100004 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5cf8680 curthread = 0xc6d9b870: pid 11 "idle: cpu3" curpcb = 0xc6b1ad80 fpcurthread = none idlethread = 0xc6d9b870: tid 100003 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 7709 (suj6) thread 0xc830d000 (100163) exclusive lockmgr ufs (ufs) r = 0 (0xc9629df0) locked @ kern/vfs_vnops.c:612 Process 7704 (suj6) thread 0xc95d5870 (100245) exclusive lockmgr ufs (ufs) r = 0 (0xc9607724) locked @ kern/vfs_vnops.c:612 Process 7703 (suj6) thread 0xc92f6870 (100218) exclusive lockmgr bufwait (bufwait) r = 0 (0xdadc23c0) locked @ kern/vfs_bio.c:2659 exclusive lockmgr ufs (ufs) r = 0 (0xc8755724) locked @ kern/vfs_vnops.c:612 Process 7701 (suj6) thread 0xc886b870 (100204) exclusive lockmgr ufs (ufs) r = 0 (0xc8c5d1b4) locked @ kern/vfs_vnops.c:612 Process 1562 (sshd) thread 0xc7cc0870 (100102) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc824bbd0) locked @ kern/uipc_sockbuf.c:148 Process 20 (softdepflush) thread 0xc7161000 (100074) exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc0fc5118) locked @ ufs/ffs/ffs_softdep.c:8706 exclusive lockmgr bufwait (bufwait) r = 0 (0xdada8be0) locked @ kern/vfs_bio.c:2659 db:0:alllocks> show lockedvnods Locked vnodes 0xc8c5d15c: tag ufs, type VREG usecount 1, writecount 1, refcount 1364 mountedhere 0 flags () v_object 0xc87775d8 ref 0 pages 5448 lock type ufs: EXCL by thread 0xc886b870 (pid 7701) #0 0xc08a677e at __lockmgr_args+0xbfe #1 0xc0b11f41 at ffs_lock+0xa1 #2 0xc0c23125 at VOP_LOCK1_APV+0xb5 #3 0xc0962b28 at _vn_lock+0x78 #4 0xc0963e96 at vn_write+0x156 #5 0xc09087d5 at dofilewrite+0x95 #6 0xc0909f78 at kern_writev+0x58 #7 0xc090a08f at write+0x4f #8 0xc08fe6f3 at syscallenter+0x263 #9 0xc0c0484f at syscall+0x4f #10 0xc0bedef1 at Xint0x80_syscall+0x21 ino 7, on dev md5a 0xc87556cc: tag ufs, type VREG usecount 1, writecount 1, refcount 1420 mountedhere 0 flags () v_object 0xc8715550 ref 0 pages 5672 lock type ufs: EXCL by thread 0xc92f6870 (pid 7703) #0 0xc08a677e at __lockmgr_args+0xbfe #1 0xc0b11f41 at ffs_lock+0xa1 #2 0xc0c23125 at VOP_LOCK1_APV+0xb5 #3 0xc0962b28 at _vn_lock+0x78 #4 0xc0963e96 at vn_write+0x156 #5 0xc09087d5 at dofilewrite+0x95 #6 0xc0909f78 at kern_writev+0x58 #7 0xc090a08f at write+0x4f #8 0xc08fe6f3 at syscallenter+0x263 #9 0xc0c0484f at syscall+0x4f #10 0xc0bedef1 at Xint0x80_syscall+0x21 ino 10, on dev md5a 0xc96076cc: tag ufs, type VREG usecount 1, writecount 1, refcount 1314 mountedhere 0 flags () v_object 0xc8770a18 ref 0 pages 5248 lock type ufs: EXCL by thread 0xc95d5870 (pid 7704) #0 0xc08a677e at __lockmgr_args+0xbfe #1 0xc0b11f41 at ffs_lock+0xa1 #2 0xc0c23125 at VOP_LOCK1_APV+0xb5 #3 0xc0962b28 at _vn_lock+0x78 #4 0xc0963e96 at vn_write+0x156 #5 0xc09087d5 at dofilewrite+0x95 #6 0xc0909f78 at kern_writev+0x58 #7 0xc090a08f at write+0x4f #8 0xc08fe6f3 at syscallenter+0x263 #9 0xc0c0484f at syscall+0x4f #10 0xc0bedef1 at Xint0x80_syscall+0x21 ino 11, on dev md5a 0xc9629d98: tag ufs, type VREG usecount 1, writecount 1, refcount 1390 mountedhere 0 flags () v_object 0xc86fccc0 ref 0 pages 5552 lock type ufs: EXCL by thread 0xc830d000 (pid 7709) #0 0xc08a677e at __lockmgr_args+0xbfe #1 0xc0b11f41 at ffs_lock+0xa1 #2 0xc0c23125 at VOP_LOCK1_APV+0xb5 #3 0xc0962b28 at _vn_lock+0x78 #4 0xc0963e96 at vn_write+0x156 #5 0xc09087d5 at dofilewrite+0x95 #6 0xc0909f78 at kern_writev+0x58 #7 0xc090a08f at write+0x4f #8 0xc08fe6f3 at syscallenter+0x263 #9 0xc0c0484f at syscall+0x4f #10 0xc0bedef1 at Xint0x80_syscall+0x21 ino 17, on dev md5a db:0:lockedvnods> show mount 0xc7c16b50 /dev/ad4s1a on / (ufs) 0xc7c17000 devfs on /dev (devfs) 0xc7f915a8 /dev/ad4s1f on /home (ufs) 0xc7f91000 /dev/ad4s1d on /usr (ufs) 0xc7c17b50 /dev/ad4s1e on /var (ufs) 0xc7c1787c /dev/ad4s1g on /tmp (ufs) 0xc955087c /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 7709 7339 7338 1001 D+ getblk 0xdadc23c0 suj6 7704 7339 7338 1001 D+ drainvp 0xc96077f8 suj6 7703 7339 7338 1001 D+ biowr 0xdadc2360 suj6 7701 7339 7338 1001 D+ bo_wwait 0xc8c5d288 suj6 7339 7338 7338 1001 S+ wait 0xc95d32a8 suj6 7338 7337 7338 1001 S+ wait 0xc8772aa0 bash 7337 7314 1578 0 S+ wait 0xc8772550 su 7331 0 0 0 DL mdwait 0xc86fa000 [md5] 7314 1578 1578 0 S+ wait 0xc92f5d48 sh 1578 1574 1578 0 S+ wait 0xc7cdfd48 sh 1574 1570 1574 0 S+ wait 0xc8229d48 bash 1570 1569 1570 0 S+ pause 0xc86bb058 csh 1569 1565 1569 1001 S+ wait 0xc86bb2a8 su 1565 1564 1565 1001 Ss+ wait 0xc86bbaa0 bash 1564 1562 1562 1001 S select 0xc72ef664 sshd 1562 1365 1562 0 Ss sbwait 0xc824bbfc sshd 1561 1 1561 0 Ss+ ttyin 0xc6f8ea70 getty 1560 1 1560 0 Ss+ ttyin 0xc6f8ec70 getty 1559 1 1559 0 Ss+ ttyin 0xc6f8ee70 getty 1558 1 1558 0 Ss+ ttyin 0xc7170070 getty 1557 1 1557 0 Ss+ ttyin 0xc7170270 getty 1556 1 1556 0 Ss+ ttyin 0xc7170470 getty 1555 1 1555 0 Ss+ ttyin 0xc6f8d670 getty 1554 1 1554 0 Ss+ ttyin 0xc6f8d070 getty 1553 1 1553 0 Ss+ ttyin 0xc6f8d270 getty 1522 1 1522 0 Ss select 0xc7cdc964 inetd 1496 1 1496 0 Ss select 0xc7cdc9a4 moused 1384 1 1384 0 Ss nanslp 0xc0e4c844 cron 1377 1 1377 25 Ss pause 0xc822b300 sendmail 1373 1 1373 0 Ss select 0xc7cdc4a4 sendmail 1365 1 1365 0 Ss select 0xc7cfcea4 sshd 1320 1 1320 0 Ss select 0xc72ef724 ntpd 1178 1177 1177 0 S (threaded) nfsd 100156 S rpcsvc 0xc7d0e6d0 nfsd: service 100155 S rpcsvc 0xc7d0e710 nfsd: service 100154 S rpcsvc 0xc7d0e750 nfsd: service 100117 S rpcsvc 0xc7d0e990 nfsd: master 1177 1 1177 0 Ss select 0xc72efba4 nfsd 1168 1 1168 0 Ss select 0xc72ef464 mountd 1071 1 1071 0 Ss select 0xc72efe24 rpcbind 1038 1 1038 0 Ss select 0xc72ef9e4 syslogd 837 1 837 0 Ss select 0xc7c19024 devd 21 0 0 0 DL flowclea 0xc0fb99a8 [flowcleaner] 20 0 0 0 RL CPU 2 [softdepflush] 19 0 0 0 DL syncer 0xc0fb97b8 [syncer] 18 0 0 0 DL vlruwt 0xc7bf47f8 [vnlru] 17 0 0 0 DL psleep 0xc0fb9448 [bufdaemon] 16 0 0 0 DL pgzero 0xc0fc6fdc [pagezero] 15 0 0 0 DL psleep 0xc0fc6bd0 [vmdaemon] 9 0 0 0 DL psleep 0xc0fc6b98 [pagedaemon] 8 0 0 0 DL ccb_scan 0xc0e18754 [xpt_thrd] 7 0 0 0 DL waiting_ 0xc0fbb1d8 [sctp_iterator] 6 0 0 0 DL - 0xc705603c [fdc0] 5 0 0 0 SL - 0xc7059000 [fw0_probe] 14 0 0 0 DL (threaded) [usb] 100056 D - 0xc7034d34 [usbus5] 100055 D - 0xc7034d04 [usbus5] 100054 D - 0xc7034cd4 [usbus5] 100053 D - 0xc7034ca4 [usbus5] 100051 D - 0xc702db5c [usbus4] 100050 D - 0xc702db2c [usbus4] 100049 D - 0xc702dafc [usbus4] 100048 D - 0xc702dacc [usbus4] 100047 D - 0xc7026b5c [usbus3] 100046 D - 0xc7026b2c [usbus3] 100045 D - 0xc7026afc [usbus3] 100044 D - 0xc7026acc [usbus3] 100043 D - 0xc701db5c [usbus2] 100042 D - 0xc701db2c [usbus2] 100041 D - 0xc701dafc [usbus2] 100040 D - 0xc701dacc [usbus2] 100038 D - 0xc7017b5c [usbus1] 100037 D - 0xc7017b2c [usbus1] 100036 D - 0xc7017afc [usbus1] 100035 D - 0xc7017acc [usbus1] 100033 D - 0xc7007b5c [usbus0] 100032 D - 0xc7007b2c [usbus0] 100031 D - 0xc7007afc [usbus0] 100030 D - 0xc7007acc [usbus0] 13 0 0 0 DL - 0xc0e4c684 [yarrow] 4 0 0 0 DL - 0xc0e4a344 [g_down] 3 0 0 0 RL CPU 1 [g_up] 2 0 0 0 DL - 0xc0e4a338 [g_event] 12 0 0 0 RL (threaded) [intr] 100064 I [irq12: psm0] 100063 I [irq1: atkbd0] 100061 I [swi0: uart] 100058 I [irq20: fwohci0] 100057 I [irq14: ata0] 100052 I [irq19: ehci0] 100039 I [irq18: ohci2 ohci4] 100034 I [irq17: ohci1 ohci3] 100029 I [irq16: ohci0] 100028 I [irq22: atapci0] 100027 I [irq9: acpi0] 100026 I [swi2: cambio] 100022 I [swi6: task queue] 100021 I [swi6: Giant taskq] 100019 I [swi5: +] 100012 I [swi1: netisr 0] 100011 I [swi3: vm] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 Run CPU 0 [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu0] 100005 CanRun [idle: cpu1] 100004 CanRun [idle: cpu2] 100003 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc6d99d48 [init] 10 0 0 0 DL audit_wo 0xc0fc4980 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc0e4c684 [deadlkres] 100059 D - 0xc6eabb80 [fw0_taskq] 100025 D - 0xc6eabc80 [acpi_task_2] 100024 D - 0xc6eabc80 [acpi_task_1] 100023 D - 0xc6eabc80 [acpi_task_0] 100020 D - 0xc6eabd40 [thread taskq] 100018 D - 0xc6eabdc0 [kqueue taskq] 100013 D - 0xc6eabe00 [firmware taskq] 100000 D sched 0xc0e4a420 [swapper] db:0:ps> allt Tracing command suj6 pid 7709 tid 100163 td 0xc830d000 sched_switch(c830d000,0,104,191,a0ba8f7f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,50,...) at mi_switch+0x200 sleepq_switch(c830d000,0,c0cec294,268,50,...) at sleepq_switch+0x15f sleepq_wait(dadc23c0,50,c0ce0da3,4,0,...) at sleepq_wait+0x63 __lockmgr_args(dadc23c0,81900,c95ca668,c0ce0da3,50,...) at __lockmgr_args+0xb1f getblk(c95ca570,e0,0,4000,0,...) at getblk+0x167 breadn(c95ca570,e0,0,4000,0,...) at breadn+0x44 bread(c95ca570,e0,0,4000,0,...) at bread+0x4c ffs_update(c9629d98,1,c0d1240d,163,c0f8b0d0,...) at ffs_update+0x172 ffs_syncvnode(c9629d98,1,c0d0f539,9c8,c9629d98,...) at ffs_syncvnode+0x48f softdep_prealloc(c9629d98,1,e98a28c4,c08adc94,c0e50fc0,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c9629d98,15ab000,0,1000,c7cdb280,...) at ffs_balloc_ufs2+0xaa ffs_write(e98a2b94,c0d290d5,c9629d98,0,c9629d98,...) at ffs_write+0x2ad VOP_WRITE_APV(c0dfc400,e98a2b94,c9629d98,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c5b690,e98a2c28,c7cdb280,0,c830d000,...) at vn_write+0x1ca dofilewrite(e98a2c28,ffffffff,ffffffff,0,c7c5b690,...) at dofilewrite+0x95 kern_writev(c830d000,3,e98a2c28,e98a2c48,1,...) at kern_writev+0x58 write(c830d000,e98a2cec,e98a2d28,c0cecacd,0,...) at write+0x4f syscallenter(c830d000,e98a2ce4,e98a2ce4,0,c0e502c0,...) at syscallenter+0x263 syscall(e98a2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj6 pid 7704 tid 100245 td 0xc95d5870 sched_switch(c95d5870,0,104,191,a0bb6a57,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4d,...) at mi_switch+0x200 sleepq_switch(c95d5870,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c96077f8,4d,c0d0fb43,0,0,...) at sleepq_wait+0x63 _sleep(c96077f8,c96077c4,4d,c0d0fb43,0,...) at _sleep+0x372 drain_output(c96077c4,0,c0d0f539,285f,c0d12416,...) at drain_output+0x81 softdep_sync_metadata(c96076cc,0,c0d1240d,144,0,...) at softdep_sync_metadata+0x21b ffs_syncvnode(c96076cc,1,c0d0f539,9c8,c96076cc,...) at ffs_syncvnode+0x3e2 softdep_prealloc(c96076cc,1,dad7ba60,e99fa8c4,c0905e4b,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c96076cc,1479000,0,1000,c7cdb280,...) at ffs_balloc_ufs2+0xaa ffs_write(e99fab94,c0d290d5,c96076cc,0,c96076cc,...) at ffs_write+0x2ad VOP_WRITE_APV(c0dfc400,e99fab94,c96076cc,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c5c3b8,e99fac28,c7cdb280,0,c95d5870,...) at vn_write+0x1ca dofilewrite(e99fac28,ffffffff,ffffffff,0,c7c5c3b8,...) at dofilewrite+0x95 kern_writev(c95d5870,3,e99fac28,e99fac48,1,...) at kern_writev+0x58 write(c95d5870,e99facec,c08e2c2d,c0e511f8,0,...) at write+0x4f syscallenter(c95d5870,e99face4,e99facc0,c08e45c8,c0e50fc0,...) at syscallenter+0x263 syscall(e99fad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj6 pid 7703 tid 100218 td 0xc92f6870 sched_switch(c92f6870,0,104,191,a0b79a70,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c92f6870,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(dadc2360,4c,c0cf31e1,0,0,...) at sleepq_wait+0x63 _sleep(dadc2360,c6d5609c,4c,c0cf31e1,0,...) at _sleep+0x372 bwait(dadc2360,4c,c0cf31e1,dadc2360,e99a9794,...) at bwait+0x6f bufwait(dadc2360,dadc2360,df,dadc2360,c8757b54,...) at bufwait+0x48 bufwrite(dadc2360,0,c0d11e67,756,0) at bufwrite+0x165 ffs_bufwrite(dadc2360,c8929900,100,4000,0,...) at ffs_bufwrite+0x290 ffs_update(c87556cc,1,c0d1240d,163,0,...) at ffs_update+0x28c ffs_syncvnode(c87556cc,1,c0d0f539,9c8,c87556cc,...) at ffs_syncvnode+0x48f softdep_prealloc(c87556cc,1,daddb040,e99a98c4,c0905e4b,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c87556cc,1623000,0,1000,c7cdb280,...) at ffs_balloc_ufs2+0xaa ffs_write(e99a9b94,c0d290d5,c87556cc,0,c87556cc,...) at ffs_write+0x2ad VOP_WRITE_APV(c0dfc400,e99a9b94,c87556cc,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c5c5e8,e99a9c28,c7cdb280,0,c92f6870,...) at vn_write+0x1ca dofilewrite(e99a9c28,ffffffff,ffffffff,0,c7c5c5e8,...) at dofilewrite+0x95 kern_writev(c92f6870,3,e99a9c28,e99a9c48,1,...) at kern_writev+0x58 write(c92f6870,e99a9cec,e99a9d28,c0cecacd,0,...) at write+0x4f syscallenter(c92f6870,e99a9ce4,e99a9ce4,0,c0e51640,...) at syscallenter+0x263 syscall(e99a9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj6 pid 7701 tid 100204 td 0xc886b870 sched_switch(c886b870,0,104,191,a0bad4e0,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4f,...) at mi_switch+0x200 sleepq_switch(c886b870,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c8c5d288,4f,c0cf2e8f,0,0,...) at sleepq_wait+0x63 _sleep(c8c5d288,c8c5d254,4f,c0cf2e8f,0,...) at _sleep+0x372 bufobj_wwait(c8c5d254,3,0,136,0,...) at bufobj_wwait+0x73 ffs_syncvnode(c8c5d15c,1,c0d0f539,9c8,c8c5d15c,...) at ffs_syncvnode+0x3b4 softdep_prealloc(c8c5d15c,1,c6d437d8,c,0,...) at softdep_prealloc+0xdd ffs_balloc_ufs2(c8c5d15c,1544000,0,1000,c7cdb280,...) at ffs_balloc_ufs2+0xaa ffs_write(e9965b94,c0d290d5,c8c5d15c,0,c8c5d15c,...) at ffs_write+0x2ad VOP_WRITE_APV(c0dfc400,e9965b94,c8c5d15c,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c7c5c8c0,e9965c28,c7cdb280,0,c886b870,...) at vn_write+0x1ca dofilewrite(e9965c28,ffffffff,ffffffff,0,c7c5c8c0,...) at dofilewrite+0x95 kern_writev(c886b870,3,e9965c28,e9965c48,1,...) at kern_writev+0x58 write(c886b870,e9965cec,e9965d28,c0cecacd,0,...) at write+0x4f syscallenter(c886b870,e9965ce4,e9965ce4,0,c0e502c0,...) at syscallenter+0x263 syscall(e9965d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181253, esp = 0xbfbfd21c, ebp = 0xbfbfe8c8 --- Tracing command suj6 pid 7339 tid 100238 td 0xc947a870 sched_switch(c947a870,0,104,191,933287df,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c947a870,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c95d32a8,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c95d32a8,c95d3330,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c947a870,ffffffff,e99e5c44,0,0,...) at kern_wait+0xb66 wait4(c947a870,e99e5cec,e99e5d28,c0cecacd,0,...) at wait4+0x3b syscallenter(c947a870,e99e5ce4,e99e5ce4,0,0,...) at syscallenter+0x263 syscall(e99e5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280efdeb, esp = 0xbfbfd1fc, ebp = 0xbfbfd218 --- Tracing command bash pid 7338 tid 100193 td 0xc830d5a0 sched_switch(c830d5a0,0,104,191,e7263530,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c830d5a0,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8772aa0,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8772aa0,c8772b28,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c830d5a0,ffffffff,e993cc44,0,0,...) at kern_wait+0xb66 wait4(c830d5a0,e993ccec,2836aa8c,1,0,...) at wait4+0x3b syscallenter(c830d5a0,e993cce4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e993cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c2deb, esp = 0xbfbfe42c, ebp = 0xbfbfe448 --- Tracing command su pid 7337 tid 100195 td 0xc88705a0 sched_switch(c88705a0,0,104,191,e669e607,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c88705a0,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8772550,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8772550,c87725d8,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c88705a0,1caa,e9944c44,2,0,...) at kern_wait+0xb66 wait4(c88705a0,e9944cec,281cba8c,1,0,...) at wait4+0x3b syscallenter(c88705a0,e9944ce4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e9944d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28123deb, esp = 0xbfbfe36c, ebp = 0xbfbfe388 --- Tracing command md5 pid 7331 tid 100211 td 0xc92f8000 sched_switch(c92f8000,0,104,191,a0bd8cce,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c92f8000,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c86fa000,4c,c0cb9611,0,0,...) at sleepq_wait+0x63 _sleep(c86fa000,c86fa020,24c,c0cb9611,0,...) at _sleep+0x372 md_kthread(c86fa000,e9994d28,c0ce2c72,33b,c92f2000,...) at md_kthread+0x115 fork_exit(c06d7b60,c86fa000,e9994d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe9994d60, ebp = 0 --- Tracing command sh pid 7314 tid 100232 td 0xc947bb40 sched_switch(c947bb40,0,104,191,e54129a5,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c947bb40,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c92f5d48,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c92f5d48,c92f5dd0,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c947bb40,ffffffff,e99d3c44,2,0,...) at kern_wait+0xb66 wait4(c947bb40,e99d3cec,e99d3d28,c0cecacd,0,...) at wait4+0x3b syscallenter(c947bb40,e99d3ce4,e99d3ce4,0,0,...) at syscallenter+0x263 syscall(e99d3d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28162deb, esp = 0xbfbfe87c, ebp = 0xbfbfe898 --- Tracing command sh pid 1578 tid 100097 td 0xc7cadb40 sched_switch(c7cadb40,0,104,191,c852c8c3,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7cadb40,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7cdfd48,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7cdfd48,c7cdfdd0,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c7cadb40,ffffffff,e9789c44,2,0,...) at kern_wait+0xb66 wait4(c7cadb40,e9789cec,e9789d28,c0cecacd,0,...) at wait4+0x3b syscallenter(c7cadb40,e9789ce4,e9789ce4,0,0,...) at syscallenter+0x263 syscall(e9789d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28162deb, esp = 0xbfbfe68c, ebp = 0xbfbfe6a8 --- Tracing command bash pid 1574 tid 100142 td 0xc7cc22d0 sched_switch(c7cc22d0,0,104,191,387a5ba1,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7cc22d0,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8229d48,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8229d48,c8229dd0,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c7cc22d0,ffffffff,e985ec44,6,0,...) at kern_wait+0xb66 wait4(c7cc22d0,e985ecec,e985ed28,c0cecacd,0,...) at wait4+0x3b syscallenter(c7cc22d0,e985ece4,e985ece4,0,0,...) at syscallenter+0x263 syscall(e985ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c2deb, esp = 0xbfbfe7cc, ebp = 0xbfbfe7e8 --- Tracing command csh pid 1570 tid 100183 td 0xc86d85a0 sched_switch(c86d85a0,0,104,191,4fbabaf1,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,68,...) at mi_switch+0x200 sleepq_switch(c86d85a0,0,c0cec294,1a7,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c86bb058,68,c0c98080,100,0,...) at sleepq_wait_sig+0x17 _sleep(c86bb058,c86bb088,168,c0c98080,0,...) at _sleep+0x35c kern_sigsuspend(c86d85a0,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c86d85a0,e990acec,e990ad28,c0cecacd,0,...) at sigsuspend+0x4d syscallenter(c86d85a0,e990ace4,e990ace4,0,0,...) at syscallenter+0x263 syscall(e990ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c87b, esp = 0xbfbfe5dc, ebp = 0xbfbfe648 --- Tracing command su pid 1569 tid 100182 td 0xc86d8870 sched_switch(c86d8870,0,104,191,f731936f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c86d8870,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c86bb2a8,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c86bb2a8,c86bb330,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c86d8870,622,e9907c44,2,0,...) at kern_wait+0xb66 wait4(c86d8870,e9907cec,281cba8c,1,0,...) at wait4+0x3b syscallenter(c86d8870,e9907ce4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e9907d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28123deb, esp = 0xbfbfe60c, ebp = 0xbfbfe628 --- Tracing command bash pid 1565 tid 100179 td 0xc86d92d0 sched_switch(c86d92d0,0,104,191,cf269fa1,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c86d92d0,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c86bbaa0,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c86bbaa0,c86bbb28,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c86d92d0,ffffffff,e98fec44,6,0,...) at kern_wait+0xb66 wait4(c86d92d0,e98fecec,e98fed28,c0cecacd,0,...) at wait4+0x3b syscallenter(c86d92d0,e98fece4,e98fece4,0,0,...) at syscallenter+0x263 syscall(e98fed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c2deb, esp = 0xbfbfe9bc, ebp = 0xbfbfe9d8 --- Tracing command sshd pid 1564 tid 100087 td 0xc7cae870 sched_switch(c7cae870,0,104,191,e75e972c,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cae870,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c72ef650,0,c0ce6225,c7cae870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72ef664,0,e9756a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72ef664,c72ef650,c0cee652,627,c8143888,...) at _cv_wait_sig+0x243 seltdwait(c8143888,58,c6d7b080,c7cae870,246,...) at seltdwait+0xa2 kern_select(c7cae870,a,288060b8,288060dc,0,0,20,c6f797f8,c6f797f8) at kern_select+0x504 select(c7cae870,e9756cec,e9756d28,c0cecacd,0,...) at select+0x66 syscallenter(c7cae870,e9756ce4,e9756ce4,0,e9756ca4,...) at syscallenter+0x263 syscall(e9756d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284b01f3, esp = 0xbfbfe1bc, ebp = 0xbfbfe208 --- Tracing command sshd pid 1562 tid 100102 td 0xc7cc0870 sched_switch(c7cc0870,0,104,191,f718b74,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,58,...) at mi_switch+0x200 sleepq_switch(c7cc0870,0,c0cec294,1a7,58,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c824bbfc,58,c0cf1f85,100,0,...) at sleepq_wait_sig+0x17 _sleep(c824bbfc,c824bbbc,158,c0cf1f85,0) at _sleep+0x35c sbwait(c824bb98,4,c0cf2054,5c9,c824bbbc,...) at sbwait+0x76 soreceive_generic(c824bb44,0,e979bc28,0,0,...) at soreceive_generic+0x3f0 soreceive(c824bb44,0,e979bc28,0,0,0) at soreceive+0x38 soo_read(c7cb6c78,e979bc28,c7c18900,0,c7cc0870,...) at soo_read+0x4e dofileread(e979bc28,ffffffff,ffffffff,0,c7cb6c78,...) at dofileread+0x9e kern_readv(c7cc0870,5,e979bc28,e979bc48,1,...) at kern_readv+0x58 read(c7cc0870,e979bcec,e979bd28,c0cecacd,0,...) at read+0x4f syscallenter(c7cc0870,e979bce4,e979bce4,0,0,...) at syscallenter+0x263 syscall(e979bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284b0273, esp = 0xbfbfdd8c, ebp = 0xbfbfddc8 --- Tracing command getty pid 1561 tid 100177 td 0xc82322d0 sched_switch(c82322d0,0,104,191,4e04afd6,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c82322d0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c82322d0,c82322d0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f8ea70,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f8ea70,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f8ea00,c6f8ea70,e98f8c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f8ea00,e98f8c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2800,e98f8c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c8143ce8,e98f8c28,c6d7be80,0,c82322d0,...) at devfs_read_f+0x7e dofileread(e98f8c28,ffffffff,ffffffff,0,c8143ce8,...) at dofileread+0x9e kern_readv(c82322d0,0,e98f8c28,e98f8c48,1,...) at kern_readv+0x58 read(c82322d0,e98f8cec,e98f8d28,c0cecacd,0,...) at read+0x4f syscallenter(c82322d0,e98f8ce4,e98f8ce4,0,0,...) at syscallenter+0x263 syscall(e98f8d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1560 tid 100176 td 0xc82325a0 sched_switch(c82325a0,0,104,191,4e167d42,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c82325a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c82325a0,c82325a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f8ec70,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f8ec70,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f8ec00,c6f8ec70,e98f5c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f8ec00,e98f5c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2900,e98f5c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7d005b0,e98f5c28,c6d7be80,0,c82325a0,...) at devfs_read_f+0x7e dofileread(e98f5c28,ffffffff,ffffffff,0,c7d005b0,...) at dofileread+0x9e kern_readv(c82325a0,0,e98f5c28,e98f5c48,1,...) at kern_readv+0x58 read(c82325a0,e98f5cec,e98f5d28,c0cecacd,0,...) at read+0x4f syscallenter(c82325a0,e98f5ce4,e98f5ce4,0,0,...) at syscallenter+0x263 syscall(e98f5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1559 tid 100175 td 0xc8232870 sched_switch(c8232870,0,104,191,4e5ab3aa,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c8232870,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c8232870,c8232870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f8ee70,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f8ee70,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f8ee00,c6f8ee70,e98f2c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f8ee00,e98f2c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2a00,e98f2c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5bb60,e98f2c28,c6d7be80,0,c8232870,...) at devfs_read_f+0x7e dofileread(e98f2c28,ffffffff,ffffffff,0,c7c5bb60,...) at dofileread+0x9e kern_readv(c8232870,0,e98f2c28,e98f2c48,1,...) at kern_readv+0x58 read(c8232870,e98f2cec,e98f2d28,c0cecacd,0,...) at read+0x4f syscallenter(c8232870,e98f2ce4,e98f2ce4,0,0,...) at syscallenter+0x263 syscall(e98f2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1558 tid 100174 td 0xc8232b40 sched_switch(c8232b40,0,104,191,4dcba8ed,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c8232b40,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c8232b40,c8232b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7170070,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7170070,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7170000,c7170070,e98efc28,1,0,...) at tty_wait+0x71 ttydisc_read(c7170000,e98efc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2b00,e98efc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c80c8930,e98efc28,c6d7be80,0,c8232b40,...) at devfs_read_f+0x7e dofileread(e98efc28,ffffffff,ffffffff,0,c80c8930,...) at dofileread+0x9e kern_readv(c8232b40,0,e98efc28,e98efc48,1,...) at kern_readv+0x58 read(c8232b40,e98efcec,e98efd28,c0cecacd,0,...) at read+0x4f syscallenter(c8232b40,e98efce4,e98efce4,0,0,...) at syscallenter+0x263 syscall(e98efd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1557 tid 100173 td 0xc830b000 sched_switch(c830b000,0,104,191,4e39e83f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c830b000,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c830b000,c830b000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7170270,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7170270,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7170200,c7170270,e98ecc28,1,0,...) at tty_wait+0x71 ttydisc_read(c7170200,e98ecc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2c00,e98ecc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7cb6968,e98ecc28,c6d7be80,0,c830b000,...) at devfs_read_f+0x7e dofileread(e98ecc28,ffffffff,ffffffff,0,c7cb6968,...) at dofileread+0x9e kern_readv(c830b000,0,e98ecc28,e98ecc48,1,...) at kern_readv+0x58 read(c830b000,e98eccec,e98ecd28,c0cecacd,0,...) at read+0x4f syscallenter(c830b000,e98ecce4,e98ecce4,0,0,...) at syscallenter+0x263 syscall(e98ecd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1556 tid 100076 td 0xc7c58b40 sched_switch(c7c58b40,0,104,191,4dea9bf3,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7c58b40,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c7c58b40,c7c58b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7170470,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7170470,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7170400,c7170470,e972ac28,1,0,...) at tty_wait+0x71 ttydisc_read(c7170400,e972ac28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2d00,e972ac28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c80c8bd0,e972ac28,c6d7be80,0,c7c58b40,...) at devfs_read_f+0x7e dofileread(e972ac28,ffffffff,ffffffff,0,c80c8bd0,...) at dofileread+0x9e kern_readv(c7c58b40,0,e972ac28,e972ac48,1,...) at kern_readv+0x58 read(c7c58b40,e972acec,e972ad28,c0cecacd,0,...) at read+0x4f syscallenter(c7c58b40,e972ace4,e972ace4,0,0,...) at syscallenter+0x263 syscall(e972ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1555 tid 100149 td 0xc822eb40 sched_switch(c822eb40,0,104,191,4dc40a2a,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c822eb40,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c822eb40,c822eb40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f8d670,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f8d670,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f8d600,c6f8d670,e9873c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f8d600,e9873c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6fc2e00,e9873c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c80c8540,e9873c28,c6d7be80,0,c822eb40,...) at devfs_read_f+0x7e dofileread(e9873c28,ffffffff,ffffffff,0,c80c8540,...) at dofileread+0x9e kern_readv(c822eb40,0,e9873c28,e9873c48,1,...) at kern_readv+0x58 read(c822eb40,e9873cec,e9873d28,c0cecacd,0,...) at read+0x4f syscallenter(c822eb40,e9873ce4,e9873ce4,0,0,...) at syscallenter+0x263 syscall(e9873d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1554 tid 100172 td 0xc830b2d0 sched_switch(c830b2d0,0,104,191,4e239d29,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c830b2d0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,c830b2d0,c830b2d0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f8d070,0,c0cf09c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f8d070,c0e4bfb0,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f8d000,c6f8d070,e98cac28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f8d000,e98cac28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c715e000,e98cac28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7d001c0,e98cac28,c6d7be80,0,c830b2d0,...) at devfs_read_f+0x7e dofileread(e98cac28,ffffffff,ffffffff,0,c7d001c0,...) at dofileread+0x9e kern_readv(c830b2d0,0,e98cac28,e98cac48,1,...) at kern_readv+0x58 read(c830b2d0,e98cacec,e98cad28,c0cecacd,0,...) at read+0x4f syscallenter(c830b2d0,e98cace4,e98cace4,0,0,...) at syscallenter+0x263 syscall(e98cad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1553 tid 100159 td 0xc822d5a0 sched_switch(c822d5a0,0,104,191,f7cd481f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c822d5a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c6f8d204,0,c0ce6225,c822d5a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f8d270,0,e9896ad8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f8d270,c6f8d204,c0cf0365,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f8d200,c6f8d270,e9896c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f8d200,e9896c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6de2c00,e9896c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c5b818,e9896c28,c6d7be80,0,c822d5a0,...) at devfs_read_f+0x7e dofileread(e9896c28,ffffffff,ffffffff,0,c7c5b818,...) at dofileread+0x9e kern_readv(c822d5a0,0,e9896c28,e9896c48,1,...) at kern_readv+0x58 read(c822d5a0,e9896cec,e9896d28,c0cecacd,0,...) at read+0x4f syscallenter(c822d5a0,e9896ce4,e9896ce4,0,0,...) at syscallenter+0x263 syscall(e9896d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196273, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command inetd pid 1522 tid 100166 td 0xc830c5a0 sched_switch(c830c5a0,0,104,191,3faa925c,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c830c5a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c7cdc950,0,c0ce6225,c830c5a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7cdc964,0,e98aba4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7cdc964,c7cdc950,c0cee652,627,c7c5b310,...) at _cv_wait_sig+0x243 seltdwait(c7c5b310,58,c6d7be80,c830c5a0,c0ce6225,...) at seltdwait+0xa2 kern_select(c830c5a0,6,bfbfdfc0,0,0,0,20,c82ef7f8,c82ef7f8) at kern_select+0x504 select(c830c5a0,e98abcec,e98abd28,c0cecacd,0,...) at select+0x66 syscallenter(c830c5a0,e98abce4,e98abce4,0,0,...) at syscallenter+0x263 syscall(e98abd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281aa1f3, esp = 0xbfbfdf7c, ebp = 0xbfbfee08 --- Tracing command moused pid 1496 tid 100169 td 0xc830bb40 sched_switch(c830bb40,0,104,191,34c27896,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c830bb40,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c7cdc990,0,c0ce6225,c830bb40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7cdc9a4,0,e98b5a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7cdc9a4,c7cdc990,c0cee652,627,c7f9a5e8,...) at _cv_wait_sig+0x243 seltdwait(c7f9a5e8,58,c6d7be80,c830bb40,0,...) at seltdwait+0xa2 kern_select(c830bb40,6,bfbfea24,0,0,0,20,c82ef000,c82ef000) at kern_select+0x504 select(c830bb40,e98b5cec,e98b5d28,c0cecacd,0,...) at select+0x66 syscallenter(c830bb40,e98b5ce4,e98b5ce4,0,0,...) at syscallenter+0x263 syscall(e98b5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281b21f3, esp = 0xbfbfe9bc, ebp = 0xbfbfeb48 --- Tracing command cron pid 1384 tid 100093 td 0xc7cc12d0 sched_switch(c7cc12d0,0,104,191,5d3e0dd1,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7cc12d0,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(ea61,c08fb210,c7cc12d0,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4c844,5c,c0ce8d12,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4c844,0,15c,c0ce8d12,ea61,...) at _sleep+0x328 kern_nanosleep(c7cc12d0,e9776c34,e9776c3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c7cc12d0,e9776cec,e9776d28,c0cecacd,0,...) at nanosleep+0x6f syscallenter(c7cc12d0,e9776ce4,e9776ce4,0,0,...) at syscallenter+0x263 syscall(e9776d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28184543, esp = 0xbfbfec6c, ebp = 0xbfbfec98 --- Tracing command sendmail pid 1377 tid 100140 td 0xc7cc2870 sched_switch(c7cc2870,0,104,191,7f99eb69,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,68,...) at mi_switch+0x200 sleepq_switch(c7cc2870,0,c0cec294,1a7,68,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c822b300,68,c0c98080,100,0,...) at sleepq_wait_sig+0x17 _sleep(c822b300,c822b330,168,c0c98080,0,...) at _sleep+0x35c kern_sigsuspend(c7cc2870,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c7cc2870,e9858cec,e9858d28,c0cecacd,0,...) at sigsuspend+0x4d syscallenter(c7cc2870,e9858ce4,e9858ce4,0,246,...) at syscallenter+0x263 syscall(e9858d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2833787b, esp = 0xbfbfcfbc, ebp = 0xbfbfcfe8 --- Tracing command sendmail pid 1373 tid 100094 td 0xc7cae5a0 sched_switch(c7cae5a0,0,104,191,89ddb98,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cae5a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e977da14,c08ae0ba,c7cdc490,0,c7cae5a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7cdc4a4,0,e977da4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7cdc4a4,c7cdc490,1389,627,c7d00818,...) at _cv_timedwait_sig+0x252 seltdwait(e977dbf8,e977dc00,c7cdb100,c7cae5a0,c15aea94,...) at seltdwait+0x8a kern_select(c7cae5a0,5,bfbfc530,0,0,e977dc40,20,5,0) at kern_select+0x504 select(c7cae5a0,e977dcec,e977dd28,c0cecacd,0,...) at select+0x66 syscallenter(c7cae5a0,e977dce4,e977dce4,0,0,...) at syscallenter+0x263 syscall(e977dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283e01f3, esp = 0xbfbfc49c, ebp = 0xbfbfcfc8 --- Tracing command sshd pid 1365 tid 100150 td 0xc822e870 sched_switch(c822e870,0,104,191,b7a6a1c,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c822e870,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c7cfce90,0,c0ce6225,c822e870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7cfcea4,0,e9876a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7cfcea4,c7cfce90,c0cee652,627,c7cb6818,...) at _cv_wait_sig+0x243 seltdwait(c7cb6818,58,c7c18b80,c822e870,c0d15127,...) at seltdwait+0xa2 kern_select(c822e870,5,2880c0b0,0,0,0,20,c82287f8,c82287f8) at kern_select+0x504 select(c822e870,e9876cec,2880d070,1,0,...) at select+0x66 syscallenter(c822e870,e9876ce4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e9876d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284b01f3, esp = 0xbfbfe27c, ebp = 0xbfbfee18 --- Tracing command ntpd pid 1320 tid 100146 td 0xc82305a0 sched_switch(c82305a0,0,104,191,9b600cbf,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c82305a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c72ef710,0,c0ce6225,c82305a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72ef724,0,e986aa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72ef724,c72ef710,c0cee652,627,c7cb69a0,...) at _cv_wait_sig+0x243 seltdwait(c7cb69a0,58,c6d7be80,c82305a0,0,...) at seltdwait+0xa2 kern_select(c82305a0,1c,bfbfed08,0,0,0,20,c82292a8,c82292a8) at kern_select+0x504 select(c82305a0,e986acec,e986ad80,e986ac88,0,...) at select+0x66 syscallenter(c82305a0,e986ace4,c0c04d66,fffffffe,246,...) at syscallenter+0x263 syscall(e986ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283581f3, esp = 0xbfbfecdc, ebp = 0xbfbfeda8 --- Tracing command nfsd pid 1178 tid 100156 td 0xc7cba5a0 sched_switch(c7cba5a0,0,104,191,5c47e683,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cba5a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e988dbe0,c08ae0ba,c6fe5c80,0,c7cba5a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d0e6d0,0,e988dc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d0e6d0,c6fe5c80,1388,3b1,8051e8c,...) at _cv_timedwait_sig+0x252 svc_run_internal(e988dd14,c08932e8,c6fe5c80,e988dd28,c0ce2c72,...) at svc_run_internal+0x356 svc_thread_start(c6fe5c80,e988dd28,c0ce2c72,33b,c80bfaa0,...) at svc_thread_start+0x10 fork_exit(c0abd6a0,c6fe5c80,e988dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 1178 tid 100155 td 0xc7cba870 sched_switch(c7cba870,0,104,191,5c477f19,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cba870,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e988abe0,c08ae0ba,c6fe5c80,0,c7cba870,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d0e710,0,e988ac18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d0e710,c6fe5c80,1388,3b1,2842a520,...) at _cv_timedwait_sig+0x252 svc_run_internal(e988ad14,c08932e8,c6fe5c80,e988ad28,c0ce2c72,...) at svc_run_internal+0x356 svc_thread_start(c6fe5c80,e988ad28,c0ce2c72,33b,c80bfaa0,...) at svc_thread_start+0x10 fork_exit(c0abd6a0,c6fe5c80,e988ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 1178 tid 100154 td 0xc7cbab40 sched_switch(c7cbab40,0,104,191,5c47fa29,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7cbab40,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e9887be0,c08ae0ba,c6fe5c80,0,c7cbab40,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d0e750,0,e9887c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d0e750,c6fe5c80,1388,3b1,bfbfdc64,...) at _cv_timedwait_sig+0x252 svc_run_internal(e9887d14,c08932e8,c6fe5c80,e9887d28,c0ce2c72,...) at svc_run_internal+0x356 svc_thread_start(c6fe5c80,e9887d28,c0ce2c72,33b,c80bfaa0,...) at svc_thread_start+0x10 fork_exit(c0abd6a0,c6fe5c80,e9887d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 1178 tid 100117 td 0xc80c65a0 sched_switch(c80c65a0,0,104,191,5c10de14,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80c65a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e97f9ab0,c08ae0ba,c6fe5c80,0,c80c65a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d0e990,0,e97f9ae8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d0e990,c6fe5c80,1388,3b1,e97f9b30,...) at _cv_timedwait_sig+0x252 svc_run_internal(c80c6748,14,c0d0c721,c0d0b1e7,e97f9c0c,...) at svc_run_internal+0x356 svc_run(c6fe5c80,0,c0d0b4c2,1c2,0,...) at svc_run+0x7b nfssvc_nfsd(bfbfe8a0,e97f9c0c,c,c6d7be80,e97f9c20,...) at nfssvc_nfsd+0xad nfssvc_nfsserver(c80c65a0,e97f9cec,c80bfaa0,0,c80c65a0,...) at nfssvc_nfsserver+0x24f nfssvc(c80c65a0,e97f9cec,e97f9d28,c0cecacd,0,...) at nfssvc+0x83 syscallenter(c80c65a0,e97f9ce4,e97f9ce4,0,0,...) at syscallenter+0x263 syscall(e97f9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280dc47b, esp = 0xbfbfe85c, ebp = 0xbfbfeac8 --- Tracing command nfsd pid 1177 tid 100151 td 0xc822e5a0 sched_switch(c822e5a0,0,104,191,cef71908,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c822e5a0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c72efb90,0,c0ce6225,c822e5a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72efba4,0,e9879a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72efba4,c72efb90,c0cee652,627,c8143348,...) at _cv_wait_sig+0x243 seltdwait(c8143348,58,c6d7be80,c822e5a0,c0d15127,...) at seltdwait+0xa2 kern_select(c822e5a0,5,bfbfecd0,0,0,0,20,c8228550,c8228550) at kern_select+0x504 select(c822e5a0,e9879cec,bfbffff4,1,0,...) at select+0x66 syscallenter(c822e5a0,e9879ce4,c0c050ad,c0e4bfb0,0,...) at syscallenter+0x263 syscall(e9879d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281841f3, esp = 0xbfbfeacc, ebp = 0xbfbfee08 --- Tracing command mountd pid 1168 tid 100121 td 0xc80c2870 sched_switch(c80c2870,0,104,191,e50274f3,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80c2870,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c72ef450,0,c0ce6225,c80c2870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72ef464,0,e9805a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72ef464,c72ef450,c0cee652,627,c80c8888,...) at _cv_wait_sig+0x243 seltdwait(c80c8888,58,c6d7be80,c80c2870,c0f8c7c8,...) at seltdwait+0xa2 kern_select(c80c2870,9,bfbfed5c,0,0,0,20,c80bf000,c80bf000) at kern_select+0x504 select(c80c2870,e9805cec,e9805d28,c0cecacd,0,...) at select+0x66 syscallenter(c80c2870,e9805ce4,e9805ce4,0,246,...) at syscallenter+0x263 syscall(e9805d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819a1f3, esp = 0xbfbfed2c, ebp = 0xbfbfedf8 --- Tracing command rpcbind pid 1071 tid 100119 td 0xc80c6000 sched_switch(c80c6000,0,104,191,2e76ce0,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80c6000,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e97ffa6c,c08ae0ba,c72efe10,0,c80c6000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c72efe24,0,e97ffaa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c72efe24,c72efe10,7531,627,e97ffb5c,...) at _cv_timedwait_sig+0x252 seltdwait(e97ffc2c,e97ffc34,535,c80c6000,e97ffb2c,...) at seltdwait+0x8a poll(c80c6000,e97ffcec,e97ffd28,c0cecacd,0,...) at poll+0x300 syscallenter(c80c6000,e97ffce4,e97ffce4,0,ec,...) at syscallenter+0x263 syscall(e97ffd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x2814007b, esp = 0xbfbfcbcc, ebp = 0xbfbfed98 --- Tracing command syslogd pid 1038 tid 100113 td 0xc80c72d0 sched_switch(c80c72d0,0,104,191,a823d6e8,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80c72d0,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c72ef9d0,0,c0ce6225,c80c72d0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72ef9e4,0,e97eda4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72ef9e4,c72ef9d0,c0cee652,627,c8143070,...) at _cv_wait_sig+0x243 seltdwait(c8143070,58,c6d7be80,c80c72d0,0,...) at seltdwait+0xa2 kern_select(c80c72d0,9,2847f0ac,0,0,0,20,c80c0550,c80c0550) at kern_select+0x504 select(c80c72d0,e97edcec,e97edd28,c0cecacd,0,...) at select+0x66 syscallenter(c80c72d0,e97edce4,e97edce4,0,246,...) at syscallenter+0x263 syscall(e97edd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281991f3, esp = 0xbfbfe2bc, ebp = 0xbfbfee08 --- Tracing command devd pid 837 tid 100116 td 0xc80c6870 sched_switch(c80c6870,0,104,191,e4917143,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c80c6870,0,c0cec294,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08ae0ba,c7c19010,0,c0ce6225,c80c6870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c19024,0,e97f6a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c19024,c7c19010,c0cee652,627,c7c78d90,...) at _cv_wait_sig+0x243 seltdwait(c7c78d90,58,c6d7be80,c80c6870,3,...) at seltdwait+0xa2 kern_select(c80c6870,6,bfbfe980,0,0,0,20,c80bfd48,c80bfd48) at kern_select+0x504 select(c80c6870,e97f6cec,e97f6d28,c0cecacd,0,...) at select+0x66 syscallenter(c80c6870,e97f6ce4,e97f6ce4,0,ec,...) at syscallenter+0x263 syscall(e97f6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x808b793, esp = 0xbfbfe94c, ebp = 0xbfbfee28 --- Tracing command flowcleaner pid 21 tid 100075 td 0xc704eb40 sched_switch(c704eb40,0,104,191,f68d5908,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704eb40,0,c0cec294,28b,c704eb40,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb99a8,0,e753acac,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c0fb99a8,c0fb99b0,4e20,620,c704eb40,...) at _cv_timedwait+0x252 flowtable_cleaner(0,e753ad28,c0ce2c72,33b,c7bf4000,...) at flowtable_cleaner+0x1ae fork_exit(c096d1f0,0,e753ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe753ad60, ebp = 0 --- Tracing command softdepflush pid 20 tid 100074 td 0xc7161000 kdb_enter(c0ce7a94,c0ce7a94,c0d0f617,e7537a70,2,...) at kdb_enter+0x3a panic(c0d0f617,c88fdb00,c0d115e9,109,c88fdb00,...) at panic+0x134 worklist_remove(c0fc5118,0,c0d0f539,2202,0,...) at worklist_remove+0x70 softdep_setup_blkfree(c955087c,dada8b80,24dc8,0,8,...) at softdep_setup_blkfree+0x65 ffs_blkfree(c8a1f000,c9602000,c95ca570,24dc8,0,...) at ffs_blkfree+0x6fd indir_trunc(fffffff4,ffffffff,c8b78600,c9153b00,c8a1f000,...) at indir_trunc+0x552 handle_workitem_indirblk(4,c0ce6225,df,c9153b00,c9153b00,...) at handle_workitem_indirblk+0x76 handle_workitem_freeblocks(0,e7537c74,2,5e3,1e0,...) at handle_workitem_freeblocks+0x97 process_worklist_item(c0fc5118,0,c0d0f539,551,c7161000,...) at process_worklist_item+0x21c softdep_process_worklist(c955087c,0,c0d0f539,4e1,3e8,...) at softdep_process_worklist+0x8c softdep_flush(0,e7537d28,c0ce2c72,33b,c7bf42a8,...) at softdep_flush+0x2a0 fork_exit(c0b05d70,0,e7537d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7537d60, ebp = 0 --- Tracing command syncer pid 19 tid 100073 td 0xc71612d0 sched_switch(c71612d0,0,104,191,a0b6c5ae,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c71612d0,0,c0cec294,28b,c71612d0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb97b8,0,e7534c78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c0fb97b8,c0fb97a4,3e8,6e8,4e20,...) at _cv_timedwait+0x252 sched_sync(0,e7534d28,c0ce2c72,33b,c7bf4550,...) at sched_sync+0x512 fork_exit(c0956100,0,e7534d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7534d60, ebp = 0 --- Tracing command vnlru pid 18 tid 100072 td 0xc71615a0 sched_switch(c71615a0,0,104,191,439a5b7e,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,50,...) at mi_switch+0x200 sleepq_switch(c71615a0,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c7bf47f8,50,c0cf6519,0,0,...) at sleepq_timedwait+0x6b _sleep(c7bf47f8,c0fb9778,250,c0cf6519,3e8,...) at _sleep+0x342 vnlru_proc(0,e7531d28,c0ce2c72,33b,c7bf47f8,...) at vnlru_proc+0xe7 fork_exit(c0957910,0,e7531d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7531d60, ebp = 0 --- Tracing command bufdaemon pid 17 tid 100071 td 0xc7161870 sched_switch(c7161870,0,104,191,a0b7d464,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,44,...) at mi_switch+0x200 sleepq_switch(c7161870,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb9448,44,c0cf383c,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fb9448,c0fb9450,44,c0cf383c,3e8,...) at _sleep+0x342 buf_daemon(0,e752ed28,c0ce2c72,33b,c7bf4aa0,...) at buf_daemon+0x16e fork_exit(c093d620,0,e752ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe752ed60, ebp = 0 --- Tracing command pagezero pid 16 tid 100070 td 0xc7161b40 sched_switch(c7161b40,0,104,191,3cbcc39e,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7161b40,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc6fdc,0,c0d17bdb,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc6fdc,c0fc5a80,0,c0d17bdb,493e0,...) at _sleep+0x342 vm_pagezero(0,e752bd28,c0ce2c72,33b,c7bf4d48,...) at vm_pagezero+0xdc fork_exit(c0b4c3f0,0,e752bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe752bd60, ebp = 0 --- Tracing command vmdaemon pid 15 tid 100069 td 0xc7162000 sched_switch(c7162000,0,104,191,57f22d6e,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,68,...) at mi_switch+0x200 sleepq_switch(c7162000,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0fc6bd0,68,c0cf383c,0,0,...) at sleepq_wait+0x63 _sleep(c0fc6bd0,c0fc6bd4,68,c0cf383c,0,...) at _sleep+0x372 vm_daemon(0,e7528d28,c0ce2c72,33b,c6d9a2a8,...) at vm_daemon+0x59 fork_exit(c0b46270,0,e7528d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7528d60, ebp = 0 --- Tracing command pagedaemon pid 9 tid 100068 td 0xc71622d0 sched_switch(c71622d0,0,104,191,1bd8ac5,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,44,...) at mi_switch+0x200 sleepq_switch(c71622d0,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc6b98,44,c0cf383c,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc6b98,c0fc5a80,44,c0cf383c,1388,...) at _sleep+0x342 vm_pageout(0,e7525d28,c0ce2c72,33b,c6d9a550,...) at vm_pageout+0x2c7 fork_exit(c0b472e0,0,e7525d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7525d60, ebp = 0 --- Tracing command xpt_thrd pid 8 tid 100067 td 0xc71625a0 sched_switch(c71625a0,0,104,191,526f1b05,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c71625a0,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e18754,4c,c0c7e40d,0,0,...) at sleepq_wait+0x63 _sleep(c0e18754,c0e18798,4c,c0c7e40d,0,...) at _sleep+0x372 xpt_scanner_thread(0,e7522d28,c0ce2c72,33b,c6d9a7f8,...) at xpt_scanner_thread+0x47 fork_exit(c0485c50,0,e7522d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7522d60, ebp = 0 --- Tracing command sctp_iterator pid 7 tid 100066 td 0xc7162870 sched_switch(c7162870,0,104,191,af2e3b1a,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7162870,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0fbb1d8,0,c0d0251d,0,0,...) at sleepq_wait+0x63 _sleep(c0fbb1d8,c0fbb1a0,0,c0d0251d,0,...) at _sleep+0x372 sctp_iterator_thread(0,e751fd28,c0ce2c72,33b,c6d9aaa0,...) at sctp_iterator_thread+0x5c fork_exit(c09e77b0,0,e751fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe751fd60, ebp = 0 --- Tracing command fdc0 pid 6 tid 100062 td 0xc70245a0 sched_switch(c70245a0,0,104,191,4c2fda93,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c70245a0,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c705603c,4c,c0cdc7c6,0,0,...) at sleepq_timedwait+0x6b _sleep(c705603c,c70560f0,4c,c0cdc7c6,3e8,...) at _sleep+0x342 fdc_thread(c7056000,e7513d28,c0ce2c72,33b,c6d9ad48,...) at fdc_thread+0x27d fork_exit(c0bcaf70,c7056000,e7513d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7513d60, ebp = 0 --- Tracing command fw0_probe pid 5 tid 100060 td 0xc7024b40 sched_switch(c7024b40,0,104,191,5a5dde82,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7024b40,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7059000,5c,c0cdc7c6,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7059000,c705d488,15c,c0cdc7c6,0,...) at _sleep+0x35c fw_bus_probe_thread(c7059000,e7503d28,c0ce2c72,33b,c6f79000,...) at fw_bus_probe_thread+0xa08 fork_exit(c067cb70,c7059000,e7503d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7503d60, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc704c870 sched_switch(c704c870,0,104,191,47fbcb55,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704c870,0,c0cec294,268,c704c870,...) at sleepq_switch+0x15f sleepq_wait(c7034d34,0,e74f0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034d34,c7034dd4,c0cd4f70,6c,c7034d3c,...) at _cv_wait+0x243 usb_process(c7034d2c,e74f0d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7034d2c,e74f0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74f0d60, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc704cb40 sched_switch(c704cb40,0,104,191,6fdb414,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704cb40,0,c0cec294,268,c704cb40,...) at sleepq_switch+0x15f sleepq_wait(c7034d04,0,e74edcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034d04,c7034dd4,c0cd4f70,6c,c7034d0c,...) at _cv_wait+0x243 usb_process(c7034cfc,e74edd28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7034cfc,e74edd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74edd60, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xc704e000 sched_switch(c704e000,0,104,191,4794b7f0,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704e000,0,c0cec294,268,c704e000,...) at sleepq_switch+0x15f sleepq_wait(c7034cd4,0,e74eacac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034cd4,c7034dd4,c0cd4f70,6c,c7034cdc,...) at _cv_wait+0x243 usb_process(c7034ccc,e74ead28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7034ccc,e74ead28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74ead60, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc704e2d0 sched_switch(c704e2d0,0,104,191,4794a882,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704e2d0,0,c0cec294,268,c704e2d0,...) at sleepq_switch+0x15f sleepq_wait(c7034ca4,0,e74e7cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7034ca4,c7034dd4,c0cd4f70,6c,c7034cac,...) at _cv_wait+0x243 usb_process(c7034c9c,e74e7d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7034c9c,e74e7d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74e7d60, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc7022000 sched_switch(c7022000,0,104,191,47949384,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7022000,0,c0cec294,268,c7022000,...) at sleepq_switch+0x15f sleepq_wait(c702db5c,0,e74decac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702db5c,c702dbfc,c0cd4f70,6c,c702db64,...) at _cv_wait+0x243 usb_process(c702db54,e74ded28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c702db54,e74ded28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74ded60, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc70222d0 sched_switch(c70222d0,0,104,191,fdde794b,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70222d0,0,c0cec294,268,c70222d0,...) at sleepq_switch+0x15f sleepq_wait(c702db2c,0,e74dbcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702db2c,c702dbfc,c0cd4f70,6c,c702db34,...) at _cv_wait+0x243 usb_process(c702db24,e74dbd28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c702db24,e74dbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74dbd60, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc70225a0 sched_switch(c70225a0,0,104,191,472f74ef,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70225a0,0,c0cec294,268,c70225a0,...) at sleepq_switch+0x15f sleepq_wait(c702dafc,0,e74d8cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702dafc,c702dbfc,c0cd4f70,6c,c702db04,...) at _cv_wait+0x243 usb_process(c702daf4,e74d8d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c702daf4,e74d8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74d8d60, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc7022870 sched_switch(c7022870,0,104,191,472f618a,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7022870,0,c0cec294,268,c7022870,...) at sleepq_switch+0x15f sleepq_wait(c702dacc,0,e74d5cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702dacc,c702dbfc,c0cd4f70,6c,c702dad4,...) at _cv_wait+0x243 usb_process(c702dac4,e74d5d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c702dac4,e74d5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74d5d60, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc7022b40 sched_switch(c7022b40,0,104,191,472f4d40,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7022b40,0,c0cec294,268,c7022b40,...) at sleepq_switch+0x15f sleepq_wait(c7026b5c,0,e74d1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026b5c,c7026bfc,c0cd4f70,6c,c7026b64,...) at _cv_wait+0x243 usb_process(c7026b54,e74d1d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7026b54,e74d1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74d1d60, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc7023000 sched_switch(c7023000,0,104,191,faa613ae,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7023000,0,c0cec294,268,c7023000,...) at sleepq_switch+0x15f sleepq_wait(c7026b2c,0,e74cecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026b2c,c7026bfc,c0cd4f70,6c,c7026b34,...) at _cv_wait+0x243 usb_process(c7026b24,e74ced28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7026b24,e74ced28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74ced60, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc70232d0 sched_switch(c70232d0,0,104,191,41577679,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70232d0,0,c0cec294,268,c70232d0,...) at sleepq_switch+0x15f sleepq_wait(c7026afc,0,e74cbcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026afc,c7026bfc,c0cd4f70,6c,c7026b04,...) at _cv_wait+0x243 usb_process(c7026af4,e74cbd28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7026af4,e74cbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74cbd60, ebp = 0 --- Tracing command usb pid 14 tid 100044 td 0xc70235a0 sched_switch(c70235a0,0,104,191,415762cb,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70235a0,0,c0cec294,268,c70235a0,...) at sleepq_switch+0x15f sleepq_wait(c7026acc,0,e74c8cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7026acc,c7026bfc,c0cd4f70,6c,c7026ad4,...) at _cv_wait+0x243 usb_process(c7026ac4,e74c8d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7026ac4,e74c8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74c8d60, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc7023870 sched_switch(c7023870,0,104,191,41574e9e,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7023870,0,c0cec294,268,c7023870,...) at sleepq_switch+0x15f sleepq_wait(c701db5c,0,e74c4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701db5c,c701dbfc,c0cd4f70,6c,c701db64,...) at _cv_wait+0x243 usb_process(c701db54,e74c4d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c701db54,e74c4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74c4d60, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc7023b40 sched_switch(c7023b40,0,104,191,f993912a,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7023b40,0,c0cec294,268,c7023b40,...) at sleepq_switch+0x15f sleepq_wait(c701db2c,0,e74c1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701db2c,c701dbfc,c0cd4f70,6c,c701db34,...) at _cv_wait+0x243 usb_process(c701db24,e74c1d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c701db24,e74c1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74c1d60, ebp = 0 --- Tracing command usb pid 14 tid 100041 td 0xc7024000 sched_switch(c7024000,0,104,191,40f284e5,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7024000,0,c0cec294,268,c7024000,...) at sleepq_switch+0x15f sleepq_wait(c701dafc,0,e74becac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701dafc,c701dbfc,c0cd4f70,6c,c701db04,...) at _cv_wait+0x243 usb_process(c701daf4,e74bed28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c701daf4,e74bed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74bed60, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc7013000 sched_switch(c7013000,0,104,191,40f272ba,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7013000,0,c0cec294,268,c7013000,...) at sleepq_switch+0x15f sleepq_wait(c701dacc,0,e74bbcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701dacc,c701dbfc,c0cd4f70,6c,c701dad4,...) at _cv_wait+0x243 usb_process(c701dac4,e74bbd28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c701dac4,e74bbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74bbd60, ebp = 0 --- Tracing command usb pid 14 tid 100038 td 0xc70135a0 sched_switch(c70135a0,0,104,191,40f25eee,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70135a0,0,c0cec294,268,c70135a0,...) at sleepq_switch+0x15f sleepq_wait(c7017b5c,0,e74b4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017b5c,c7017bfc,c0cd4f70,6c,c7017b64,...) at _cv_wait+0x243 usb_process(c7017b54,e74b4d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7017b54,e74b4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74b4d60, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc7013870 sched_switch(c7013870,0,104,191,f8813d80,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7013870,0,c0cec294,268,c7013870,...) at sleepq_switch+0x15f sleepq_wait(c7017b2c,0,e74b1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017b2c,c7017bfc,c0cd4f70,6c,c7017b34,...) at _cv_wait+0x243 usb_process(c7017b24,e74b1d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7017b24,e74b1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74b1d60, ebp = 0 --- Tracing command usb pid 14 tid 100036 td 0xc7013b40 sched_switch(c7013b40,0,104,191,408d3f2a,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7013b40,0,c0cec294,268,c7013b40,...) at sleepq_switch+0x15f sleepq_wait(c7017afc,0,e74aecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017afc,c7017bfc,c0cd4f70,6c,c7017b04,...) at _cv_wait+0x243 usb_process(c7017af4,e74aed28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7017af4,e74aed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74aed60, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc7015000 sched_switch(c7015000,0,104,191,408d2c69,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7015000,0,c0cec294,268,c7015000,...) at sleepq_switch+0x15f sleepq_wait(c7017acc,0,e74abcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7017acc,c7017bfc,c0cd4f70,6c,c7017ad4,...) at _cv_wait+0x243 usb_process(c7017ac4,e74abd28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7017ac4,e74abd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74abd60, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc70155a0 sched_switch(c70155a0,0,104,191,408d172c,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c70155a0,0,c0cec294,268,c70155a0,...) at sleepq_switch+0x15f sleepq_wait(c7007b5c,0,e74a4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007b5c,c7007bfc,c0cd4f70,6c,c7007b64,...) at _cv_wait+0x243 usb_process(c7007b54,e74a4d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7007b54,e74a4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74a4d60, ebp = 0 --- Tracing command usb pid 14 tid 100032 td 0xc7015870 sched_switch(c7015870,0,104,191,f65b87d1,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7015870,0,c0cec294,268,c7015870,...) at sleepq_switch+0x15f sleepq_wait(c7007b2c,0,e74a1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007b2c,c7007bfc,c0cd4f70,6c,c7007b34,...) at _cv_wait+0x243 usb_process(c7007b24,e74a1d28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7007b24,e74a1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74a1d60, ebp = 0 --- Tracing command usb pid 14 tid 100031 td 0xc7015b40 sched_switch(c7015b40,0,104,191,402136e9,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7015b40,0,c0cec294,268,c7015b40,...) at sleepq_switch+0x15f sleepq_wait(c7007afc,0,e749ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007afc,c7007bfc,c0cd4f70,6c,c7007b04,...) at _cv_wait+0x243 usb_process(c7007af4,e749ed28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7007af4,e749ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe749ed60, ebp = 0 --- Tracing command usb pid 14 tid 100030 td 0xc6eaf2d0 sched_switch(c6eaf2d0,0,104,191,40212392,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6eaf2d0,0,c0cec294,268,c6eaf2d0,...) at sleepq_switch+0x15f sleepq_wait(c7007acc,0,e749bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7007acc,c7007bfc,c0cd4f70,6c,c7007ad4,...) at _cv_wait+0x243 usb_process(c7007ac4,e749bd28,c0ce2c72,33b,c6f792a8,...) at usb_process+0x193 fork_exit(c07e8100,c7007ac4,e749bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe749bd60, ebp = 0 --- Tracing command yarrow pid 13 tid 100017 td 0xc6eae5a0 sched_switch(c6eae5a0,0,104,191,99f7f5f7,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6eae5a0,0,c0cec294,28b,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0e4c684,0,c0cdc7c6,2,0,...) at sleepq_timedwait+0x6b _sleep(c0e4c684,0,0,c0cdc7c6,64,...) at _sleep+0x342 pause(c0cdc7c6,64,c0cc8878,111,0,...) at pause+0x47 random_kthread(0,c6b45d28,c0ce2c72,33b,c6f79550,...) at random_kthread+0x1ef fork_exit(c0759b40,0,c6b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b45d60, ebp = 0 --- Tracing command g_down pid 4 tid 100016 td 0xc6eae870 sched_switch(c6eae870,0,104,191,a0bbedd9,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c6eae870,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e4a344,4c,c0cdc7c6,0,0,...) at sleepq_wait+0x63 _sleep(c0e4a344,c0e4a2a8,24c,c0cdc7c6,0,...) at _sleep+0x372 g_io_schedule_down(c6eae870,0,c0cddf54,74,0,...) at g_io_schedule_down+0x5b g_down_procbody(0,c6b42d28,c0ce2c72,33b,c6d99000,...) at g_down_procbody+0x8d fork_exit(c0857550,0,c6b42d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b42d60, ebp = 0 --- Tracing command g_up pid 3 tid 100015 td 0xc6eaeb40 cpustop_handler(2,c6b3fb6c,c0c04966,c0d256f6,ec,...) at cpustop_handler+0x34 ipi_nmi_handler(c0d256f6,ec,0,c08ae27c,c6d992a8,...) at ipi_nmi_handler+0x2f trap(c6b3fb78) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08ae287, esp = 0xc6b3fbb8, ebp = 0xc6b3fbd4 --- _mtx_lock_sleep(c0fc5118,c6eaeb40,0,c0d0f539,61b,...) at _mtx_lock_sleep+0xa7 _mtx_lock_flags(c0fc5118,0,c0d0f539,61b,0,...) at _mtx_lock_flags+0xf7 softdep_move_dependencies(daeb0460,dada8b80,c0d11e67,705,c95ca668,...) at softdep_move_dependencies+0x30 ffs_backgroundwritedone(daeb0460,c158ea80,daeb0460,c8304688,c6b3fc7c,...) at ffs_backgroundwritedone+0xb8 bufdone(daeb0460,c6d565c4) at bufdone+0x53 g_vfs_done(c8304688,0,c0cf2e41,c5c,c6eaeb40,...) at g_vfs_done+0x85 biodone(c8304688,c0e4a2c8,24c,c0cdc7c6,0,...) at biodone+0xa5 g_io_schedule_up(c6eaeb40,0,c0cddf54,5d,0,...) at g_io_schedule_up+0xde g_up_procbody(0,c6b3fd28,c0ce2c72,33b,c6d992a8,...) at g_up_procbody+0x8d fork_exit(c08575e0,0,c6b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b3fd60, ebp = 0 --- Tracing command g_event pid 2 tid 100014 td 0xc6eaf000 sched_switch(c6eaf000,0,104,191,9ee8bad0,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c6eaf000,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0e4a338,4c,c0cdc7c6,0,0,...) at sleepq_timedwait+0x6b _sleep(c0e4a338,0,4c,c0cdc7c6,64,...) at _sleep+0x342 g_event_procbody(0,c6b3cd28,c0ce2c72,33b,c6d99550,...) at g_event_procbody+0xcb fork_exit(c0857670,0,c6b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100064 td 0xc7164000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100063 td 0xc70242d0 sched_switch(c70242d0,0,109,191,401da7b7,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0ef0,...) at mi_switch+0x200 ithread_loop(c6de83b0,e7516d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de83b0,e7516d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7516d60, ebp = 0 --- Tracing command intr pid 12 tid 100061 td 0xc7024870 sched_switch(c7024870,0,109,191,f7cd0624,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de12f0,...) at mi_switch+0x200 ithread_loop(c6de8020,e7506d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8020,e7506d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7506d60, ebp = 0 --- Tracing command intr pid 12 tid 100058 td 0xc704c2d0 sched_switch(c704c2d0,0,109,191,3f9a99c5,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0570,...) at mi_switch+0x200 ithread_loop(c6de8370,e74fad28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8370,e74fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74fad60, ebp = 0 --- Tracing command intr pid 12 tid 100057 td 0xc704c5a0 sched_switch(c704c5a0,0,109,191,4d36b725,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0870,...) at mi_switch+0x200 ithread_loop(c6de8690,e74f6d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8690,e74f6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74f6d60, ebp = 0 --- Tracing command intr pid 12 tid 100052 td 0xc704e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xc70132d0 sched_switch(c70132d0,0,109,191,65805e39,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0670,...) at mi_switch+0x200 ithread_loop(c6de8580,e74b8d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8580,e74b8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74b8d60, ebp = 0 --- Tracing command intr pid 12 tid 100034 td 0xc70152d0 sched_switch(c70152d0,0,109,191,5fb4bf4c,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de06f0,...) at mi_switch+0x200 ithread_loop(c6de8140,e74a8d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8140,e74a8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe74a8d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc6eaf5a0 sched_switch(c6eaf5a0,0,109,191,5de30767,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0770,...) at mi_switch+0x200 ithread_loop(c6de8700,e7498d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8700,e7498d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7498d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc6eaf870 sched_switch(c6eaf870,0,109,191,37ebfd0d,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0470,...) at mi_switch+0x200 ithread_loop(c6de8420,e7389d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8420,e7389d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7389d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc6eafb40 sched_switch(c6eafb40,0,109,191,401e48ef,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0af0,...) at mi_switch+0x200 ithread_loop(c6de8630,c6b8ad28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8630,c6b8ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b8ad60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc6fa3000 sched_switch(c6fa3000,0,109,191,567df8cc,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6fa2070,...) at mi_switch+0x200 ithread_loop(c6de8760,c6b60d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8760,c6b60d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b60d60, ebp = 0 --- Tracing command intr pid 12 tid 100022 td 0xc6fa3b40 sched_switch(c6fa3b40,0,109,191,8615f3ad,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6fa2170,...) at mi_switch+0x200 ithread_loop(c6de8770,c6b54d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8770,c6b54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b54d60, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc6de9870 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100019 td 0xc6eae000 sched_switch(c6eae000,0,109,191,3de52257,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0070,...) at mi_switch+0x200 ithread_loop(c6de8790,c6b4bd28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de8790,c6b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b4bd60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc6da15a0 sched_switch(c6da15a0,0,109,191,2d6c661b,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de00f0,...) at mi_switch+0x200 ithread_loop(c6de87a0,c6b36d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de87a0,c6b36d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b36d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc6da1870 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc6da1b40 sched_switch(c6da1b40,0,109,191,8482ea72,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de01f0,...) at mi_switch+0x200 ithread_loop(c6de87c0,c6b30d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de87c0,c6b30d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b30d60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc6de9000 sched_switch(c6de9000,0,109,191,9ee75c45,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de0270,...) at mi_switch+0x200 ithread_loop(c6de87d0,c6b2dd28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de87d0,c6b2dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b2dd60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc6de92d0 sched_switch(c6de92d0,0,109,191,8f3db56a,...) at sched_switch+0x3bc mi_switch(109,0,c0ce2eb8,52d,c6de02f0,...) at mi_switch+0x200 ithread_loop(c6de87e0,c6b2ad28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0x206 fork_exit(c0896230,c6de87e0,c6b2ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b2ad60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc6de95a0 cpustop_handler(1,c6b27b74,c0c04966,0,c6b27b14,...) at cpustop_handler+0x34 ipi_nmi_handler(0,c6b27b14,c08e2c3c,54a,c6d997f8,...) at ipi_nmi_handler+0x2f trap(c6b27b80) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc04fbe83, esp = 0xc6b27bc0, ebp = 0xc6b27bc0 --- acpi_timer_read(c0d3d2e0,c0e4c880,c6b27c08,c08c988d,c0d3d2e0,...) at acpi_timer_read+0x13 acpi_timer_get_timecount_safe(c0d3d2e0,c0e242c8,c6b27c08,c06173c4,c0e242e0,...) at acpi_timer_get_timecount_safe+0x11 binuptime(c6b27c6c,0,c0ce8e2b,1a1,c6de9844,...) at binuptime+0x3d softclock(c0e4c880,c6b27cb8,c08adc94,c0e502c0,c6de0338,...) at softclock+0x28b intr_event_execute_handlers(c6d997f8,c6de0300,c0ce2eb8,533,c6de0370,...) at intr_event_execute_handlers+0x125 ithread_loop(c6de87f0,c6b27d28,c0ce2c72,33b,c6d997f8,...) at ithread_loop+0xac fork_exit(c0896230,c6de87f0,c6b27d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b27d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc6d9b000 sched_switch(c6d9b000,0,108,18c,a39fa147,...) at sched_switch+0x3bc mi_switch(108,0,c0ce9665,9fe,c6d9b000,...) at mi_switch+0x200 sched_idletd(0,c6b23d28,c0ce2c72,33b,c6d99aa0,...) at sched_idletd+0x2bf fork_exit(c08e3670,0,c6b23d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b23d60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc6d9b2d0 sched_switch(c6d9b2d0,0,108,18c,a0bb8036,...) at sched_switch+0x3bc mi_switch(108,0,c0ce9665,9fe,c6d9b2d0,...) at mi_switch+0x200 sched_idletd(0,c6b20d28,c0ce2c72,33b,c6d99aa0,...) at sched_idletd+0x2bf fork_exit(c08e3670,0,c6b20d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b20d60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc6d9b5a0 sched_switch(c6d9b5a0,0,108,18c,a0b4dc3f,...) at sched_switch+0x3bc mi_switch(108,0,c0ce9665,3aa,c6d9b5a0,...) at mi_switch+0x200 sched_idletd(0,c6b1dd28,c0ce2c72,33b,c6d99aa0,...) at sched_idletd+0x19f fork_exit(c08e3670,0,c6b1dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b1dd60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc6d9b870 cpustop_handler(8,c6b1ac04,c0c04966,46,c6b10c80,...) at cpustop_handler+0x34 ipi_nmi_handler(46,c6b10c80,c6b1ab9c,c08adc94,c6d99aa0,...) at ipi_nmi_handler+0x2f trap(c6b1ac10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0be63d5, esp = 0xc6b1ac50, ebp = 0xc6b1ac50 --- acpi_cpu_c1(c6b1ac6c,c0e189d0,3,2e9,54a,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c6b1aca0,c0bf66b0,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c0e51640,2,c6b1ace8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c6b1acc4,c0ce9665,3ac,c6d9b870,...) at cpu_idle+0x90 sched_idletd(0,c6b1ad28,c0ce2c72,33b,c6d99aa0,...) at sched_idletd+0x263 fork_exit(c08e3670,0,c6b1ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b1ad60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc6d9bb40 sched_switch(c6d9bb40,0,104,191,7f958b9d,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6d9bb40,0,c0cec294,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0cec294,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6d99d48,5c,c0ceebec,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6d99d48,c6d99dd0,15c,c0ceebec,0,...) at _sleep+0x35c kern_wait(c6d9bb40,ffffffff,c6b16c44,0,0,...) at kern_wait+0xb66 wait4(c6d9bb40,c6b16cec,c6b16d28,c0cecacd,0,...) at wait4+0x3b syscallenter(c6d9bb40,c6b16ce4,c6b16ce4,0,0,...) at syscallenter+0x263 syscall(c6b16d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054cd3, esp = 0xbfbfe8dc, ebp = 0xbfbfe8f8 --- Tracing command audit pid 10 tid 100001 td 0xc6da1000 sched_switch(c6da1000,0,104,191,401eb410,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6da1000,0,c0cec294,268,c6da1000,...) at sleepq_switch+0x15f sleepq_wait(c0fc4980,0,c6b13c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c0fc4980,c0fc4964,c0d0d488,194,0,...) at _cv_wait+0x243 audit_worker(0,c6b13d28,c0ce2c72,33b,c6d9a000,...) at audit_worker+0x84 fork_exit(c0acd830,0,c6b13d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b13d60, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc7162b40 sched_switch(c7162b40,0,104,191,4bc434ff,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c7162b40,0,c0cec294,28b,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0e4c684,0,c0cdc7c6,2,0,...) at sleepq_timedwait+0x6b _sleep(c0e4c684,0,0,c0cdc7c6,bb8,...) at _sleep+0x342 pause(c0cdc7c6,bb8,120,11e,c0e4a4a8,...) at pause+0x47 deadlkres(0,e751cd28,c0ce2c72,33b,c0e4a420,...) at deadlkres+0x302 fork_exit(c08784c0,0,e751cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe751cd60, ebp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xc704c000 sched_switch(c704c000,0,104,191,9f561e44,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c704c000,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabb80,0,c0ce864a,c0cdc7c6,0,...) at sleepq_wait+0x63 msleep_spin(c6eabb80,c6eabb9c,c0cdc7c6,0,c0ce6225,...) at msleep_spin+0x21d taskqueue_thread_loop(c705d49c,e7500d28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0x8f fork_exit(c08fe330,c705d49c,e7500d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7500d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc6fa32d0 sched_switch(c6fa32d0,0,104,191,480ca8b3,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6fa32d0,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabc80,0,c0ce864a,c0cdc7c6,0,...) at sleepq_wait+0x63 msleep_spin(c6eabc80,c6eabc9c,c0cdc7c6,0,c0ce6225,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e1b620,c6b5dd28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0x8f fork_exit(c08fe330,c0e1b620,c6b5dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc6fa35a0 sched_switch(c6fa35a0,0,104,191,480c969b,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6fa35a0,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabc80,0,c0ce864a,c0cdc7c6,0,...) at sleepq_wait+0x63 msleep_spin(c6eabc80,c6eabc9c,c0cdc7c6,0,c0ce6225,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e1b620,c6b5ad28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0x8f fork_exit(c08fe330,c0e1b620,c6b5ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc6fa3870 sched_switch(c6fa3870,0,104,191,480c860f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6fa3870,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabc80,0,c0ce864a,c0cdc7c6,0,...) at sleepq_wait+0x63 msleep_spin(c6eabc80,c6eabc9c,c0cdc7c6,0,c0ce6225,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e1b620,c6b57d28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0x8f fork_exit(c08fe330,c0e1b620,c6b57d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b57d60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc6de9b40 sched_switch(c6de9b40,0,104,191,5680231f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6de9b40,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabd40,0,c0cdc7c6,0,0,...) at sleepq_wait+0x63 _sleep(c6eabd40,c6eabd5c,0,c0cdc7c6,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e5efe8,c6b4ed28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fe330,c0e5efe8,c6b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc6eae2d0 sched_switch(c6eae2d0,0,104,191,48017cba,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6eae2d0,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabdc0,0,c0cdc7c6,0,0,...) at sleepq_wait+0x63 _sleep(c6eabdc0,c6eabddc,0,c0cdc7c6,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e4ad78,c6b48d28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fe330,c0e4ad78,c6b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b48d60, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc6da12d0 sched_switch(c6da12d0,0,104,191,5c35fe74,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6da12d0,0,c0cec294,268,0,...) at sleepq_switch+0x15f sleepq_wait(c6eabe00,0,c0cdc7c6,0,0,...) at sleepq_wait+0x63 _sleep(c6eabe00,c6eabe1c,0,c0cdc7c6,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e5da60,c6b39d28,c0ce2c72,33b,c0e4a420,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fe330,c0e5da60,c6b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b39d60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc0e4a6d0 sched_switch(c0e4a6d0,0,104,191,ea45be0f,...) at sched_switch+0x3bc mi_switch(104,0,c0cec294,1f3,44,...) at mi_switch+0x200 sleepq_switch(c0e4a6d0,0,c0cec294,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0e4a420,44,c0ce9f79,0,0,...) at sleepq_timedwait+0x6b _sleep(c0e4a420,0,44,c0ce9f79,2710,...) at _sleep+0x342 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x23e mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3439 MB Dumping 244 MB: 229 213 197 181 165 149 133 117 101 85 69 53 37 21 5 Dump complete = 0xf db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump () at pcpu.h:231 #1 0xc04d5b29 in db_fncall (dummy1=0xc08f113a, dummy2=0x0, dummy3=0xffffffff, dummy4=0xe7537714 "(wSç") at ../../../ddb/db_command.c:548 #2 0xc04d5f5f in db_command (last_cmdp=0xc0e197fc, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:445 #3 0xc04d6014 in db_command_script (command=0xc0e1a708 "call doadump") at ../../../ddb/db_command.c:516 #4 0xc04da260 in db_script_exec (scriptname=0xc0e1a060 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc04da2f1 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc0fe78e0, modif=0xe753784c "") at ../../../ddb/db_script.c:375 #6 0xc04d5f21 in db_command (last_cmdp=0xc0e197fc, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:445 #7 0xc04d607a in db_command_loop () at ../../../ddb/db_command.c:498 #8 0xc04d7f9d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc08f0f6e in kdb_trap (type=0x3, code=0x0, tf=0xe75379f0) at ../../../kern/subr_kdb.c:546 #10 0xc0c04f9b in trap (frame=0xe75379f0) at ../../../i386/i386/trap.c:732 #11 0xc0bede8c in calltrap () at ../../../i386/i386/exception.s:168 #12 0xc08f113a in kdb_enter (why=0xc0ce7a94 "panic", msg=0xc0ce7a94 "panic") at cpufunc.h:71 #13 0xc08bdf04 in panic (fmt=0xc0d0f617 "worklist_remove: %p %s(0x%X) not on list") at ../../../kern/kern_shutdown.c:574 #14 0xc0af70f0 in worklist_remove (item=0xc88fdb00, locked=Variable "locked" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:962 #15 0xc0afdd75 in softdep_setup_blkfree (mp=0xc955087c, bp=0xdada8b80, blkno=0x24dc8, frags=0x8, wkhd=0xe7537c00) at ../../../ufs/ffs/ffs_softdep.c:8720 #16 0xc0ae323d in ffs_blkfree (ump=0xc8a1f000, fs=0xc9602000, devvp=0xc95ca570, bno=0x24dc8, size=0x4000, inum=0xd, dephd=0xe7537c00) at ../../../ufs/ffs/ffs_alloc.c:1962 #17 0xc0afe402 in indir_trunc (freework=0xc8b78600, dbn=0x7400, lbn=0xfffffffffffffff4) at ../../../ufs/ffs/ffs_softdep.c:6189 #18 0xc0afeb26 in handle_workitem_indirblk (freework=0xc8b78600) at ../../../ufs/ffs/ffs_softdep.c:5925 #19 0xc0afebd7 in handle_workitem_freeblocks (freeblks=0xc9153b00, flags=Variable "flags" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:5990 #20 0xc0afeeac in process_worklist_item (mp=0xc955087c, flags=Variable "flags" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:1522 #21 0xc0b05a4c in softdep_process_worklist (mp=0xc955087c, full=0x0) at ../../../ufs/ffs/ffs_softdep.c:1366 #22 0xc0b06010 in softdep_flush () at ../../../ufs/ffs/ffs_softdep.c:1244 #23 0xc08932e8 in fork_exit (callout=0xc0b05d70 , arg=0x0, frame=0xe7537d28) at ../../../kern/kern_fork.c:835 #24 0xc0bedf04 in fork_trampoline () at ../../../i386/i386/exception.s:275 (kgdb) f 14 #14 0xc0af70f0 in worklist_remove (item=0xc88fdb00, locked=Variable "locked" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:962 962 panic("worklist_remove: %p %s(0x%X) not on list", (kgdb) l 957 { 958 959 if (locked) 960 mtx_assert(&lk, MA_OWNED); 961 if ((item->wk_state & ONWORKLIST) == 0) 962 panic("worklist_remove: %p %s(0x%X) not on list", 963 item, TYPENAME(item->wk_type), item->wk_state); 964 if (item->wk_state & BLOCKEDWK) 965 panic("worklist_remove: blocked remove %p %s(0x%x)", 966 item, TYPENAME(item->wk_type), item->wk_state); (kgdb) p *item $1 = {wk_list = {le_next = 0x0, le_prev = 0xe7537c00}, wk_mp = 0xc955087c, wk_type = 0x13, wk_state = 0x109, wk_stack_ins = {depth = 0x9, pcs = {0xc0af72f7, 0xc0afe3a7, 0xc0afeb26, 0xc0afebd7, 0xc0afeeac, 0xc0b05a4c, 0xc0b06010, 0xc08932e8, 0xc0bedf04, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}, wk_stack_rem = {depth = 0x9, pcs = {0xc0af7199, 0xc0afe150, 0xc0afeb26, 0xc0afebd7, 0xc0afeeac, 0xc0b05a4c, 0xc0b06010, 0xc08932e8, 0xc0bedf04, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}, wk_onworklist = 0x1} (kgdb) l *0xc0af72f7 0xc0af72f7 is in worklist_insert (../../../ufs/ffs/ffs_softdep.c:951). 946 item, TYPENAME(item->wk_type), item->wk_state); 947 item->wk_onworklist = 1; 948 item->wk_state |= ONWORKLIST; 949 LIST_INSERT_HEAD(head, item, wk_list); 950 stack_save(&item->wk_stack_ins); 951 } 952 953 static void 954 worklist_remove(item, locked) 955 struct worklist *item; (kgdb) l *0xc0afe3a7 0xc0afe3a7 is in indir_trunc (../../../ufs/ffs/ffs_softdep.c:6188). 6183 } else { 6184 struct workhead freewk; 6185 6186 LIST_INIT(&freewk); 6187 WORKLIST_INSERT_UNLOCKED(&freewk, wk); 6188 wk->wk_state |= BLOCKEDWK; 6189 ffs_blkfree(ump, fs, freeblks->fb_devvp, 6190 jnewblk->jn_blkno, fs->fs_bsize, 6191 freeblks->fb_previousinum, &freewk); 6192 } (kgdb) l *0xc0afeb26 0xc0afeb26 is in handle_workitem_indirblk (../../../ufs/ffs/ffs_softdep.c:5927). 5922 if (freework->fw_off == NINDIR(fs)) 5923 freework_freeblock(freework); 5924 else 5925 indir_trunc(freework, fsbtodb(fs, freework->fw_blkno), 5926 freework->fw_lbn); 5927 } 5928 5929 /* 5930 * Called when a freework structure attached to a cg buf is written. The 5931 * ref on either the parent or the freeblks structure is released and (kgdb) l *0xc0afebd7 0xc0afebd7 is in handle_workitem_freeblocks (../../../ufs/ffs/ffs_softdep.c:5990). 5985 ("handle_workitem_freeblocks: Unknown type %s", 5986 TYPENAME(wk->wk_type))); 5987 WORKLIST_REMOVE_UNLOCKED(wk); 5988 freework = WK_FREEWORK(wk); 5989 if (freework->fw_lbn <= -NDADDR) 5990 handle_workitem_indirblk(freework); 5991 else 5992 freework_freeblock(freework); 5993 } 5994 ACQUIRE_LOCK(&lk); (kgdb) l *0xc0afeeac 0xc0afeeac is in process_worklist_item (../../../ufs/ffs/ffs_softdep.c:1522). 1517 vput(vp); 1518 break; 1519 1520 case D_FREEBLKS: 1521 /* releasing blocks and/or fragments from a file */ 1522 handle_workitem_freeblocks(WK_FREEBLKS(wk), flags & LK_NOWAIT); 1523 break; 1524 1525 case D_FREEFRAG: 1526 /* releasing a fragment when replaced as a file grows */ (kgdb) l *0xc0b05a4c 0xc0b05a4c is in softdep_process_worklist (../../../ufs/ffs/ffs_softdep.c:1366). 1361 ACQUIRE_LOCK(&lk); 1362 loopcount = 1; 1363 starttime = time_second; 1364 softdep_process_journal(mp, full?MNT_WAIT:0); 1365 while (ump->softdep_on_worklist > 0) { 1366 if ((cnt = process_worklist_item(mp, LK_NOWAIT)) == -1) 1367 break; 1368 else 1369 matchcnt += cnt; 1370 /* (kgdb) l *0xc0b06010 0xc0b06010 is in softdep_flush (../../../ufs/ffs/ffs_softdep.c:1244). 1239 if ((mp->mnt_flag & MNT_SOFTDEP) == 0) 1240 continue; 1241 if (vfs_busy(mp, MBF_NOWAIT | MBF_MNTLSTLOCK)) 1242 continue; 1243 vfslocked = VFS_LOCK_GIANT(mp); 1244 progress += softdep_process_worklist(mp, 0); 1245 ump = VFSTOUFS(mp); 1246 remaining += ump->softdep_on_worklist - 1247 ump->softdep_on_worklist_inprogress; 1248 VFS_UNLOCK_GIANT(vfslocked); (kgdb) l *0xc08932e8 0xc08932e8 is in fork_exit (../../../kern/kern_fork.c:841). 836 837 /* 838 * Check if a kernel thread misbehaved and returned from its main 839 * function. 840 */ 841 if (p->p_flag & P_KTHREAD) { 842 printf("Kernel thread \"%s\" (pid %d) exited prematurely.\n", 843 td->td_name, p->p_pid); 844 kproc_exit(0); 845 } (kgdb) l *0xc0af7199 0xc0af7199 is in worklist_remove (../../../ufs/ffs/ffs_softdep.c:971). 966 item, TYPENAME(item->wk_type), item->wk_state); 967 item->wk_onworklist = 0; 968 item->wk_state &= ~ONWORKLIST; 969 LIST_REMOVE(item, wk_list); 970 stack_save(&item->wk_stack_rem); 971 } 972 #endif /* DEBUG */ 973 974 /* 975 * Merge two jsegdeps keeping only the oldest one as newer references (kgdb) l *0xc0afe150 0xc0afe150 is in indir_trunc (../../../ufs/ffs/ffs_softdep.c:6155). 6150 cnt = 0; 6151 LIST_FOREACH_SAFE(wk, &wkhd, wk_list, wkn) { 6152 if (wk->wk_type != D_JNEWBLK) 6153 continue; 6154 WORKLIST_REMOVE_UNLOCKED(wk); 6155 jnewblk = WK_JNEWBLK(wk); 6156 if (jnewblk->jn_lbn > 0) 6157 i = (jnewblk->jn_lbn - -lbn) / lbnadd; 6158 else 6159 i = (jnewblk->jn_lbn - (lbn + level)) / lbnadd; (kgdb) l *0xc0afeb26 0xc0afeb26 is in handle_workitem_indirblk (../../../ufs/ffs/ffs_softdep.c:5927). 5922 if (freework->fw_off == NINDIR(fs)) 5923 freework_freeblock(freework); 5924 else 5925 indir_trunc(freework, fsbtodb(fs, freework->fw_blkno), 5926 freework->fw_lbn); 5927 } 5928 5929 /* 5930 * Called when a freework structure attached to a cg buf is written. The 5931 * ref on either the parent or the freeblks structure is released and (kgdb) l *0xc0afebd7 0xc0afebd7 is in handle_workitem_freeblocks (../../../ufs/ffs/ffs_softdep.c:5990). 5985 ("handle_workitem_freeblocks: Unknown type %s", 5986 TYPENAME(wk->wk_type))); 5987 WORKLIST_REMOVE_UNLOCKED(wk); 5988 freework = WK_FREEWORK(wk); 5989 if (freework->fw_lbn <= -NDADDR) 5990 handle_workitem_indirblk(freework); 5991 else 5992 freework_freeblock(freework); 5993 } 5994 ACQUIRE_LOCK(&lk); (kgdb) l *0xc0afeeac 0xc0afeeac is in process_worklist_item (../../../ufs/ffs/ffs_softdep.c:1522). 1517 vput(vp); 1518 break; 1519 1520 case D_FREEBLKS: 1521 /* releasing blocks and/or fragments from a file */ 1522 handle_workitem_freeblocks(WK_FREEBLKS(wk), flags & LK_NOWAIT); 1523 break; 1524 1525 case D_FREEFRAG: 1526 /* releasing a fragment when replaced as a file grows */ (kgdb) l *0xc0b05a4c 0xc0b05a4c is in softdep_process_worklist (../../../ufs/ffs/ffs_softdep.c:1366). 1361 ACQUIRE_LOCK(&lk); 1362 loopcount = 1; 1363 starttime = time_second; 1364 softdep_process_journal(mp, full?MNT_WAIT:0); 1365 while (ump->softdep_on_worklist > 0) { 1366 if ((cnt = process_worklist_item(mp, LK_NOWAIT)) == -1) 1367 break; 1368 else 1369 matchcnt += cnt; 1370 /* (kgdb) l *0xc0b06010 0xc0b06010 is in softdep_flush (../../../ufs/ffs/ffs_softdep.c:1244). 1239 if ((mp->mnt_flag & MNT_SOFTDEP) == 0) 1240 continue; 1241 if (vfs_busy(mp, MBF_NOWAIT | MBF_MNTLSTLOCK)) 1242 continue; 1243 vfslocked = VFS_LOCK_GIANT(mp); 1244 progress += softdep_process_worklist(mp, 0); 1245 ump = VFSTOUFS(mp); 1246 remaining += ump->softdep_on_worklist - 1247 ump->softdep_on_worklist_inprogress; 1248 VFS_UNLOCK_GIANT(vfslocked); (kgdb) git diff master diff --git a/sys/ufs/ffs/ffs_inode.c b/sys/ufs/ffs/ffs_inode.c index ffbe16e..ba2813d 100644 --- a/sys/ufs/ffs/ffs_inode.c +++ b/sys/ufs/ffs/ffs_inode.c @@ -582,9 +582,7 @@ ffs_indirtrunc(ip, lbn, dbn, lastbn, level, countp) * block to be kept. -1 indicates the entire * block so we need not calculate the index. */ - factor = 1; - for (i = SINGLE; i < level; i++) - factor *= NINDIR(fs); + factor = lbn_offset(fs, level); last = lastbn; if (lastbn > 0) last /= factor; diff --git a/sys/ufs/ffs/ffs_softdep.c b/sys/ufs/ffs/ffs_softdep.c index ca4ea0b..7d2eac2 100644 --- a/sys/ufs/ffs/ffs_softdep.c +++ b/sys/ufs/ffs/ffs_softdep.c @@ -944,8 +944,10 @@ worklist_insert(head, item, locked) if (item->wk_state & ONWORKLIST) panic("worklist_insert: %p %s(0x%X) already on list", item, TYPENAME(item->wk_type), item->wk_state); + item->wk_onworklist = 1; item->wk_state |= ONWORKLIST; LIST_INSERT_HEAD(head, item, wk_list); + stack_save(&item->wk_stack_ins); } static void @@ -959,8 +961,13 @@ worklist_remove(item, locked) if ((item->wk_state & ONWORKLIST) == 0) panic("worklist_remove: %p %s(0x%X) not on list", item, TYPENAME(item->wk_type), item->wk_state); + if (item->wk_state & BLOCKEDWK) + panic("worklist_remove: blocked remove %p %s(0x%x)", + item, TYPENAME(item->wk_type), item->wk_state); + item->wk_onworklist = 0; item->wk_state &= ~ONWORKLIST; LIST_REMOVE(item, wk_list); + stack_save(&item->wk_stack_rem); } #endif /* DEBUG */ @@ -2270,7 +2277,6 @@ journal_mount(mp, fs, cred) int error; int i; - mp->mnt_kern_flag |= MNTK_SUJ; error = softdep_journal_lookup(mp, &vp); if (error != 0) { printf("Failed to find journal. Use tunefs to create one\n"); @@ -2295,20 +2301,26 @@ journal_mount(mp, fs, cred) } jblocks->jb_low = jblocks->jb_free / 3; /* Reserve 33%. */ jblocks->jb_min = jblocks->jb_free / 10; /* Suspend at 10%. */ - /* - * Only validate the journal contents if the filesystem is clean, - * otherwise we write the logs but they'll never be used. If the - * filesystem was still dirty when we mounted it the journal is - * invalid and a new journal can only be valid if it starts from a - * clean mount. - */ - if (fs->fs_clean) { - DIP_SET(ip, i_modrev, fs->fs_mtime); - ip->i_flags |= IN_MODIFIED; - ffs_update(vp, 1); - } VFSTOUFS(mp)->softdep_jblocks = jblocks; out: + if (error == 0) { + MNT_ILOCK(mp); + mp->mnt_kern_flag |= MNTK_SUJ; + MNT_IUNLOCK(mp); + /* + * Only validate the journal contents if the + * filesystem is clean, otherwise we write the logs + * but they'll never be used. If the filesystem was + * still dirty when we mounted it the journal is + * invalid and a new journal can only be valid if it + * starts from a clean mount. + */ + if (fs->fs_clean) { + DIP_SET(ip, i_modrev, fs->fs_mtime); + ip->i_flags |= IN_MODIFIED; + ffs_update(vp, 1); + } + } vput(vp); return (error); } @@ -5265,7 +5277,7 @@ softdep_setup_freeblocks(ip, length, flags) if (delay) WORKLIST_INSERT(&bp->b_dep, &freeblks->fb_list); else if (needj) - freeblks->fb_state |= DEPCOMPLETE | COMPLETE; + freeblks->fb_state |= COMPLETE; /* * Because the file length has been truncated to zero, any * pending block allocation dependency structures associated @@ -5327,8 +5339,9 @@ restart: if (inodedep_lookup(mp, ip->i_number, 0, &inodedep) != 0) (void) free_inodedep(inodedep); - if (delay) { + if (delay || needj) freeblks->fb_state |= DEPCOMPLETE; + if (delay) { /* * If the inode with zeroed block pointers is now on disk * we can start freeing blocks. Add freeblks to the worklist @@ -5339,6 +5352,8 @@ restart: if ((freeblks->fb_state & ALLCOMPLETE) == ALLCOMPLETE) add_to_worklist(&freeblks->fb_list, 1); } + if (needj && LIST_EMPTY(&freeblks->fb_jfreeblkhd)) + needj = 0; FREE_LOCK(&lk); /* @@ -5488,7 +5503,7 @@ cancel_allocdirect(adphead, adp, freeblks, delay) newblk = (struct newblk *)adp; /* * If the journal hasn't been written the jnewblk must be passed - * to the call to ffs_freeblk that reclaims the space. We accomplish + * to the call to ffs_blkfree that reclaims the space. We accomplish * this by linking the journal dependency into the freework to be * freed when freework_freeblock() is called. If the journal has * been written we can simply reclaim the journal space when the @@ -6016,11 +6031,11 @@ handle_complete_freeblocks(freeblks) vput(vp); } -#ifdef INVARIANTS - if (freeblks->fb_chkcnt != 0 && - ((fs->fs_flags & FS_UNCLEAN) == 0 || (flags & LK_NOWAIT) != 0)) - printf("handle_workitem_freeblocks: block count\n"); -#endif /* INVARIANTS */ + KASSERT(freeblks->fb_chkcnt == 0 || + ((fs->fs_flags & FS_UNCLEAN) != 0 && (flags & LK_NOWAIT) == 0), + ("handle_workitem_freeblocks: inode %ju block count %jd\n", + (uintmax_t)freeblks->fb_previousinum, + (intmax_t)freeblks->fb_chkcnt)); ACQUIRE_LOCK(&lk); /* @@ -6075,9 +6090,7 @@ indir_trunc(freework, dbn, lbn) fs_pendingblocks = 0; freedeps = 0; needj = UFSTOVFS(ump)->mnt_kern_flag & MNTK_SUJ; - lbnadd = 1; - for (i = level; i > 0; i--) - lbnadd *= NINDIR(fs); + lbnadd = lbn_offset(fs, level); /* * Get buffer of block pointers to be freed. This routine is not * called until the zero'ed inode has been written, so it is safe @@ -6136,20 +6149,17 @@ indir_trunc(freework, dbn, lbn) */ cnt = 0; LIST_FOREACH_SAFE(wk, &wkhd, wk_list, wkn) { - struct workhead freewk; if (wk->wk_type != D_JNEWBLK) continue; WORKLIST_REMOVE_UNLOCKED(wk); - LIST_INIT(&freewk); - WORKLIST_INSERT_UNLOCKED(&freewk, wk); jnewblk = WK_JNEWBLK(wk); if (jnewblk->jn_lbn > 0) i = (jnewblk->jn_lbn - -lbn) / lbnadd; else - i = (jnewblk->jn_lbn - (lbn + 1)) / lbnadd; + i = (jnewblk->jn_lbn - (lbn + level)) / lbnadd; KASSERT(i >= 0 && i < NINDIR(fs), - ("indir_trunc: Index out of range %d parent %jd lbn %jd", - i, lbn, jnewblk->jn_lbn)); + ("indir_trunc: Index out of range %d parent %jd lbn %jd level %d", + i, lbn, jnewblk->jn_lbn, level)); /* Clear the pointer so it isn't found below. */ if (ufs1fmt) { nb = bap1[i]; @@ -6161,8 +6171,25 @@ indir_trunc(freework, dbn, lbn) KASSERT(nb == jnewblk->jn_blkno, ("indir_trunc: Block mismatch %jd != %jd", nb, jnewblk->jn_blkno)); - ffs_blkfree(ump, fs, freeblks->fb_devvp, jnewblk->jn_blkno, - fs->fs_bsize, freeblks->fb_previousinum, &freewk); + if (level != 0) { + ufs_lbn_t nlbn; + + nlbn = (lbn + 1) - (i * lbnadd); + nfreework = newfreework(freeblks, freework, + nlbn, nb, fs->fs_frag, 0); + WORKLIST_INSERT_UNLOCKED(&nfreework->fw_jwork, wk); + freedeps++; + indir_trunc(nfreework, fsbtodb(fs, nb), nlbn); + } else { + struct workhead freewk; + + LIST_INIT(&freewk); + WORKLIST_INSERT_UNLOCKED(&freewk, wk); + wk->wk_state |= BLOCKEDWK; + ffs_blkfree(ump, fs, freeblks->fb_devvp, + jnewblk->jn_blkno, fs->fs_bsize, + freeblks->fb_previousinum, &freewk); + } cnt++; } ACQUIRE_LOCK(&lk); @@ -6772,7 +6799,8 @@ cancel_diradd(dap, dirrem, jremref, dotremref, dotdotremref) mkdir->md_jaddref = NULL; if (mkdir->md_state & MKDIR_PARENT) { if (cancel_jaddref(jaddref, NULL, - &dirrem->dm_jwork) == 0) { + &dirrem->dm_jwork) == 0 && + dotdotremref != NULL) { free_jremref(dotdotremref); dotdotremref = NULL; } @@ -8688,6 +8716,7 @@ softdep_setup_blkfree(mp, bp, blkno, frags, wkhd) jnewblk = WK_JNEWBLK(wk); KASSERT(jnewblk->jn_state & GOINGAWAY, ("softdep_setup_blkfree: jnewblk not canceled.")); + wk->wk_state &= ~BLOCKEDWK; WORKLIST_REMOVE(wk); #ifdef SUJ_DEBUG /* diff --git a/sys/ufs/ffs/fs.h b/sys/ufs/ffs/fs.h index 42c4cfe..ba98ed3 100644 --- a/sys/ufs/ffs/fs.h +++ b/sys/ufs/ffs/fs.h @@ -607,6 +607,11 @@ struct cg { : (fragroundup(fs, blkoff(fs, (size))))) /* + * Number of indirects in a filesystem block. + */ +#define NINDIR(fs) ((fs)->fs_nindir) + +/* * Indirect lbns are aligned on NDADDR addresses where single indirects * are the negated address of the lowest lbn reachable, double indirects * are this lbn - 1 and triple indirects are this lbn - 2. This yields @@ -631,6 +636,17 @@ lbn_level(ufs_lbn_t lbn) } return (-1); } + +static inline ufs_lbn_t +lbn_offset(struct fs *fs, int level) +{ + ufs_lbn_t res; + + for (res = 1; level > 0; level--) + res *= NINDIR(fs); + return (res); +} + /* * Number of inodes in a secondary storage block/fragment. */ @@ -638,11 +654,6 @@ lbn_level(ufs_lbn_t lbn) #define INOPF(fs) ((fs)->fs_inopb >> (fs)->fs_fragshift) /* - * Number of indirects in a filesystem block. - */ -#define NINDIR(fs) ((fs)->fs_nindir) - -/* * Softdep journal record format. */ diff --git a/sys/ufs/ffs/softdep.h b/sys/ufs/ffs/softdep.h index f584e91..b187be7 100644 --- a/sys/ufs/ffs/softdep.h +++ b/sys/ufs/ffs/softdep.h @@ -139,6 +139,7 @@ #define UNLINKNEXT 0x080000 /* inodedep has valid di_freelink */ #define UNLINKPREV 0x100000 /* inodedep is pointed at in the unlink list */ #define UNLINKONLIST 0x200000 /* inodedep is in the unlinked list on disk */ +#define BLOCKEDWK 0x400000 #define UNLINKLINKS (UNLINKNEXT | UNLINKPREV) #define ALLCOMPLETE (ATTACHED | COMPLETE | DEPCOMPLETE) @@ -164,11 +165,15 @@ * worklist is needed in the structure, then a wk_data field must be added * and the macros below changed to use it. */ +#include struct worklist { LIST_ENTRY(worklist) wk_list; /* list of work requests */ struct mount *wk_mp; /* Mount we live in */ unsigned int wk_type:8, /* type of request */ wk_state:24; /* state flags */ + struct stack wk_stack_ins; + struct stack wk_stack_rem; + int wk_onworklist; }; #define WK_DATA(wk) ((void *)(wk)) #define WK_PAGEDEP(wk) ((struct pagedep *)(wk)) -- Test scenario: suj6.sh