GENERIC HEAD from 2011-06-11 04:59:01 UTC, r222975M, vmcore.162 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #0 r222975M: Sat Jun 11 23:37:27 CEST 2011 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3535958016 (3372 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: 2357 files, 678175 used, 334840 free (1480 frags, 41670 blocks, 0.1% fragmentation) /dev/ad4s1f: 15566 files, 815610 used, 197405 free (4461 frags, 24118 blocks, 0.4% fragmentation) /dev/label/tmp: UNREF FILE I=274 OWNER=root MODE=100600 /dev/label/tmp: SIZE=247 MTIME=Jun 12 20:32 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=275 OWNER=root MODE=100600 /dev/label/tmp: SIZE=624 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=280 OWNER=root MODE=100600 /dev/label/tmp: SIZE=525 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=281 OWNER=root MODE=100600 /dev/label/tmp: SIZE=915 MTIME=Jun 12 21:23 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=282 OWNER=root MODE=100600 /dev/label/tmp: SIZE=438 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=284 OWNER=root MODE=100600 /dev/label/tmp: SIZE=210 MTIME=Jun 12 21:23 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=285 OWNER=root MODE=100600 /dev/label/tmp: SIZE=762 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=286 OWNER=root MODE=100600 /dev/label/tmp: SIZE=240 MTIME=Jun 12 21:24 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=287 OWNER=root MODE=100600 /dev/label/tmp: SIZE=215 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=288 OWNER=root MODE=100600 /dev/label/tmp: SIZE=356 MTIME=Jun 12 21:24 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=289 OWNER=root MODE=100600 /dev/label/tmp: SIZE=491 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=290 OWNER=root MODE=100600 /dev/label/tmp: SIZE=368 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=291 OWNER=root MODE=100600 /dev/label/tmp: SIZE=1069 MTIME=Jun 12 21:23 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=294 OWNER=root MODE=100600 /dev/label/tmp: SIZE=225 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=295 OWNER=root MODE=100600 /dev/label/tmp: SIZE=263 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=297 OWNER=root MODE=100600 /dev/label/tmp: SIZE=441 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=299 OWNER=root MODE=100600 /dev/label/tmp: SIZE=210 MTIME=Jun 12 21:23 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=300 OWNER=root MODE=100600 /dev/label/tmp: SIZE=317 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=301 OWNER=root MODE=100600 /dev/label/tmp: SIZE=71 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=304 OWNER=root MODE=100600 /dev/label/tmp: SIZE=293 MTIME=Jun 12 21:23 2011 (CLEARED) /dev/label/tmp: UNREF FILE I=306 OWNER=root MODE=100600 /dev/label/tmp: SIZE=941 MTIME=Jun 12 21:25 2011 (CLEARED) /dev/label/tmp: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/label/tmp: SUMMARY INFORMATION BAD (SALVAGED) /dev/label/tmp: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ad4s1d: INCORRECT BLOCK COUNT I=1985649 (8 should be 0) (CORRECTED) /dev/label/tmp: 101375 files, 24005164 used, 94308817 free (2953 frags, 11788233 blocks, 0.0% fragmentation) /dev/ad4s1d: UNREF FILE I=1066671 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=1352 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1066672 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=1908 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1066676 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=2064 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1066678 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=0 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1985642 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=4428 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1985643 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=2524 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1985646 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=9008 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1985647 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=7760 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1985648 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=7256 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=1985649 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=0 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=2072947 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=13184 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=2096364 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=0 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: UNREF FILE I=2096380 OWNER=root MODE=100644 /dev/ad4s1d: SIZE=18455 MTIME=Jun 12 21:27 2011 (CLEARED) /dev/ad4s1d: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/ad4s1d: SUMMARY INFORMATION BAD (SALVAGED) /dev/ad4s1d: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ad4s1d: 760169 files, 7712848 used, 2441351 free (233847 frags, 275938 blocks, 2.3% fragmentation) /dev/ad4s1e: 620188 files, 18937073 used, 6451444 free (48356 frags, 800386 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 Starting devd. Starting Network: usbus0. Starting Network: usbus1. Starting Network: usbus2. Starting Network: usbus3. Starting Network: usbus4. Starting Network: usbus5. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb ch 1 dma -1 re0: link state changed to UP Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe07198a0 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc78b5c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0e95b56,2e687361,38323a63,c7000a34,a7a,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c09e61bb,c0e9955f,c6d5e2a0,c6d61ff8,ef264894,...) at kdb_backtrace+0x2a _witness_debugger(c0e9955f,c78b5c00,c0ec8822,c6d61ff8,c0ec84b4,...) at _witness_debugger+0x25 witness_checkorder(c78b5c00,9,c0ec84ab,11c,0,...) at witness_checkorder+0x839 _sx_xlock(c78b5c00,0,c0ec84ab,11c,c7716e80,...) at _sx_xlock+0x85 ufsdirhash_acquire(e0719840,ef2649ec,70,e1339894,ef264964,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7716e80,ef2649ec,1894,ef264950,ef264954,...) at ufsdirhash_add+0x13 ufs_direnter(c771a570,c78bec3c,ef2649ec,ef264bd0,e0719ec0,...) at ufs_direnter+0x749 ufs_mkdir(ef264bf8,c0ee67a7,0,0,ef264b3c,...) at ufs_mkdir+0x936 VOP_MKDIR_APV(c0fc7500,ef264bf8,ef264bd0,ef264b3c,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(c71778a0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x225 kern_mkdir(c71778a0,28404020,0,1c0,ef264c7c,...) at kern_mkdir+0x2e mkdir(c71778a0,ef264cec,ef264d28,c0e97daa,0,...) at mkdir+0x29 syscallenter(c71778a0,ef264ce4,ef264ce4,0,0,...) at syscallenter+0x263 syscall(ef264d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28172663, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). Starting mountd. NFSv4 is disabled Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc771a5c8 ufs (ufs) @ kern/vfs_subr.c:2134 2nd 0xe07198a0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xc793f9dc ufs (ufs) @ kern/vfs_subr.c:2134 KDB: stack backtrace: db_trace_self_wrapper(c0e95b56,3a632e73,a313632,ef1e4800,246,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c09e61bb,c0e99578,c6d5e2a0,c6d61f90,ef1e48a4,...) at kdb_backtrace+0x2a _witness_debugger(c0e99578,c793f9dc,c0e88914,c6d61f90,c0ea117b,...) at _witness_debugger+0x25 witness_checkorder(c793f9dc,9,c0ea1172,856,0,...) at witness_checkorder+0x839 __lockmgr_args(c793f9dc,80100,c793fa48,0,0,...) at __lockmgr_args+0x814 ffs_lock(ef1e49c8,c09f7aab,c0ea04d7,80100,c793f984,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0fc7500,ef1e49c8,109,c0fe2500,c793f984,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c793f984,80100,c0ea1172,856,4,...) at _vn_lock+0x78 vget(c793f984,80100,c7456000,50,0,...) at vget+0xbb vfs_hash_get(c771b5a8,1cdcc00,80000,c7456000,ef1e4b0c,...) at vfs_hash_get+0xed ffs_vgetf(c771b5a8,1cdcc00,80000,ef1e4b0c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(c771a570,e0719840,1,107,0,...) at softdep_sync_buf+0x4a3 ffs_syncvnode(c771a570,1,c7456000,566,0,...) at ffs_syncvnode+0x238 ffs_sync(c771b5a8,1,ef1e4c14,4ee,0,...) at ffs_sync+0x26f dounmount(c771b5a8,8080000,c7456000,473,5b85c5ea,...) at dounmount+0x447 unmount(c7456000,ef1e4cec,28176705,1,0,...) at unmount+0x310 syscallenter(c7456000,ef1e4ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef1e4d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dcd5b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- lock order reversal: 1st 0xc74e1058 ufs (ufs) @ kern/vfs_mount.c:1193 2nd 0xc749c058 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1827 KDB: stack backtrace: db_trace_self_wrapper(c0e95b56,38313a63,a3732,c0ec9ea1,c15b3888,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c09e61bb,c0e9955f,c6d61f90,c6d61e58,ef1e4a04,...) at kdb_backtrace+0x2a _witness_debugger(c0e9955f,c749c058,c0e80787,c6d61e58,c0ec4aa9,...) at _witness_debugger+0x25 witness_checkorder(c749c058,9,c0ec4aa0,723,c749c0c4,...) at witness_checkorder+0x839 __lockmgr_args(c749c058,80400,c749c0c4,0,0,...) at __lockmgr_args+0x814 vop_stdlock(ef1e4b24,4,c0e90227,80400,c749c000,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c0f9d000,ef1e4b24,c119b230,c0fe2500,c749c000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c749c000,80400,c0ec4aa0,723,c771b5a8,...) at _vn_lock+0x78 softdep_flushworklist(c771b5a8,ef1e4bd0,c7456000,574,0,...) at softdep_flushworklist+0x47 ffs_sync(c771b5a8,1,ef1e4c14,4ee,0,...) at ffs_sync+0x2fd dounmount(c771b5a8,8080000,c7456000,473,5b85c5ea,...) at dounmount+0x447 unmount(c7456000,ef1e4cec,28176705,1,0,...) at unmount+0x310 syscallenter(c7456000,ef1e4ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef1e4d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dcd5b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 101375 files, 24005164 used, 94308817 free (2953 frags, 11788233 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 101375 files, 24005164 used, 94308817 free (2953 frags, 11788233 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun Jun 12 21:53:52 CEST 2011 FreeBSD/i386 Expensive timeout(9) function: 0xc07ff800(0xc11bd500) 0.012135787 s (x4.osted.lan) (console) login: Jun 12 21:55:14 x4 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xe073bc40 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc781db1c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:808 KDB: stack backtrace: db_trace_self_wrapper(c0e95b56,632e746f,3830383a,ef20000a,c09f7aab,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c09e61bb,c0e9955f,c6d5e2a0,c6d627b0,ef20650c,...) at kdb_backtrace+0x2a _witness_debugger(c0e9955f,c781db1c,c0ec4545,c6d627b0,c0ec44cf,...) at _witness_debugger+0x25 witness_checkorder(c781db1c,9,c0ec44c6,328,cb9ee37c,...) at witness_checkorder+0x839 __lockmgr_args(c781db1c,80400,cb9ee37c,0,0,...) at __lockmgr_args+0x814 ffs_lock(ef206630,e096ade0,100000,80400,cb9ee2b8,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0fc7500,ef206630,e096ae88,c0fe2500,cb9ee2b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cb9ee2b8,80400,c0ec44c6,328,0,...) at _vn_lock+0x78 ffs_snapshot(c73fa5a8,c7010b40,c0ec7950,174,ef206980,...) at ffs_snapshot+0x2946 ffs_mount(c73fa5a8,c9a1ca00,ff,393,0,...) at ffs_mount+0x1590 vfs_donmount(c74532e0,211300,c7406600,c7406600,c74bd000,...) at vfs_donmount+0x1147 nmount(c74532e0,ef206cec,ef206d28,c0e97daa,0,...) at nmount+0x84 syscallenter(c74532e0,ef206ce4,ef206ce4,0,0,...) at syscallenter+0x263 syscall(ef206d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (378, FreeBSD ELF32, nmount), eip = 0x280da9db, esp = 0xbfbfe0ec, ebp = 0xbfbfe868 --- fsync: giving up on dirty 0xc96f2414: tag devfs, type VCHR usecount 1, writecount 0, refcount 572 mountedhere 0xc740c500 flags (VV_COPYONWRITE) v_object 0xc775f220 ref 0 pages 2274 lock type devfs: EXCL by thread 0xc74af5c0 (pid 2389) #0 0xc099587e at __lockmgr_args+0xbfe #1 0xc0a35865 at vop_stdlock+0x65 #2 0xc0cfda65 at VOP_LOCK1_APV+0xb5 #3 0xc0a557f8 at _vn_lock+0x78 #4 0xc0bdfa17 at softdep_flushworklist+0x47 #5 0xc0be32ed at ffs_sync+0x2fd #6 0xc0a555d2 at vfs_write_suspend+0x122 #7 0xc0bc7cc1 at ffs_snapshot+0xc91 #8 0xc0be5220 at ffs_mount+0x1590 #9 0xc0a3eff7 at vfs_donmount+0x1147 #10 0xc0a3f664 at nmount+0x84 #11 0xc09f0473 at syscallenter+0x263 #12 0xc0cdb04f at syscall+0x4f #13 0xc0cc4711 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xc96f2414: tag devfs, type VCHR usecount 1, writecount 0, refcount 571 mountedhere 0xc740c500 flags (VV_COPYONWRITE) v_object 0xc775f220 ref 0 pages 2278 lock type devfs: EXCL by thread 0xc74af5c0 (pid 2389) #0 0xc099587e at __lockmgr_args+0xbfe #1 0xc0a35865 at vop_stdlock+0x65 #2 0xc0cfda65 at VOP_LOCK1_APV+0xb5 #3 0xc0a557f8 at _vn_lock+0x78 #4 0xc0be33c5 at ffs_sync+0x3d5 #5 0xc0a555d2 at vfs_write_suspend+0x122 #6 0xc0bc7cc1 at ffs_snapshot+0xc91 #7 0xc0be5220 at ffs_mount+0x1590 #8 0xc0a3eff7 at vfs_donmount+0x1147 #9 0xc0a3f664 at nmount+0x84 #10 0xc09f0473 at syscallenter+0x263 #11 0xc0cdb04f at syscall+0x4f #12 0xc0cc4711 at Xint0x80_syscall+0x21 dev md5a Jun 12 21:56:02 x4 kernel: pid 2395 (suj20), uid 1001 inumber 25044 on /mnt: filesystem full Jun 12 21:56:06 x4 kernel: pid 2415 (suj20), uid 1001 inumber 48341 on /mnt: filesystem full lock order reversal: 1st 0xc781db1c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:957 2nd 0xc9a35880 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1608 KDB: stack backtrace: db_trace_self_wrapper(c0e95b56,a383036,a00,c0ea117b,c1166f20,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c09e61bb,c0e9955f,c6d627b0,c6d61f90,ef1996ec,...) at kdb_backtrace+0x2a _witness_debugger(c0e9955f,c9a35880,c0e88914,c6d61f90,c0ec44cf,...) at _witness_debugger+0x25 witness_checkorder(c9a35880,9,c0ec44c6,648,0,...) at witness_checkorder+0x839 __lockmgr_args(c9a35880,80000,0,0,0,...) at __lockmgr_args+0x814 ffs_snapremove(c9a35828,c0ec4404,ef199850,c09f7aab,c0e9e7d4,...) at ffs_snapremove+0x11f ffs_truncate(c9a35828,0,0,c00,0,...) at ffs_truncate+0x607 ufs_inactive(ef199ad4,c0ee5e7d,c9a358ec,c9a358ec,c9a35828,...) at ufs_inactive+0x21d VOP_INACTIVE_APV(c0fc7500,ef199ad4,c0ea1172,94e,c0fe24c0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c0fc7500,ef199b08,c0ea1172,8a5,0,...) at vinactive+0xb1 vputx(ef199c20,c0a4d3ad,c9a35828,ffffffdf,c9a35828,...) at vputx+0x36c vput(c9a35828,ffffffdf,c9a35828,ef199bd8,cb9ee570,...) at vput+0x10 kern_unlinkat(c7433b80,ffffff9c,bfbfea9e,0,0,...) at kern_unlinkat+0x23d kern_unlink(c7433b80,bfbfea9e,0,ef199c7c,c09f0473,...) at kern_unlink+0x2f unlink(c7433b80,ef199cec,ef199d28,c0e97daa,0,...) at unlink+0x22 syscallenter(c7433b80,ef199ce4,ef199ce4,0,0,...) at syscallenter+0x263 syscall(ef199d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, unlink), eip = 0x28171bcf, esp = 0xbfbfe7dc, ebp = 0xbfbfe858 --- Jun 12 21:56:09 x4 kernel: pid 2426 (suj20), uid 1001 inumber 70805 on /mnt: filesystem full Jun 12 21:56:14 x4 kernel: pid 2452 (suj20), uid 1001 inumber 118801 on /mnt: filesystem full panic: handle_disk_write_complete: Unknown type freedep cpuid = 0 KDB: enter: panic [ thread pid 13 tid 100014 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 13 tid 100014 td 0xc6ece000 kdb_enter(c0e91c42,c0e91c42,c0ec6043,c6b5cb10,0,...) at kdb_enter+0x3a panic(c0ec6043,c0ec72b5,c0ec4aa0,286a,3,...) at panic+0x134 softdep_disk_write_complete(e0994e40,c1168ea0,c6ece0b0,c0fac4f8,c1168ea0,...) at softdep_disk_write_complete+0x1a53 bufdone_finish(e0994e40,c15ae000,e0994e40,c7714850,c6b5cc80,...) at bufdone_finish+0x26 bufdone(e0994e40,c6d755d8) at bufdone+0x6a g_vfs_done(c7714850,0,c0e9e7cb,c56,c6ece000,...) at g_vfs_done+0x85 biodone(c7714850,c101b428,25c,c0e84d12,0,...) at biodone+0xa5 g_io_schedule_up(c6ece000,0,c0e86865,5f,c6b5cd14,...) at g_io_schedule_up+0xde g_up_procbody(0,c6b5cd28,c0e8c598,390,c6dbc2bc,...) at g_up_procbody+0x9d fork_exit(c0943100,0,c6b5cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5cd60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x442400 curthread = 0xc6ece000: pid 13 "g_up" curpcb = 0xc6b5cd80 fpcurthread = none idlethread = 0xc6dbe8a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5b47400 curthread = 0xc6dbe5c0: pid 11 "idle: cpu1" curpcb = 0xc6b3dd80 fpcurthread = none idlethread = 0xc6dbe5c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5b4a400 curthread = 0xc6dbe2e0: pid 11 "idle: cpu2" curpcb = 0xc6b40d80 fpcurthread = none idlethread = 0xc6dbe2e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5b4d400 curthread = 0xc71755c0: pid 9 "bufdaemon" curpcb = 0xecf9dd80 fpcurthread = none idlethread = 0xc6dbe000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 2463 (suj20) thread 0xccd4f000 (100197) exclusive lockmgr ufs (ufs) r = 0 (0xca5e1b38) locked @ kern/vfs_vnops.c:612 Process 2347 (sshd) thread 0xc74af2e0 (100156) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7d2e08c) locked @ kern/uipc_sockbuf.c:148 Process 2346 (sshd) thread 0xc96c52e0 (100174) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc774470c) locked @ kern/uipc_sockbuf.c:148 Process 2345 (sshd) thread 0xc7453b80 (100098) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc79d522c) locked @ kern/uipc_sockbuf.c:148 Process 2338 (md5) thread 0xc96c5000 (100175) exclusive sleep mutex vm object (standard object) r = 0 (0xc9707ee0) locked @ dev/md/md.c:671 Process 2184 (sshd) thread 0xc74335c0 (100082) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc773fa4c) locked @ kern/uipc_sockbuf.c:148 Process 9 (bufdaemon) thread 0xc71755c0 (100072) exclusive lockmgr bufwait (bufwait) r = 0 (0xe07b2300) locked @ kern/vfs_bio.c:2325 exclusive sleep mutex buf queue lock (buf queue lock) r = 0 (0xc1194954) locked @ kern/vfs_bio.c:2395 Process 13 (geom) thread 0xc6ece000 (100014) exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc119b230) locked @ ufs/ffs/ffs_softdep.c:10346 db:0:alllocks> show lockedvnods Locked vnodes 0xca5e1ae0: 0xca5e1ae0: tag ufs, type VREG tag ufs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 usecount 1, writecount 1, refcount 3 mountedhere 0 flags () flags () v_object 0xcb7fc440 ref 0 pages 2 v_object 0xcb7fc440 ref 0 pages 2 lock type ufs: EXCL by thread 0xccd4f000 (pid 2463) lock type ufs: EXCL by thread 0xccd4f000 (pid 2463) #0 0xc099587e at __lockmgr_args+0xbfe #0 0xc099587e at __lockmgr_args+0xbfe #1 0xc0be7e51 at ffs_lock+0xa1 #1 0xc0be7e51 at ffs_lock+0xa1 #2 0xc0cfda65 at VOP_LOCK1_APV+0xb5 #2 0xc0cfda65 at VOP_LOCK1_APV+0xb5 #3 0xc0a557f8 at _vn_lock+0x78 #3 0xc0a557f8 at _vn_lock+0x78 #4 0xc0a56b66 at vn_write+0x156 #4 0xc0a56b66 at vn_write+0x156 #5 0xc09fa445 at dofilewrite+0x95 #5 0xc09fa445 at dofilewrite+0x95 #6 0xc09fbbe8 at kern_writev+0x58 #6 0xc09fbbe8 at kern_writev+0x58 #7 0xc09fbcff at write+0x4f #7 0xc09fbcff at write+0x4f #8 0xc09f0473 at syscallenter+0x263 #8 0xc09f0473 at syscallenter+0x263 #9 0xc0cdb04f at syscall+0x4f #9 0xc0cdb04f at syscall+0x4f #10 0xc0cc4711 at Xint0x80_syscall+0x21 #10 0xc0cc4711 at Xint0x80_syscall+0x21 ino 24517, on dev md5a ino 24517, on dev md5a db:0:lockedvnods> show mount 0xc73f9b50 /dev/ad4s1a on / (ufs) 0xc73fa000 devfs on /dev (devfs) 0xc73f987c /dev/ad4s1f on /home (ufs) 0xc771b2d4 /dev/ad4s1d on /usr (ufs) 0xc771b000 /dev/ad4s1e on /var (ufs) 0xc73fab50 procfs on /proc (procfs) 0xc73fa87c /dev/label/tmp on /tmp (ufs) 0xc73fa5a8 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 2463 2462 2463 1001 R+ suj20 2462 2319 2319 0 S+ wait 0xc7c73578 su 2441 2357 2354 1001 S nanslp 0xc101ea84 sleep 2358 2354 2354 1001 S piperd 0xc79d7dc8 awk 2357 2354 2354 1001 S wait 0xc7948000 sh 2356 2353 2356 1001 Ss+ select 0xc794d964 top 2355 2352 2355 1001 Ss kqread 0xca189c00 tail 2354 2351 2354 1001 Ss wait 0xc7c7c2bc sh 2353 2347 2347 1001 S select 0xc794d164 sshd 2352 2346 2346 1001 S select 0xc794d9a4 sshd 2351 2345 2345 1001 S select 0xc74ab9a4 sshd 2347 2091 2347 0 Ss sbwait 0xc7d2e0b8 sshd 2346 2091 2346 0 Ss sbwait 0xc7744738 sshd 2345 2091 2345 0 Ss sbwait 0xc79d5258 sshd 2338 0 0 0 DL mdwait 0xc8c84000 [md5] 2319 2312 2319 0 S+ wait 0xc74bdaf0 sh 2312 2308 2312 0 S+ wait 0xc96bc2bc bash 2308 2307 2308 0 S+ pause 0xc96be314 csh 2307 2187 2307 1001 S+ wait 0xc742d000 su 2290 1 2290 0 Ss+ ttyin 0xc7181070 getty 2289 1 2289 0 Ss+ ttyin 0xc7181270 getty 2288 1 2288 0 Ss+ ttyin 0xc7181470 getty 2287 1 2287 0 Ss+ ttyin 0xc6f59070 getty 2286 1 2286 0 Ss+ ttyin 0xc6f59270 getty 2285 1 2285 0 Ss+ ttyin 0xc6f59470 getty 2284 1 2284 0 Ss+ ttyin 0xc6f59670 getty 2283 1 2283 0 Ss+ ttyin 0xc6f59870 getty 2282 1 2282 0 Ss+ ttyin 0xc6f59a70 getty 2242 1 2242 0 Ss select 0xc74320a4 inetd 2218 1 2218 0 Ss nanslp 0xc101ea84 watchdogd 2187 2186 2187 1001 Ss+ wait 0xc7c7c578 bash 2186 2184 2184 1001 S select 0xc74321a4 sshd 2184 2091 2184 0 Ss sbwait 0xc773fa78 sshd 2113 1 2113 0 Ss nanslp 0xc101ea84 cron 2105 1 2105 25 Ss pause 0xc7c7488c sendmail 2099 1 2099 0 Ss select 0xc74326a4 sendmail 2091 1 2091 0 Ss select 0xc6ecde64 sshd 2031 1 2031 0 Ss select 0xc6ecde24 moused 1971 1 1971 0 Ss select 0xc74abae4 ntpd 1855 1854 1854 0 S (threaded) nfsd 100125 S rpcsvc 0xc73d65d0 nfsd: service 100124 S rpcsvc 0xc74cbc10 nfsd: service 100123 S rpcsvc 0xc73d6590 nfsd: service 100103 S rpcsvc 0xc73d6610 nfsd: master 1854 1 1854 0 Ss select 0xc7432724 nfsd 1844 1 1844 0 Ss select 0xc74abba4 mountd 1745 1 1745 0 Ss select 0xc74abbe4 rpcbind 1717 1 1717 0 Ss select 0xc6ecd964 syslogd 1516 1 1516 0 Ss select 0xc7432764 devd 18 0 0 0 DL sdflush 0xc119b280 [softdepflush] 17 0 0 0 DL vlruwt 0xc73a1578 [vnlru] 16 0 0 0 DL syncer 0xc1194c74 [syncer] 9 0 0 0 RL CPU 3 [bufdaemon] 8 0 0 0 DL pgzero 0xc119d0dc [pagezero] 7 0 0 0 DL psleep 0xc119ccc8 [vmdaemon] 6 0 0 0 DL psleep 0xc119cc90 [pagedaemon] 5 0 0 0 DL ccb_scan 0xc0fe3954 [xpt_thrd] 4 0 0 0 DL waiting_ 0xc1196798 [sctp_iterator] 3 0 0 0 DL - 0xc6fe9e3c [fdc0] 2 0 0 0 SL - 0xc706b000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100057 D - 0xc704cd34 [usbus5] 100056 D - 0xc704cd04 [usbus5] 100055 D - 0xc704ccd4 [usbus5] 100054 D - 0xc704cca4 [usbus5] 100052 D - 0xc703eb5c [usbus4] 100051 D - 0xc703eb2c [usbus4] 100050 D - 0xc703eafc [usbus4] 100049 D - 0xc703eacc [usbus4] 100048 D - 0xc7038b5c [usbus3] 100047 D - 0xc7038b2c [usbus3] 100046 D - 0xc7038afc [usbus3] 100045 D - 0xc7038acc [usbus3] 100044 D - 0xc702fb5c [usbus2] 100043 D - 0xc702fb2c [usbus2] 100042 D - 0xc702fafc [usbus2] 100041 D - 0xc702facc [usbus2] 100039 D - 0xc7028b5c [usbus1] 100038 D - 0xc7028b2c [usbus1] 100037 D - 0xc7028afc [usbus1] 100036 D - 0xc7028acc [usbus1] 100034 D - 0xc701fb5c [usbus0] 100033 D - 0xc701fb2c [usbus0] 100032 D - 0xc701fafc [usbus0] 100031 D - 0xc701facc [usbus0] 14 0 0 0 DL - 0xc101d884 [yarrow] 13 0 0 0 RL (threaded) [geom] 100015 D - 0xc101b4a8 [g_down] 100014 Run CPU 0 [g_up] 100013 D - 0xc101b49c [g_event] 12 0 0 0 WL (threaded) [intr] 100065 I [irq12: psm0] 100064 I [irq1: atkbd0] 100062 I [swi0: uart] 100059 I [irq20: fwohci0] 100058 I [irq14: ata0] 100053 I [irq19: ehci0] 100040 I [irq18: ohci2 ohci4] 100035 I [irq17: ohci1 ohci3] 100030 I [irq16: ohci0] 100029 I [irq22: ahci0] 100028 I [irq256: re0] 100027 I [swi5: +] 100026 I [swi2: cambio] 100021 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 255 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc6dbcaf0 [init] 10 0 0 0 DL audit_wo 0xc119aa00 [audit] 0 0 0 0 DLs (threaded) [kernel] 100076 D - 0xc73729c0 [mca taskq] 100066 D - 0xc101d884 [deadlkres] 100060 D - 0xc7034480 [fw0_taskq] 100025 D - 0xc6f50540 [acpi_task_2] 100024 D - 0xc6f50540 [acpi_task_1] 100023 D - 0xc6f50540 [acpi_task_0] 100022 D - 0xc6f50580 [kqueue taskq] 100020 D - 0xc6f50600 [ffs_trim taskq] 100018 D - 0xc6f50680 [thread taskq] 100016 D - 0xc6d76b80 [firmware taskq] 100000 D sched 0xc101b580 [swapper] db:0:ps> allt Tracing command suj20 pid 2463 tid 100197 td 0xccd4f000 sched_switch(ccd4f000,0,602,18c,f683c08c,...) at sched_switch+0x3bc mi_switch(602,0,c0e9247f,cd,4,...) at mi_switch+0x1eb critical_exit(ccd4f000,0,1,0,c6d5a340,...) at critical_exit+0xa8 ipi_bitmap_handler(8,28,28,c1166f58,c6d5a340,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0xc09f891f, esp = 0xef39299c, ebp = 0xef3929f0 --- witness_checkorder(c96bf344,9,c0ea2978,546,0,...) at witness_checkorder+0x23f _mtx_lock_flags(c96bf344,0,c0ea2978,546,ef392c28,...) at _mtx_lock_flags+0xc4 vn_rlimit_fsize(ca5e1ae0,ef392c28,ccd4f000,c09f7aab,60,...) at vn_rlimit_fsize+0x58 ffs_write(ef392b94,c0ee68a3,ca5e1ae0,0,ca5e1ae0,...) at ffs_write+0x168 VOP_WRITE_APV(c0fc7500,ef392b94,ca5e1ae0,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c78430e0,ef392c28,ca731c00,0,ccd4f000,...) at vn_write+0x1ca dofilewrite(ef392c28,ffffffff,ffffffff,0,c78430e0,...) at dofilewrite+0x95 kern_writev(ccd4f000,3,ef392c28,ef392c48,1,...) at kern_writev+0x58 write(ccd4f000,ef392cec,ef392d28,c0e97daa,0,...) at write+0x4f syscallenter(ccd4f000,ef392ce4,ef392ce4,0,74b,...) at syscallenter+0x263 syscall(ef392d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28181623, esp = 0xbfbfe7ec, ebp = 0xbfbfe898 --- Tracing command su pid 2462 tid 100155 td 0xc74af5c0 sched_switch(c74af5c0,0,104,191,aece908e,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c74af5c0,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c73578,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c73578,c7c73600,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c74af5c0,99f,ef314c44,2,0,...) at kern_wait+0xbe6 wait4(c74af5c0,ef314cec,281c8d28,1,0,...) at wait4+0x3b syscallenter(c74af5c0,ef314ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef314d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2812393b, esp = 0xbfbfe33c, ebp = 0xbfbfe358 --- Tracing command sleep pid 2441 tid 100187 td 0xccd51000 sched_switch(ccd51000,0,104,191,e3f92c22,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(ccd51000,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c09ec990,ccd51000,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c101ea84,6c,c0e93177,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c101ea84,0,16c,c0e93177,2711,...) at _sleep+0x328 kern_nanosleep(ccd51000,ef374c34,ef374c3c,a,0,...) at kern_nanosleep+0xc1 nanosleep(ccd51000,ef374cec,ef374d28,c0e97daa,0,...) at nanosleep+0x6f syscallenter(ccd51000,ef374ce4,ef374ce4,0,0,...) at syscallenter+0x263 syscall(ef374d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28165b77, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command awk pid 2358 tid 100176 td 0xc96c4b80 sched_switch(c96c4b80,0,104,191,e3b88f05,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c96c4b80,0,c0e97420,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c79d7dc8,5c,c0e99c2f,100,0,...) at sleepq_wait_sig+0x17 _sleep(c79d7dc8,c79d7f38,15c,c0e99c2f,0,...) at _sleep+0x35c pipe_read(c7843b98,ef353c28,c7d38c00,0,c96c4b80,...) at pipe_read+0x417 dofileread(ef353c28,ffffffff,ffffffff,0,c7843b98,...) at dofileread+0x9e kern_readv(c96c4b80,0,ef353c28,ef353c48,1,...) at kern_readv+0x58 read(c96c4b80,ef353cec,ef353d80,ef353c88,0,...) at read+0x4f syscallenter(c96c4b80,ef353ce4,c0cdb566,0,0,...) at syscallenter+0x263 syscall(ef353d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281b8643, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 2357 tid 100122 td 0xc794fb80 sched_switch(c794fb80,0,104,191,e3cf2227,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c794fb80,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7948000,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7948000,c7948088,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c794fb80,ffffffff,ef299c44,2,0,...) at kern_wait+0xbe6 wait4(c794fb80,ef299cec,ef299d28,c0e97daa,0,...) at wait4+0x3b syscallenter(c794fb80,ef299ce4,ef299ce4,0,0,...) at syscallenter+0x263 syscall(ef299d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a93b, esp = 0xbfbfe98c, ebp = 0xbfbfe9a8 --- Tracing command top pid 2356 tid 100181 td 0xc7d3eb80 sched_switch(c7d3eb80,0,104,191,f157f9e4,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d3eb80,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef362a14,c099d73a,c794d950,0,c7d3eb80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c794d964,0,ef362a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c794d964,c794d950,3e9,627,c7436968,...) at _cv_timedwait_sig+0x252 seltdwait(ef362bf8,ef362c00,c79b8580,c7d3eb80,32354830,...) at seltdwait+0x8a kern_select(c7d3eb80,2,bfbfebac,0,0,ef362c40,20,1,0) at kern_select+0x504 select(c7d3eb80,ef362cec,ef362d28,c0e97daa,0,...) at select+0x66 syscallenter(c7d3eb80,ef362ce4,ef362ce4,0,0,...) at syscallenter+0x263 syscall(ef362d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281ee5c3, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command tail pid 2355 tid 100137 td 0xc7c83000 sched_switch(c7c83000,0,104,191,ce6740d3,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c7c83000,0,c0e97420,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c09ec990,c7c83000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca189c00,68,c0e8c19c,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(ca189c00,ca189c00,168,c0e8c19c,3e9,...) at _sleep+0x328 kern_kevent(c7c83000,4,0,1,ef2dec28,...) at kern_kevent+0x364 kevent(c7c83000,ef2decec,ef2ded28,c0e97daa,0,...) at kevent+0x19e syscallenter(c7c83000,ef2dece4,ef2dece4,0,0,...) at syscallenter+0x263 syscall(ef2ded28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, kevent), eip = 0x28169cab, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sh pid 2354 tid 100154 td 0xc7c7f8a0 sched_switch(c7c7f8a0,0,104,191,54b9112d,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7c7f8a0,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c7c2bc,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c7c2bc,c7c7c344,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c7c7f8a0,ffffffff,ef311c44,2,0,...) at kern_wait+0xbe6 wait4(c7c7f8a0,ef311cec,2820fd28,1,0,...) at wait4+0x3b syscallenter(c7c7f8a0,ef311ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef311d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a93b, esp = 0xbfbfeb3c, ebp = 0xbfbfeb58 --- Tracing command sshd pid 2353 tid 100096 td 0xc74552e0 sched_switch(c74552e0,0,104,191,f15b165c,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74552e0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c794d150,0,c0e90227,c74552e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c794d164,0,ef1f7a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c794d164,c794d150,c0e99a71,627,c74c2a10,...) at _cv_wait_sig+0x243 seltdwait(c74c2a10,58,c73fbc00,c74552e0,246,...) at seltdwait+0xa2 kern_select(c74552e0,a,288060b4,288060bc,0,0,20,c74be000,c74be000) at kern_select+0x504 select(c74552e0,ef1f7cec,ef1f7d28,c0e97daa,0,...) at select+0x66 syscallenter(c74552e0,ef1f7ce4,ef1f7ce4,0,0,...) at syscallenter+0x263 syscall(ef1f7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c45c3, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2352 tid 100179 td 0xc96c42e0 sched_switch(c96c42e0,0,104,191,20d9b0f8,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c96c42e0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c794d990,0,c0e90227,c96c42e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c794d9a4,0,ef35ca4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c794d9a4,c794d990,c0e99a71,627,c74365b0,...) at _cv_wait_sig+0x243 seltdwait(c74365b0,58,cafdcc00,c96c42e0,246,...) at seltdwait+0xa2 kern_select(c96c42e0,c,288060b4,288060bc,0,0,20,c96bc578,c96bc578) at kern_select+0x504 select(c96c42e0,ef35ccec,ef35cd28,c0e97daa,0,...) at select+0x66 syscallenter(c96c42e0,ef35cce4,ef35cce4,0,c102bd80,...) at syscallenter+0x263 syscall(ef35cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c45c3, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2351 tid 100169 td 0xc96c72e0 sched_switch(c96c72e0,0,104,191,4ee92afa,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c96c72e0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c74ab990,0,c0e90227,c96c72e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c74ab9a4,0,ef33ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74ab9a4,c74ab990,c0e99a71,627,c74c2348,...) at _cv_wait_sig+0x243 seltdwait(c74c2348,58,ca732b80,c96c72e0,f33,...) at seltdwait+0xa2 kern_select(c96c72e0,c,288060b4,288060bc,0,0,20,c96be578,c96be578) at kern_select+0x504 select(c96c72e0,ef33ecec,ef33ed28,c0e97daa,0,...) at select+0x66 syscallenter(c96c72e0,ef33ece4,ef33ece4,0,0,...) at syscallenter+0x263 syscall(ef33ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c45c3, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2347 tid 100156 td 0xc74af2e0 sched_switch(c74af2e0,0,104,191,4f4dd362,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c74af2e0,0,c0e97420,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d2e0b8,68,c0e9d8c1,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7d2e0b8,c7d2e078,168,c0e9d8c1,0) at _sleep+0x35c sbwait(c7d2e054,4,c0e9d999,5ec,c7d2e078,...) at sbwait+0x76 soreceive_generic(c7d2e000,0,ef317c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7d2e000,0,ef317c28,0,0,0) at soreceive+0x38 soo_read(c74c2ce8,ef317c28,cb5b6180,0,c74af2e0,...) at soo_read+0x4e dofileread(ef317c28,ffffffff,ffffffff,0,c74c2ce8,...) at dofileread+0x9e kern_readv(c74af2e0,5,ef317c28,ef317c48,1,...) at kern_readv+0x58 read(c74af2e0,ef317cec,2888a010,1,0,...) at read+0x4f syscallenter(c74af2e0,ef317ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef317d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c4643, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command sshd pid 2346 tid 100174 td 0xc96c52e0 sched_switch(c96c52e0,0,104,191,4eabbfcb,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c96c52e0,0,c0e97420,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7744738,68,c0e9d8c1,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7744738,c77446f8,168,c0e9d8c1,0) at _sleep+0x35c sbwait(c77446d4,4,c0e9d999,5ec,c77446f8,...) at sbwait+0x76 soreceive_generic(c7744680,0,ef34dc28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7744680,0,ef34dc28,0,0,0) at soreceive+0x38 soo_read(c7436578,ef34dc28,c79b8500,0,c96c52e0,...) at soo_read+0x4e dofileread(ef34dc28,ffffffff,ffffffff,0,c7436578,...) at dofileread+0x9e kern_readv(c96c52e0,5,ef34dc28,ef34dc48,1,...) at kern_readv+0x58 read(c96c52e0,ef34dcec,ef34dd28,c0e97daa,0,...) at read+0x4f syscallenter(c96c52e0,ef34dce4,ef34dce4,0,0,...) at syscallenter+0x263 syscall(ef34dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c4643, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command sshd pid 2345 tid 100098 td 0xc7453b80 sched_switch(c7453b80,0,104,191,4eaab771,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c7453b80,0,c0e97420,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c79d5258,68,c0e9d8c1,100,0,...) at sleepq_wait_sig+0x17 _sleep(c79d5258,c79d5218,168,c0e9d8c1,0) at _sleep+0x35c sbwait(c79d51f4,4,c0e9d999,5ec,c79d5218,...) at sbwait+0x76 soreceive_generic(c79d51a0,0,ef1fdc28,0,0,...) at soreceive_generic+0x3f0 soreceive(c79d51a0,0,ef1fdc28,0,0,0) at soreceive+0x38 soo_read(c7435038,ef1fdc28,cb5b6580,0,c7453b80,...) at soo_read+0x4e dofileread(ef1fdc28,ffffffff,ffffffff,0,c7435038,...) at dofileread+0x9e kern_readv(c7453b80,5,ef1fdc28,ef1fdc48,1,...) at kern_readv+0x58 read(c7453b80,ef1fdcec,ef1fdd28,c0e97daa,0,...) at read+0x4f syscallenter(c7453b80,ef1fdce4,ef1fdce4,0,c102b700,...) at syscallenter+0x263 syscall(ef1fdd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c4643, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command md5 pid 2338 tid 100175 td 0xc96c5000 sched_switch(c96c5000,0,104,191,f684fd38,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c96c5000,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c8c84000,5c,c0e3da91,0,0,...) at sleepq_wait+0x63 _sleep(c8c84000,c8c84020,25c,c0e3da91,0,...) at _sleep+0x372 md_kthread(c8c84000,ef350d28,c0e8c598,390,c96bd2bc,...) at md_kthread+0x11a fork_exit(c072b540,c8c84000,ef350d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef350d60, ebp = 0 --- Tracing command sh pid 2319 tid 100097 td 0xc7455000 sched_switch(c7455000,0,104,191,ad7e8edd,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7455000,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c74bdaf0,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c74bdaf0,c74bdb78,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c7455000,ffffffff,ef1fac44,2,0,...) at kern_wait+0xbe6 wait4(c7455000,ef1facec,ef1fad28,c0e97daa,0,...) at wait4+0x3b syscallenter(c7455000,ef1face4,ef1face4,0,0,...) at syscallenter+0x263 syscall(ef1fad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a93b, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command bash pid 2312 tid 100180 td 0xc96c4000 sched_switch(c96c4000,0,104,191,bccfabf1,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c96c4000,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c96bc2bc,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c96bc2bc,c96bc344,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c96c4000,ffffffff,ef35fc44,6,0,...) at kern_wait+0xbe6 wait4(c96c4000,ef35fcec,ef35fd28,c0e97daa,0,...) at wait4+0x3b syscallenter(c96c4000,ef35fce4,ef35fce4,0,0,...) at syscallenter+0x263 syscall(ef35fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c393b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command csh pid 2308 tid 100170 td 0xc96c7000 sched_switch(c96c7000,0,104,191,635057b7,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c96c7000,0,c0e97420,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c96be314,74,c0d29e0e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c96be314,c96be344,174,c0d29e0e,0,...) at _sleep+0x35c kern_sigsuspend(c96c7000,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c96c7000,ef341cec,ef341d28,c0e97daa,0,...) at sigsuspend+0x4d syscallenter(c96c7000,ef341ce4,ef341ce4,0,c102b700,...) at syscallenter+0x263 syscall(ef341d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2818ac7b, esp = 0xbfbfe58c, ebp = 0xbfbfe5f8 --- Tracing command su pid 2307 tid 100084 td 0xc7433000 sched_switch(c7433000,0,104,191,130d7188,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7433000,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c742d000,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c742d000,c742d088,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c7433000,904,ef1b9c44,2,0,...) at kern_wait+0xbe6 wait4(c7433000,ef1b9cec,281c8d28,1,0,...) at wait4+0x3b syscallenter(c7433000,ef1b9ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef1b9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2812393b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command getty pid 2290 tid 100168 td 0xc96c75c0 sched_switch(c96c75c0,0,104,191,92971e47,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c96c75c0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c96c75c0,c96c75c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7181070,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7181070,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7181000,c7181070,ef33bc28,1,0,...) at tty_wait+0x71 ttydisc_read(c7181000,ef33bc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705e600,ef33bc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c78438f8,ef33bc28,c6d9fe00,0,c96c75c0,...) at devfs_read_f+0x7e dofileread(ef33bc28,ffffffff,ffffffff,0,c78438f8,...) at dofileread+0x9e kern_readv(c96c75c0,0,ef33bc28,ef33bc48,1,...) at kern_readv+0x58 read(c96c75c0,ef33bcec,ef33bd28,c0e97daa,0,...) at read+0x4f syscallenter(c96c75c0,ef33bce4,ef33bce4,0,0,...) at syscallenter+0x263 syscall(ef33bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2289 tid 100167 td 0xc7c7f000 sched_switch(c7c7f000,0,104,191,92a29bf4,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c7f000,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c7c7f000,c7c7f000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7181270,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7181270,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7181200,c7181270,ef338c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7181200,ef338c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705e700,ef338c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7843cb0,ef338c28,c6d9fe00,0,c7c7f000,...) at devfs_read_f+0x7e dofileread(ef338c28,ffffffff,ffffffff,0,c7843cb0,...) at dofileread+0x9e kern_readv(c7c7f000,0,ef338c28,ef338c48,1,...) at kern_readv+0x58 read(c7c7f000,ef338cec,ef338d28,c0e97daa,0,...) at read+0x4f syscallenter(c7c7f000,ef338ce4,ef338ce4,0,0,...) at syscallenter+0x263 syscall(ef338d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2288 tid 100166 td 0xc7c7f2e0 sched_switch(c7c7f2e0,0,104,191,92932579,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c7f2e0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c7c7f2e0,c7c7f2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7181470,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7181470,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7181400,c7181470,ef335c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7181400,ef335c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705e800,ef335c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7435348,ef335c28,c6d9fe00,0,c7c7f2e0,...) at devfs_read_f+0x7e dofileread(ef335c28,ffffffff,ffffffff,0,c7435348,...) at dofileread+0x9e kern_readv(c7c7f2e0,0,ef335c28,ef335c48,1,...) at kern_readv+0x58 read(c7c7f2e0,ef335cec,ef335d28,c0e97daa,0,...) at read+0x4f syscallenter(c7c7f2e0,ef335ce4,ef335ce4,0,0,...) at syscallenter+0x263 syscall(ef335d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2287 tid 100099 td 0xc74538a0 sched_switch(c74538a0,0,104,191,92a7d7cd,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74538a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c74538a0,c74538a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f59070,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f59070,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f59000,c6f59070,ef200c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f59000,ef200c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705e900,ef200c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7436700,ef200c28,c6d9fe00,0,c74538a0,...) at devfs_read_f+0x7e dofileread(ef200c28,ffffffff,ffffffff,0,c7436700,...) at dofileread+0x9e kern_readv(c74538a0,0,ef200c28,ef200c48,1,...) at kern_readv+0x58 read(c74538a0,ef200cec,ef200d28,c0e97daa,0,...) at read+0x4f syscallenter(c74538a0,ef200ce4,ef200ce4,0,0,...) at syscallenter+0x263 syscall(ef200d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2286 tid 100102 td 0xc74ae8a0 sched_switch(c74ae8a0,0,104,191,95901324,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74ae8a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c74ae8a0,c74ae8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f59270,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f59270,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f59200,c6f59270,ef216c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f59200,ef216c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705ea00,ef216c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7435e70,ef216c28,c6d9fe00,0,c74ae8a0,...) at devfs_read_f+0x7e dofileread(ef216c28,ffffffff,ffffffff,0,c7435e70,...) at dofileread+0x9e kern_readv(c74ae8a0,0,ef216c28,ef216c48,1,...) at kern_readv+0x58 read(c74ae8a0,ef216cec,ef216d80,ef216c88,0,...) at read+0x4f syscallenter(c74ae8a0,ef216ce4,c0cdb566,0,0,...) at syscallenter+0x263 syscall(ef216d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2285 tid 100128 td 0xc794f2e0 sched_switch(c794f2e0,0,104,191,92b68e59,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794f2e0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c794f2e0,c794f2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f59470,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f59470,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f59400,c6f59470,ef2aec28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f59400,ef2aec28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705eb00,ef2aec28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7843c40,ef2aec28,c6d9fe00,0,c794f2e0,...) at devfs_read_f+0x7e dofileread(ef2aec28,ffffffff,ffffffff,0,c7843c40,...) at dofileread+0x9e kern_readv(c794f2e0,0,ef2aec28,ef2aec48,1,...) at kern_readv+0x58 read(c794f2e0,ef2aecec,ef2aed28,c0e97daa,0,...) at read+0x4f syscallenter(c794f2e0,ef2aece4,ef2aece4,0,0,...) at syscallenter+0x263 syscall(ef2aed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2284 tid 100136 td 0xc7453000 sched_switch(c7453000,0,104,191,92a94792,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7453000,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c7453000,c7453000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f59670,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f59670,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f59600,c6f59670,ef2dbc28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f59600,ef2dbc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705ec00,ef2dbc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7843000,ef2dbc28,c6d9fe00,0,c7453000,...) at devfs_read_f+0x7e dofileread(ef2dbc28,ffffffff,ffffffff,0,c7843000,...) at dofileread+0x9e kern_readv(c7453000,0,ef2dbc28,ef2dbc48,1,...) at kern_readv+0x58 read(c7453000,ef2dbcec,ef2dbd28,c0e97daa,0,...) at read+0x4f syscallenter(c7453000,ef2dbce4,ef2dbce4,0,0,...) at syscallenter+0x263 syscall(ef2dbd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2283 tid 100160 td 0xc7d3ab80 sched_switch(c7d3ab80,0,104,191,92b40ce6,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d3ab80,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,c7d3ab80,c7d3ab80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f59870,0,c0e9c13e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f59870,c101d170,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f59800,c6f59870,ef323c28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f59800,ef323c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c705ed00,ef323c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c78437a8,ef323c28,c6d9fe00,0,c7d3ab80,...) at devfs_read_f+0x7e dofileread(ef323c28,ffffffff,ffffffff,0,c78437a8,...) at dofileread+0x9e kern_readv(c7d3ab80,0,ef323c28,ef323c48,1,...) at kern_readv+0x58 read(c7d3ab80,ef323cec,ef323d28,c0e97daa,0,...) at read+0x4f syscallenter(c7d3ab80,ef323ce4,ef323ce4,0,0,...) at syscallenter+0x263 syscall(ef323d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2282 tid 100131 td 0xc794e8a0 sched_switch(c794e8a0,0,104,191,28723dad,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794e8a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c6f59a04,0,c0e90227,c794e8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6f59a70,0,ef2baad8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6f59a70,c6f59a04,c0e9badc,514,0,...) at _cv_wait_sig+0x243 tty_wait(c6f59a00,c6f59a70,ef2bac28,1,0,...) at tty_wait+0x71 ttydisc_read(c6f59a00,ef2bac28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c6ec6000,ef2bac28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c74c2738,ef2bac28,c6d9fe00,0,c794e8a0,...) at devfs_read_f+0x7e dofileread(ef2bac28,ffffffff,ffffffff,0,c74c2738,...) at dofileread+0x9e kern_readv(c794e8a0,0,ef2bac28,ef2bac48,1,...) at kern_readv+0x58 read(c794e8a0,ef2bacec,ef2bad28,c0e97daa,0,...) at read+0x4f syscallenter(c794e8a0,ef2bace4,ef2bace4,0,0,...) at syscallenter+0x263 syscall(ef2bad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196643, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 2242 tid 100152 td 0xc7c80000 sched_switch(c7c80000,0,104,191,6879febf,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c80000,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c7432090,0,c0e90227,c7c80000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c74320a4,0,ef30ba4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74320a4,c7432090,c0e99a71,627,c79bb578,...) at _cv_wait_sig+0x243 seltdwait(c79bb578,58,c6d9fe00,c7c80000,c0e90227,...) at seltdwait+0xa2 kern_select(c7c80000,6,bfbfdfa0,0,0,0,20,c7c7c834,c7c7c834) at kern_select+0x504 select(c7c80000,ef30bcec,ef30bd28,c0e97daa,0,...) at select+0x66 syscallenter(c7c80000,ef30bce4,ef30bce4,0,0,...) at syscallenter+0x263 syscall(ef30bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281a85c3, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 2218 tid 100119 td 0xc78345c0 sched_switch(c78345c0,0,104,191,f848cadc,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c78345c0,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c09ec990,c78345c0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c101ea84,6c,c0e93177,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c101ea84,0,16c,c0e93177,ea61,...) at _sleep+0x328 kern_nanosleep(c78345c0,ef279c34,ef279c3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c78345c0,ef279cec,ef279d28,c0e97daa,0,...) at nanosleep+0x6f syscallenter(c78345c0,ef279ce4,ef279ce4,0,0,...) at syscallenter+0x263 syscall(ef279d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28191b77, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 2187 tid 100153 td 0xc7c7fb80 sched_switch(c7c7fb80,0,104,191,e5485f88,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7c7fb80,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c7c578,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c7c578,c7c7c600,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c7c7fb80,ffffffff,ef30ec44,6,0,...) at kern_wait+0xbe6 wait4(c7c7fb80,ef30ecec,ef30ed28,c0e97daa,0,...) at wait4+0x3b syscallenter(c7c7fb80,ef30ece4,ef30ece4,0,0,...) at syscallenter+0x263 syscall(ef30ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c393b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 2186 tid 100079 td 0xc74568a0 sched_switch(c74568a0,0,104,191,ad466d01,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74568a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c7432190,0,c0e90227,c74568a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c74321a4,0,ef1a1a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74321a4,c7432190,c0e99a71,627,c7435690,...) at _cv_wait_sig+0x243 seltdwait(c7435690,58,c701ca80,c74568a0,246,...) at seltdwait+0xa2 kern_select(c74568a0,c,288060b4,288060bc,0,0,20,c7024af0,c7024af0) at kern_select+0x504 select(c74568a0,ef1a1cec,ef1a1d28,c0e97daa,0,...) at select+0x66 syscallenter(c74568a0,ef1a1ce4,ef1a1ce4,0,0,...) at syscallenter+0x263 syscall(ef1a1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c45c3, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2184 tid 100082 td 0xc74335c0 sched_switch(c74335c0,0,104,191,fdfafe67,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c74335c0,0,c0e97420,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c773fa78,68,c0e9d8c1,100,0,...) at sleepq_wait_sig+0x17 _sleep(c773fa78,c773fa38,168,c0e9d8c1,0) at _sleep+0x35c sbwait(c773fa14,4,c0e9d999,5ec,c773fa38,...) at sbwait+0x76 soreceive_generic(c773f9c0,0,ef1b0c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c773f9c0,0,ef1b0c28,0,0,0) at soreceive+0x38 soo_read(c7843d58,ef1b0c28,c7d38700,0,c74335c0,...) at soo_read+0x4e dofileread(ef1b0c28,ffffffff,ffffffff,0,c7843d58,...) at dofileread+0x9e kern_readv(c74335c0,5,ef1b0c28,ef1b0c48,1,...) at kern_readv+0x58 read(c74335c0,ef1b0cec,ef1b0d28,c0e97daa,0,...) at read+0x4f syscallenter(c74335c0,ef1b0ce4,ef1b0ce4,0,0,...) at syscallenter+0x263 syscall(ef1b0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c4643, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command cron pid 2113 tid 100110 td 0xc742e000 sched_switch(c742e000,0,104,191,5b1aeb3f,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c742e000,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c09ec990,c742e000,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c101ea84,6c,c0e93177,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c101ea84,0,16c,c0e93177,ea61,...) at _sleep+0x328 kern_nanosleep(c742e000,ef25ec34,ef25ec3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c742e000,ef25ecec,ef25ed28,c0e97daa,0,...) at nanosleep+0x6f syscallenter(c742e000,ef25ece4,ef25ece4,0,0,...) at syscallenter+0x263 syscall(ef25ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28184b77, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 2105 tid 100135 td 0xc78338a0 sched_switch(c78338a0,0,104,191,eb42d90b,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c78338a0,0,c0e97420,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7c7488c,74,c0d29e0e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7c7488c,c7c748bc,174,c0d29e0e,0,...) at _sleep+0x35c kern_sigsuspend(c78338a0,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c78338a0,ef2d5cec,ef2d5d28,c0e97daa,0,...) at sigsuspend+0x4d syscallenter(c78338a0,ef2d5ce4,ef2d5ce4,0,246,...) at syscallenter+0x263 syscall(ef2d5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28338c7b, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 2099 tid 100116 td 0xc7835000 sched_switch(c7835000,0,104,191,3691ef31,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7835000,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef270a14,c099d73a,c7432690,0,c7835000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c74326a4,0,ef270a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c74326a4,c7432690,1389,627,c7459b98,...) at _cv_timedwait_sig+0x252 seltdwait(ef270bf8,ef270c00,c74a0d00,c7835000,ef270af8,...) at seltdwait+0x8a kern_select(c7835000,5,bfbfc510,0,0,ef270c40,20,5,0) at kern_select+0x504 select(c7835000,ef270cec,ef270d28,c0e97daa,0,...) at select+0x66 syscallenter(c7835000,ef270ce4,ef270ce4,0,0,...) at syscallenter+0x263 syscall(ef270d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283e05c3, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 2091 tid 100094 td 0xc74558a0 sched_switch(c74558a0,0,104,191,4e3a7566,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74558a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c6ecde50,0,c0e90227,c74558a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ecde64,0,ef1f0a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ecde64,c6ecde50,c0e99a71,627,c7459930,...) at _cv_wait_sig+0x243 seltdwait(c7459930,58,c79ad180,c74558a0,ef1f0ab4,...) at seltdwait+0xa2 kern_select(c74558a0,5,288cc0b4,0,0,0,20,c74be578,c74be578) at kern_select+0x504 select(c74558a0,ef1f0cec,ef1f0d28,c0e97daa,0,...) at select+0x66 syscallenter(c74558a0,ef1f0ce4,ef1f0ce4,0,0,...) at syscallenter+0x263 syscall(ef1f0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c45c3, esp = 0xbfbfe25c, ebp = 0xbfbfedf8 --- Tracing command moused pid 2031 tid 100115 td 0xc78352e0 sched_switch(c78352e0,0,104,191,3d013398,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78352e0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c6ecde10,0,c0e90227,c78352e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ecde24,0,ef26da4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ecde24,c6ecde10,c0e99a71,627,c74597e0,...) at _cv_wait_sig+0x243 seltdwait(c74597e0,58,c6d9fe00,c78352e0,14,...) at seltdwait+0xa2 kern_select(c78352e0,6,bfbfea04,0,0,0,20,c782b578,c782b578) at kern_select+0x504 select(c78352e0,ef26dcec,ef26dd28,c0e97daa,0,...) at select+0x66 syscallenter(c78352e0,ef26dce4,ef26dce4,0,0,...) at syscallenter+0x263 syscall(ef26dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281b35c3, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1971 tid 100089 td 0xc742e5c0 sched_switch(c742e5c0,0,104,191,96122ab2,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742e5c0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c74abad0,0,c0e90227,c742e5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c74abae4,0,ef1d1a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74abae4,c74abad0,c0e99a71,627,c78431c0,...) at _cv_wait_sig+0x243 seltdwait(c78431c0,58,c6d9fe00,c742e5c0,0,...) at seltdwait+0xa2 kern_select(c742e5c0,1c,bfbfece8,0,0,0,20,c73a3578,c73a3578) at kern_select+0x504 select(c742e5c0,ef1d1cec,ef1d1d80,ef1d1c88,0,...) at select+0x66 syscallenter(c742e5c0,ef1d1ce4,c0cdb566,fffffffe,246,...) at syscallenter+0x263 syscall(ef1d1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283625c3, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1855 tid 100125 td 0xc74a68a0 sched_switch(c74a68a0,0,104,191,ea0fa043,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74a68a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef2a3be0,c099d73a,c703db80,0,c74a68a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c73d65d0,0,ef2a3c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c73d65d0,c703db80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(ef2a3d14,c09809f8,c703db80,ef2a3d28,c0e8c598,...) at svc_run_internal+0x356 svc_thread_start(c703db80,ef2a3d28,c0e8c598,390,c74a52bc,...) at svc_thread_start+0x10 fork_exit(c0b910b0,c703db80,ef2a3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1855 tid 100124 td 0xc74a6b80 sched_switch(c74a6b80,0,104,191,eb588030,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74a6b80,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef2a0be0,c099d73a,c703db80,0,c74a6b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c74cbc10,0,ef2a0c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c74cbc10,c703db80,1388,3ec,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(ef2a0d14,c09809f8,c703db80,ef2a0d28,c0e8c598,...) at svc_run_internal+0x356 svc_thread_start(c703db80,ef2a0d28,c0e8c598,390,c74a52bc,...) at svc_thread_start+0x10 fork_exit(c0b910b0,c703db80,ef2a0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1855 tid 100123 td 0xc74ad000 sched_switch(c74ad000,0,104,191,ea0f7e46,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74ad000,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef29dbe0,c099d73a,c703db80,0,c74ad000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c73d6590,0,ef29dc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c73d6590,c703db80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(ef29dd14,c09809f8,c703db80,ef29dd28,c0e8c598,...) at svc_run_internal+0x356 svc_thread_start(c703db80,ef29dd28,c0e8c598,390,c74a52bc,...) at svc_thread_start+0x10 fork_exit(c0b910b0,c703db80,ef29dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1855 tid 100103 td 0xc74ae5c0 sched_switch(c74ae5c0,0,104,191,ea0f4f49,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74ae5c0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef21a5b4,c099d73a,c703db80,0,c74ae5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c73d6610,0,ef21a5ec,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c73d6610,c703db80,1388,3b1,c74a68a0,...) at _cv_timedwait_sig+0x252 svc_run_internal(c74ae770,14,c0ec029a,c0e8425b,ef21a7f4,...) at svc_run_internal+0x356 svc_run(c703db80,0,c0e84236,19d,ef21ac38,...) at svc_run+0x7b nfsrvd_nfsd(c74ae5c0,ef21a7f4,c,100000,ef21a7c4,...) at nfsrvd_nfsd+0x8e nfssvc_nfsd(c74ae5c0,ef21acec,c74a52bc,0,ef21ac7c,...) at nfssvc_nfsd+0x167 nfssvc(c74ae5c0,ef21acec,ef21ad28,c0e97daa,0,...) at nfssvc+0xeb syscallenter(c74ae5c0,ef21ace4,ef21ace4,0,0,...) at syscallenter+0x263 syscall(ef21ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280dd85b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1854 tid 100118 td 0xc78348a0 sched_switch(c78348a0,0,104,191,7a2c802f,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78348a0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c7432710,0,c0e90227,c78348a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7432724,0,ef276a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7432724,c7432710,c0e99a71,627,c7435310,...) at _cv_wait_sig+0x243 seltdwait(c7435310,58,c6d9fe00,c78348a0,f33,...) at seltdwait+0xa2 kern_select(c78348a0,7,bfbfecb4,0,0,0,20,c74bfaf0,c74bfaf0) at kern_select+0x504 select(c78348a0,ef276cec,bfbffff4,1,0,...) at select+0x66 syscallenter(c78348a0,ef276ce4,c0cdb8ad,c101d170,0,...) at syscallenter+0x263 syscall(ef276d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281845c3, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command mountd pid 1844 tid 100087 td 0xc74aeb80 sched_switch(c74aeb80,0,104,191,29d75c1e,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74aeb80,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c74abb90,0,c0e90227,c74aeb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c74abba4,0,ef1c7a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74abba4,c74abb90,c0e99a71,627,c7459bd0,...) at _cv_wait_sig+0x243 seltdwait(c7459bd0,58,c6d9fe00,c74aeb80,c0e99977,...) at seltdwait+0xa2 kern_select(c74aeb80,9,bfbfed3c,0,0,0,20,c74a5834,c74a5834) at kern_select+0x504 select(c74aeb80,ef1c7cec,ef1c7d28,c0e97daa,0,...) at select+0x66 syscallenter(c74aeb80,ef1c7ce4,ef1c7ce4,0,0,...) at syscallenter+0x263 syscall(ef1c7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819a5c3, esp = 0xbfbfed0c, ebp = 0xbfbfedd8 --- Tracing command rpcbind pid 1745 tid 100117 td 0xc7834b80 sched_switch(c7834b80,0,104,191,ef89598f,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7834b80,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef273a6c,c099d73a,c74abbd0,0,c7834b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c74abbe4,0,ef273aa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c74abbe4,c74abbd0,7531,627,ef273b5c,...) at _cv_timedwait_sig+0x252 seltdwait(ef273c2c,ef273c34,535,c7834b80,ef273b2c,...) at seltdwait+0x8a poll(c7834b80,ef273cec,ef273d28,c0e97daa,0,...) at poll+0x300 syscallenter(c7834b80,ef273ce4,ef273ce4,0,0,...) at syscallenter+0x263 syscall(ef273d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x2813f7ab, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 1717 tid 100100 td 0xc74535c0 sched_switch(c74535c0,0,104,191,3622cebe,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74535c0,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c6ecd950,0,c0e90227,c74535c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6ecd964,0,ef203a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6ecd964,c6ecd950,c0e99a71,627,c7436460,...) at _cv_wait_sig+0x243 seltdwait(c7436460,58,c6d9fe00,c74535c0,58,...) at seltdwait+0xa2 kern_select(c74535c0,9,2847f0ac,0,0,0,20,c74bd2bc,c74bd2bc) at kern_select+0x504 select(c74535c0,ef203cec,ef203d28,c0e97daa,0,...) at select+0x66 syscallenter(c74535c0,ef203ce4,ef203ce4,0,246,...) at syscallenter+0x263 syscall(ef203d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281995c3, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 1516 tid 100078 td 0xc7456b80 sched_switch(c7456b80,0,104,191,4eecf677,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7456b80,0,c0e97420,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c099d73a,c7432750,0,c0e90227,c7456b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7432764,0,ef19da4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7432764,c7432750,c0e99a71,627,c7435578,...) at _cv_wait_sig+0x243 seltdwait(c7435578,58,c6d9fe00,c7456b80,c0ec9ea1,...) at seltdwait+0xa2 kern_select(c7456b80,5,bfbfe960,0,0,0,20,c73a1000,c73a1000) at kern_select+0x504 select(c7456b80,ef19dcec,ef19dc7c,c099d314,0,...) at select+0x66 syscallenter(c7456b80,ef19dce4,c0ee1b68,f4,0,...) at syscallenter+0x263 syscall(ef19dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x808b98b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 18 tid 100075 td 0xc7045b80 sched_switch(c7045b80,0,104,191,eceb3c52,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c7045b80,0,c0e97420,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c119b280,54,c0ec70fa,0,0,...) at sleepq_timedwait+0x6b _sleep(c119b280,c119b230,54,c0ec70fa,3e8,...) at _sleep+0x342 softdep_flush(0,ecfa6d28,c0e8c598,390,c73a12bc,...) at softdep_flush+0x256 fork_exit(c0bdfbe0,0,ecfa6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecfa6d60, ebp = 0 --- Tracing command vnlru pid 17 tid 100074 td 0xc7175000 sched_switch(c7175000,0,104,191,f21fcd04,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c7175000,0,c0e97420,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c73a1578,60,c0ea20e4,0,0,...) at sleepq_timedwait+0x6b _sleep(c73a1578,c1194c34,260,c0ea20e4,3e8,...) at _sleep+0x342 vnlru_proc(0,ecfa3d28,c0e8c598,390,c73a1578,...) at vnlru_proc+0xe7 fork_exit(c0a4a190,0,ecfa3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecfa3d60, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc71752e0 sched_switch(c71752e0,0,104,191,f316f735,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c71752e0,0,c0e97420,28b,c71752e0,...) at sleepq_switch+0x162 sleepq_timedwait(c1194c74,0,ecfa0c78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c1194c74,c1194c60,3e8,76a,4e20,...) at _cv_timedwait+0x252 sched_sync(0,ecfa0d28,c0e8c598,390,c73a1834,...) at sched_sync+0x595 fork_exit(c0a48130,0,ecfa0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecfa0d60, ebp = 0 --- Tracing command bufdaemon pid 9 tid 100072 td 0xc71755c0 cpustop_handler(8,ecf9db84,c0cdb166,f4,0,...) at cpustop_handler+0x49 ipi_nmi_handler(f4,0,1958b78,c099d901,c73a1af0,...) at ipi_nmi_handler+0x44 trap(ecf9db90) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc099d8f9, esp = 0xecf9dbd0, ebp = 0xecf9dbec --- _mtx_lock_sleep(c119b230,c71755c0,0,c0ec4aa0,324b,...) at _mtx_lock_sleep+0x99 _mtx_lock_flags(c119b230,0,c0ec4aa0,324b,e07b22a0,...) at _mtx_lock_flags+0xf7 softdep_count_dependencies(e07b22a0,0,c0e9e7cb,922,0,...) at softdep_count_dependencies+0x30 flushbufqueues(d0,c0e90227,c73a1b78,391,391,...) at flushbufqueues+0x450 buf_do_flush(c73a1af0,0,c0e9e7cb,8ac,3e8,...) at buf_do_flush+0x19 buf_daemon(0,ecf9dd28,c0e8c598,390,c73a1af0,...) at buf_daemon+0xea fork_exit(c0a2f8a0,0,ecf9dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf9dd60, ebp = 0 --- Tracing command pagezero pid 8 tid 100071 td 0xc71758a0 sched_switch(c71758a0,0,104,191,4147b71d,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c71758a0,0,c0e97420,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c119d0dc,0,c0ecd968,0,0,...) at sleepq_timedwait+0x6b _sleep(c119d0dc,c119bb80,0,c0ecd968,493e0,...) at _sleep+0x342 vm_pagezero(0,ecf9ad28,c0e8c598,390,c73a3000,...) at vm_pagezero+0xdc fork_exit(c0c239b0,0,ecf9ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf9ad60, ebp = 0 --- Tracing command vmdaemon pid 7 tid 100070 td 0xc7175b80 sched_switch(c7175b80,0,104,191,cb98e63c,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c7175b80,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c119ccc8,74,c0e9f112,0,0,...) at sleepq_wait+0x63 _sleep(c119ccc8,c119cccc,74,c0e9f112,0,...) at _sleep+0x372 vm_daemon(0,ecf97d28,c0e8c598,390,c6dbd2bc,...) at vm_daemon+0x59 fork_exit(c0c1d570,0,ecf97d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf97d60, ebp = 0 --- Tracing command pagedaemon pid 6 tid 100069 td 0xc7176000 sched_switch(c7176000,0,104,191,e17e689b,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c7176000,0,c0e97420,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c119cc90,54,c0e9f112,0,0,...) at sleepq_timedwait+0x6b _sleep(c119cc90,c119bb80,54,c0e9f112,1388,...) at _sleep+0x342 vm_pageout(0,ecf94d28,c0e8c598,390,c6dbd578,...) at vm_pageout+0x2c7 fork_exit(c0c1e590,0,ecf94d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf94d60, ebp = 0 --- Tracing command xpt_thrd pid 5 tid 100068 td 0xc71762e0 sched_switch(c71762e0,0,104,191,c757e20a,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c71762e0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c0fe3954,5c,c0d02a32,0,0,...) at sleepq_wait+0x63 _sleep(c0fe3954,c0fe3998,5c,c0d02a32,0,...) at _sleep+0x372 xpt_scanner_thread(0,ecf91d28,c0e8c598,390,c6dbd834,...) at xpt_scanner_thread+0x47 fork_exit(c048c530,0,ecf91d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf91d60, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100067 td 0xc71765c0 sched_switch(c71765c0,0,104,191,79a7edad,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c71765c0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1196798,0,c0eb533f,0,0,...) at sleepq_wait+0x63 _sleep(c1196798,c1196760,0,c0eb533f,0,...) at _sleep+0x372 sctp_iterator_thread(0,ecf8ed28,c0e8c598,390,c6dbdaf0,...) at sctp_iterator_thread+0x5c fork_exit(c0ad9ac0,0,ecf8ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf8ed60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100063 td 0xc70372e0 sched_switch(c70372e0,0,104,191,e3a3b54a,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c70372e0,0,c0e97420,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c6fe9e3c,5c,c0e84d12,0,0,...) at sleepq_timedwait+0x6b _sleep(c6fe9e3c,c6fe9ef0,5c,c0e84d12,3e8,...) at _sleep+0x342 fdc_thread(c6fe9e00,ecf82d28,c0e8c598,390,c7024000,...) at fdc_thread+0x27d fork_exit(c0ca2bd0,c6fe9e00,ecf82d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf82d60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100061 td 0xc70378a0 sched_switch(c70378a0,0,104,191,c7bbc69f,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c70378a0,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c706b000,6c,c0e84d12,100,0,...) at sleepq_wait_sig+0x17 _sleep(c706b000,c706f488,16c,c0e84d12,0,...) at _sleep+0x35c fw_bus_probe_thread(c706b000,ecf72d28,c0e8c598,390,c70242bc,...) at fw_bus_probe_thread+0xa08 fork_exit(c06ae8d0,c706b000,ecf72d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf72d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc70435c0 sched_switch(c70435c0,0,104,191,b4bf7029,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70435c0,0,c0e97420,268,c70435c0,...) at sleepq_switch+0x162 sleepq_wait(c704cd34,0,ecf5fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c704cd34,c704cdd4,c0e632de,6b,c704cd3c,...) at _cv_wait+0x243 usb_process(c704cd2c,ecf5fd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c704cd2c,ecf5fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf5fd60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc70438a0 sched_switch(c70438a0,0,104,191,51829295,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70438a0,0,c0e97420,268,c70438a0,...) at sleepq_switch+0x162 sleepq_wait(c704cd04,0,ecf5ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c704cd04,c704cdd4,c0e632de,6b,c704cd0c,...) at _cv_wait+0x243 usb_process(c704ccfc,ecf5cd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c704ccfc,ecf5cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf5cd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc7043b80 sched_switch(c7043b80,0,104,191,b45825eb,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7043b80,0,c0e97420,268,c7043b80,...) at sleepq_switch+0x162 sleepq_wait(c704ccd4,0,ecf59cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c704ccd4,c704cdd4,c0e632de,6b,c704ccdc,...) at _cv_wait+0x243 usb_process(c704cccc,ecf59d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c704cccc,ecf59d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf59d60, ebp = 0 --- Tracing command usb pid 15 tid 100054 td 0xc7045000 sched_switch(c7045000,0,104,191,b45812a2,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7045000,0,c0e97420,268,c7045000,...) at sleepq_switch+0x162 sleepq_wait(c704cca4,0,ecf56cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c704cca4,c704cdd4,c0e632de,6b,c704ccac,...) at _cv_wait+0x243 usb_process(c704cc9c,ecf56d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c704cc9c,ecf56d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf56d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc70455c0 sched_switch(c70455c0,0,104,191,b457fded,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70455c0,0,c0e97420,268,c70455c0,...) at sleepq_switch+0x162 sleepq_wait(c703eb5c,0,ecf4dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c703eb5c,c703ebfc,c0e632de,6b,c703eb64,...) at _cv_wait+0x243 usb_process(c703eb54,ecf4dd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c703eb54,ecf4dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf4dd60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc7035000 sched_switch(c7035000,0,104,191,5181ad3c,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7035000,0,c0e97420,268,c7035000,...) at sleepq_switch+0x162 sleepq_wait(c703eb2c,0,ecf4acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c703eb2c,c703ebfc,c0e632de,6b,c703eb34,...) at _cv_wait+0x243 usb_process(c703eb24,ecf4ad28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c703eb24,ecf4ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf4ad60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc70352e0 sched_switch(c70352e0,0,104,191,b3f3f391,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70352e0,0,c0e97420,268,c70352e0,...) at sleepq_switch+0x162 sleepq_wait(c703eafc,0,ecf47cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c703eafc,c703ebfc,c0e632de,6b,c703eb04,...) at _cv_wait+0x243 usb_process(c703eaf4,ecf47d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c703eaf4,ecf47d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf47d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc70355c0 sched_switch(c70355c0,0,104,191,b3f3e208,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70355c0,0,c0e97420,268,c70355c0,...) at sleepq_switch+0x162 sleepq_wait(c703eacc,0,ecf44cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c703eacc,c703ebfc,c0e632de,6b,c703ead4,...) at _cv_wait+0x243 usb_process(c703eac4,ecf44d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c703eac4,ecf44d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf44d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc70358a0 sched_switch(c70358a0,0,104,191,b3f3cd4b,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70358a0,0,c0e97420,268,c70358a0,...) at sleepq_switch+0x162 sleepq_wait(c7038b5c,0,ecf40cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7038b5c,c7038bfc,c0e632de,6b,c7038b64,...) at _cv_wait+0x243 usb_process(c7038b54,ecf40d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7038b54,ecf40d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf40d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc7035b80 sched_switch(c7035b80,0,104,191,51812c0d,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7035b80,0,c0e97420,268,c7035b80,...) at sleepq_switch+0x162 sleepq_wait(c7038b2c,0,ecf3dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7038b2c,c7038bfc,c0e632de,6b,c7038b34,...) at _cv_wait+0x243 usb_process(c7038b24,ecf3dd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7038b24,ecf3dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf3dd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc7036000 sched_switch(c7036000,0,104,191,ae1b90cc,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7036000,0,c0e97420,268,c7036000,...) at sleepq_switch+0x162 sleepq_wait(c7038afc,0,ecf3acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7038afc,c7038bfc,c0e632de,6b,c7038b04,...) at _cv_wait+0x243 usb_process(c7038af4,ecf3ad28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7038af4,ecf3ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf3ad60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc70362e0 sched_switch(c70362e0,0,104,191,ae1b8007,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70362e0,0,c0e97420,268,c70362e0,...) at sleepq_switch+0x162 sleepq_wait(c7038acc,0,ecf37cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7038acc,c7038bfc,c0e632de,6b,c7038ad4,...) at _cv_wait+0x243 usb_process(c7038ac4,ecf37d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7038ac4,ecf37d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf37d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc70365c0 sched_switch(c70365c0,0,104,191,ae1b6ace,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70365c0,0,c0e97420,268,c70365c0,...) at sleepq_switch+0x162 sleepq_wait(c702fb5c,0,ecf33cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702fb5c,c702fbfc,c0e632de,6b,c702fb64,...) at _cv_wait+0x243 usb_process(c702fb54,ecf33d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c702fb54,ecf33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf33d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc70368a0 sched_switch(c70368a0,0,104,191,2530876d,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70368a0,0,c0e97420,268,c70368a0,...) at sleepq_switch+0x162 sleepq_wait(c702fb2c,0,e0bffcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702fb2c,c702fbfc,c0e632de,6b,c702fb34,...) at _cv_wait+0x243 usb_process(c702fb24,e0bffd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c702fb24,e0bffd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bffd60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc7036b80 sched_switch(c7036b80,0,104,191,adb703e2,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7036b80,0,c0e97420,268,c7036b80,...) at sleepq_switch+0x162 sleepq_wait(c702fafc,0,e0bfccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702fafc,c702fbfc,c0e632de,6b,c702fb04,...) at _cv_wait+0x243 usb_process(c702faf4,e0bfcd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c702faf4,e0bfcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bfcd60, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xc7037000 sched_switch(c7037000,0,104,191,adb6f0df,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7037000,0,c0e97420,268,c7037000,...) at sleepq_switch+0x162 sleepq_wait(c702facc,0,e0bf9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c702facc,c702fbfc,c0e632de,6b,c702fad4,...) at _cv_wait+0x243 usb_process(c702fac4,e0bf9d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c702fac4,e0bf9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bf9d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc70252e0 sched_switch(c70252e0,0,104,191,adb6dcaf,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70252e0,0,c0e97420,268,c70252e0,...) at sleepq_switch+0x162 sleepq_wait(c7028b5c,0,e0bf2cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7028b5c,c7028bfc,c0e632de,6b,c7028b64,...) at _cv_wait+0x243 usb_process(c7028b54,e0bf2d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7028b54,e0bf2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bf2d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc70255c0 sched_switch(c70255c0,0,104,191,24029f92,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70255c0,0,c0e97420,268,c70255c0,...) at sleepq_switch+0x162 sleepq_wait(c7028b2c,0,e0befcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7028b2c,c7028bfc,c0e632de,6b,c7028b34,...) at _cv_wait+0x243 usb_process(c7028b24,e0befd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7028b24,e0befd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0befd60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc70258a0 sched_switch(c70258a0,0,104,191,ad52edc5,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70258a0,0,c0e97420,268,c70258a0,...) at sleepq_switch+0x162 sleepq_wait(c7028afc,0,e0beccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7028afc,c7028bfc,c0e632de,6b,c7028b04,...) at _cv_wait+0x243 usb_process(c7028af4,e0becd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7028af4,e0becd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0becd60, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xc7025b80 sched_switch(c7025b80,0,104,191,ad52db71,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7025b80,0,c0e97420,268,c7025b80,...) at sleepq_switch+0x162 sleepq_wait(c7028acc,0,e0be9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7028acc,c7028bfc,c0e632de,6b,c7028ad4,...) at _cv_wait+0x243 usb_process(c7028ac4,e0be9d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c7028ac4,e0be9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0be9d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc70272e0 sched_switch(c70272e0,0,104,191,ad52c573,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70272e0,0,c0e97420,268,c70272e0,...) at sleepq_switch+0x162 sleepq_wait(c701fb5c,0,e0be2cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701fb5c,c701fbfc,c0e632de,6b,c701fb64,...) at _cv_wait+0x243 usb_process(c701fb54,e0be2d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c701fb54,e0be2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0be2d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc70275c0 sched_switch(c70275c0,0,104,191,221452de,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70275c0,0,c0e97420,268,c70275c0,...) at sleepq_switch+0x162 sleepq_wait(c701fb2c,0,e0bdfcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701fb2c,c701fbfc,c0e632de,6b,c701fb34,...) at _cv_wait+0x243 usb_process(c701fb24,e0bdfd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c701fb24,e0bdfd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bdfd60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc70278a0 sched_switch(c70278a0,0,104,191,acee633c,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70278a0,0,c0e97420,268,c70278a0,...) at sleepq_switch+0x162 sleepq_wait(c701fafc,0,e0bdccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701fafc,c701fbfc,c0e632de,6b,c701fb04,...) at _cv_wait+0x243 usb_process(c701faf4,e0bdcd28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c701faf4,e0bdcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bdcd60, ebp = 0 --- Tracing command usb pid 15 tid 100031 td 0xc7027b80 sched_switch(c7027b80,0,104,191,acee4f60,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7027b80,0,c0e97420,268,c7027b80,...) at sleepq_switch+0x162 sleepq_wait(c701facc,0,e0bd9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c701facc,c701fbfc,c0e632de,6b,c701fad4,...) at _cv_wait+0x243 usb_process(c701fac4,e0bd9d28,c0e8c598,390,c7024578,...) at usb_process+0x193 fork_exit(c08543c0,c701fac4,e0bd9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bd9d60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc6ecc5c0 sched_switch(c6ecc5c0,0,104,191,f934f23d,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6ecc5c0,0,c0e97420,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c101d884,0,c0e84d12,2,0,...) at sleepq_timedwait+0x6b _sleep(c101d884,0,0,c0e84d12,64,...) at _sleep+0x342 pause(c0e84d12,64,c0e51cae,111,0,...) at pause+0x47 random_kthread(0,c6b65d28,c0e8c598,390,c6dbc000,...) at random_kthread+0x1ef fork_exit(c07bf4a0,0,c6b65d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b65d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc6eccb80 sched_switch(c6eccb80,0,104,191,f68432e6,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c6eccb80,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c101b4a8,5c,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c101b4a8,c101b408,25c,c0e84d12,0,...) at _sleep+0x372 g_io_schedule_down(c6eccb80,0,c0e86865,6c,c6b5fd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c6b5fd28,c0e8c598,390,c6dbc2bc,...) at g_down_procbody+0x9d fork_exit(c0943060,0,c6b5fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5fd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc6ece000 kdb_enter(c0e91c42,c0e91c42,c0ec6043,c6b5cb10,0,...) at kdb_enter+0x3a panic(c0ec6043,c0ec72b5,c0ec4aa0,286a,3,...) at panic+0x134 softdep_disk_write_complete(e0994e40,c1168ea0,c6ece0b0,c0fac4f8,c1168ea0,...) at softdep_disk_write_complete+0x1a53 bufdone_finish(e0994e40,c15ae000,e0994e40,c7714850,c6b5cc80,...) at bufdone_finish+0x26 bufdone(e0994e40,c6d755d8) at bufdone+0x6a g_vfs_done(c7714850,0,c0e9e7cb,c56,c6ece000,...) at g_vfs_done+0x85 biodone(c7714850,c101b428,25c,c0e84d12,0,...) at biodone+0xa5 g_io_schedule_up(c6ece000,0,c0e86865,5f,c6b5cd14,...) at g_io_schedule_up+0xde g_up_procbody(0,c6b5cd28,c0e8c598,390,c6dbc2bc,...) at g_up_procbody+0x9d fork_exit(c0943100,0,c6b5cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b5cd60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc6dbf2e0 sched_switch(c6dbf2e0,0,104,191,294ed589,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c6dbf2e0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c101b49c,5c,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c101b49c,c101b3cc,25c,c0e84d12,0,...) at _sleep+0x372 g_run_events(c102b700,0,c0e86865,79,c6b59d14,...) at g_run_events+0x526 g_event_procbody(0,c6b59d28,c0e8c598,390,c6dbc2bc,...) at g_event_procbody+0x90 fork_exit(c09431a0,0,c6b59d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b59d60, ebp = 0 --- Tracing command intr pid 12 tid 100065 td 0xc7176b80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100064 td 0xc7177000 sched_switch(c7177000,0,109,191,acea8f15,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c7177000,...) at mi_switch+0x1eb ithread_loop(c6dbaa00,ecf85d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaa00,ecf85d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf85d60, ebp = 0 --- Tracing command intr pid 12 tid 100062 td 0xc70375c0 sched_switch(c70375c0,0,109,191,28718d47,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c70375c0,...) at mi_switch+0x1eb ithread_loop(c6dbaa10,ecf75d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaa10,ecf75d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf75d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc7043000 sched_switch(c7043000,0,109,191,ace9c8a8,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c7043000,...) at mi_switch+0x1eb ithread_loop(c6dbaa40,ecf69d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaa40,ecf69d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf69d60, ebp = 0 --- Tracing command intr pid 12 tid 100058 td 0xc70432e0 sched_switch(c70432e0,0,109,191,c87ae568,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c70432e0,...) at mi_switch+0x1eb ithread_loop(c6dbaa70,ecf65d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaa70,ecf65d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf65d60, ebp = 0 --- Tracing command intr pid 12 tid 100053 td 0xc70452e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xc7025000 sched_switch(c7025000,0,109,191,d200913b,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c7025000,...) at mi_switch+0x1eb ithread_loop(c6dbaa90,e0bf6d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaa90,e0bf6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bf6d60, ebp = 0 --- Tracing command intr pid 12 tid 100035 td 0xc7027000 sched_switch(c7027000,0,109,191,cc87a8cc,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c7027000,...) at mi_switch+0x1eb ithread_loop(c6dbaaa0,e0be6d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaaa0,e0be6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0be6d60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc6ece2e0 sched_switch(c6ece2e0,0,109,191,ca998316,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6ece2e0,...) at mi_switch+0x1eb ithread_loop(c6dbaab0,e0bd6d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbaab0,e0bd6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0bd6d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc6ece5c0 sched_switch(c6ece5c0,0,109,191,76954e77,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6ece5c0,...) at mi_switch+0x1eb ithread_loop(c6dbab40,e0a80d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbab40,e0a80d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0a80d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc6ece8a0 sched_switch(c6ece8a0,0,109,191,f15e01c1,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6ece8a0,...) at mi_switch+0x1eb ithread_loop(c6dbab50,e0a7cd28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbab50,e0a7cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0a7cd60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc6eceb80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100026 td 0xc6fb3000 sched_switch(c6fb3000,0,109,191,7695c0f9,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6fb3000,...) at mi_switch+0x1eb ithread_loop(c6dbab80,c6b80d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbab80,c6b80d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b80d60, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc6e048a0 sched_switch(c6e048a0,0,109,191,5056a1c7,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6e048a0,...) at mi_switch+0x1eb ithread_loop(c6dbabc0,c6b71d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbabc0,c6b71d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b71d60, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc6ecc000 sched_switch(c6ecc000,0,109,191,c81c03aa,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6ecc000,...) at mi_switch+0x1eb ithread_loop(c6dbabd0,c6b6bd28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbabd0,c6b6bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b6bd60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc6dbf5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc6dbf8a0 sched_switch(c6dbf8a0,0,109,191,ee79f48e,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6dbf8a0,...) at mi_switch+0x1eb ithread_loop(c6dbabf0,c6b53d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbabf0,c6b53d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b53d60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc6dbfb80 sched_switch(c6dbfb80,0,109,191,f934c626,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6dbfb80,...) at mi_switch+0x1eb ithread_loop(c6dbac00,c6b50d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbac00,c6b50d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b50d60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc6e04000 sched_switch(c6e04000,0,109,191,d90495b4,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6e04000,...) at mi_switch+0x1eb ithread_loop(c6dbac10,c6b4dd28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbac10,c6b4dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b4dd60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc6e042e0 sched_switch(c6e042e0,0,109,191,f97cc20d,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6e042e0,...) at mi_switch+0x1eb ithread_loop(c6dbac20,c6b4ad28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbac20,c6b4ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b4ad60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc6e045c0 sched_switch(c6e045c0,0,109,191,933b40e8,...) at sched_switch+0x3bc mi_switch(109,0,c0e8c8bd,554,c6e045c0,...) at mi_switch+0x1eb ithread_loop(c6dbac30,c6b47d28,c0e8c598,390,c6dbc578,...) at ithread_loop+0x1fb fork_exit(c0984580,c6dbac30,c6b47d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b47d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc6dbe000 sched_switch(c6dbe000,0,108,18c,f6737182,...) at sched_switch+0x3bc mi_switch(108,0,c0e93c4b,3b9,c6dbe000,...) at mi_switch+0x1eb sched_idletd(0,c6b43d28,c0e8c598,390,c6dbc834,...) at sched_idletd+0x19f fork_exit(c09d3440,0,c6b43d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b43d60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc6dbe2e0 cpustop_handler(4,c6b40c04,c0cdb166,f4,0,...) at cpustop_handler+0x49 ipi_nmi_handler(f4,0,0,c11c01f8,c6dbc834,...) at ipi_nmi_handler+0x44 trap(c6b40c10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0cc0075, esp = 0xc6b40c50, ebp = 0xc6b40c50 --- acpi_cpu_c1(c6b40c6c,c0fe3bd0,2,300,2b3,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c6b40ca0,c0cce299,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c102c400,2,c6b40ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c6b40cc4,c0e93c4b,3bb,c6dbe2e0,...) at cpu_idle+0x89 sched_idletd(0,c6b40d28,c0e8c598,390,c6dbc834,...) at sched_idletd+0x263 fork_exit(c09d3440,0,c6b40d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b40d60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc6dbe5c0 cpustop_handler(2,c6b3dbe0,c0cdb166,c11f2480,c6b3db78,...) at cpustop_handler+0x49 ipi_nmi_handler(c11f2480,c6b3db78,0,c6dbe5c0,c6dbc834,...) at ipi_nmi_handler+0x44 trap(c6b3dbec) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc099cf06, esp = 0xc6b3dc2c, ebp = 0xc6b3dc3c --- _mtx_assert(c102bd80,14,c0e93c4b,74b,c102bd80,...) at _mtx_assert+0x6 sched_switch(c6dbe5c0,0,108,18c,fb029ef2,...) at sched_switch+0x428 mi_switch(108,0,c0e93c4b,a03,c6dbe5c0,...) at mi_switch+0x1eb sched_idletd(0,c6b3dd28,c0e8c598,390,c6dbc834,...) at sched_idletd+0x2bf fork_exit(c09d3440,0,c6b3dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b3dd60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc6dbe8a0 sched_switch(c6dbe8a0,0,108,18c,f683ab80,...) at sched_switch+0x3bc mi_switch(108,0,c0e93c4b,a03,c6dbe8a0,...) at mi_switch+0x1eb sched_idletd(0,c6b3ad28,c0e8c598,390,c6dbc834,...) at sched_idletd+0x2bf fork_exit(c09d3440,0,c6b3ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b3ad60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc6dbeb80 sched_switch(c6dbeb80,0,104,191,93954ba3,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c6dbeb80,0,c0e97420,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0e97420,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6dbcaf0,6c,c0e9a1fe,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6dbcaf0,c6dbcb78,16c,c0e9a1fe,0,...) at _sleep+0x35c kern_wait(c6dbeb80,ffffffff,c6b36c44,0,0,...) at kern_wait+0xbe6 wait4(c6dbeb80,c6b36cec,c6b36d28,c0e97daa,0,...) at wait4+0x3b syscallenter(c6dbeb80,c6b36ce4,c6b36ce4,0,0,...) at syscallenter+0x263 syscall(c6b36d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8060df7, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc6dbf000 sched_switch(c6dbf000,0,104,191,acec244e,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6dbf000,0,c0e97420,268,c6dbf000,...) at sleepq_switch+0x162 sleepq_wait(c119aa00,0,c6b33c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c119aa00,c119a9e4,c0ec1d17,194,0,...) at _cv_wait+0x243 audit_worker(0,c6b33d28,c0e8c598,390,c6dbd000,...) at audit_worker+0x84 fork_exit(c0ba1200,0,c6b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b33d60, ebp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xc70458a0 sched_switch(c70458a0,0,104,191,cb9906d2,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c70458a0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c73729c0,0,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c73729c0,c73729d8,0,c0e84d12,0,...) at _sleep+0x372 taskqueue_thread_loop(c11f2520,ecfa9d28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0xb5 fork_exit(c09f00b0,c11f2520,ecfa9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecfa9d60, ebp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xc71768a0 sched_switch(c71768a0,0,104,191,e2e55da7,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c71768a0,0,c0e97420,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c101d884,0,c0e84d12,2,0,...) at sleepq_timedwait+0x6b _sleep(c101d884,0,0,c0e84d12,bb8,...) at _sleep+0x342 pause(c0e84d12,bb8,124,122,c101b608,...) at pause+0x47 deadlkres(0,ecf8bd28,c0e8c598,390,c101b580,...) at deadlkres+0x324 fork_exit(c0964c50,0,ecf8bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf8bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xc7037b80 sched_switch(c7037b80,0,104,191,f97d0374,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7037b80,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7034480,0,c0e929a1,c0e84d12,0,...) at sleepq_wait+0x63 msleep_spin(c7034480,c7034498,c0e84d12,0,c0e90227,...) at msleep_spin+0x21d taskqueue_thread_loop(c706f49c,ecf6fd28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0x8f fork_exit(c09f00b0,c706f49c,ecf6fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xecf6fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc6fb32e0 sched_switch(c6fb32e0,0,104,191,c75ee728,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6fb32e0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6f50540,0,c0e929a1,c0e84d12,0,...) at sleepq_wait+0x63 msleep_spin(c6f50540,c6f50558,c0e84d12,0,c0e90227,...) at msleep_spin+0x21d taskqueue_thread_loop(c0fe6838,c6b7dd28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0x8f fork_exit(c09f00b0,c0fe6838,c6b7dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b7dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc6fb35c0 sched_switch(c6fb35c0,0,104,191,c75ed91d,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6fb35c0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6f50540,0,c0e929a1,c0e84d12,0,...) at sleepq_wait+0x63 msleep_spin(c6f50540,c6f50558,c0e84d12,0,c0e90227,...) at msleep_spin+0x21d taskqueue_thread_loop(c0fe6838,c6b7ad28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0x8f fork_exit(c09f00b0,c0fe6838,c6b7ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b7ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc6fb38a0 sched_switch(c6fb38a0,0,104,191,c75ec957,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6fb38a0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6f50540,0,c0e929a1,c0e84d12,0,...) at sleepq_wait+0x63 msleep_spin(c6f50540,c6f50558,c0e84d12,0,c0e90227,...) at msleep_spin+0x21d taskqueue_thread_loop(c0fe6838,c6b77d28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0x8f fork_exit(c09f00b0,c0fe6838,c6b77d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b77d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc6fb3b80 sched_switch(c6fb3b80,0,104,191,c758652c,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6fb3b80,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6f50580,0,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c6f50580,c6f50598,0,c0e84d12,0,...) at _sleep+0x372 taskqueue_thread_loop(c101bf18,c6b74d28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0xb5 fork_exit(c09f00b0,c101bf18,c6b74d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b74d60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc6e04b80 sched_switch(c6e04b80,0,104,191,c758547b,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6e04b80,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6f50600,0,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c6f50600,c6f50618,0,c0e84d12,0,...) at _sleep+0x372 taskqueue_thread_loop(c119afe4,c6b6ed28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0xb5 fork_exit(c09f00b0,c119afe4,c6b6ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b6ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc6ecc2e0 sched_switch(c6ecc2e0,0,104,191,ca24536b,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6ecc2e0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6f50680,0,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c6f50680,c6f50698,0,c0e84d12,0,...) at _sleep+0x372 taskqueue_thread_loop(c103a488,c6b68d28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0xb5 fork_exit(c09f00b0,c103a488,c6b68d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b68d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc6ecc8a0 sched_switch(c6ecc8a0,0,104,191,ee4f8e70,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c6ecc8a0,0,c0e97420,268,0,...) at sleepq_switch+0x162 sleepq_wait(c6d76b80,0,c0e84d12,0,0,...) at sleepq_wait+0x63 _sleep(c6d76b80,c6d76b98,0,c0e84d12,0,...) at _sleep+0x372 taskqueue_thread_loop(c1038ea0,c6b62d28,c0e8c598,390,c101b580,...) at taskqueue_thread_loop+0xb5 fork_exit(c09f00b0,c1038ea0,c6b62d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6b62d60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc101b840 sched_switch(c101b840,0,104,191,cb0de595,...) at sched_switch+0x3bc mi_switch(104,0,c0e97420,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c101b840,0,c0e97420,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c101b580,54,c0e9455d,0,0,...) at sleepq_timedwait+0x6b _sleep(c101b580,0,54,c0e9455d,2710,...) at _sleep+0x342 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3439 MB Physical memory: 3439 MB Dumping 303 MB:Dumping 303 MB: 288 288 272 272 256 256 240 240 224 224 208 208 192 192 176 176 160 160 144 144 128 128 112 112 96 96 80 80 64 64 48 48 32 32 16 16 Dump complete Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xc6b5c714) at pcpu.h:244 #1 0xc04de7e9 in db_fncall (dummy1=0xc09e19ea, dummy2=0x0, dummy3=0xffffffff, dummy4=0xc6b5c7a8 "¼ÇµÆ") at ../../../ddb/db_command.c:572 #2 0xc04dec1f in db_command (last_cmdp=0xc0fe49fc, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:448 #3 0xc04decd4 in db_command_script (command=0xc0fe5908 "call doadump") at ../../../ddb/db_command.c:519 #4 0xc04e3010 in db_script_exec (scriptname=0xc0fe5260 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc04e30a1 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc11bd500, modif=0xc6b5c8e0 "") at ../../../ddb/db_script.c:375 #6 0xc04debe1 in db_command (last_cmdp=0xc0fe49fc, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:448 #7 0xc04ded3a in db_command_loop () at ../../../ddb/db_command.c:501 #8 0xc04e0d2d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc09e1b62 in kdb_trap (type=0x3, code=0x0, tf=0xc6b5ca90) at ../../../kern/subr_kdb.c:534 #10 0xc0cdb79b in trap (frame=0xc6b5ca90) at ../../../i386/i386/trap.c:719 #11 0xc0cc46ac in calltrap () at ../../../i386/i386/exception.s:168 #12 0xc09e19ea in kdb_enter (why=0xc0e91c42 "panic", msg=0xc0e91c42 "panic") at cpufunc.h:71 #13 0xc09acf24 in panic (fmt=0xc0ec6043 "handle_disk_write_complete: Unknown type %s") at ../../../kern/kern_shutdown.c:587 #14 0xc0bd5303 in softdep_disk_write_complete (bp=0xe0994e40) at ../../../ufs/ffs/ffs_softdep.c:10415 #15 0xc0a2e1f6 in bufdone_finish (bp=0xe0994e40) at buf.h:412 #16 0xc0a2e64a in bufdone (bp=0xe0994e40) at ../../../kern/vfs_bio.c:3326 #17 0xc0947ef5 in g_vfs_done (bip=0xc7714850) at ../../../geom/geom_vfs.c:97 #18 0xc0a2b0c5 in biodone (bp=0xc7714850) at ../../../kern/vfs_bio.c:3160 #19 0xc094290e in g_io_schedule_up (tp=0xc6ece000) at ../../../geom/geom_io.c:679 #20 0xc094319d in g_up_procbody (arg=0x0) at ../../../geom/geom_kern.c:97 #21 0xc09809f8 in fork_exit (callout=0xc0943100 , arg=0x0, frame=0xc6b5cd28) at ../../../kern/kern_fork.c:920 #22 0xc0cc4724 in fork_trampoline () at ../../../i386/i386/exception.s:275 (kgdb) f 14 #14 0xc0bd5303 in softdep_disk_write_complete (bp=0xe0994e40) at ../../../ufs/ffs/ffs_softdep.c:10415 10415 panic("handle_disk_write_complete: Unknown type %s", (kgdb) l 10410 if (handle_written_sbdep(WK_SBDEP(wk), bp)) 10411 WORKLIST_INSERT(&reattach, wk); 10412 continue; 10413 10414 default: 10415 panic("handle_disk_write_complete: Unknown type %s", 10416 TYPENAME(wk->wk_type)); 10417 /* NOTREACHED */ 10418 } 10419 } (kgdb) info loc wk = (struct worklist *) 0xcc961740 owk = (struct worklist *) 0x0 reattach = {lh_first = 0x0} sbp = (struct buf *) 0x0 (kgdb) p *wk $1 = {wk_list = {le_next = 0xc74c48c0, le_prev = 0xe0994fcc}, wk_mp = 0xc73fa5a8, wk_type = 0xf, wk_state = 0x0} (kgdb) p *bp $2 = {b_bufobj = 0xc9b02d34, b_bcount = 0x4000, b_caller1 = 0x0, b_data = 0xe74f8000 "\001", b_error = 0x0, b_iocmd = 0x2, b_ioflags = 0x2, b_iooffset = 0x9978000, b_resid = 0x0, b_iodone = 0, b_blkno = 0x4cbc0, b_offset = 0xfffffffff3fd0000, b_bobufs = {tqe_next = 0xe0722740, tqe_prev = 0xe0765cd8}, b_left = 0xe083e380, b_right = 0xe0722740, b_vflags = 0x1, b_freelist = {tqe_next = 0xe0828620, tqe_prev = 0xe085bfec}, b_qindex = 0x2, b_flags = 0x80020024, b_xflags = 0x2, b_lock = {lock_object = {lo_name = 0xc0e9f2f4 "bufwait", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc6d5e2a0}, lk_lock = 0xfffffff0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x8, pcs = {0xc0994a12, 0xc0a2eb6d, 0xc0a2ef38, 0xc0a2f500, 0xc0a2f7b9, 0xc0a2f98a, 0xc09809f8, 0xc0cc4724, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, b_bufsize = 0x4000, b_runningbufspace = 0x0, b_kvabase = 0xe74f8000 "\001", b_kvasize = 0x4000, b_lblkno = 0xffffffffffffcff4, b_vp = 0xc9b02c3c, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_rcred = 0x0, b_wcred = 0x0, b_saveaddr = 0xe74f8000, b_pager = {pg_reqpage = 0x0}, b_cluster = { cluster_head = {tqh_first = 0x0, tqh_last = 0xe0753e00}, cluster_entry = {tqe_next = 0x0, tqe_prev = 0xe0753e00}}, b_pages = {0xc1bc87a8, 0xc3a51f68, 0xc3a51fb0, 0xc3004f68, 0x0 }, b_npages = 0x4, b_dep = { lh_first = 0xc74c48c0}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_pin_count = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ufs/ufs_vnops.c =================================================================== --- /usr/src/sys/ufs/ufs/ufs_vnops.c (revision 222975) +++ /usr/src/sys/ufs/ufs/ufs_vnops.c (working copy) @@ -1838,6 +1838,8 @@ ufs_mkdir(ap) #ifdef QUOTA if ((error = getinoquota(ip)) || (error = chkiq(ip, 1, ucp, 0))) { + if (DOINGSOFTDEP(tvp)) + softdep_revert_link(dp, ip); UFS_VFREE(tvp, ip->i_number, dmode); vput(tvp); return (error); @@ -1850,6 +1852,8 @@ ufs_mkdir(ap) #ifdef QUOTA if ((error = getinoquota(ip)) || (error = chkiq(ip, 1, cnp->cn_cred, 0))) { + if (DOINGSOFTDEP(tvp)) + softdep_revert_link(dp, ip); UFS_VFREE(tvp, ip->i_number, dmode); vput(tvp); return (error); @@ -2608,6 +2612,8 @@ ufs_makeinode(mode, dvp, vpp, cnp) #ifdef QUOTA if ((error = getinoquota(ip)) || (error = chkiq(ip, 1, ucp, 0))) { + if (DOINGSOFTDEP(tvp)) + softdep_revert_link(pdir, ip); UFS_VFREE(tvp, ip->i_number, mode); vput(tvp); return (error); @@ -2620,6 +2626,8 @@ ufs_makeinode(mode, dvp, vpp, cnp) #ifdef QUOTA if ((error = getinoquota(ip)) || (error = chkiq(ip, 1, cnp->cn_cred, 0))) { + if (DOINGSOFTDEP(tvp)) + softdep_revert_link(pdir, ip); UFS_VFREE(tvp, ip->i_number, mode); vput(tvp); return (error); Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 222975) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -584,6 +584,33 @@ softdep_get_depcounts(struct mount *mp, *softdepactiveaccp = 0; } +void +softdep_buf_append(bp, wkhd) + struct buf *bp; + struct workhead *wkhd; +{ + + panic("softdep_buf_appendwork called"); +} + +void +softdep_inode_append(ip, cred, wkhd) + struct inode *ip; + struct ucred *cred; + struct workhead *wkhd; +{ + + panic("softdep_inode_appendwork called"); +} + +void +softdep_freework(wkhd) + struct workhead *wkhd; +{ + + panic("softdep_freework called"); +} + #else FEATURE(softupdates, "FFS soft-updates support"); @@ -755,6 +782,7 @@ static int flush_newblk_dep(struct vnode *, struct static int flush_inodedep_deps(struct vnode *, struct mount *, ino_t); static int flush_deplist(struct allocdirectlst *, int, int *); static int sync_cgs(struct mount *, int); +static void sync_snap(struct mount *, int); static int handle_written_filepage(struct pagedep *, struct buf *); static int handle_written_sbdep(struct sbdep *, struct buf *); static void initiate_write_sbdep(struct sbdep *); @@ -867,7 +895,7 @@ static void freework_enqueue(struct freework *); static int handle_workitem_freeblocks(struct freeblks *, int); static int handle_complete_freeblocks(struct freeblks *, int); static void handle_workitem_indirblk(struct freework *); -static void handle_written_freework(struct freework *, int); +static void handle_written_freework(struct freework *); static void merge_inode_lists(struct allocdirectlst *,struct allocdirectlst *); static struct worklist *jnewblk_merge(struct worklist *, struct worklist *, struct workhead *); @@ -1632,6 +1660,7 @@ process_truncates(vp) if (cgwait) { FREE_LOCK(&lk); sync_cgs(mp, MNT_WAIT); + sync_snap(mp, MNT_WAIT); ACQUIRE_LOCK(&lk); continue; } @@ -5915,7 +5944,7 @@ complete_trunc_indir(freework) */ if (bp == NULL) { if (LIST_EMPTY(&indirdep->ir_freeblks->fb_jblkdephd)) - handle_written_freework(freework, 0); + handle_written_freework(freework); else WORKLIST_INSERT(&indirdep->ir_freeblks->fb_freeworkhd, &freework->fw_list); @@ -5967,7 +5996,7 @@ out: */ if (totblks > datablocks) return (0); - return (totblks - datablocks); + return (datablocks - totblks); } /* @@ -7221,6 +7250,7 @@ freework_freeblock(freework) cancel_jnewblk(jnewblk, &wkhd); needj = 0; } else if (needj) { + freework->fw_state |= DELAYEDFREE; freeblks->fb_cgwait++; WORKLIST_INSERT(&wkhd, &freework->fw_list); } @@ -7234,7 +7264,7 @@ freework_freeblock(freework) * made it to disk. We can immediately free the freeblk. */ if (needj == 0) - handle_written_freework(freework, 0); + handle_written_freework(freework); } /* @@ -7249,7 +7279,8 @@ freework_enqueue(freework) struct freeblks *freeblks; freeblks = freework->fw_freeblks; - WORKLIST_INSERT(&freeblks->fb_freeworkhd, &freework->fw_list); + if ((freework->fw_state & INPROGRESS) == 0) + WORKLIST_INSERT(&freeblks->fb_freeworkhd, &freework->fw_list); if ((freeblks->fb_state & (ONWORKLIST | INPROGRESS | ALLCOMPLETE)) == ALLCOMPLETE && LIST_EMPTY(&freeblks->fb_jblkdephd)) @@ -7275,13 +7306,14 @@ handle_workitem_indirblk(freework) ump = VFSTOUFS(freeblks->fb_list.wk_mp); fs = ump->um_fs; if (freework->fw_state & DEPCOMPLETE) { - handle_written_freework(freework, 0); + handle_written_freework(freework); return; } if (freework->fw_off == NINDIR(fs)) { freework_freeblock(freework); return; } + freework->fw_state |= INPROGRESS; FREE_LOCK(&lk); indir_trunc(freework, fsbtodb(fs, freework->fw_blkno), freework->fw_lbn); @@ -7294,16 +7326,16 @@ handle_workitem_indirblk(freework) * the freeblks is added back to the worklist if there is more work to do. */ static void -handle_written_freework(freework, cgwrite) +handle_written_freework(freework) struct freework *freework; - int cgwrite; { struct freeblks *freeblks; struct freework *parent; freeblks = freework->fw_freeblks; parent = freework->fw_parent; - freeblks->fb_cgwait -= cgwrite; + if (freework->fw_state & DELAYEDFREE) + freeblks->fb_cgwait--; freework->fw_state |= COMPLETE; if ((freework->fw_state & ALLCOMPLETE) == ALLCOMPLETE) WORKITEM_FREE(freework, D_FREEWORK); @@ -7545,6 +7577,8 @@ indir_trunc(freework, dbn, lbn) return; } ACQUIRE_LOCK(&lk); + /* Protects against a race with complete_trunc_indir(). */ + freework->fw_state &= ~INPROGRESS; /* * If we have an indirdep we need to enforce the truncation order * and discard it when it is complete. @@ -7668,7 +7702,7 @@ indir_trunc(freework, dbn, lbn) if (freework->fw_blkno == dbn) { freework->fw_state |= ALLCOMPLETE; ACQUIRE_LOCK(&lk); - handle_written_freework(freework, 0); + handle_written_freework(freework); FREE_LOCK(&lk); } return; @@ -10361,8 +10395,7 @@ softdep_disk_write_complete(bp) continue; case D_FREEWORK: - /* Freework on an indirect block, not bmsafemap. */ - handle_written_freework(WK_FREEWORK(wk), 0); + handle_written_freework(WK_FREEWORK(wk)); break; case D_JSEGDEP: @@ -10533,7 +10566,7 @@ handle_jwork(wkhd) free_freedep(WK_FREEDEP(wk)); continue; case D_FREEWORK: - handle_written_freework(WK_FREEWORK(wk), 1); + handle_written_freework(WK_FREEWORK(wk)); continue; default: panic("handle_jwork: Unknown type %s\n", @@ -11766,6 +11799,42 @@ sync_cgs(mp, waitfor) } /* + * sync snapshots to force freework records waiting on snapshots to claim + * blocks to free. + */ +void +sync_snap(mp, waitfor) + struct mount *mp; + int waitfor; +{ + struct snapdata *sn; + struct vnode *devvp; + struct vnode *vp; + struct inode *ip; + + devvp = VFSTOUFS(mp)->um_devvp; + if ((devvp->v_vflag & VV_COPYONWRITE) == 0) + return; + for (;;) { + VI_LOCK(devvp); + sn = devvp->v_rdev->si_snapdata; + if (sn == NULL) { + VI_UNLOCK(devvp); + return; + } + if (lockmgr(&sn->sn_lock, + LK_INTERLOCK | LK_EXCLUSIVE | LK_SLEEPFAIL, + VI_MTX(devvp)) == 0) + break; + } + TAILQ_FOREACH(ip, &sn->sn_head, i_nextsnap) { + vp = ITOV(ip); + ffs_syncvnode(vp, waitfor); + } + lockmgr(&sn->sn_lock, LK_RELEASE, NULL); +} + +/* * This routine is called when we are trying to synchronously flush a * file. This routine must eliminate any filesystem metadata dependencies * so that the syncing routine can succeed. @@ -12731,6 +12800,53 @@ clear_inodedeps(td) } } +void +softdep_buf_append(bp, wkhd) + struct buf *bp; + struct workhead *wkhd; +{ + struct worklist *wk; + + ACQUIRE_LOCK(&lk); + while ((wk = LIST_FIRST(wkhd)) != NULL) { + WORKLIST_REMOVE(wk); + WORKLIST_INSERT(&bp->b_dep, wk); + } + FREE_LOCK(&lk); + +} + +void +softdep_inode_append(ip, cred, wkhd) + struct inode *ip; + struct ucred *cred; + struct workhead *wkhd; +{ + struct buf *bp; + struct fs *fs; + int error; + + fs = ip->i_fs; + error = bread(ip->i_devvp, fsbtodb(fs, ino_to_fsba(fs, ip->i_number)), + (int)fs->fs_bsize, cred, &bp); + if (error) { + softdep_freework(wkhd); + return; + } + softdep_buf_append(bp, wkhd); + bqrelse(bp); +} + +void +softdep_freework(wkhd) + struct workhead *wkhd; +{ + + ACQUIRE_LOCK(&lk); + handle_jwork(wkhd); + FREE_LOCK(&lk); +} + /* * Function to determine if the buffer has outstanding dependencies * that will cause a roll-back if the buffer is written. If wantcount Index: /usr/src/sys/ufs/ffs/ffs_alloc.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_alloc.c (revision 222975) +++ /usr/src/sys/ufs/ffs/ffs_alloc.c (working copy) @@ -2035,7 +2035,7 @@ ffs_blkfree(ump, fs, devvp, bno, size, inum, dephd */ if (devvp->v_type != VREG && (devvp->v_vflag & VV_COPYONWRITE) && - ffs_snapblkfree(fs, devvp, bno, size, inum)) { + ffs_snapblkfree(fs, devvp, bno, size, inum, dephd)) { return; } if (!ump->um_candelete) { Index: /usr/src/sys/ufs/ffs/ffs_extern.h =================================================================== --- /usr/src/sys/ufs/ffs/ffs_extern.h (revision 222975) +++ /usr/src/sys/ufs/ffs/ffs_extern.h (working copy) @@ -80,7 +80,8 @@ int ffs_realloccg(struct inode *, ufs2_daddr_t, uf ufs2_daddr_t, int, int, int, struct ucred *, struct buf **); int ffs_sbupdate(struct ufsmount *, int, int); void ffs_setblock(struct fs *, u_char *, ufs1_daddr_t); -int ffs_snapblkfree(struct fs *, struct vnode *, ufs2_daddr_t, long, ino_t); +int ffs_snapblkfree(struct fs *, struct vnode *, ufs2_daddr_t, long, ino_t, + struct workhead *); void ffs_snapremove(struct vnode *vp); int ffs_snapshot(struct mount *mp, char *snapfile); void ffs_snapshot_mount(struct mount *mp); @@ -149,6 +150,9 @@ int softdep_prealloc(struct vnode *, int); int softdep_journal_lookup(struct mount *, struct vnode **); void softdep_journal_freeblocks(struct inode *, struct ucred *, off_t, int); void softdep_journal_fsync(struct inode *); +void softdep_buf_append(struct buf *, struct workhead *); +void softdep_inode_append(struct inode *, struct ucred *, struct workhead *); +void softdep_freework(struct workhead *); /* @@ -161,4 +165,14 @@ void softdep_journal_fsync(struct inode *); int ffs_rdonly(struct inode *); +TAILQ_HEAD(snaphead, inode); + +struct snapdata { + LIST_ENTRY(snapdata) sn_link; + struct snaphead sn_head; + daddr_t sn_listsize; + daddr_t *sn_blklist; + struct lock sn_lock; +}; + #endif /* !_UFS_FFS_EXTERN_H */ Index: /usr/src/sys/ufs/ffs/ffs_snapshot.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_snapshot.c (revision 222975) +++ /usr/src/sys/ufs/ffs/ffs_snapshot.c (working copy) @@ -81,12 +81,13 @@ ffs_snapshot(mp, snapfile) } int -ffs_snapblkfree(fs, devvp, bno, size, inum) +ffs_snapblkfree(fs, devvp, bno, size, inum, wkhd) struct fs *fs; struct vnode *devvp; ufs2_daddr_t bno; long size; ino_t inum; + struct workhead *wkhd; { return (EINVAL); } @@ -126,16 +127,6 @@ ffs_copyonwrite(devvp, bp) #else FEATURE(ffs_snapshot, "FFS snapshot support"); -TAILQ_HEAD(snaphead, inode); - -struct snapdata { - LIST_ENTRY(snapdata) sn_link; - struct snaphead sn_head; - daddr_t sn_listsize; - daddr_t *sn_blklist; - struct lock sn_lock; -}; - LIST_HEAD(, snapdata) snapfree; static struct mtx snapfree_lock; MTX_SYSINIT(ffs_snapfree, &snapfree_lock, "snapdata free list", MTX_DEF); @@ -1635,7 +1626,7 @@ ffs_snapremove(vp) DIP_SET(ip, i_db[blkno], 0); else if ((dblk == blkstofrags(fs, blkno) && ffs_snapblkfree(fs, ip->i_devvp, dblk, fs->fs_bsize, - ip->i_number))) { + ip->i_number, NULL))) { DIP_SET(ip, i_blocks, DIP(ip, i_blocks) - btodb(fs->fs_bsize)); DIP_SET(ip, i_db[blkno], 0); @@ -1660,7 +1651,7 @@ ffs_snapremove(vp) ((ufs1_daddr_t *)(ibp->b_data))[loc]= 0; else if ((dblk == blkstofrags(fs, blkno) && ffs_snapblkfree(fs, ip->i_devvp, dblk, - fs->fs_bsize, ip->i_number))) { + fs->fs_bsize, ip->i_number, NULL))) { ip->i_din1->di_blocks -= btodb(fs->fs_bsize); ((ufs1_daddr_t *)(ibp->b_data))[loc]= 0; @@ -1674,7 +1665,7 @@ ffs_snapremove(vp) ((ufs2_daddr_t *)(ibp->b_data))[loc] = 0; else if ((dblk == blkstofrags(fs, blkno) && ffs_snapblkfree(fs, ip->i_devvp, dblk, - fs->fs_bsize, ip->i_number))) { + fs->fs_bsize, ip->i_number, NULL))) { ip->i_din2->di_blocks -= btodb(fs->fs_bsize); ((ufs2_daddr_t *)(ibp->b_data))[loc] = 0; } @@ -1722,12 +1713,13 @@ ffs_snapremove(vp) * must always have been allocated from a BLK_NOCOPY location. */ int -ffs_snapblkfree(fs, devvp, bno, size, inum) +ffs_snapblkfree(fs, devvp, bno, size, inum, wkhd) struct fs *fs; struct vnode *devvp; ufs2_daddr_t bno; long size; ino_t inum; + struct workhead *wkhd; { struct buf *ibp, *cbp, *savedcbp = 0; struct thread *td = curthread; @@ -1825,6 +1817,17 @@ retry: "Grabonremove: snapino", ip->i_number, (intmax_t)lbn, inum); #endif + /* + * If journaling is tracking this write we must add + * the work to the inode or indirect being written. + */ + if (wkhd != NULL) { + if (lbn < NDADDR) + softdep_inode_append(ip, + curthread->td_ucred, wkhd); + else + softdep_buf_append(ibp, wkhd); + } if (lbn < NDADDR) { DIP_SET(ip, i_db[lbn], bno); } else if (ip->i_ump->um_fstype == UFS1) { @@ -1902,6 +1905,8 @@ retry: * not be freed. Although space will be lost, the snapshot * will stay consistent. */ + if (error != 0 && wkhd != NULL) + softdep_freework(wkhd); lockmgr(vp->v_vnlock, LK_RELEASE, NULL); return (error); } -- Test scenario: suj21.sh