GENERIC HEAD from 2012-04-01 09:35:23 UTC, r233758M, vmcore.322 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r233758M: Sun Apr 1 22:17:45 CEST 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531657216 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 115971 free (907 frags, 14383 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 125592 free (5216 frags, 15047 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 111642322 free (2410 frags, 13954989 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3271781 free (235621 frags, 379520 blocks, 2.3% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 16654874 free (44794 frags, 2076260 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe191e360 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xca7ef400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,2e687361,38323a63,c0000a34,c1254818,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c1254808,11c,f2750874,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,ca7ef400,c0fab29a,c7d72610,c0faaf2c,...) at _witness_debugger+0x25 witness_checkorder(ca7ef400,9,c0faaf23,11c,0,...) at witness_checkorder+0x86f _sx_xlock(ca7ef400,0,c0faaf23,11c,ca7b032c,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e191e300,ca7b032c,f27509f0,e23f2cf4,f2750944,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(ca7b032c,f27509f0,2cf4,f2750930,f2750934,...) at ufsdirhash_add+0x13 ufs_direnter(caae8414,cad36414,f27509f0,f2750b80,e191e980,...) at ufs_direnter+0x7a9 ufs_mkdir(f2750c10,c0fcc712,0,0,f2750ba8,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10bc1a0,f2750c10,f2750b80,f2750ba8,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca8012e0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(ca8012e0,28404020,0,1c0,f2750d1c,...) at kern_mkdir+0x2e sys_mkdir(ca8012e0,f2750cec,c0fc519c,c0f7b852,202,...) at sys_mkdir+0x29 syscall(f2750d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817fb33, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). lock order reversal: 1st 0xcaae8b38 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xe190ba00 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcacfa724 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,3a632e73,a303632,0,ffffffc0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab59,c12547e8,877,f2730354,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab59,cacfa724,c0f69284,c7d725a8,c0f82bb5,...) at _witness_debugger+0x25 witness_checkorder(cacfa724,9,c0f82bac,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cacfa724,80100,cacfa790,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f2730450,c0a8e12c,ca6d75c0,80100,cacfa6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f2730450,c7d6b1e0,c10cd360,cacfa6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cacfa6cc,80100,c0f82bac,877,4,...) at _vn_lock+0x78 vget(cacfa6cc,80100,ca6d75c0,50,0,...) at vget+0xbb vfs_hash_get(ca79cb40,1a9896,80000,ca6d75c0,f273059c,...) at vfs_hash_get+0xed ffs_vgetf(ca79cb40,1a9896,80000,f273059c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(caae8ae0,e190b9a0,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(caae8ae0,1,0,f273062c,c0a8c007,...) at ffs_syncvnode+0x24c ffs_truncate(caae8ae0,200,0,880,c7dafe00,...) at ffs_truncate+0x8b5 ufs_direnter(caae8ae0,cacfa6cc,f2730914,f2730bbc,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f2730bbc,c10bc760,f2730b00,f2730a5c,c0dd08e5,...) at ufs_makeinode+0x65d ufs_create(f2730b00,c0fcc8d8,0,0,f2730b7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bc1a0,f2730b00,f2730bbc,f2730a98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f2730b7c,f2730c44,1a4,0,c7dafe00,...) at vn_open_cred+0x205 vn_open(f2730b7c,f2730c44,1a4,ca7d4d20,201,...) at vn_open+0x3b kern_openat(ca6d75c0,ffffff9c,2842d67c,0,602,...) at kern_openat+0x1ec kern_open(ca6d75c0,2842d67c,0,601,1b6,...) at kern_open+0x35 sys_open(ca6d75c0,f2730cec,c0fc519c,c0f7b9f1,246,...) at sys_open+0x30 syscall(f2730d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28201193, esp = 0xbfbfdc3c, ebp = 0xbfbfdcf8 --- Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcaad69dc ufs (ufs) @ kern/vfs_mount.c:1251 2nd 0xca8529dc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1843 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,38313a63,a3334,c7d6b7f8,c8182c30,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c1254048,733,f27d79bc,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,ca8529dc,c0f6e1f4,c7d72408,c0fa7378,...) at _witness_debugger+0x25 witness_checkorder(ca8529dc,9,c0fa736f,733,ca852a48,...) at witness_checkorder+0x86f __lockmgr_args(ca8529dc,80400,ca852a48,0,0,...) at __lockmgr_args+0x8c5 vop_stdlock(f27d7ab4,4,c0f712f3,80400,ca852984,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c1091a00,f27d7ab4,c1287e40,c10cd360,ca852984,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca852984,80400,c0fa736f,733,caadb2d0,...) at _vn_lock+0x78 softdep_flushworklist(caadb2d0,f27d7b68,c8182b80,632,c0ae0baa,...) at softdep_flushworklist+0x82 ffs_sync(caadb2d0,1,f27d7bbc,51c,c7c34000,...) at ffs_sync+0x533 dounmount(caadb2d0,8080000,c8182b80,49e,f27d7c04,...) at dounmount+0x3f8 sys_unmount(c8182b80,f27d7cec,c0fc519c,c,206,...) at sys_unmount+0x421 syscall(f27d7d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 79661 files, 6671659 used, 111642322 free (2410 frags, 13954989 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 79661 files, 6671659 used, 111642322 free (2410 frags, 13954989 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun Apr 1 22:35:03 CEST 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Apr 1 22:35:47 x4 su: pho to root on /dev/pts/1 lock order reversal: 1st 0xe1a90680 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 2nd 0xc7fc851c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2307 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,632e746f,3033323a,c1000a37,cbfc7828,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c12537c0,903,f284f874,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,c7fc851c,c0fa6dd4,c7d72d60,c0fa6d5e,...) at _witness_debugger+0x25 witness_checkorder(c7fc851c,9,c0fa6d55,903,0,...) at witness_checkorder+0x86f __lockmgr_args(c7fc851c,80900,cb5ced00,0,0,...) at __lockmgr_args+0x8c5 ffs_copyonwrite(cb5cec3c,e1a90620,0,e1a90620,cbfb6414,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(cb5ced34,e1a90620,f284f9d0,cb0de2e0,cbfbeb90,...) at ffs_geom_strategy+0xeb ufs_strategy(f284fa0c,c0fcc5d3,cbfbeb90,e1a90620,0,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c10bc1a0,f284fa0c,cbfbeb90,c10cd3c0,cbfb6414,...) at VOP_STRATEGY_APV+0xe5 bufstrategy(cbfb650c,e1a90620,eb,e1a90680,e1a90620,...) at bufstrategy+0x61 bufwrite(e1a90620,e1a90620,1,106,0,...) at bufwrite+0x159 ffs_syncvnode(cbfb6414,1,0,c10bc1a0,cbfb650c,...) at ffs_syncvnode+0x385 ffs_fsync(f284fafc,c0fcbd8f,cbfab1d0,f284fafc,0,...) at ffs_fsync+0x2f VOP_FSYNC_APV(c10bc1a0,f284fafc,500800c,0,cbfb6414,...) at VOP_FSYNC_APV+0xc5 ufs_remove(f284fc18,c0fcc7cb,0,0,cbfc7828,...) at ufs_remove+0xd2 VOP_REMOVE_APV(c10bc1a0,f284fc18,cbfc7828,f284fb90,0,...) at VOP_REMOVE_APV+0xf6 kern_unlinkat(cb0de2e0,ffffff9c,bfbfe444,0,0,...) at kern_unlinkat+0x258 kern_unlink(cb0de2e0,bfbfe444,0,f284fd1c,c0daab43,...) at kern_unlink+0x2f sys_unlink(cb0de2e0,f284fcec,c0fc519c,c,206,...) at sys_unlink+0x22 syscall(f284fd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28186f5f, esp = 0xbfbfdf7c, ebp = 0xbfbfe858 --- lock order reversal: 1st 0xc7fc851c snaplk (snaplk) @ kern/vfs_vnops.c:310 2nd 0xcbfc7880 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1637 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,a373336,cb0de200,f284f5d0,246,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c12537b0,665,f284f67c,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,cbfc7880,c0f69284,c7d725a8,c0fa6d5e,...) at _witness_debugger+0x25 witness_checkorder(cbfc7880,9,c0fa6d55,665,0,...) at witness_checkorder+0x86f __lockmgr_args(cbfc7880,80000,0,0,0,...) at __lockmgr_args+0x8c5 ffs_snapremove(cbfc7828,c0fa6c93,c0f712f3,eb,cbfc7920,...) at ffs_snapremove+0x11f ffs_truncate(cbfc7828,0,0,c00,0,...) at ffs_truncate+0x647 ufs_inactive(f284fa2c,c0fcc2a5,cbfc78ec,cbfc78ec,cbfc7828,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10bc1a0,f284fa2c,c0f82bac,96f,c10cd320,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10bc1a0,f284fa60,c0f82bac,8c6,0,...) at vinactive+0xb1 vputx(f284fac8,c0af18da,cbfc7828,f284faa4,c0f843b0,...) at vputx+0x36c vput(cbfc7828,f284faa4,c0f843b0,136,0,...) at vput+0x10 vn_close(cbfc7828,1,ca6ce800,cb0de2e0,281b5000,...) at vn_close+0x19a vn_closefile(ca818c08,cb0de2e0,c10a2ac0,0,ca818c08,...) at vn_closefile+0xe4 _fdrop(ca818c08,cb0de2e0,0,f284fb8c,0,c0a8bcfa,c12537b0,cb0de390,c12537b0,c10a2ac0,cb0de2e0,cbeb4d2c,79f,f284fb9c,c0a4a4d5,cbeb4d2c,8,c0f6c40c,ca818c08) at _fdrop+0x43 closef(ca818c08,cb0de2e0,79f,79c,c7d6a340,...) at closef+0x2b0 fdfree(cb0de2e0,0,c0f6d0b3,107,f284fc68,...) at fdfree+0x3ea exit1(cb0de2e0,0,f284fd1c,c0daab43,cb0de2e0,...) at exit1+0x573 sys_sys_exit(cb0de2e0,f284fcec,c0fc519c,c0f7b89a,282,...) at sys_sys_exit+0x1d syscall(f284fd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x281182ff, esp = 0xbfbfdf0c, ebp = 0xbfbfdf18 --- Expensive timeout(9) function: 0xc0ca7270(0) 0.304298422 s Apr 1 23:17:46 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 1 23:17:46 x4 mountd[1009]: can't delete exports for /mnt16: Invalid argument Apr 1 23:17:46 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:17:46 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:17:46 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:17:47 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:17:47 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:17:47 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 1 23:17:47 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:17:58 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:17:58 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:17:58 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 1 23:17:58 x4 mountd[1009]: can't delete exports for /mnt16: Invalid argument Apr 1 23:17:58 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:17:58 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 1 23:18:02 x4 mountd[1009]: can't delete exports for /mnt18: Device busy Apr 1 23:18:02 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:18:03 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt9: Device busy Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 1 23:18:07 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt16: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 1 23:18:10 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:18:12 x4 mountd[1009]: can't delete exports for /mnt6: Device busy Apr 1 23:18:12 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:18:12 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 1 23:18:12 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:12 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:18:12 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 1 23:18:13 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:15 x4 mountd[1009]: can't delete exports for /mnt14: Device busy Apr 1 23:18:18 x4 mountd[1009]: can't delete exports for /mnt18: Device busy Apr 1 23:18:18 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 1 23:18:18 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:19 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 1 23:18:19 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:19 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:19 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 1 23:18:25 x4 mountd[1009]: can't delete exports for /mnt18: Device busy Apr 1 23:18:27 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:27 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:27 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:18:27 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:18:27 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:27 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 1 23:18:28 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:29 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt8: Device busy Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 1 23:18:30 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:18:31 x4 mountd[1009]: can't delete exports for /mnt5: Device busy Apr 1 23:18:31 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 1 23:18:31 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 1 23:18:31 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:18:31 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:18:33 x4 mountd[1009]: can't delete exports for /mnt6: Device busy Apr 1 23:18:33 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 1 23:18:33 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 1 23:18:33 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:18:36 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 1 23:18:37 x4 mountd[1009]: can't delete exports for /mnt17: Device busy Apr 1 23:18:37 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 1 23:18:37 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument lock order reversal: 1st 0xcc5c4b38 syncer (syncer) @ kern/vfs_subr.c:1767 2nd 0xcb7759dc ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,a3736,c1118600,ee31e998,c0a6a5a8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c1254d00,877,ee31ea18,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,cb7759dc,c0f69284,c7d725a8,c0f82bb5,...) at _witness_debugger+0x25 witness_checkorder(cb7759dc,9,c0f82bac,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cb7759dc,80100,cb775a48,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(ee31eb14,c8056950,6c5,80100,cb775984,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,ee31eb14,c7d6b1e0,c10cd360,cb775984,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cb775984,80100,c0f82bac,877,4,...) at _vn_lock+0x78 vget(cb775984,80100,c80568a0,42c,cc088000,...) at vget+0xbb qsync(cc088000,0,c0faa230,5c6,cc088000,...) at qsync+0x17a ffs_sync(cc088000,3,2,ddb,cc088000,...) at ffs_sync+0x244 sync_fsync(ee31ec6c,c0fcbd8f,cc5c4ba4,ee31ec6c,cc5c4ae0,...) at sync_fsync+0x156 VOP_FSYNC_APV(c10aae40,ee31ec6c,c0f82bac,6e7,c80568a0,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c1281b74,c1281b60,3e8,78b,4e20,...) at sync_vnode+0x16b sched_sync(0,ee31ed28,c0f6d330,3d8,ca6c12cc,...) at sched_sync+0x282 fork_exit(c0ae2cc0,0,ee31ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ed60, ebp = 0 --- Apr 1 23:18:41 x4 mountd[1009]: can't delete exports for /mnt13: Device busy Apr 1 23:18:41 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 1 23:18:41 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 1 23:18:41 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Apr 1 23:18:41 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 1 23:18:47 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument : Apr 1 23:35:04 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 1 23:35:04 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 1 23:35:04 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:35:05 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 1 23:35:05 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 1 23:35:05 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:35:05 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 1 23:40:32 x4 kernel: pid 68100 (rw), uid 1004 inumber 11 on /mnt: filesystem full Apr 1 23:42:32 x4 kernel: pid 68459 (rw), uid 1004 inumber 106611 on /mnt: filesystem full Apr 1 23:46:33 x4 kernel: pid 69060 (rw), uid 1004 inumber 98312 on /mnt: filesystem full Apr 1 23:48:36 x4 kernel: pid 69401 (rw), uid 1004 inumber 98306 on /mnt: filesystem full Apr 1 23:50:37 x4 kernel: pid 69767 (rw), uid 1004 inumber 32881 on /mnt: filesystem full Apr 1 23:52:37 x4 kernel: pid 70100 (rw), uid 1004 inumber 32823 on /mnt: filesystem full Apr 1 23:54:38 x4 kernel: pid 70456 (rw), uid 1004 inumber 98311 on /mnt: filesystem full Apr 1 23:56:38 x4 kernel: pid 70819 (rw), uid 1004 inumber 65606 on /mnt: filesystem full lock order reversal: 1st 0xca80e92c filedesc structure (filedesc structure) @ kern/kern_descrip.c:820 2nd 0xcaceec94 ufs (ufs) @ kern/vfs_subr.c:4272 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,20296572,656b2040,6b2f6e72,5f6e7265,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c1253de0,10b0,f27d7a78,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,caceec94,c0f69284,c7d725a8,c0f82bb5,...) at _witness_debugger+0x25 witness_checkorder(caceec94,9,c0f82bac,10b0,caceed00,...) at witness_checkorder+0x86f __lockmgr_args(caceec94,80400,caceed00,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f27d7b74,c7d6e6b0,c,80400,caceec3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f27d7b74,f27d7b90,c10cd360,caceec3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(caceec3c,80400,c0f82bac,10b0,f27d7bd0,...) at _vn_lock+0x78 vfs_knllock(caceec3c,0,c0f6cc51,728,cad89dc8,...) at vfs_knllock+0x29 knlist_remove_kq(0,f27d7bf0,c0add049,cb0c701c,cad89dc8,...) at knlist_remove_kq+0x85 knlist_remove(cb0c701c,cad89dc8,0,f27d7c1c,c0a0bc25,...) at knlist_remove+0x1b filt_vfsdetach(cad89dc8,0,c0f6cc51,832,334,...) at filt_vfsdetach+0x39 knote_fdclose(c8182b80,3,c0f6c40c,334,5,...) at knote_fdclose+0xf5 do_dup(3,c8182dc8,f27d7d1c,c0daab43,c8182b80,...) at do_dup+0x351 sys_dup2(c8182b80,f27d7cec,c0fc519c,c,206,...) at sys_dup2+0x28 syscall(f27d7d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (90, FreeBSD ELF32, sys_dup2), eip = 0x28115eef, esp = 0xbfbfeacc, ebp = 0xbfbfeb18 --- Apr 2 00:54:26 x4 mountd[1009]: can't delete exports for /home/pho/stress2/misc/mp1: Invalid argument ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior. Consider tuning vm.kmem_size and vm.kmem_size_max in /boot/loader.conf. ZFS filesystem version 5 ZFS storage pool version 28 Apr 2 01:59:59 x4 kernel: pid 261 (cp), uid 0 inumber 51553 on /mnt: filesystem full Apr 2 02:00:00 x4 kernel: pid 279 (cp), uid 0 inumber 51556 on /mnt: filesystem full lock order reversal: 1st 0xe1af3880 bufwait (bufwait) @ kern/vfs_bio.c:1905 2nd 0xd0e6d7a0 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,75626b63,3a632e66,a383431,f2b45300,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c124c5a0,94,f2b453d8,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,d0e6d7a0,c0f6b062,c7d72748,c0f7f03e,...) at _witness_debugger+0x25 witness_checkorder(d0e6d7a0,9,c0f7f035,94,0,...) at witness_checkorder+0x86f _sx_xlock(d0e6d7a0,40,c0f7f035,94,f2b45470,...) at _sx_xlock+0xa0 sblock(d0e6d768,1,202,2,c1ba68d4,...) at sblock+0x85 sosend_generic(d0e6d680,0,0,cbb4b800,0,...) at sosend_generic+0xc2 sosend(d0e6d680,0,0,cbb4b800,0,...) at sosend+0x3f clnt_vc_call(ca872bc0,f2b455f4,10,cb34a800,f2b45804,...) at clnt_vc_call+0x4af clnt_reconnect_call(cd98e6c0,f2b455f4,10,cb34a800,f2b45804,...) at clnt_reconnect_call+0x670 newnfs_request(f2b45804,c9692800,0,c9692910,cc7ce984,cdda4000,c7ed6280,186a3,3,0,1,0) at newnfs_request+0xc65 nfscl_request(f2b45804,cc7ce984,cdda4000,c7ed6280,0,...) at nfscl_request+0x82 nfsrpc_readdir(cc7ce984,f2b45990,f2b4594c,c7ed6280,cdda4000,...) at nfsrpc_readdir+0xce6 ncl_readdirrpc(cc7ce984,f2b45990,c7ed6280,cdda4000,c0f712f3,...) at ncl_readdirrpc+0xec ncl_doio(cc7ce984,e1af3820,c7ed6280,cdda4000,0,...) at ncl_doio+0x2c0 ncl_bioread(cc7ce984,f2b45be8,0,c7ed6280,f2b45b24,...) at ncl_bioread+0xc3d nfs_readdir(f2b45c08,c0fcbd4a,0,0,cc7ce984,...) at nfs_readdir+0x192 VOP_READDIR_APV(c1092b20,f2b45c08,c0f841a7,1055,f2b45c30,...) at VOP_READDIR_APV+0xc5 kern_getdirentries(cdda4000,5,28494000,1000,f2b45c5c,...) at kern_getdirentries+0x230 sys_getdirentries(cdda4000,f2b45cec,c0fc519c,c0f7b7ff,246,...) at sys_getdirentries+0x31 syscall(f2b45d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x28105e8f, esp = 0xbfbfe76c, ebp = 0xbfbfe798 --- Apr 2 02:30:55 x4 kernel: pid 1036 (nfsd), uid 0 inumber 5407 on /mnt: filesystem full Apr 2 02:32:10 x4 mountd[1009]: bad exports list line /mnt Expensive timeout(9) function: 0xc0ca7270(0) 0.901970228 s Apr 2 03:44:54 x4 mountd[1009]: bad exports list line /mnt lock order reversal: 1st 0xcad6421c ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:114 2nd 0xd2513310 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1711 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,66000a31,66752f73,78655f73,74746174,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab40,c124ec78,6af,f2730744,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab40,d2513310,c0f69284,c7d725a8,c0faa239,...) at _witness_debugger+0x25 witness_checkorder(d2513310,9,c0faa230,6af,0,...) at witness_checkorder+0x86f __lockmgr_args(d2513310,80000,0,0,0,...) at __lockmgr_args+0x8c5 ffs_vgetf(cc19eb40,2,80000,f2730878,0,...) at ffs_vgetf+0x189 ffs_vget(cc19eb40,2,80000,f2730878,0,...) at ffs_vget+0x2e ufs_root(cc19eb40,80000,f27308a0,cad64200,cc19eb40,...) at ufs_root+0x28 ufs_extattr_autostart(cc19eb40,ca6d75c0,c0faa230,42f,0,...) at ufs_extattr_autostart+0x50 ffs_mount(cc19eb40,c10bbd60,cda35280,c7ed6280,ca6d8a68,...) at ffs_mount+0x2f1d vfs_donmount(ca6d75c0,0,0,cb796580,cb796580,...) at vfs_donmount+0xc0a sys_nmount(ca6d75c0,f2730cec,c0fc519c,c,207,...) at sys_nmount+0x7f syscall(f2730d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280fabbb, esp = 0xbfbfd86c, ebp = 0xbfbfddc8 --- Apr 2 03:45:03 x4 last message repeated 99 times lock order reversal: 1st 0xd3f64880 newnfs (newnfs) @ kern/vfs_syscalls.c:4181 2nd 0xe1b16920 bufwait (bufwait) @ kern/vfs_bio.c:1905 3rd 0xd1bed1b4 newnfs (newnfs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f77093,a3736,a3100,f2ab0380,c0d9dc5e,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb9b,c0f7ab59,c12476e8,877,f2ab0430,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab59,d1bed1b4,c0f638cb,c7d73240,c0f82bb5,...) at _witness_debugger+0x25 witness_checkorder(d1bed1b4,9,c0f82bac,877,0,...) at witness_checkorder+0x86f __lockmgr_args(d1bed1b4,80100,d1bed220,0,0,...) at __lockmgr_args+0x8c5 nfs_lock1(f2ab0528,246,c7d6b7f8,80100,d1bed15c,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c1092b20,f2ab0528,c7d6b1e0,c10cd360,d1bed15c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d1bed15c,80100,c0f82bac,877,4,...) at _vn_lock+0x78 vget(d1bed15c,80100,cc22f2e0,50,0,...) at vget+0xbb vfs_hash_get(cc1ad2d0,5c078f90,80000,cc22f2e0,f2ab05f0,...) at vfs_hash_get+0xed nfscl_nget(cc1ad2d0,d3f64828,cdbab880,f2ab07a4,cc22f2e0,...) at nfscl_nget+0x8d nfsrpc_readdirplus(d3f64828,f2ab0990,f2ab094c,cda7c200,cc22f2e0,...) at nfsrpc_readdirplus+0x13ce ncl_readdirplusrpc(d3f64828,f2ab0990,cda7c200,cc22f2e0,c0f712f3,...) at ncl_readdirplusrpc+0xec ncl_doio(d3f64828,e1b168c0,cda7c200,cc22f2e0,0,...) at ncl_doio+0x28d ncl_bioread(d3f64828,f2ab0be8,0,cda7c200,f2ab0b24,...) at ncl_bioread+0xc3d nfs_readdir(f2ab0c08,c0fcbd4a,0,0,d3f64828,...) at nfs_readdir+0x192 VOP_READDIR_APV(c1092b20,f2ab0c08,c0f841a7,1055,f2ab0c30,...) at VOP_READDIR_APV+0xc5 kern_getdirentries(cc22f2e0,5,28495000,1000,f2ab0c5c,...) at kern_getdirentries+0x230 sys_getdirentries(cc22f2e0,f2ab0cec,c0fc519c,c0f7b7ff,246,...) at sys_getdirentries+0x31 syscall(f2ab0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x28105e8f, esp = 0xbfbfe73c, ebp = 0xbfbfe768 --- Apr 2 04:50:49 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 2 04:50:49 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt10: Invalid argument Apr 2 04:50:50 x4 mountd[1009]: can't delete exports for /mnt16: Invalid argument Apr 2 04:50:51 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 2 04:50:51 x4 mountd[1009]: can't delete exports for /mnt9: Invalid argument Apr 2 04:50:52 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument : Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt13: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt7: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt5: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt15: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt12: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt14: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt18: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt11: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 2 06:38:40 x4 mountd[1009]: can't delete exports for /mnt17: Invalid argument Apr 2 06:38:41 x4 mountd[1009]: can't delete exports for /mnt6: Invalid argument Apr 2 06:38:41 x4 mountd[1009]: can't delete exports for /mnt19: Invalid argument Apr 2 06:38:41 x4 mountd[1009]: can't delete exports for /mnt8: Invalid argument Sleeping thread (tid 3181114, pid 18107) owns a non-sleepable lock sched_switch(de17fb80,0,104,1a3,fa4f47a8,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(de17fb80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(e1a22840,60,c0f80bb4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1a22840,80000,d2924668,0,0,...) at __lockmgr_args+0xc86 vop_stdfsync(f3081b4c,f3081ae0,0,c1091a00,f3081b4c,...) at vop_stdfsync+0xf0 devfs_fsync(f3081b4c,c0fcbd8f,d2924570,d2924570,d2924668,...) at devfs_fsync+0x7c VOP_FSYNC_APV(c1091a00,f3081b4c,c0faa230,648,d4927d98,...) at VOP_FSYNC_APV+0xc5 ffs_sync(d61305a0,1,c0f82211,51c,c7c34000,...) at ffs_sync+0x620 dounmount(d61305a0,8000000,de17fb80,49e,f3081c04,...) at dounmount+0x3f8 sys_unmount(de17fb80,f3081cec,c0fc519c,c,206,...) at sys_unmount+0x421 syscall(f3081d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- panic: sleeping thread cpuid = 0 KDB: enter: panic [ thread pid 18098 tid 3182287 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 18098 tid 3182287 td 0xcb32b8a0 kdb_enter(c0f73050,c0f73050,c0f796c7,f2dcb9b4,0,...) at kdb_enter+0x3a panic(c0f796c7,ffffffff,46bb,cd,4,...) at panic+0x18c propagate_priority(c1127a34,0,c0f7944c,2e2,690,...) at propagate_priority+0x18f turnstile_wait(cb281000,de17fb80,0,1c5,c0a8bcfa,...) at turnstile_wait+0x467 _mtx_lock_sleep(d2924668,cb32b8a0,0,c0f8008b,613,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(d2924668,0,c0f8008b,613,4,...) at _mtx_lock_flags+0xff bqrelse(e1a227e0,0,c0f8008b,9c7,8,...) at bqrelse+0x1f6 bdwrite(e1a227e0,cd644a00,100,8000,0,...) at bdwrite+0x1e9 ffs_update(ced382b8,0,1,f2dcbb68,c123b2a0,...) at ffs_update+0x3f5 ufs_inactive(f2dcbbc0,c0fcc2a5,ced3837c,ced3837c,ced382b8,...) at ufs_inactive+0x37a VOP_INACTIVE_APV(c10bc1a0,f2dcbbc0,c0f82bac,96f,c10cd320,...) at VOP_INACTIVE_APV+0xc5 vinactive(ced3837c,0,c0f82bac,8e8,0,...) at vinactive+0xb1 vputx(f2dcbc68,c0aed655,ced382b8,c0f841a7,319,...) at vputx+0x36c vrele(ced382b8,c0f841a7,319,316,f2dcbc54,...) at vrele+0x10 sys_fchdir(cb32b8a0,f2dcbcec,c0fc519c,c0f7b8dd,246,...) at sys_fchdir+0x395 syscall(f2dcbd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (13, FreeBSD ELF32, sys_fchdir), eip = 0x280ee05b, esp = 0xbfbfe61c, ebp = 0xbfbfe6a8 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x757400 curthread = 0xcb32b8a0: pid 18098 "find" curpcb = 0xf2dcbd80 fpcurthread = none idlethread = 0xc7dcd8a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6a48400 curthread = 0xcb30eb80: pid 18097 "find" curpcb = 0xf2e85d80 fpcurthread = none idlethread = 0xc7dcd5c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6a4b400 curthread = 0xd16728a0: pid 7842 "sh" curpcb = 0xf2730d80 fpcurthread = none idlethread = 0xc7dcd2e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6a4e400 curthread = 0xde02bb80: pid 18114 "find" curpcb = 0xf2d2bd80 fpcurthread = none idlethread = 0xc7dcd000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 18115 (find) thread 0xca6d12e0 (100156) exclusive sleep mutex page lock (page lock) r = 0 (0xc1289480) locked @ vm/vm_object.c:1129 exclusive sleep mutex vm object (standard object) r = 0 (0xd5afc940) locked @ vm/vm_object.c:1077 shared sx user map (user map) r = 0 (0xcb903300) locked @ vm/vm_map.c:2040 Process 18114 (find) thread 0xde02bb80 (3183205) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1b360e0) locked @ kern/vfs_bio.c:2652 shared lockmgr ufs (ufs) r = 0 (0xd14b646c) locked @ kern/vfs_vnops.c:562 Process 18113 (find) thread 0xd0f22000 (3183792) shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_lookup.c:542 Process 18112 (find) thread 0xde03a5c0 (3180910) shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_lookup.c:542 Process 18111 (find) thread 0xcb0dfb80 (100268) shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_lookup.c:542 Process 18110 (find) thread 0xdd9fc2e0 (3182067) shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_lookup.c:542 Process 18109 (find) thread 0xcb0b28a0 (932100) shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_lookup.c:542 Process 18107 (umount) thread 0xde17fb80 (3181114) exclusive sleep mutex bufobj interlock (bufobj interlock) r = 0 (0xd2924668) locked @ kern/vfs_default.c:633 exclusive lockmgr devfs (devfs) r = 0 (0xd29245c8) locked @ ufs/ffs/ffs_vfsops.c:1608 exclusive lockmgr ufs (ufs) r = 0 (0xd2a42df0) locked @ kern/vfs_mount.c:1251 Process 18098 (find) thread 0xcb32b8a0 (3182287) exclusive sleep mutex buf queue lock (buf queue lock) r = 0 (0xc1281854) locked @ kern/vfs_bio.c:1551 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a22840) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xced38310) locked @ kern/vfs_subr.c:2279 Process 18097 (find) thread 0xcb30eb80 (932208) shared sx user map (user map) r = 0 (0xcc2a2300) locked @ vm/vm_map.c:3721 Process 18094 (find) thread 0xcb23d5c0 (932118) shared sx user map (user map) r = 0 (0xcddf36a0) locked @ vm/vm_map.c:3721 Process 18091 (find) thread 0xcadde5c0 (930967) shared sx user map (user map) r = 0 (0xce2c63e8) locked @ vm/vm_map.c:3721 Process 18027 (find) thread 0xcb19d2e0 (932127) shared sx user map (user map) r = 0 (0xcde7a6a0) locked @ vm/vm_map.c:3721 Process 18026 (find) thread 0xcb1785c0 (100265) exclusive sleep mutex vm page queue mutex (vm page queue mutex) r = 0 (0xc1289880) locked @ i386/i386/pmap.c:4685 exclusive sleep mutex page lock (page lock) r = 0 (0xc1288d00) locked @ vm/vm_object.c:1129 exclusive sleep mutex vm object (standard object) r = 0 (0xcbe07940) locked @ vm/vm_object.c:1077 shared sx user map (user map) r = 0 (0xcc2a2a40) locked @ vm/vm_map.c:2040 Process 7842 (sh) thread 0xd16728a0 (100332) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1adc2c0) locked @ kern/vfs_bio.c:2652 shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_syscalls.c:4181 Process 7817 (sh) thread 0xcb6c4000 (100183) shared lockmgr ufs (ufs) r = 0 (0xca7b1310) locked @ kern/vfs_syscalls.c:4181 Process 7806 (md19) thread 0xcad5c5c0 (931780) exclusive lockmgr bufwait (bufwait) r = 0 (0xe194b340) locked @ kern/vfs_bio.c:1905 exclusive lockmgr ufs (ufs) r = 0 (0xce1da310) locked @ dev/md/md.c:616 db:0:alllocks> show lockedvnods Locked vnodes 0xd2a42d98: tag ufs, type VDIR usecount 1, writecount 0, refcount 8 mountedhere 0xd61305a0 flags () v_object 0xcee641bc ref 0 pages 1 lock type ufs: EXCL by thread 0xde17fb80 (pid 18107, umount, tid 3181114) with shared waiters pending #0 0xc0a28a4e at __lockmgr_args+0xd6e #1 0xc0c8e3c1 at ffs_lock+0xa1 #2 0xc0dcf915 at VOP_LOCK1_APV+0xb5 #3 0xc0aefec8 at _vn_lock+0x78 #4 0xc0ad86bc at dounmount+0x8c #5 0xc0ad9111 at sys_unmount+0x421 #6 0xc0daab43 at syscall+0x2c3 #7 0xc0d94f31 at Xint0x80_syscall+0x21 ino 70658, on dev ada0s1a 0xca7b12b8: tag ufs, type VDIR usecount 185, writecount 0, refcount 188 mountedhere 0 flags (VV_ROOT) v_object 0xca6d84a0 ref 0 pages 1 lock type ufs: SHARED (count 7) #0 0xc0a28342 at __lockmgr_args+0x662 #1 0xc0c8e3c1 at ffs_lock+0xa1 #2 0xc0dcf915 at VOP_LOCK1_APV+0xb5 #3 0xc0aefec8 at _vn_lock+0x78 #4 0xc0ad3086 at lookup+0x106 #5 0xc0ad468f at namei+0x6bf #6 0xc0aef69f at vn_open_cred+0x31f #7 0xc0aef99b at vn_open+0x3b #8 0xc0aebbec at kern_openat+0x1ec #9 0xc0aec095 at kern_open+0x35 #10 0xc0aec0d0 at sys_open+0x30 #11 0xc0daab43 at syscall+0x2c3 #12 0xc0d94f31 at Xint0x80_syscall+0x21 ino 2, on dev ada0s1a 0xd2924570: tag devfs, type VCHR usecount 1, writecount 0, refcount 5 mountedhere 0xcafde000 flags () v_object 0xd305dcb8 ref 0 pages 10 lock type devfs: EXCL by thread 0xde17fb80 (pid 18107, umount, tid 3181114) #0 0xc0a28a4e at __lockmgr_args+0xd6e #1 0xc0acdbe5 at vop_stdlock+0x65 #2 0xc0dcf915 at VOP_LOCK1_APV+0xb5 #3 0xc0aefec8 at _vn_lock+0x78 #4 0xc0c88638 at ffs_sync+0x5f8 #5 0xc0ad8a28 at dounmount+0x3f8 #6 0xc0ad9111 at sys_unmount+0x421 #7 0xc0daab43 at syscall+0x2c3 #8 0xc0d94f31 at Xint0x80_syscall+0x21 dev md10a 0xd14b6414: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc5d7d4c ref 0 pages 1 lock type ufs: SHARED (count 1) #0 0xc0a28342 at __lockmgr_args+0x662 #1 0xc0c8e3c1 at ffs_lock+0xa1 #2 0xc0dcf915 at VOP_LOCK1_APV+0xb5 #3 0xc0aefec8 at _vn_lock+0x78 #4 0xc0af13c6 at vn_read+0x456 #5 0xc0a9069e at dofileread+0x9e #6 0xc0a90878 at kern_readv+0x68 #7 0xc0a9098f at sys_read+0x4f #8 0xc0daab43 at syscall+0x2c3 #9 0xc0d94f31 at Xint0x80_syscall+0x21 ino 4003844, on dev ada0s1e 0xce1da2b8: tag ufs, type VREG usecount 1, writecount 1, refcount 59 mountedhere 0 flags (VV_MD) v_object 0xd5ca89d4 ref 0 pages 228 lock type ufs: EXCL by thread 0xcad5c5c0 (pid 7806, md19, tid 931780) #0 0xc0a28a4e at __lockmgr_args+0xd6e #1 0xc0c8e3c1 at ffs_lock+0xa1 #2 0xc0dcf915 at VOP_LOCK1_APV+0xb5 #3 0xc0aefec8 at _vn_lock+0x78 #4 0xc077a435 at mdstart_vnode+0x405 #5 0xc07790f0 at md_kthread+0x1c0 #6 0xc0a13408 at fork_exit+0xb8 #7 0xc0d94f44 at fork_trampoline+0x8 ino 6194269, on dev ada0s1e 0xced382b8: tag ufs, type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcefb5940 ref 0 pages 1 lock type ufs: EXCL by thread 0xcb32b8a0 (pid 18098, find, tid 3182287) #0 0xc0a28a4e at __lockmgr_args+0xd6e #1 0xc0c8e3c1 at ffs_lock+0xa1 #2 0xc0dcf915 at VOP_LOCK1_APV+0xb5 #3 0xc0aefec8 at _vn_lock+0x78 #4 0xc0ae4206 at vputx+0x266 #5 0xc0ae4a50 at vrele+0x10 #6 0xc0aed655 at sys_fchdir+0x395 #7 0xc0daab43 at syscall+0x2c3 #8 0xc0d94f31 at Xint0x80_syscall+0x21 ino 3, on dev md10a db:0:lockedvnods> show mount 0xca79bb40 /dev/ad4s1a on / (ufs) 0xca79c000 devfs on /dev (devfs) 0xcaadb5a0 /dev/ad4s1f on /home (ufs) 0xcaadb000 /dev/ad4s1d on /usr (ufs) 0xca79cb40 /dev/ad4s1e on /var (ufs) 0xca79c870 procfs on /proc (procfs) 0xca79b870 /dev/label/tmp on /tmp (ufs) 0xd61305a0 /dev/md10a on /mnt10 (ufs) 0xcc1a0870 /dev/md7a on /mnt7 (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 18115 7825 4143 0 L+ *vm page 0xcb728000 find 18114 7840 4143 0 L+ *buf queu 0xcb26da00 find 18113 7830 4143 0 D+ ufs 0xd2a42df0 find 18112 7834 4143 0 D+ ufs 0xd2a42df0 find 18111 7836 4143 0 D+ ufs 0xd2a42df0 find 18110 7823 4143 0 D+ ufs 0xd2a42df0 find 18109 7832 4143 0 D+ ufs 0xd2a42df0 find 18108 7824 4143 0 D+ g_waitid 0xc1107908 umount 18107 7820 4143 0 D+ bufwait 0xe1a22840 umount 18106 7828 4143 0 R+ umount 18104 7810 4143 0 D+ g_waitid 0xc1107908 umount 18098 7811 4143 0 L+ *bufobj i 0xcb281000 find 18097 7815 4143 0 RL+ CPU 1 find 18095 7839 4143 0 R+ umount 18094 7813 4143 0 LL+ *vm page 0xcb728000 find 18093 7837 4143 0 D+ g_waitid 0xc1107908 umount 18091 7821 4143 0 LL+ *vm page 0xcb728000 find 18090 7831 4143 0 D+ g_waitid 0xc1107908 umount 18083 7816 4143 0 R+ umount 18078 7833 4143 0 D+ g_waitid 0xc1107908 umount 18068 7822 4143 0 D+ g_waitid 0xc1107908 umount 18067 7841 4143 0 D+ g_waitid 0xc1107908 umount 18065 7818 4143 0 D+ g_waitid 0xc1107908 umount 18064 7835 4143 0 D+ g_waitid 0xc1107908 umount 18063 7812 4143 0 D+ g_waitid 0xc1107908 umount 18027 7819 4143 0 LL+ *vm page 0xcb728000 find 18026 7838 4143 0 R+ find 18019 7814 4143 0 D+ g_waitid 0xc1107908 mount 17334 1202 1200 1001 S nanslp 0xc110b9a4 sleep 7842 7621 4143 0 R+ CPU 2 sh 7841 7621 4143 0 S+ wait 0xcc14c598 sh 7840 7621 4143 0 S+ wait 0xcb5d4598 sh 7839 7621 4143 0 S+ wait 0xcb476000 sh 7838 7621 4143 0 S+ wait 0xcb7dd598 sh 7837 7621 4143 0 S+ wait 0xcb31e000 sh 7836 7621 4143 0 S+ wait 0xcc1a2598 sh 7835 7621 4143 0 S+ wait 0xcb47f864 sh 7834 7621 4143 0 S+ wait 0xcac00864 sh 7833 7621 4143 0 S+ wait 0xca7f8864 sh 7832 7621 4143 0 S+ wait 0xca6c2598 sh 7831 7621 4143 0 S+ wait 0xcb0cb2cc sh 7830 7621 4143 0 S+ wait 0xcb4902cc sh 7828 7621 4143 0 S+ wait 0xcc20d598 sh 7825 7621 4143 0 S+ wait 0xcb5d3b30 sh 7824 7621 4143 0 S+ wait 0xcb8edb30 sh 7823 7621 4143 0 S+ wait 0xcb63d000 sh 7822 7621 4143 0 S+ wait 0xcc2362cc sh 7821 7621 4143 0 S+ wait 0xcb31a598 sh 7820 7621 4143 0 S+ wait 0xcb8ed2cc sh 7819 7621 4143 0 S+ wait 0xcb0d8864 sh 7818 7621 4143 0 S+ wait 0xcc1d62cc sh 7817 7621 4143 0 D+ getblk 0xe1adc2c0 sh 7816 7621 4143 0 S+ wait 0xcb0d6598 sh 7815 7621 4143 0 S+ wait 0xcb7c9000 sh 7814 7621 4143 0 S+ wait 0xcb7c42cc sh 7813 7621 4143 0 S+ wait 0xcc14d864 sh 7812 7621 4143 0 S+ wait 0xcb649000 sh 7811 7621 4143 0 S+ wait 0xcb797598 sh 7810 7621 4143 0 S+ wait 0xcc20bb30 sh 7806 0 0 0 DL biord 0xe194b2e0 [md19] 7794 0 0 0 DL mdwait 0xcb53c000 [md18] 7782 0 0 0 DL mdwait 0xcc0e5000 [md17] 7770 0 0 0 DL mdwait 0xcc0e4000 [md16] 7758 0 0 0 DL mdwait 0xced14800 [md15] 7746 0 0 0 DL mdwait 0xcb271000 [md14] 7734 0 0 0 DL mdwait 0xced14000 [md13] 7722 0 0 0 DL mdwait 0xced13800 [md12] 7710 0 0 0 DL mdwait 0xcb273000 [md11] 7698 0 0 0 DL mdwait 0xcb27f800 [md10] 7686 0 0 0 DL mdwait 0xcb27b000 [md9] 7674 0 0 0 DL mdwait 0xced13000 [md8] 7662 0 0 0 DL mdwait 0xced06000 [md7] 7650 0 0 0 DL mdwait 0xcb27b800 [md6] 7638 0 0 0 DL mdwait 0xced12800 [md5] 7621 4143 4143 0 S+ wait 0xcb47f598 sh 84446 0 0 0 DL (threaded) [zfskern] 2932215 D l2arc_fe 0xd00c3e84 [l2arc_feed_thread] 931812 D arc_recl 0xd00b4cfc [arc_reclaim_thread] 4143 1659 4143 0 S+ wait 0xcb5d32cc sh 1659 1656 1659 0 SW+ wait 0xca6c22cc bash 1656 1655 1656 0 SW+ pause 0xcb0cb058 csh 1655 1222 1655 1001 SW+ wait 0xcb0d7864 su 1594 1 1594 0 Ss+ ttyin 0xc818a670 getty 1593 1 1593 0 Ss+ ttyin 0xc818a870 getty 1592 1 1592 0 Ss+ ttyin 0xc818aa70 getty 1591 1 1591 0 Ss+ ttyin 0xc7ef5270 getty 1590 1 1590 0 Ss+ ttyin 0xc7ef5470 getty 1589 1 1589 0 Ss+ ttyin 0xc7ef5670 getty 1588 1 1588 0 Ss+ ttyin 0xc7ef5870 getty 1587 1 1587 0 Ss+ ttyin 0xc7ef5a70 getty 1586 1 1586 0 Ss+ ttyin 0xc7ef5c70 getty 1569 1 1569 0 Ss select 0xca800ae4 inetd 1544 1 1544 0 Ss nanslp 0xc110b9a4 watchdogd 1222 1221 1222 1001 SWs+ wait 0xcb0d8b30 bash 1221 1219 1219 1001 S select 0xc7edaae4 sshd 1219 1142 1219 0 Ss select 0xc95edc64 sshd 1203 1200 1200 1001 S piperd 0xcb058c80 awk 1202 1200 1200 1001 S wait 0xcb05ab30 sh 1201 1198 1201 1001 Ss+ select 0xca7ff224 top 1200 1197 1200 1001 SWs wait 0xca7f82cc sh 1199 1196 1199 1001 Ss kqread 0xca7f0b00 tail 1198 1190 1190 1001 S select 0xca7ff424 sshd 1197 1192 1192 1001 S select 0xca6d55e4 sshd 1196 1191 1191 1001 S select 0xca6d51e4 sshd 1192 1142 1192 0 Ss select 0xc95edde4 sshd 1191 1142 1191 0 Ss select 0xc95edd64 sshd 1190 1142 1190 0 Ss select 0xca800524 sshd 1153 1 1153 0 Ss nanslp 0xc110b9a4 cron 1148 1 1148 25 SWs pause 0xca7c3058 sendmail 1145 1 1145 0 Ss select 0xca7ff124 sendmail 1142 1 1142 0 Ss select 0xca8008a4 sshd 1111 1 1111 0 Ss select 0xca6d53a4 moused 1091 1 1091 0 Ss select 0xca6d5364 ntpd 1036 1031 1031 0 S (threaded) nfsd 100125 S rpcsvc 0xca6da410 nfsd: service 100124 S rpcsvc 0xca6da450 nfsd: service 100123 S rpcsvc 0xca6da490 nfsd: service 100106 S rpcsvc 0xca630d10 nfsd: master 1031 1 1031 0 Ss select 0xc95ed124 nfsd 1029 1025 1025 0 S select 0xca6d57e4 nfsuserd 1028 1025 1025 0 S select 0xca7ff8e4 nfsuserd 1027 1025 1025 0 S select 0xca7ff924 nfsuserd 1026 1025 1025 0 S select 0xca6d5824 nfsuserd 1025 1 1025 0 SWs pause 0xca7c35f0 nfsuserd 1009 1 1009 0 Ss select 0xca863024 mountd 976 1 976 0 Ss select 0xca863064 rpcbind 961 1 961 0 Ss select 0xca7ff9e4 syslogd 838 1 838 0 Ss select 0xca6d58e4 devd 19 0 0 0 DL sdflush 0xc1287e80 [softdepflush] 18 0 0 0 DL syncer 0xc1281b74 [syncer] 17 0 0 0 DL vlruwt 0xca6c1598 [vnlru] 16 0 0 0 DL psleep 0xc1281808 [bufdaemon] 9 0 0 0 DL pgzero 0xc1289d5c [pagezero] 8 0 0 0 DL psleep 0xc1289948 [vmdaemon] 7 0 0 0 DL psleep 0xc1289910 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10ce954 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc1283698 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc818f000 [ctl_thrd] 3 0 0 0 DL - 0xc7ff523c [fdc0] 2 0 0 0 SL - 0xc8086000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc805cd34 [usbus5] 100057 D - 0xc805cd04 [usbus5] 100056 D - 0xc805ccd4 [usbus5] 100055 D - 0xc805cca4 [usbus5] 100053 D - 0xc804db5c [usbus4] 100052 D - 0xc804db2c [usbus4] 100051 D - 0xc804dafc [usbus4] 100050 D - 0xc804dacc [usbus4] 100049 D - 0xc8048b5c [usbus3] 100048 D - 0xc8048b2c [usbus3] 100047 D - 0xc8048afc [usbus3] 100046 D - 0xc8048acc [usbus3] 100045 D - 0xc8041b5c [usbus2] 100044 D - 0xc8041b2c [usbus2] 100043 D - 0xc8041afc [usbus2] 100042 D - 0xc8041acc [usbus2] 100040 D - 0xc803ab5c [usbus1] 100039 D - 0xc803ab2c [usbus1] 100038 D - 0xc803aafc [usbus1] 100037 D - 0xc803aacc [usbus1] 100035 D - 0xc802fb5c [usbus0] 100034 D - 0xc802fb2c [usbus0] 100033 D - 0xc802fafc [usbus0] 100032 D - 0xc802facc [usbus0] 14 0 0 0 DL - 0xc110a7a4 [yarrow] 13 0 0 0 RL (threaded) [geom] 100016 D - 0xc11079e8 [g_down] 100015 D - 0xc11079e4 [g_up] 100014 RunQ [g_event] 12 0 0 0 WL (threaded) [intr] 100078 I [swi6: mca:scan+] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100018 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7dcbb30 [init] 10 0 0 0 DL audit_wo 0xc12875c0 [audit] 0 0 0 0 DLs (threaded) [kernel] 2932214 D - 0xca810a00 [system_taskq_3] 2932213 D - 0xca810a00 [system_taskq_2] 2931705 D - 0xca810a00 [system_taskq_1] 2930174 D - 0xca810a00 [system_taskq_0] 100068 D - 0xc110a7a4 [deadlkres] 100061 D - 0xc8084540 [fw0_taskq] 100025 D - 0xc7f5e740 [thread taskq] 100023 D - 0xc7f5e7c0 [ffs_trim taskq] 100022 D - 0xc7f5e800 [kqueue taskq] 100021 D - 0xc7f5e840 [acpi_task_2] 100020 D - 0xc7f5e840 [acpi_task_1] 100019 D - 0xc7f5e840 [acpi_task_0] 100013 D - 0xc7d9fc00 [firmware taskq] 100000 D sched 0xc1107b00 [swapper] db:0:ps> allt Tracing command find pid 18115 tid 100156 td 0xca6d12e0 sched_switch(ca6d12e0,0,103,19e,fa4efb45,...) at sched_switch+0x3fc mi_switch(103,0,c0f7944c,2e2,240,...) at mi_switch+0x1ff turnstile_wait(cb728000,cb1785c0,0,1c5,f2863b64,...) at turnstile_wait+0x4a4 _mtx_lock_sleep(c1289880,ca6d12e0,0,c0fc3d12,124d,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(c1289880,0,c0fc3d12,124d,c0fae7e1,...) at _mtx_lock_flags+0xff pmap_clear_modify(c3657dc8,0,c0fae7e1,469,0,...) at pmap_clear_modify+0x92 vm_object_madvise(d5afc940,2e7,0,2eb,0,...) at vm_object_madvise+0x3a5 vm_map_madvise(cb9032b8,28497000,2849b000,5,281ac5ac,...) at vm_map_madvise+0x283 sys_madvise(ca6d12e0,f2863cec,c0fc519c,c0f636d1,206,...) at sys_madvise+0xdb syscall(f2863d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (75, FreeBSD ELF32, sys_madvise), eip = 0x2811627b, esp = 0xbfbfdfac, ebp = 0xbfbfe048 --- Tracing command find pid 18114 tid 3183205 td 0xde02bb80 cpustop_handler(3,f2d2b8f4,c0daafd6,3,98,...) at cpustop_handler+0x26 ipi_nmi_handler(3,98,7fffffff,3,cc20b000,...) at ipi_nmi_handler+0x35 trap(f2d2b900) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0dbae6d, esp = 0xf2d2b940, ebp = 0xf2d2b984 --- DELAY(1,19,c0f7944c,cc,0,...) at DELAY+0x10d thread_lock_flags_(cb32b8a0,10,c0f7944c,cc,4,...) at thread_lock_flags_+0x24c propagate_priority(c11275e4,0,c0f7944c,2e2,240,...) at propagate_priority+0xd2 turnstile_wait(cb26da00,cb32b8a0,0,1c5,c0f8008b,...) at turnstile_wait+0x467 _mtx_lock_sleep(c1281854,de02bb80,0,c0f8008b,60f,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(c1281854,0,c0f8008b,60f,119,...) at _mtx_lock_flags+0xff bqrelse(e1b36080,99,f2d2bc40,800,0,...) at bqrelse+0x1cc ffs_read(f2d2bba4,c0fcbe13,0,0,0,...) at ffs_read+0x50b VOP_READ_APV(c10bc1a0,f2d2bba4,d14b6414,232,ca7d3ce8,...) at VOP_READ_APV+0xc5 vn_read(ca7d3ce8,f2d2bc40,c7ed6280,0,de02bb80,...) at vn_read+0x256 dofileread(f2d2bc40,ffffffff,ffffffff,0,f2d2bc1c,...) at dofileread+0x9e kern_readv(de02bb80,3,f2d2bc40,f2d2bc60,1,...) at kern_readv+0x68 sys_read(de02bb80,f2d2bcec,c0fc519c,c0f7b81f,206,...) at sys_read+0x4f syscall(f2d2bd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2805c813, esp = 0xbfbfde4c, ebp = 0xbfbfdef8 --- Tracing command find pid 18113 tid 3183792 td 0xd0f22000 sched_switch(d0f22000,0,104,1a3,e622d60f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d0f22000,0,c0f78a60,268,60,...) at sleepq_switch+0x162 sleepq_wait(d2a42df0,60,c0f69284,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d2a42df0,200100,d2a42e5c,0,0,...) at __lockmgr_args+0x593 ffs_lock(f2de08d0,c123e04c,c12818bc,200100,d2a42d98,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f2de08d0,c7d6b1e0,c10cd360,d2a42d98,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2a42d98,200100,c0f82bac,877,0,...) at _vn_lock+0x78 vget(d2a42d98,200100,d0f22000,29d,0,...) at vget+0xbb cache_lookup(ca7b12b8,f2de0afc,f2de0b10,0,0,...) at cache_lookup+0x6f8 vfs_cache_lookup(f2de0a1c,c0f838ab,c10ccfa0,200000,f2de0ad0,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10bc1a0,f2de0a1c,f2de0b10,21e,f2de09f4,...) at VOP_LOOKUP_APV+0xe5 lookup(f2de0ad0,c0f81fbe,10e,dc,f2de0a70,...) at lookup+0x6eb namei(f2de0ad0,f2de0b38,60,0,d0f22000,...) at namei+0x6bf kern_statat_vnhook(d0f22000,200,ffffff9c,28446478,0,...) at kern_statat_vnhook+0xbf kern_statat(d0f22000,200,ffffff9c,28446478,0,...) at kern_statat+0x3c kern_lstat(d0f22000,28446478,0,f2de0c00,6b,...) at kern_lstat+0x36 sys_lstat(d0f22000,f2de0cec,c0fc519c,c0f7b866,246,...) at sys_lstat+0x2f syscall(f2de0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28187af3, esp = 0xbfbfe67c, ebp = 0xbfbfe708 --- Tracing command find pid 18112 tid 3180910 td 0xde03a5c0 sched_switch(de03a5c0,0,104,1a3,e64a4348,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(de03a5c0,0,c0f78a60,268,60,...) at sleepq_switch+0x162 sleepq_wait(d2a42df0,60,c0f69284,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d2a42df0,200100,d2a42e5c,0,0,...) at __lockmgr_args+0x593 ffs_lock(f309c8d0,c1248d34,c12818bc,200100,d2a42d98,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f309c8d0,c7d6b1e0,c10cd360,d2a42d98,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2a42d98,200100,c0f82bac,877,0,...) at _vn_lock+0x78 vget(d2a42d98,200100,de03a5c0,29d,0,...) at vget+0xbb cache_lookup(ca7b12b8,f309cafc,f309cb10,0,0,...) at cache_lookup+0x6f8 vfs_cache_lookup(f309ca1c,c0f838ab,c10ccfa0,200000,f309cad0,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10bc1a0,f309ca1c,f309cb10,21e,f309c9f4,...) at VOP_LOOKUP_APV+0xe5 lookup(f309cad0,c0f81fbe,10e,dc,f309ca70,...) at lookup+0x6eb namei(f309cad0,f309cb38,60,0,de03a5c0,...) at namei+0x6bf kern_statat_vnhook(de03a5c0,200,ffffff9c,28446478,0,...) at kern_statat_vnhook+0xbf kern_statat(de03a5c0,200,ffffff9c,28446478,0,...) at kern_statat+0x3c kern_lstat(de03a5c0,28446478,0,f309cc00,6b,...) at kern_lstat+0x36 sys_lstat(de03a5c0,f309ccec,c0fc519c,c0f7b866,246,...) at sys_lstat+0x2f syscall(f309cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28187af3, esp = 0xbfbfe67c, ebp = 0xbfbfe708 --- Tracing command find pid 18111 tid 100268 td 0xcb0dfb80 sched_switch(cb0dfb80,0,104,1a3,e631bae7,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb0dfb80,0,c0f78a60,268,60,...) at sleepq_switch+0x162 sleepq_wait(d2a42df0,60,c0f69284,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d2a42df0,200100,d2a42e5c,0,0,...) at __lockmgr_args+0x593 ffs_lock(f2a328d0,c124b5c4,c12818bc,200100,d2a42d98,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f2a328d0,c7d6b1e0,c10cd360,d2a42d98,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2a42d98,200100,c0f82bac,877,0,...) at _vn_lock+0x78 vget(d2a42d98,200100,cb0dfb80,29d,0,...) at vget+0xbb cache_lookup(ca7b12b8,f2a32afc,f2a32b10,0,0,...) at cache_lookup+0x6f8 vfs_cache_lookup(f2a32a1c,c0f838ab,c10ccfa0,200000,f2a32ad0,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10bc1a0,f2a32a1c,f2a32b10,21e,f2a329f4,...) at VOP_LOOKUP_APV+0xe5 lookup(f2a32ad0,c0f81fbe,10e,dc,f2a32a70,...) at lookup+0x6eb namei(f2a32ad0,f2a32b38,60,0,cb0dfb80,...) at namei+0x6bf kern_statat_vnhook(cb0dfb80,200,ffffff9c,28446478,0,...) at kern_statat_vnhook+0xbf kern_statat(cb0dfb80,200,ffffff9c,28446478,0,...) at kern_statat+0x3c kern_lstat(cb0dfb80,28446478,0,f2a32c00,6b,...) at kern_lstat+0x36 sys_lstat(cb0dfb80,f2a32cec,c0fc519c,c0f7b866,246,...) at sys_lstat+0x2f syscall(f2a32d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28187af3, esp = 0xbfbfe67c, ebp = 0xbfbfe708 --- Tracing command find pid 18110 tid 3182067 td 0xdd9fc2e0 sched_switch(dd9fc2e0,0,104,1a3,e5729742,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(dd9fc2e0,0,c0f78a60,268,60,...) at sleepq_switch+0x162 sleepq_wait(d2a42df0,60,c0f69284,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d2a42df0,200100,d2a42e5c,0,0,...) at __lockmgr_args+0x593 ffs_lock(f2c0e8d0,c12331ac,c12818bc,200100,d2a42d98,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f2c0e8d0,c7d6b1e0,c10cd360,d2a42d98,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2a42d98,200100,c0f82bac,877,0,...) at _vn_lock+0x78 vget(d2a42d98,200100,dd9fc2e0,29d,0,...) at vget+0xbb cache_lookup(ca7b12b8,f2c0eafc,f2c0eb10,0,0,...) at cache_lookup+0x6f8 vfs_cache_lookup(f2c0ea1c,c0f838ab,c10ccfa0,200000,f2c0ead0,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10bc1a0,f2c0ea1c,f2c0eb10,21e,f2c0e9f4,...) at VOP_LOOKUP_APV+0xe5 lookup(f2c0ead0,c0f81fbe,10e,dc,f2c0ea70,...) at lookup+0x6eb namei(f2c0ead0,f2c0eb38,60,0,dd9fc2e0,...) at namei+0x6bf kern_statat_vnhook(dd9fc2e0,200,ffffff9c,28446478,0,...) at kern_statat_vnhook+0xbf kern_statat(dd9fc2e0,200,ffffff9c,28446478,0,...) at kern_statat+0x3c kern_lstat(dd9fc2e0,28446478,0,f2c0ec00,6b,...) at kern_lstat+0x36 sys_lstat(dd9fc2e0,f2c0ecec,c0fc519c,c0f7b866,246,...) at sys_lstat+0x2f syscall(f2c0ed28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28187af3, esp = 0xbfbfe67c, ebp = 0xbfbfe708 --- Tracing command find pid 18109 tid 932100 td 0xcb0b28a0 sched_switch(cb0b28a0,0,104,1a3,e6542d1c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb0b28a0,0,c0f78a60,268,60,...) at sleepq_switch+0x162 sleepq_wait(d2a42df0,60,c0f69284,4,1,...) at sleepq_wait+0x63 __lockmgr_args(d2a42df0,200100,d2a42e5c,0,0,...) at __lockmgr_args+0x593 ffs_lock(f2cef8d0,c12401a4,c12818bc,200100,d2a42d98,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f2cef8d0,c7d6b1e0,c10cd360,d2a42d98,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d2a42d98,200100,c0f82bac,877,0,...) at _vn_lock+0x78 vget(d2a42d98,200100,cb0b28a0,29d,0,...) at vget+0xbb cache_lookup(ca7b12b8,f2cefafc,f2cefb10,0,0,...) at cache_lookup+0x6f8 vfs_cache_lookup(f2cefa1c,c0f838ab,c10ccfa0,200000,f2cefad0,...) at vfs_cache_lookup+0xbd VOP_LOOKUP_APV(c10bc1a0,f2cefa1c,f2cefb10,21e,f2cef9f4,...) at VOP_LOOKUP_APV+0xe5 lookup(f2cefad0,c0f81fbe,10e,dc,f2cefa70,...) at lookup+0x6eb namei(f2cefad0,f2cefb38,60,0,cb0b28a0,...) at namei+0x6bf kern_statat_vnhook(cb0b28a0,200,ffffff9c,28446478,0,...) at kern_statat_vnhook+0xbf kern_statat(cb0b28a0,200,ffffff9c,28446478,0,...) at kern_statat+0x3c kern_lstat(cb0b28a0,28446478,0,f2cefc00,6b,...) at kern_lstat+0x36 sys_lstat(cb0b28a0,f2cefcec,c0fc519c,c0f7b866,246,...) at sys_lstat+0x2f syscall(f2cefd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28187af3, esp = 0xbfbfe67c, ebp = 0xbfbfe708 --- Tracing command umount pid 18108 tid 100245 td 0xcc17c2e0 sched_switch(cc17c2e0,0,104,1a3,e600e49d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc17c2e0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(989d6bdc,0,bfbfe144,0,cc17c2e0,...) at g_waitidle+0xc0 userret(cc17c2e0,f29edd28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f29edd28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18107 tid 3181114 td 0xde17fb80 sched_switch(de17fb80,0,104,1a3,fa4f47a8,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(de17fb80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(e1a22840,60,c0f80bb4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1a22840,80000,d2924668,0,0,...) at __lockmgr_args+0xc86 vop_stdfsync(f3081b4c,f3081ae0,0,c1091a00,f3081b4c,...) at vop_stdfsync+0xf0 devfs_fsync(f3081b4c,c0fcbd8f,d2924570,d2924570,d2924668,...) at devfs_fsync+0x7c VOP_FSYNC_APV(c1091a00,f3081b4c,c0faa230,648,d4927d98,...) at VOP_FSYNC_APV+0xc5 ffs_sync(d61305a0,1,c0f82211,51c,c7c34000,...) at ffs_sync+0x620 dounmount(d61305a0,8000000,de17fb80,49e,f3081c04,...) at dounmount+0x3f8 sys_unmount(de17fb80,f3081cec,c0fc519c,c,206,...) at sys_unmount+0x421 syscall(f3081d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18106 tid 931753 td 0xcad462e0 sched_switch(cad462e0,0,104,1a3,f9fa6467,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cad462e0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(c1d2ea9f,0,bfbfe144,0,cad462e0,...) at g_waitidle+0xc0 userret(cad462e0,f2c71d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2c71d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18104 tid 3180579 td 0xcadec2e0 sched_switch(cadec2e0,0,104,1a3,e659de93,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cadec2e0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(2e5f92e9,0,bfbfe144,0,cadec2e0,...) at g_waitidle+0xc0 userret(cadec2e0,f30c0d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f30c0d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command find pid 18098 tid 3182287 td 0xcb32b8a0 kdb_enter(c0f73050,c0f73050,c0f796c7,f2dcb9b4,0,...) at kdb_enter+0x3a panic(c0f796c7,ffffffff,46bb,cd,4,...) at panic+0x18c propagate_priority(c1127a34,0,c0f7944c,2e2,690,...) at propagate_priority+0x18f turnstile_wait(cb281000,de17fb80,0,1c5,c0a8bcfa,...) at turnstile_wait+0x467 _mtx_lock_sleep(d2924668,cb32b8a0,0,c0f8008b,613,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(d2924668,0,c0f8008b,613,4,...) at _mtx_lock_flags+0xff bqrelse(e1a227e0,0,c0f8008b,9c7,8,...) at bqrelse+0x1f6 bdwrite(e1a227e0,cd644a00,100,8000,0,...) at bdwrite+0x1e9 ffs_update(ced382b8,0,1,f2dcbb68,c123b2a0,...) at ffs_update+0x3f5 ufs_inactive(f2dcbbc0,c0fcc2a5,ced3837c,ced3837c,ced382b8,...) at ufs_inactive+0x37a VOP_INACTIVE_APV(c10bc1a0,f2dcbbc0,c0f82bac,96f,c10cd320,...) at VOP_INACTIVE_APV+0xc5 vinactive(ced3837c,0,c0f82bac,8e8,0,...) at vinactive+0xb1 vputx(f2dcbc68,c0aed655,ced382b8,c0f841a7,319,...) at vputx+0x36c vrele(ced382b8,c0f841a7,319,316,f2dcbc54,...) at vrele+0x10 sys_fchdir(cb32b8a0,f2dcbcec,c0fc519c,c0f7b8dd,246,...) at sys_fchdir+0x395 syscall(f2dcbd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (13, FreeBSD ELF32, sys_fchdir), eip = 0x280ee05b, esp = 0xbfbfe61c, ebp = 0xbfbfe6a8 --- Tracing command find pid 18097 tid 932208 td 0xcb30eb80 cpustop_handler(1,f2e858d4,c0daafd6,159d25a,c0dba315,...) at cpustop_handler+0x26 ipi_nmi_handler(159d25a,c0dba315,0,1,cb7dd864,...) at ipi_nmi_handler+0x35 trap(f2e858e0) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0dbae6d, esp = 0xf2e85920, ebp = 0xf2e85964 --- DELAY(1,c0a8c007,c0f7af3a,c1250ec8,cb30ec30,...) at DELAY+0x10d _mtx_lock_spin(c11275e4,cb30eb80,0,c0f7944c,224,...) at _mtx_lock_spin+0x14c _mtx_lock_spin_flags(c11275e4,0,c0f7944c,224,c1289880,...) at _mtx_lock_spin_flags+0x156 turnstile_trywait(c1289880,c7d6ba68,c0a8c007,c0f7af3a,f2e85a4c,...) at turnstile_trywait+0x3f _mtx_lock_sleep(c1289880,cb30eb80,0,c0fc3d12,d07,...) at _mtx_lock_sleep+0x1a9 _mtx_lock_flags(c1289880,0,c0fc3d12,d07,f2e85a74,...) at _mtx_lock_flags+0xff pmap_enter(cc2a2368,2866d000,2,c4b52740,3,...) at pmap_enter+0xb6 vm_fault_hold(cc2a22b8,2866d000,2,0,0,...) at vm_fault_hold+0x1adc vm_fault(cc2a22b8,2866d000,2,0,2866d000,...) at vm_fault+0x46 trap_pfault(c1119980,14,c0f75122,777,cb7dd864,...) at trap_pfault+0x1b9 trap(f2e85d28) at trap+0x2a9 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28197ddf, esp = 0xbfbfe4a0, ebp = 0xbfbfe538 --- Tracing command umount pid 18095 tid 928155 td 0xcadebb80 sched_switch(cadebb80,0,104,1a3,e5340263,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cadebb80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(588e5133,0,bfbfe144,0,cadebb80,...) at g_waitidle+0xc0 userret(cadebb80,f2bedd28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2bedd28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command find pid 18094 tid 932118 td 0xcb23d5c0 sched_switch(cb23d5c0,0,103,19e,fa516e61,...) at sched_switch+0x3fc mi_switch(103,0,c0f7944c,2e2,240,...) at mi_switch+0x1ff turnstile_wait(cb728000,cb1785c0,0,1c5,f2d25a4c,...) at turnstile_wait+0x4a4 _mtx_lock_sleep(c1289880,cb23d5c0,0,c0fc3d12,d07,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(c1289880,0,c0fc3d12,d07,f2d25a74,...) at _mtx_lock_flags+0xff pmap_enter(cddf3708,28607000,2,c2b3bd38,3,...) at pmap_enter+0xb6 vm_fault_hold(cddf3658,28607000,2,0,0,...) at vm_fault_hold+0x1adc vm_fault(cddf3658,28607000,2,0,28607000,...) at vm_fault+0x46 trap_pfault(c1109710,0,c0fc50f2,305,cb63d598,...) at trap_pfault+0x1b9 trap(f2d25d28) at trap+0x2a9 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28197ddf, esp = 0xbfbfe4a0, ebp = 0xbfbfe538 --- Tracing command umount pid 18093 tid 100329 td 0xcc235b80 sched_switch(cc235b80,0,104,1a3,e5ffc973,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc235b80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(bb3a2024,0,bfbfe144,0,cc235b80,...) at g_waitidle+0xc0 userret(cc235b80,f2b06d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2b06d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command find pid 18091 tid 930967 td 0xcadde5c0 sched_switch(cadde5c0,0,103,19e,fa53434f,...) at sched_switch+0x3fc mi_switch(103,0,c0f7944c,2e2,240,...) at mi_switch+0x1ff turnstile_wait(cb728000,cb1785c0,0,1c5,f2c14a4c,...) at turnstile_wait+0x4a4 _mtx_lock_sleep(c1289880,cadde5c0,0,c0fc3d12,d07,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(c1289880,0,c0fc3d12,d07,f2c14a74,...) at _mtx_lock_flags+0xff pmap_enter(ce2c6450,285ee000,2,c5704a88,3,...) at pmap_enter+0xb6 vm_fault_hold(ce2c63a0,285ee000,2,0,0,...) at vm_fault_hold+0x1adc vm_fault(ce2c63a0,285ee000,2,0,285ee004,...) at vm_fault+0x46 trap_pfault(c1109710,0,c0fc50f2,305,cb26a864,...) at trap_pfault+0x1b9 trap(f2c14d28) at trap+0x2a9 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2810e462, esp = 0xbfbfe430, ebp = 0xbfbfe4a8 --- Tracing command umount pid 18090 tid 100331 td 0xcd96ab80 sched_switch(cd96ab80,0,104,1a3,e5fc7b0f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cd96ab80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(51d7b574,0,bfbfe144,0,cd96ab80,...) at g_waitidle+0xc0 userret(cd96ab80,f2b0cd28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2b0cd28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18083 tid 100237 td 0xcc17f8a0 sched_switch(cc17f8a0,0,104,1a3,f3e610d7,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc17f8a0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(f502c5e0,0,bfbfe144,0,cc17f8a0,...) at g_waitidle+0xc0 userret(cc17f8a0,f29d5d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f29d5d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18078 tid 680744 td 0xcab2b8a0 sched_switch(cab2b8a0,0,104,1a3,f29e891e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cab2b8a0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(a5858482,0,bfbfe144,0,cab2b8a0,...) at g_waitidle+0xc0 userret(cab2b8a0,f2bccd28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2bccd28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18068 tid 3183817 td 0xde1f2b80 sched_switch(de1f2b80,0,104,1a3,f9637291,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(de1f2b80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(d0ba1367,0,bfbfe144,0,de1f2b80,...) at g_waitidle+0xc0 userret(de1f2b80,f2c1ad28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2c1ad28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18067 tid 100233 td 0xcc1805c0 sched_switch(cc1805c0,0,104,1a3,e5f4ebb3,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc1805c0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(d1974747,0,bfbfe144,0,cc1805c0,...) at g_waitidle+0xc0 userret(cc1805c0,f29c9d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f29c9d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18065 tid 100338 td 0xcd96a2e0 sched_switch(cd96a2e0,0,104,1a3,e7c91e9d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cd96a2e0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(541e8584,0,bfbfe144,0,cd96a2e0,...) at g_waitidle+0xc0 userret(cd96a2e0,f2b21d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2b21d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18064 tid 100222 td 0xcc1708a0 sched_switch(cc1708a0,0,104,1a3,f2a02290,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc1708a0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(2711bdd1,0,bfbfe144,0,cc1708a0,...) at g_waitidle+0xc0 userret(cc1708a0,f29a8d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f29a8d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command umount pid 18063 tid 100275 td 0xcc1ebb80 sched_switch(cc1ebb80,0,104,1a3,f138a87d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc1ebb80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(a9f6bcfb,0,bfbfe144,0,cc1ebb80,...) at g_waitidle+0xc0 userret(cc1ebb80,f2a47d28,c0fc519c,c0fa6fb2,206,...) at userret+0x43 syscall(f2a47d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280e7f9b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Tracing command find pid 18027 tid 932127 td 0xcb19d2e0 sched_switch(cb19d2e0,0,103,19e,fa50497a,...) at sched_switch+0x3fc mi_switch(103,0,c0f7944c,2e2,240,...) at mi_switch+0x1ff turnstile_wait(cb728000,cb1785c0,0,1c5,f2d5aa4c,...) at turnstile_wait+0x4a4 _mtx_lock_sleep(c1289880,cb19d2e0,0,c0fc3d12,d07,...) at _mtx_lock_sleep+0x23c _mtx_lock_flags(c1289880,0,c0fc3d12,d07,f2d5aa74,...) at _mtx_lock_flags+0xff pmap_enter(cde7a708,286e9000,2,c3361c98,3,...) at pmap_enter+0xb6 vm_fault_hold(cde7a658,286e9000,2,0,0,...) at vm_fault_hold+0x1adc vm_fault(cde7a658,286e9000,2,0,286e9000,...) at vm_fault+0x46 trap_pfault(c1109710,0,c0fc50f2,305,cb63a864,...) at trap_pfault+0x1b9 trap(f2d5ad28) at trap+0x2a9 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28197ddf, esp = 0xbfbfe4a0, ebp = 0xbfbfe538 --- Tracing command find pid 18026 tid 100265 td 0xcb1785c0 sched_switch(cb1785c0,0,602,19e,fa4ecfb9,...) at sched_switch+0x3fc mi_switch(602,0,c0f7389f,cd,0,...) at mi_switch+0x1ff critical_exit(cb1785c0,0,0,c5dc60c0,c5dc60c0,...) at critical_exit+0xb5 ipi_bitmap_handler(8,28,28,cbe07940,c5dc60c0,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0xc0da5d90, esp = 0xf2a29b8c, ebp = 0xf2a29bb4 --- pmap_clear_modify(c5dc60c0,0,c0fae7e1,469,0,...) at pmap_clear_modify+0xc0 vm_object_madvise(cbe07940,331,0,336,0,...) at vm_object_madvise+0x3a5 vm_map_madvise(cc2a29f8,284d6000,284e6000,5,281ac5ac,...) at vm_map_madvise+0x283 sys_madvise(cb1785c0,f2a29cec,1be275a,cb6c4000,206,...) at sys_madvise+0xdb syscall(f2a29d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (75, FreeBSD ELF32, sys_madvise), eip = 0x2811627b, esp = 0xbfbfe4ac, ebp = 0xbfbfe548 --- Tracing command mount pid 18019 tid 100242 td 0xcc17cb80 sched_switch(cc17cb80,0,104,1a3,f2a492d3,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cc17cb80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107908,74,c0f66c4f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107908,c110790c,74,c0f66c4f,c8,...) at _sleep+0x36a g_waitidle(0,0,bfbfd894,0,cc17cb80,...) at g_waitidle+0xc0 userret(cc17cb80,f29e4d28,c0fc519c,c0fa6fb3,207,...) at userret+0x43 syscall(f29e4d28) at syscall+0x4c4 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x280fabbb, esp = 0xbfbfd86c, ebp = 0xbfbfddc8 --- Tracing command sleep pid 17334 tid 100319 td 0xcc23cb80 sched_switch(cc23cb80,0,104,1a3,e1eda818,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cc23cb80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a823c0,cc23cb80,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110b9a4,6c,c0f745b7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110b9a4,0,16c,c0f745b7,2711,...) at _sleep+0x34f kern_nanosleep(cc23cb80,f2acbc4c,f2acbc54,a,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cc23cb80,f2acbcec,c0fc519c,c0f7c226,246,...) at sys_nanosleep+0x6f syscall(f2acbd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816e223, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command sh pid 7842 tid 100332 td 0xd16728a0 cpustop_handler(2,f27308c4,c0daafd6,0,c0f82bac,...) at cpustop_handler+0x26 ipi_nmi_handler(0,c0f82bac,1be,ca7b12b8,cc1a5b30,...) at ipi_nmi_handler+0x35 trap(f27308d0) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0dba315, esp = 0xf2730910, ebp = 0xf2730910 --- get_tsc(c0fe1d60,0,f4240,0,1,...) at get_tsc+0x5 DELAY(1,1bdfdec,1be2757,cadde5c0,d16728a0,...) at DELAY+0xdb _mtx_lock_spin(cb26da00,d16728a0,0,c0f7944c,227,...) at _mtx_lock_spin+0x14c _mtx_lock_spin_flags(cb26da00,0,c0f7944c,227,c1281854,...) at _mtx_lock_spin_flags+0x156 turnstile_trywait(c1281854,c7d6e308,f2730a10,c0a4b3f7,c1109710,...) at turnstile_trywait+0x77 _mtx_lock_sleep(c1281854,d16728a0,0,c0f8008b,60f,...) at _mtx_lock_sleep+0x1a9 _mtx_lock_flags(c1281854,0,c0f8008b,60f,400,...) at _mtx_lock_flags+0xff bqrelse(e1adc260,400,f2730be8,800,0,...) at bqrelse+0x1cc ffs_read(f2730b80,c0fcbe13,0,0,f2730c08,...) at ffs_read+0x50b VOP_READ_APV(c10bc1a0,f2730b80,c0dcbab5,0,f2730be8,...) at VOP_READ_APV+0xc5 ufs_readdir(f2730c08,c0fcbd4a,0,0,ca7b12b8,...) at ufs_readdir+0xe3 VOP_READDIR_APV(c10bc1a0,f2730c08,c0f841a7,1055,f2730c30,...) at VOP_READDIR_APV+0xc5 kern_getdirentries(d16728a0,3,284ca000,1000,f2730c5c,...) at kern_getdirentries+0x230 sys_getdirentries(d16728a0,f2730cec,c0fc519c,c,246,...) at sys_getdirentries+0x31 syscall(f2730d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x28177e8f, esp = 0xbfbfe4dc, ebp = 0xbfbfe508 --- Tracing command sh pid 7841 tid 100227 td 0xcc16f8a0 sched_switch(cc16f8a0,0,104,1a3,c993a173,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cc16f8a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc14c598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc14c598,cc14c620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cc16f8a0,ffffffff,f29b7c5c,2,0,...) at kern_wait+0x597 sys_wait4(cc16f8a0,f29b7cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f29b7d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7840 tid 100176 td 0xcb0dc2e0 sched_switch(cb0dc2e0,0,104,1a3,fa05dda2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb0dc2e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb5d4598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb5d4598,cb5d4620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb0dc2e0,ffffffff,f28b4c5c,2,0,...) at kern_wait+0x597 sys_wait4(cb0dc2e0,f28b4cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f28b4d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7839 tid 3182389 td 0xd1661b80 sched_switch(d1661b80,0,104,1a3,d58eb5c7,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d1661b80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb476000,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb476000,cb476088,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(d1661b80,ffffffff,f30b4c5c,2,0,...) at kern_wait+0x597 sys_wait4(d1661b80,f30b4cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f30b4d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7838 tid 932209 td 0xcb30e000 sched_switch(cb30e000,0,104,1a3,ba9a5633,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb30e000,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb7dd598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb7dd598,cb7dd620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb30e000,ffffffff,f2e88c5c,2,0,...) at kern_wait+0x597 sys_wait4(cb30e000,f2e88cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2e88d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7837 tid 925109 td 0xcad465c0 sched_switch(cad465c0,0,104,1a3,d5739730,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cad465c0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb31e000,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb31e000,cb31e088,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cad465c0,ffffffff,f2be1c5c,2,0,...) at kern_wait+0x597 sys_wait4(cad465c0,f2be1cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2be1d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7836 tid 3181624 td 0xde1048a0 sched_switch(de1048a0,0,104,1a3,e5733ff5,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(de1048a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc1a2598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc1a2598,cc1a2620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(de1048a0,ffffffff,f2e2bc5c,2,0,...) at kern_wait+0x597 sys_wait4(de1048a0,f2e2bcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2e2bd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7835 tid 3183154 td 0xde127000 sched_switch(de127000,0,104,1a3,c8eda4e0,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(de127000,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb47f864,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb47f864,cb47f8ec,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(de127000,ffffffff,f30bac5c,2,0,...) at kern_wait+0x597 sys_wait4(de127000,f30bacec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f30bad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7834 tid 3168712 td 0xcf59f2e0 sched_switch(cf59f2e0,0,104,1a3,e594f1c0,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cf59f2e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cac00864,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cac00864,cac008ec,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cf59f2e0,ffffffff,f3069c5c,2,0,...) at kern_wait+0x597 sys_wait4(cf59f2e0,f3069cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f3069d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7833 tid 3180655 td 0xcd21f000 sched_switch(cd21f000,0,104,1a3,ce7c8f9b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cd21f000,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7f8864,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7f8864,ca7f88ec,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cd21f000,ffffffff,f30b7c5c,2,0,...) at kern_wait+0x597 sys_wait4(cd21f000,f30b7cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f30b7d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7832 tid 100102 td 0xca6d62e0 sched_switch(ca6d62e0,0,104,1a3,e4d03d8e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6d62e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6c2598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca6c2598,ca6c2620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(ca6d62e0,ffffffff,f275dc5c,2,0,...) at kern_wait+0x597 sys_wait4(ca6d62e0,f275dcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f275dd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7831 tid 100137 td 0xca8038a0 sched_switch(ca8038a0,0,104,1a3,d36d4371,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca8038a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb0cb2cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb0cb2cc,cb0cb354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(ca8038a0,ffffffff,f2824c5c,2,0,...) at kern_wait+0x597 sys_wait4(ca8038a0,f2824cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2824d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7830 tid 932098 td 0xcb0b2b80 sched_switch(cb0b2b80,0,104,1a3,e5cb031f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb0b2b80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb4902cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb4902cc,cb490354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb0b2b80,ffffffff,f2ce9c5c,2,0,...) at kern_wait+0x597 sys_wait4(cb0b2b80,f2ce9cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2ce9d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7828 tid 3181191 td 0xde1f28a0 sched_switch(de1f28a0,0,104,1a3,d812af4b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(de1f28a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc20d598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc20d598,cc20d620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(de1f28a0,ffffffff,f30ccc5c,2,0,...) at kern_wait+0x597 sys_wait4(de1f28a0,f30cccec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f30ccd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7825 tid 100179 td 0xcb6c4b80 sched_switch(cb6c4b80,0,104,1a3,fa0c9a38,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb6c4b80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb5d3b30,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb5d3b30,cb5d3bb8,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb6c4b80,ffffffff,f28bdc5c,2,0,...) at kern_wait+0x597 sys_wait4(cb6c4b80,f28bdcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f28bdd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7824 tid 3183282 td 0xdde15b80 sched_switch(dde15b80,0,104,1a3,dccd0515,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(dde15b80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb8edb30,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb8edb30,cb8edbb8,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(dde15b80,ffffffff,f2ce0c5c,2,0,...) at kern_wait+0x597 sys_wait4(dde15b80,f2ce0cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2ce0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7823 tid 3180987 td 0xcabb3000 sched_switch(cabb3000,0,104,1a3,e4d82295,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cabb3000,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb63d000,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb63d000,cb63d088,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cabb3000,ffffffff,f3093c5c,2,0,...) at kern_wait+0x597 sys_wait4(cabb3000,f3093cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f3093d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7822 tid 100325 td 0xcc23b8a0 sched_switch(cc23b8a0,0,104,1a3,caa08f1d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cc23b8a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc2362cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc2362cc,cc236354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cc23b8a0,ffffffff,f2addc5c,2,0,...) at kern_wait+0x597 sys_wait4(cc23b8a0,f2addcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2addd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7821 tid 927319 td 0xcb02ab80 sched_switch(cb02ab80,0,104,1a3,d54e6564,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb02ab80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb31a598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb31a598,cb31a620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb02ab80,ffffffff,f2beac5c,2,0,...) at kern_wait+0x597 sys_wait4(cb02ab80,f2beacec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2bead28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7820 tid 932205 td 0xcacce5c0 sched_switch(cacce5c0,0,104,1a3,db7e3f93,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cacce5c0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb8ed2cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb8ed2cc,cb8ed354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cacce5c0,ffffffff,f2e7cc5c,2,0,...) at kern_wait+0x597 sys_wait4(cacce5c0,f2e7ccec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2e7cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7819 tid 100154 td 0xca6d18a0 sched_switch(ca6d18a0,0,104,1a3,baa1b8ca,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6d18a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb0d8864,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb0d8864,cb0d88ec,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(ca6d18a0,ffffffff,f285dc5c,2,0,...) at kern_wait+0x597 sys_wait4(ca6d18a0,f285dcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f285dd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7818 tid 100264 td 0xcb1788a0 sched_switch(cb1788a0,0,104,1a3,c9467966,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb1788a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc1d62cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc1d62cc,cc1d6354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb1788a0,ffffffff,f2a26c5c,2,0,...) at kern_wait+0x597 sys_wait4(cb1788a0,f2a26cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2a26d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7817 tid 100183 td 0xcb6c4000 sched_switch(cb6c4000,0,104,1a3,fa4d4058,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb6c4000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(e1adc2c0,60,c0f6af14,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1adc2c0,81900,ca7b13b0,c0f6af14,60,...) at __lockmgr_args+0xc86 getblk(ca7b12b8,0,0,800,0,...) at getblk+0x167 breadn_flags(ca7b12b8,0,0,800,0,...) at breadn_flags+0x43 ffs_read(f28d1b80,c0fcbe13,0,0,f28d1c08,...) at ffs_read+0x301 VOP_READ_APV(c10bc1a0,f28d1b80,c0dcbab5,0,f28d1be8,...) at VOP_READ_APV+0xc5 ufs_readdir(f28d1c08,c0fcbd4a,0,0,ca7b12b8,...) at ufs_readdir+0xe3 VOP_READDIR_APV(c10bc1a0,f28d1c08,c0f841a7,1055,f28d1c30,...) at VOP_READDIR_APV+0xc5 kern_getdirentries(cb6c4000,3,284ca000,1000,f28d1c5c,...) at kern_getdirentries+0x230 sys_getdirentries(cb6c4000,f28d1cec,c0fc519c,c,246,...) at sys_getdirentries+0x31 syscall(f28d1d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x28177e8f, esp = 0xbfbfe4dc, ebp = 0xbfbfe508 --- Tracing command sh pid 7816 tid 3184072 td 0xde1b6b80 sched_switch(de1b6b80,0,104,1a3,cfad5e4c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(de1b6b80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb0d6598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb0d6598,cb0d6620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(de1b6b80,ffffffff,f2bffc5c,2,0,...) at kern_wait+0x597 sys_wait4(de1b6b80,f2bffcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2bffd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7815 tid 932148 td 0xcacff2e0 sched_switch(cacff2e0,0,104,1a3,d5dbdffa,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cacff2e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb7c9000,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb7c9000,cb7c9088,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cacff2e0,ffffffff,f2dd1c5c,2,0,...) at kern_wait+0x597 sys_wait4(cacff2e0,f2dd1cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2dd1d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7814 tid 932157 td 0xcb33b2e0 sched_switch(cb33b2e0,0,104,1a3,b8727bce,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb33b2e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb7c42cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb7c42cc,cb7c4354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb33b2e0,ffffffff,f2decc5c,2,0,...) at kern_wait+0x597 sys_wait4(cb33b2e0,f2deccec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2decd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7813 tid 3183409 td 0xcb8c12e0 sched_switch(cb8c12e0,0,104,1a3,d57baa5f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb8c12e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc14d864,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc14d864,cc14d8ec,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb8c12e0,ffffffff,f2d37c5c,2,0,...) at kern_wait+0x597 sys_wait4(cb8c12e0,f2d37cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2d37d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7812 tid 932110 td 0xcb2b9b80 sched_switch(cb2b9b80,0,104,1a3,c90acfa4,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb2b9b80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb649000,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb649000,cb649088,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb2b9b80,ffffffff,f2d0dc5c,2,0,...) at kern_wait+0x597 sys_wait4(cb2b9b80,f2d0dcec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2d0dd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command sh pid 7811 tid 932176 td 0xcb209000 sched_switch(cb209000,0,104,1a3,d5b043e6,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb209000,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb797598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb797598,cb797620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb209000,ffffffff,f2e25c5c,2,0,...) at kern_wait+0x597 sys_wait4(cb209000,f2e25cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2e25d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command sh pid 7810 tid 100288 td 0xcc2148a0 sched_switch(cc2148a0,0,104,1a3,d7a96390,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cc2148a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc20bb30,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc20bb30,cc20bbb8,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cc2148a0,ffffffff,f2a6ec5c,2,0,...) at kern_wait+0x597 sys_wait4(cc2148a0,f2a6ecec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2a6ed28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe51c, ebp = 0xbfbfe538 --- Tracing command md19 pid 7806 tid 931780 td 0xcad5c5c0 sched_switch(cad5c5c0,0,104,1a3,f9fbd675,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cad5c5c0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(e194b2e0,5c,c0f80435,0,0,...) at sleepq_wait+0x63 _sleep(e194b2e0,c7d859d4,5c,c0f80435,0,...) at _sleep+0x39c bwait(e194b2e0,5c,c0f80435,e194b2e0,f2c89b7c,...) at bwait+0x6f bufwait(e194b2e0,e194b2e0,0,4000,0,...) at bufwait+0x28 cluster_read(ce1da2b8,100000,0,10,0,...) at cluster_read+0x785 ffs_read(f2c89c8c,c0fcbe13,cad5c5c0,f2c89c8c,ce1da2b8,...) at ffs_read+0x369 VOP_READ_APV(c10bc1a0,f2c89c8c,c0f19bd5,268,0,...) at VOP_READ_APV+0xc5 mdstart_vnode(cb519800,ca5bd7b8,c0f19bd5,2fe,0,...) at mdstart_vnode+0x43a md_kthread(cb519800,f2c89d28,c0f6d330,3d8,cb31e2cc,...) at md_kthread+0x1c0 fork_exit(c0778f30,cb519800,f2c89d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2c89d60, ebp = 0 --- Tracing command md18 pid 7794 tid 100121 td 0xc81822e0 sched_switch(c81822e0,0,104,1a3,e52de0ce,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c81822e0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb53c000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cb53c000,cb53c020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cb53c000,f27e0d28,c0f6d330,3d8,ca85e598,...) at md_kthread+0x11a fork_exit(c0778f30,cb53c000,f27e0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf27e0d60, ebp = 0 --- Tracing command md17 pid 7782 tid 100296 td 0xcc1568a0 sched_switch(cc1568a0,0,104,1a3,e5db8ff1,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cc1568a0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cc0e5000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cc0e5000,cc0e5020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cc0e5000,f2a86d28,c0f6d330,3d8,cc22e864,...) at md_kthread+0x11a fork_exit(c0778f30,cc0e5000,f2a86d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2a86d60, ebp = 0 --- Tracing command md16 pid 7770 tid 3181293 td 0xcf8c1b80 sched_switch(cf8c1b80,0,104,1a3,db677a94,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cf8c1b80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cc0e4000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cc0e4000,cc0e4020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cc0e4000,f3072d28,c0f6d330,3d8,cb05a598,...) at md_kthread+0x11a fork_exit(c0778f30,cc0e4000,f3072d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf3072d60, ebp = 0 --- Tracing command md15 pid 7758 tid 3184123 td 0xde1ea5c0 sched_switch(de1ea5c0,0,104,1a3,dca9ecae,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(de1ea5c0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ced14800,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(ced14800,ced14820,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(ced14800,f2dd7d28,c0f6d330,3d8,cb63c2cc,...) at md_kthread+0x11a fork_exit(c0778f30,ced14800,f2dd7d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2dd7d60, ebp = 0 --- Tracing command md14 pid 7746 tid 3183384 td 0xde147000 sched_switch(de147000,0,104,1a3,e5f4c422,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(de147000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb271000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cb271000,cb271020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cb271000,f2d60d28,c0f6d330,3d8,cb5d6864,...) at md_kthread+0x11a fork_exit(c0778f30,cb271000,f2d60d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2d60d60, ebp = 0 --- Tracing command md13 pid 7734 tid 932168 td 0xcb1f08a0 sched_switch(cb1f08a0,0,104,1a3,e0508e96,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb1f08a0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ced14000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(ced14000,ced14020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(ced14000,f2e0dd28,c0f6d330,3d8,cb7c1000,...) at md_kthread+0x11a fork_exit(c0778f30,ced14000,f2e0dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2e0dd60, ebp = 0 --- Tracing command md12 pid 7722 tid 932130 td 0xcb361b80 sched_switch(cb361b80,0,104,1a3,e53fa99e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb361b80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ced13800,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(ced13800,ced13820,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(ced13800,f2d63d28,c0f6d330,3d8,cb63a000,...) at md_kthread+0x11a fork_exit(c0778f30,ced13800,f2d63d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2d63d60, ebp = 0 --- Tracing command md11 pid 7710 tid 3181420 td 0xdd36f000 sched_switch(dd36f000,0,104,1a3,df0c1ea7,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(dd36f000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb273000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cb273000,cb273020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cb273000,f3063d28,c0f6d330,3d8,cb9602cc,...) at md_kthread+0x11a fork_exit(c0778f30,cb273000,f3063d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf3063d60, ebp = 0 --- Tracing command md10 pid 7698 tid 3180334 td 0xdd9dd5c0 sched_switch(dd9dd5c0,0,104,1a3,fa4e668d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(dd9dd5c0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb27f800,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cb27f800,cb27f820,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cb27f800,f30d2d28,c0f6d330,3d8,cb4b3864,...) at md_kthread+0x11a fork_exit(c0778f30,cb27f800,f30d2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf30d2d60, ebp = 0 --- Tracing command md9 pid 7686 tid 3181038 td 0xde03ab80 sched_switch(de03ab80,0,104,1a3,d234a8c1,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(de03ab80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb27b000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cb27b000,cb27b020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cb27b000,f308ad28,c0f6d330,3d8,cb4a7864,...) at md_kthread+0x11a fork_exit(c0778f30,cb27b000,f308ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf308ad60, ebp = 0 --- Tracing command md8 pid 7674 tid 100360 td 0xcdd9b5c0 sched_switch(cdd9b5c0,0,104,1a3,dbb6898f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cdd9b5c0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ced13000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(ced13000,ced13020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(ced13000,f2b63d28,c0f6d330,3d8,cb85ab30,...) at md_kthread+0x11a fork_exit(c0778f30,ced13000,f2b63d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2b63d60, ebp = 0 --- Tracing command md7 pid 7662 tid 3182874 td 0xdde158a0 sched_switch(dde158a0,0,104,1a3,e267ac23,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(dde158a0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ced06000,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(ced06000,ced06020,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(ced06000,f2e6ad28,c0f6d330,3d8,ca85a000,...) at md_kthread+0x11a fork_exit(c0778f30,ced06000,f2e6ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2e6ad60, ebp = 0 --- Tracing command md6 pid 7650 tid 3182848 td 0xd0ab02e0 sched_switch(d0ab02e0,0,104,1a3,d7bba303,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(d0ab02e0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb27b800,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(cb27b800,cb27b820,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(cb27b800,f2c68d28,c0f6d330,3d8,cb05bb30,...) at md_kthread+0x11a fork_exit(c0778f30,cb27b800,f2c68d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2c68d60, ebp = 0 --- Tracing command md5 pid 7638 tid 100097 td 0xca6d7000 sched_switch(ca6d7000,0,104,1a3,e654a98b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(ca6d7000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ced12800,5c,c0f19c82,0,0,...) at sleepq_wait+0x63 _sleep(ced12800,ced12820,25c,c0f19c82,0,...) at _sleep+0x39c md_kthread(ced12800,f2748d28,c0f6d330,3d8,ca7c32cc,...) at md_kthread+0x11a fork_exit(c0778f30,ced12800,f2748d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2748d60, ebp = 0 --- Tracing command sh pid 7621 tid 931207 td 0xcb32b2e0 sched_switch(cb32b2e0,0,104,1a3,9cd0b5d2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb32b2e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb47f598,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb47f598,cb47f620,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb32b2e0,ffffffff,f2c1dc5c,2,0,...) at kern_wait+0x597 sys_wait4(cb32b2e0,f2c1dcec,c0fc519c,c,216,...) at sys_wait4+0x3b syscall(f2c1dd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe69c, ebp = 0xbfbfe6b8 --- Tracing command zfskern pid 84446 tid 2932215 td 0xcabb35c0 sched_switch(cabb35c0,0,104,1a3,de577a27,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cabb35c0,0,c0f78a60,28b,cabb35c0,...) at sleepq_switch+0x162 sleepq_timedwait(d00c3e84,0,f2ebcbb4,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(d00c3e84,d00c3e70,3e8,0,69622f74,...) at _cv_timedwait+0x270 l2arc_feed_thread(0,f2ebcd28,c0f6d330,3d8,cb4cd864,...) at l2arc_feed_thread+0x204 fork_exit(cff957e0,0,f2ebcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2ebcd60, ebp = 0 --- Tracing command zfskern pid 84446 tid 931812 td 0xcb2df2e0 sched_switch(cb2df2e0,0,104,1a3,a0a52d3e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb2df2e0,0,c0f78a60,28b,cb2df2e0,...) at sleepq_switch+0x162 sleepq_timedwait(d00b4cfc,0,f2ca7c68,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(d00b4cfc,d00b4ce8,3e8,0,dd8e0f69,...) at _cv_timedwait+0x270 arc_reclaim_thread(0,f2ca7d28,c0f6d330,3d8,cb4cd864,...) at arc_reclaim_thread+0x28e fork_exit(cff95380,0,f2ca7d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2ca7d60, ebp = 0 --- Tracing command sh pid 4143 tid 100182 td 0xcb6c42e0 sched_switch(cb6c42e0,0,104,1a3,94123aba,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb6c42e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb5d32cc,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb5d32cc,cb5d3354,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cb6c42e0,ffffffff,f28cec5c,2,0,...) at kern_wait+0x597 sys_wait4(cb6c42e0,f28cecec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f28ced28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe71c, ebp = 0xbfbfe738 --- Tracing command bash pid 1659 tid 100103 td 0xca6d6000 Tracing command csh pid 1656 tid 100140 td 0xca8035c0 Tracing command su pid 1655 tid 100159 td 0xcb17b5c0 Tracing command getty pid 1594 tid 100136 td 0xca803b80 sched_switch(ca803b80,0,104,1a3,1e97da3f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca803b80,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,ca803b80,ca803b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c818a670,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c818a670,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c818a600,c818a670,f2821c40,1,0,...) at tty_wait+0x71 ttydisc_read(c818a600,f2821c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8189100,f2821c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cb0d3a10,f2821c40,c7dafe00,0,ca803b80,...) at devfs_read_f+0x7e dofileread(f2821c40,ffffffff,ffffffff,0,f2821c1c,...) at dofileread+0x9e kern_readv(ca803b80,0,f2821c40,f2821c60,1,...) at kern_readv+0x68 sys_read(ca803b80,f2821cec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f2821d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1593 tid 100086 td 0xca8655c0 sched_switch(ca8655c0,0,104,1a3,1ebfc312,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8655c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,ca8655c0,ca8655c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c818a870,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c818a870,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c818a800,c818a870,f271cc40,1,0,...) at tty_wait+0x71 ttydisc_read(c818a800,f271cc40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8189200,f271cc40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7d3118,f271cc40,c7dafe00,0,ca8655c0,...) at devfs_read_f+0x7e dofileread(f271cc40,ffffffff,ffffffff,0,f271cc1c,...) at dofileread+0x9e kern_readv(ca8655c0,0,f271cc40,f271cc60,1,...) at kern_readv+0x68 sys_read(ca8655c0,f271ccec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f271cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1592 tid 100147 td 0xcb0df000 sched_switch(cb0df000,0,104,1a3,1ecd46ac,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb0df000,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,cb0df000,cb0df000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c818aa70,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c818aa70,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c818aa00,c818aa70,f2842c40,1,0,...) at tty_wait+0x71 ttydisc_read(c818aa00,f2842c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8189300,f2842c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7d3770,f2842c40,c7dafe00,0,cb0df000,...) at devfs_read_f+0x7e dofileread(f2842c40,ffffffff,ffffffff,0,f2842c1c,...) at dofileread+0x9e kern_readv(cb0df000,0,f2842c40,f2842c60,1,...) at kern_readv+0x68 sys_read(cb0df000,f2842cec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f2842d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1591 tid 100095 td 0xca8018a0 sched_switch(ca8018a0,0,104,1a3,1ef2f5b6,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8018a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,ca8018a0,ca8018a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef5270,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef5270,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef5200,c7ef5270,f2740c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef5200,f2740c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8189400,f2740c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca830508,f2740c40,c7dafe00,0,ca8018a0,...) at devfs_read_f+0x7e dofileread(f2740c40,ffffffff,ffffffff,0,f2740c1c,...) at dofileread+0x9e kern_readv(ca8018a0,0,f2740c40,f2740c60,1,...) at kern_readv+0x68 sys_read(ca8018a0,f2740cec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f2740d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1590 tid 100167 td 0xcb178b80 sched_switch(cb178b80,0,104,1a3,1f0d5056,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb178b80,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,cb178b80,cb178b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef5470,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef5470,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef5400,c7ef5470,f2896c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef5400,f2896c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8189500,f2896c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7d3230,f2896c40,c7dafe00,0,cb178b80,...) at devfs_read_f+0x7e dofileread(f2896c40,ffffffff,ffffffff,0,f2896c1c,...) at dofileread+0x9e kern_readv(cb178b80,0,f2896c40,f2896c60,1,...) at kern_readv+0x68 sys_read(cb178b80,f2896cec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f2896d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1589 tid 100109 td 0xca85f8a0 sched_switch(ca85f8a0,0,104,1a3,1ed2d407,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca85f8a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,ca85f8a0,ca85f8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef5670,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef5670,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef5600,c7ef5670,f278dc40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef5600,f278dc40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8189600,f278dc40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca80f540,f278dc40,c7dafe00,0,ca85f8a0,...) at devfs_read_f+0x7e dofileread(f278dc40,ffffffff,ffffffff,0,f278dc1c,...) at dofileread+0x9e kern_readv(ca85f8a0,0,f278dc40,f278dc60,1,...) at kern_readv+0x68 sys_read(ca85f8a0,f278dcec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f278dd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1588 tid 100108 td 0xca85fb80 sched_switch(ca85fb80,0,104,1a3,1efdb585,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca85fb80,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,ca85fb80,ca85fb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef5870,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef5870,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef5800,c7ef5870,f2789c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef5800,f2789c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c806e500,f2789c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca830b98,f2789c40,c7dafe00,0,ca85fb80,...) at devfs_read_f+0x7e dofileread(f2789c40,ffffffff,ffffffff,0,f2789c1c,...) at dofileread+0x9e kern_readv(ca85fb80,0,f2789c40,f2789c60,1,...) at kern_readv+0x68 sys_read(ca85fb80,f2789cec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f2789d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1587 tid 100150 td 0xcb0de5c0 sched_switch(cb0de5c0,0,104,1a3,1efc68f0,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb0de5c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,cb0de5c0,cb0de5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef5a70,0,c0f7d8c4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef5a70,c1109710,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef5a00,c7ef5a70,f284bc40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef5a00,f284bc40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c806e600,f284bc40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca830930,f284bc40,c7dafe00,0,cb0de5c0,...) at devfs_read_f+0x7e dofileread(f284bc40,ffffffff,ffffffff,0,f284bc1c,...) at dofileread+0x9e kern_readv(cb0de5c0,0,f284bc40,f284bc60,1,...) at kern_readv+0x68 sys_read(cb0de5c0,f284bcec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f284bd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1586 tid 100160 td 0xcb17b2e0 sched_switch(cb17b2e0,0,104,1a3,df772c0d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb17b2e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,c7ef5c04,0,c0f712f3,cb17b2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef5c70,0,f2872aec,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef5c70,c7ef5c04,c0f7d29c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef5c00,c7ef5c70,f2872c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef5c00,f2872c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7ed7d00,f2872c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7d3150,f2872c40,c7dafe00,0,cb17b2e0,...) at devfs_read_f+0x7e dofileread(f2872c40,ffffffff,ffffffff,0,f2872c1c,...) at dofileread+0x9e kern_readv(cb17b2e0,0,f2872c40,f2872c60,1,...) at kern_readv+0x68 sys_read(cb17b2e0,f2872cec,c0fc519c,c0ddee76,246,...) at sys_read+0x4f syscall(f2872d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 1569 tid 100155 td 0xca6d15c0 sched_switch(ca6d15c0,0,104,1a3,10cd40ab,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6d15c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca800ad0,0,c0f712f3,ca6d15c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca800ae4,0,f2860a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca800ae4,ca800ad0,c0f7b1b4,6ae,ca830888,...) at _cv_wait_sig+0x260 seltdwait(ca830888,58,c7dafe00,ca6d15c0,1,...) at seltdwait+0xa2 kern_select(ca6d15c0,8,bfbfdfa0,0,0,0,20,cb0d8598,4) at kern_select+0x655 sys_select(ca6d15c0,f2860cec,c0fc519c,c0f7b9f1,202,...) at sys_select+0x66 syscall(f2860d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8663, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 1544 tid 100143 td 0xca8032e0 sched_switch(ca8032e0,0,104,1a3,4c9acf4c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca8032e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a823c0,ca8032e0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110b9a4,6c,c0f745b7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110b9a4,0,16c,c0f745b7,ea61,...) at _sleep+0x34f kern_nanosleep(ca8032e0,f2836c4c,f2836c54,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca8032e0,f2836cec,c0fc519c,c0ddee76,206,...) at sys_nanosleep+0x6f syscall(f2836d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819e223, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 1222 tid 100144 td 0xca6d1b80 Tracing command sshd pid 1221 tid 100122 td 0xcac048a0 sched_switch(cac048a0,0,104,1a3,8ec40c62,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac048a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,c7edaad0,0,c0f712f3,cac048a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7edaae4,0,f27e3a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7edaae4,c7edaad0,c0f7b1b4,6ae,ca80f070,...) at _cv_wait_sig+0x260 seltdwait(ca80f070,58,ca6ce980,cac048a0,f27e3ac8,...) at seltdwait+0xa2 kern_select(cac048a0,c,288060b8,288060c0,0,0,20,ca85e2cc,0) at kern_select+0x655 sys_select(cac048a0,f27e3cec,c0fc519c,c0f7baf9,206,...) at sys_select+0x66 syscall(f27e3d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1219 tid 100129 td 0xcac03b80 sched_switch(cac03b80,0,104,1a3,35849554,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac03b80,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,c95edc50,0,c0f712f3,cac03b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c95edc64,0,f2809ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c95edc64,c95edc50,c0f7b1b4,6ae,f2809b40,...) at _cv_wait_sig+0x260 seltdwait(ca871e2c,c0f7b1b4,5ab,cac03b80,8,...) at seltdwait+0xa2 sys_poll(cac03b80,f2809cec,c0fc519c,c0f636d1,202,...) at sys_poll+0x321 syscall(f2809d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command awk pid 1203 tid 100133 td 0xcac03000 sched_switch(cac03000,0,104,1a3,e1bd2127,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cac03000,0,c0f78a60,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb058c80,5c,c0f7b3e3,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb058c80,cb058df8,15c,c0f7b3e3,0,...) at _sleep+0x385 pipe_read(ca80f4d0,f2818c40,ca6ced00,0,cac03000,...) at pipe_read+0x427 dofileread(f2818c40,ffffffff,ffffffff,0,f2818c1c,...) at dofileread+0x9e kern_readv(cac03000,0,f2818c40,f2818c60,1,...) at kern_readv+0x68 sys_read(cac03000,f2818cec,c0fc519c,c0dda143,216,...) at sys_read+0x4f syscall(f2818d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c86e3, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 1202 tid 100132 td 0xcac032e0 sched_switch(cac032e0,0,104,1a3,e1d06f76,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac032e0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb05ab30,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb05ab30,cb05abb8,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(cac032e0,ffffffff,f2815c5c,2,0,...) at kern_wait+0x597 sys_wait4(cac032e0,f2815cec,c0fc519c,c0f7b984,216,...) at sys_wait4+0x3b syscall(f2815d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command top pid 1201 tid 100131 td 0xcac035c0 sched_switch(cac035c0,0,104,1a3,b97ebfbe,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac035c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2812a1c,c0a30a4a,ca7ff210,0,cac035c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7ff224,0,f2812a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7ff224,ca7ff210,3e9,6ae,ca7d43b8,...) at _cv_timedwait_sig+0x270 seltdwait(f2812c0c,f2812c14,c7ed6d00,cac035c0,31325b1b,...) at seltdwait+0x8a kern_select(cac035c0,2,bfbfebac,0,0,f2812c58,20,1,0) at kern_select+0x655 sys_select(cac035c0,f2812cec,c0fc519c,c0f4c3e2,246,...) at sys_select+0x66 syscall(f2812d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fd663, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command sh pid 1200 tid 100096 td 0xca8015c0 Tracing command tail pid 1199 tid 100118 td 0xc8182b80 sched_switch(c8182b80,0,104,1a3,de4e8f45,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,68,...) at mi_switch+0x1ff sleepq_switch(c8182b80,0,c0f78a60,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a823c0,c8182b80,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7f0b00,68,c0f6ceee,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(ca7f0b00,ca7f0b00,168,c0f6ceee,3e9,...) at _sleep+0x34f kern_kevent(c8182b80,4,0,1,f27d7c40,...) at kern_kevent+0x374 sys_kevent(c8182b80,f27d7cec,1be2655,cac038a0,286,...) at sys_kevent+0x19e syscall(f27d7d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2817213b, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sshd pid 1198 tid 100080 td 0xca803000 sched_switch(ca803000,0,104,1a3,b982d2d2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca803000,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca7ff410,0,c0f712f3,ca803000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7ff424,0,f2704a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7ff424,ca7ff410,c0f7b1b4,6ae,ca7d38f8,...) at _cv_wait_sig+0x260 seltdwait(ca7d38f8,58,ca6ce200,ca803000,f2704ac8,...) at seltdwait+0xa2 kern_select(ca803000,a,288060b8,288060c0,0,0,20,ca7fab30,0) at kern_select+0x655 sys_select(ca803000,f2704cec,c0fc519c,c0f7baf9,206,...) at sys_select+0x66 syscall(f2704d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1197 tid 100100 td 0xca6d68a0 sched_switch(ca6d68a0,0,104,1a3,aa5b731f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6d68a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca6d55d0,0,c0f712f3,ca6d68a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6d55e4,0,f2754a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6d55e4,ca6d55d0,c0f7b1b4,6ae,ca7d3c08,...) at _cv_wait_sig+0x260 seltdwait(ca7d3c08,58,ca7f0280,ca6d68a0,f2754ac8,...) at seltdwait+0xa2 kern_select(ca6d68a0,c,288060b8,288060c0,0,0,20,ca6c2b30,0) at kern_select+0x655 sys_select(ca6d68a0,f2754cec,c0fc519c,c0f7baf9,206,...) at sys_select+0x66 syscall(f2754d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1196 tid 100130 td 0xcac038a0 sched_switch(cac038a0,0,104,1a3,de4e5dda,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac038a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca6d51d0,0,c0f712f3,cac038a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6d51e4,0,f280ea54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6d51e4,ca6d51d0,c0f7b1b4,6ae,ca80f578,...) at _cv_wait_sig+0x260 seltdwait(ca80f578,58,ca612980,cac038a0,f280eac8,...) at seltdwait+0xa2 kern_select(cac038a0,c,288060b8,288060c0,0,0,20,cb05b2cc,0) at kern_select+0x655 sys_select(cac038a0,f280ecec,c0fc519c,c0f7baf9,206,...) at sys_select+0x66 syscall(f280ed28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1192 tid 100119 td 0xc81828a0 sched_switch(c81828a0,0,104,1a3,7e8920af,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81828a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,c95eddd0,0,c0f712f3,c81828a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c95edde4,0,f27daab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c95edde4,c95eddd0,c0f7b1b4,6ae,f27dab40,...) at _cv_wait_sig+0x260 seltdwait(ca6c372c,c0f7b1b4,5ab,c81828a0,0,...) at seltdwait+0xa2 sys_poll(c81828a0,f27dacec,c0fc519c,c0dda143,202,...) at sys_poll+0x321 syscall(f27dad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 1191 tid 100099 td 0xca8012e0 sched_switch(ca8012e0,0,104,1a3,7e86b2a9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8012e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,c95edd50,0,c0f712f3,ca8012e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c95edd64,0,f2750ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c95edd64,c95edd50,c0f7b1b4,6ae,f2750b40,...) at _cv_wait_sig+0x260 seltdwait(ca87162c,c0f7b1b4,5ab,ca8012e0,0,...) at seltdwait+0xa2 sys_poll(ca8012e0,f2750cec,c0fc519c,c0dda143,202,...) at sys_poll+0x321 syscall(f2750d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 1190 tid 100093 td 0xca8648a0 sched_switch(ca8648a0,0,104,1a3,804a7775,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8648a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca800510,0,c0f712f3,ca8648a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca800524,0,f2738ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca800524,ca800510,c0f7b1b4,6ae,f2738b40,...) at _cv_wait_sig+0x260 seltdwait(cab2782c,c0f7b1b4,5ab,ca8648a0,0,...) at seltdwait+0xa2 sys_poll(ca8648a0,f2738cec,c0fc519c,c,202,...) at sys_poll+0x321 syscall(f2738d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command cron pid 1153 tid 100082 td 0xca8028a0 sched_switch(ca8028a0,0,104,1a3,a3f23609,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca8028a0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a823c0,ca8028a0,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110b9a4,6c,c0f745b7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110b9a4,0,16c,c0f745b7,ea61,...) at _sleep+0x34f kern_nanosleep(ca8028a0,f270cc4c,f270cc54,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca8028a0,f270ccec,c0fc519c,c0f7be52,206,...) at sys_nanosleep+0x6f syscall(f270cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28190223, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 1148 tid 100098 td 0xca6d6b80 Tracing command sendmail pid 1145 tid 100107 td 0xca864000 sched_switch(ca864000,0,104,1a3,94892f27,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca864000,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2785a1c,c0a30a4a,ca7ff110,0,ca864000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7ff124,0,f2785a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7ff124,ca7ff110,1389,6ae,cc241e38,...) at _cv_timedwait_sig+0x270 seltdwait(f2785c0c,f2785c14,ca824080,ca864000,c0a2d28d,...) at seltdwait+0x8a kern_select(ca864000,5,bfbfc510,0,0,f2785c58,20,5,0) at kern_select+0x655 sys_select(ca864000,f2785cec,c0fc519c,c0f7bdb1,206,...) at sys_select+0x66 syscall(f2785d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f4663, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 1142 tid 100089 td 0xca865000 sched_switch(ca865000,0,104,1a3,3313d951,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca865000,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca800890,0,c0f712f3,ca865000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca8008a4,0,f2728a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca8008a4,ca800890,c0f7b1b4,6ae,ca818658,...) at _cv_wait_sig+0x260 seltdwait(ca818658,58,ca7f0980,ca865000,c0cafbbe,...) at seltdwait+0xa2 kern_select(ca865000,9,2880c0b8,0,0,0,20,ca85d864,a) at kern_select+0x655 sys_select(ca865000,f2728cec,c0fc519c,c,206,...) at sys_select+0x66 syscall(f2728d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 1111 tid 100084 td 0xca8022e0 sched_switch(ca8022e0,0,104,1a3,1acbdec2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8022e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca6d5390,0,c0f712f3,ca8022e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6d53a4,0,f2714a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6d53a4,ca6d5390,c0f7b1b4,6ae,ca818af0,...) at _cv_wait_sig+0x260 seltdwait(ca818af0,58,c7dafe00,ca8022e0,f6,...) at seltdwait+0xa2 kern_select(ca8022e0,400,bfbfea04,0,0,0,20,ca7fa000,1) at kern_select+0x655 sys_select(ca8022e0,f2714cec,c0fc519c,c0ddee76,246,...) at sys_select+0x66 syscall(f2714d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c5663, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1091 tid 100087 td 0xca8652e0 sched_switch(ca8652e0,0,104,1a3,e9158488,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8652e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca6d5350,0,c0f712f3,ca8652e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6d5364,0,f2720a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6d5364,ca6d5350,c0f7b1b4,6ae,ca8180a8,...) at _cv_wait_sig+0x260 seltdwait(ca8180a8,58,c7dafe00,ca8652e0,0,...) at seltdwait+0xa2 kern_select(ca8652e0,1c,bfbfece8,0,0,0,20,ca85db30,0) at kern_select+0x655 sys_select(ca8652e0,f2720cec,c0fc519c,c0f7c238,202,...) at sys_select+0x66 syscall(f2720d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28373663, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1036 tid 100125 td 0xca7fb8a0 sched_switch(ca7fb8a0,0,104,1a3,b2080482,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7fb8a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27ecbe0,c0a30a4a,c803e880,0,ca7fb8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6da410,0,f27ecc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6da410,c803e880,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f27ecd14,c0a13408,c803e880,f27ecd28,c0f6d330,...) at svc_run_internal+0x356 svc_thread_start(c803e880,f27ecd28,c0f6d330,3d8,c8038864,...) at svc_thread_start+0x10 fork_exit(c0c338f0,c803e880,f27ecd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1036 tid 100124 td 0xca7fbb80 sched_switch(ca7fbb80,0,104,1a3,b275b884,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7fbb80,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27e9be0,c0a30a4a,c803e880,0,ca7fbb80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6da450,0,f27e9c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6da450,c803e880,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f27e9d14,c0a13408,c803e880,f27e9d28,c0f6d330,...) at svc_run_internal+0x356 svc_thread_start(c803e880,f27e9d28,c0f6d330,3d8,c8038864,...) at svc_thread_start+0x10 fork_exit(c0c338f0,c803e880,f27e9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1036 tid 100123 td 0xca801000 sched_switch(ca801000,0,104,1a3,11858191,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca801000,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27e6be0,c0a30a4a,c803e880,0,ca801000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6da490,0,f27e6c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6da490,c803e880,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f27e6d14,c0a13408,c803e880,f27e6d28,c0f6d330,...) at svc_run_internal+0x356 svc_thread_start(c803e880,f27e6d28,c0f6d330,3d8,c8038864,...) at svc_thread_start+0x10 fork_exit(c0c338f0,c803e880,f27e6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1036 tid 100106 td 0xca6cd5c0 sched_switch(ca6cd5c0,0,104,1a3,11859dc0,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd5c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2781494,c0a30a4a,c803e880,0,ca6cd5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca630d10,0,f27814cc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca630d10,c803e880,1388,3b1,f2781514,...) at _cv_timedwait_sig+0x270 svc_run_internal(ca6cd770,14,c0fa283a,c0f64bdb,f278180c,...) at svc_run_internal+0x356 svc_run(c803e880,0,c0f64bb6,19f,c0a8e12c,...) at svc_run+0x7b nfsrvd_nfsd(ca6cd5c0,f278180c,c,c0a8e12c,c7d6a3a8,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(ca6cd5c0,f2781cec,bfbfe870,ca6cd5c0,f2781d1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(ca6cd5c0,f2781cec,c0fc519c,c0f7bdb1,206,...) at sys_nfssvc+0xeb syscall(f2781d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e8a9b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1031 tid 100104 td 0xca8642e0 sched_switch(ca8642e0,0,104,1a3,b46a6707,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8642e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,c95ed110,0,c0f712f3,ca8642e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c95ed124,0,f2773a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c95ed124,c95ed110,c0f7b1b4,6ae,ca8185e8,...) at _cv_wait_sig+0x260 seltdwait(ca8185e8,58,c7dafe00,ca8642e0,58,...) at seltdwait+0xa2 kern_select(ca8642e0,7,bfbfecb4,0,0,0,20,ca85ab30,7) at kern_select+0x655 sys_select(ca8642e0,f2773cec,c0fc519c,c0f636d1,202,...) at sys_select+0x66 syscall(f2773d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192663, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command nfsuserd pid 1029 tid 100115 td 0xca6cb5c0 sched_switch(ca6cb5c0,0,104,1a3,f00bf645,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cb5c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27cea1c,c0a30a4a,ca6d57d0,0,ca6cb5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6d57e4,0,f27cea54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6d57e4,ca6d57d0,7531,6ae,ca80f818,...) at _cv_timedwait_sig+0x270 seltdwait(f27cec0c,f27cec14,c7dafe00,ca6cb5c0,c0cafbbe,...) at seltdwait+0x8a kern_select(ca6cb5c0,4,bfbfebc4,0,0,f27cec58,20,1e,0) at kern_select+0x655 sys_select(ca6cb5c0,f27cecec,c0fc519c,c0f7bae2,202,...) at sys_select+0x66 syscall(f27ced28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1028 tid 100111 td 0xca6cd2e0 sched_switch(ca6cd2e0,0,104,1a3,cbad240f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd2e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27c2a1c,c0a30a4a,ca7ff8d0,0,ca6cd2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7ff8e4,0,f27c2a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7ff8e4,ca7ff8d0,7531,6ae,ca80f818,...) at _cv_timedwait_sig+0x270 seltdwait(f27c2c0c,f27c2c14,c7dafe00,ca6cd2e0,c0cafbbe,...) at seltdwait+0x8a kern_select(ca6cd2e0,4,bfbfebc4,0,0,f27c2c58,20,1e,0) at kern_select+0x655 sys_select(ca6cd2e0,f27c2cec,c0fc519c,c0f7bae2,202,...) at sys_select+0x66 syscall(f27c2d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1027 tid 100114 td 0xca6cb8a0 sched_switch(ca6cb8a0,0,104,1a3,aaf9c269,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cb8a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27cba1c,c0a30a4a,ca7ff910,0,ca6cb8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7ff924,0,f27cba54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7ff924,ca7ff910,7531,6ae,ca80f818,...) at _cv_timedwait_sig+0x270 seltdwait(f27cbc0c,f27cbc14,c7dafe00,ca6cb8a0,c0cafbbe,...) at seltdwait+0x8a kern_select(ca6cb8a0,4,bfbfebc4,0,0,f27cbc58,20,1e,0) at kern_select+0x655 sys_select(ca6cb8a0,f27cbcec,c0fc519c,c0f7bae2,202,...) at sys_select+0x66 syscall(f27cbd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1026 tid 100113 td 0xca6cbb80 sched_switch(ca6cbb80,0,104,1a3,a12f0264,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cbb80,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27c8a1c,c0a30a4a,ca6d5810,0,ca6cbb80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6d5824,0,f27c8a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6d5824,ca6d5810,7531,6ae,ca80f818,...) at _cv_timedwait_sig+0x270 seltdwait(f27c8c0c,f27c8c14,c7dafe00,ca6cbb80,c0cafbbe,...) at seltdwait+0x8a kern_select(ca6cbb80,4,bfbfebc4,0,0,f27c8c58,20,1e,0) at kern_select+0x655 sys_select(ca6cbb80,f27c8cec,c0fc519c,c0f7bae2,202,...) at sys_select+0x66 syscall(f27c8d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1025 tid 100092 td 0xca6d72e0 Tracing command mountd pid 1009 tid 100116 td 0xca6cb2e0 sched_switch(ca6cb2e0,0,104,1a3,df252d20,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cb2e0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca863010,0,c0f712f3,ca6cb2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca863024,0,f27d1a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca863024,ca863010,c0f7b1b4,6ae,ca818230,...) at _cv_wait_sig+0x260 seltdwait(ca818230,58,c7dafe00,ca6cb2e0,47d,...) at seltdwait+0xa2 kern_select(ca6cb2e0,9,bfbfed04,0,0,0,20,cabfe598,bfbfed04) at kern_select+0x655 sys_select(ca6cb2e0,f27d1cec,c0fc519c,c0f62937,206,...) at sys_select+0x66 syscall(f27d1d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa663, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 976 tid 100083 td 0xca8025c0 sched_switch(ca8025c0,0,104,1a3,8eaca4fb,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8025c0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2710a80,c0a30a4a,ca863050,0,ca8025c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca863064,0,f2710ab8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca863064,ca863050,7531,6ae,f2710b70,...) at _cv_timedwait_sig+0x270 seltdwait(f2710c40,f2710c48,5ab,ca8025c0,5,...) at seltdwait+0x8a sys_poll(ca8025c0,f2710cec,c0fc519c,c0f7bae2,212,...) at sys_poll+0x321 syscall(f2710d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a33b, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 961 tid 100105 td 0xca6cd8a0 sched_switch(ca6cd8a0,0,104,1a3,f29e439b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd8a0,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca7ff9d0,0,c0f712f3,ca6cd8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7ff9e4,0,f2778a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7ff9e4,ca7ff9d0,c0f7b1b4,6ae,ca7d44d0,...) at _cv_wait_sig+0x260 seltdwait(ca7d44d0,58,c7dafe00,ca6cd8a0,58,...) at seltdwait+0xa2 kern_select(ca6cd8a0,9,2847f0ac,0,0,0,20,c8038b30,0) at kern_select+0x655 sys_select(ca6cd8a0,f2778cec,c0fc519c,c0dda143,246,...) at sys_select+0x66 syscall(f2778d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a9663, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 838 tid 100117 td 0xca6cb000 sched_switch(ca6cb000,0,104,1a3,c6c8b8b5,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cb000,0,c0f78a60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a4a,ca6d58d0,0,c0f712f3,ca6cb000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6d58e4,0,f27d4a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6d58e4,ca6d58d0,c0f7b1b4,6ae,ca7d4700,...) at _cv_wait_sig+0x260 seltdwait(ca7d4700,58,c7dafe00,ca6cb000,c1254948,...) at seltdwait+0xa2 kern_select(ca6cb000,5,bfbfe960,0,0,0,20,cabfe2cc,46) at kern_select+0x655 sys_select(ca6cb000,f27d4cec,c0fc519c,c0dda143,206,...) at sys_select+0x66 syscall(f27d4d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809169b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100077 td 0xca6cdb80 sched_switch(ca6cdb80,0,104,1a3,da5b7e3a,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(ca6cdb80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1287e80,54,c0fa98af,0,0,...) at sleepq_timedwait+0x6b _sleep(c1287e80,c1287e40,54,c0fa98af,3e8,...) at _sleep+0x36a softdep_flush(0,ee321d28,c0f6d330,3d8,ca6c1000,...) at softdep_flush+0x266 fork_exit(c0c834b0,0,ee321d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee321d60, ebp = 0 --- Tracing command syncer pid 18 tid 100076 td 0xc80568a0 sched_switch(c80568a0,0,104,1a3,de566422,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80568a0,0,c0f78a60,28b,c80568a0,...) at sleepq_switch+0x162 sleepq_timedwait(c1281b74,0,ee31ec78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c1281b74,c1281b60,3e8,78b,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee31ed28,c0f6d330,3d8,ca6c12cc,...) at sched_sync+0x595 fork_exit(c0ae2cc0,0,ee31ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ed60, ebp = 0 --- Tracing command vnlru pid 17 tid 100075 td 0xc8056b80 sched_switch(c8056b80,0,104,1a3,b23dd8a9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(c8056b80,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca6c1598,60,c0f83b14,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6c1598,c1281b34,260,c0f83b14,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31bd28,c0f6d330,3d8,ca6c1598,...) at vnlru_proc+0xe7 fork_exit(c0ae3950,0,ee31bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31bd60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100074 td 0xc8180000 sched_switch(c8180000,0,104,1a3,da710645,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c8180000,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1281808,54,c0f809d2,0,0,...) at sleepq_timedwait+0x6b _sleep(c1281808,c1281810,54,c0f809d2,3e8,...) at _sleep+0x36a buf_daemon(0,ee318d28,c0f6d330,3d8,ca6c1864,...) at buf_daemon+0x175 fork_exit(c0ac71a0,0,ee318d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee318d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100073 td 0xc81802e0 sched_switch(c81802e0,0,104,1a3,df392316,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81802e0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1289d5c,0,c0fb0986,0,0,...) at sleepq_timedwait+0x6b _sleep(c1289d5c,c1288800,0,c0fb0986,493e0,...) at _sleep+0x36a vm_pagezero(0,ee315d28,c0f6d330,3d8,ca6c1b30,...) at vm_pagezero+0xdc fork_exit(c0cca300,0,ee315d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee315d60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100072 td 0xc81805c0 sched_switch(c81805c0,0,104,1a3,4f11383,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(c81805c0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1289948,74,c0f809d2,0,0,...) at sleepq_wait+0x63 _sleep(c1289948,c128994c,74,c0f809d2,0,...) at _sleep+0x39c vm_daemon(0,ee312d28,c0f6d330,3d8,ca6c2000,...) at vm_daemon+0x59 fork_exit(c0cc3c50,0,ee312d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee312d60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100071 td 0xc81808a0 sched_switch(c81808a0,0,104,1a3,91168167,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c81808a0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1289910,54,c0f809d2,0,0,...) at sleepq_timedwait+0x6b _sleep(c1289910,c1288800,54,c0f809d2,1388,...) at _sleep+0x36a vm_pageout(0,ee30fd28,c0f6d330,3d8,c7dcc2cc,...) at vm_pageout+0x2c7 fork_exit(c0cc4cd0,0,ee30fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee30fd60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100070 td 0xc8180b80 sched_switch(c8180b80,0,104,1a3,ebfc6727,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8180b80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10ce954,5c,c0dd4947,0,0,...) at sleepq_wait+0x63 _sleep(c10ce954,c10ce998,5c,c0dd4947,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18cd28,c0f6d330,3d8,c7dcc598,...) at xpt_scanner_thread+0x47 fork_exit(c049e280,0,ee18cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18cd60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100069 td 0xc8181000 sched_switch(c8181000,0,104,1a3,428f9453,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8181000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1283698,0,c0f9767f,0,0,...) at sleepq_wait+0x63 _sleep(c1283698,c1283660,0,c0f9767f,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee189d28,c0f6d330,3d8,c7dcc864,...) at sctp_iterator_thread+0x5c fork_exit(c0b75a50,0,ee189d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee189d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc81815c0 sched_switch(c81815c0,0,104,1a3,d99c3d93,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c81815c0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c818f000,5c,c0ddf352,0,0,...) at sleepq_wait+0x63 _sleep(c818f000,c818f000,5c,c0ddf352,0,...) at _sleep+0x39c ctl_work_thread(c818f000,ee183d28,c0f6d330,3d8,c7dccb30,...) at ctl_work_thread+0x22f6 fork_exit(c04c7720,c818f000,ee183d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee183d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc8182000 sched_switch(c8182000,0,104,1a3,aeb3911e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8182000,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c7ff523c,5c,c0f65652,0,0,...) at sleepq_timedwait+0x6b _sleep(c7ff523c,c7ff52f0,5c,c0f65652,3e8,...) at _sleep+0x36a fdc_thread(c7ff5200,ee17ad28,c0f6d330,3d8,c8038000,...) at fdc_thread+0x27d fork_exit(c0d4c580,c7ff5200,ee17ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17ad60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80475c0 sched_switch(c80475c0,0,104,1a3,ebfca028,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c80475c0,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8086000,6c,c0f65652,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8086000,c808a488,16c,c0f65652,0,...) at _sleep+0x385 fw_bus_probe_thread(c8086000,ee16ad28,c0f6d330,3d8,c80382cc,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f72e0,c8086000,ee16ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16ad60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc80542e0 sched_switch(c80542e0,0,104,1a3,d997104b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80542e0,0,c0f78a60,268,c80542e0,...) at sleepq_switch+0x162 sleepq_wait(c805cd34,0,ee153cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805cd34,c805ce4c,c0f56cd1,74,c805cd3c,...) at _cv_wait+0x260 usb_process(c805cd2c,ee153d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c805cd2c,ee153d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee153d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc80545c0 sched_switch(c80545c0,0,104,1a3,9dc508c6,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80545c0,0,c0f78a60,268,c80545c0,...) at sleepq_switch+0x162 sleepq_wait(c805cd04,0,ee150cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805cd04,c805ce4c,c0f56cd1,74,c805cd0c,...) at _cv_wait+0x260 usb_process(c805ccfc,ee150d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c805ccfc,ee150d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee150d60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc80548a0 sched_switch(c80548a0,0,104,1a3,d9305e76,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80548a0,0,c0f78a60,268,c80548a0,...) at sleepq_switch+0x162 sleepq_wait(c805ccd4,0,ee14dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805ccd4,c805ce4c,c0f56cd1,74,c805ccdc,...) at _cv_wait+0x260 usb_process(c805cccc,ee14dd28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c805cccc,ee14dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14dd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8054b80 sched_switch(c8054b80,0,104,1a3,d9304ca8,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8054b80,0,c0f78a60,268,c8054b80,...) at sleepq_switch+0x162 sleepq_wait(c805cca4,0,ee14acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805cca4,c805ce4c,c0f56cd1,74,c805ccac,...) at _cv_wait+0x260 usb_process(c805cc9c,ee14ad28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c805cc9c,ee14ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14ad60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc80562e0 sched_switch(c80562e0,0,104,1a3,d9303938,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80562e0,0,c0f78a60,268,c80562e0,...) at sleepq_switch+0x162 sleepq_wait(c804db5c,0,ee141cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804db5c,c804dc74,c0f56cd1,74,c804db64,...) at _cv_wait+0x260 usb_process(c804db54,ee141d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c804db54,ee141d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee141d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc80565c0 sched_switch(c80565c0,0,104,1a3,9dc38ebc,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80565c0,0,c0f78a60,268,c80565c0,...) at sleepq_switch+0x162 sleepq_wait(c804db2c,0,ee13ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804db2c,c804dc74,c0f56cd1,74,c804db34,...) at _cv_wait+0x260 usb_process(c804db24,ee13ed28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c804db24,ee13ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ed60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8045000 sched_switch(c8045000,0,104,1a3,d8cc8294,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8045000,0,c0f78a60,268,c8045000,...) at sleepq_switch+0x162 sleepq_wait(c804dafc,0,ee13bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804dafc,c804dc74,c0f56cd1,74,c804db04,...) at _cv_wait+0x260 usb_process(c804daf4,ee13bd28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c804daf4,ee13bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13bd60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc80452e0 sched_switch(c80452e0,0,104,1a3,d8cc7125,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80452e0,0,c0f78a60,268,c80452e0,...) at sleepq_switch+0x162 sleepq_wait(c804dacc,0,ee138cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804dacc,c804dc74,c0f56cd1,74,c804dad4,...) at _cv_wait+0x260 usb_process(c804dac4,ee138d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c804dac4,ee138d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee138d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc80455c0 sched_switch(c80455c0,0,104,1a3,d8cc5c7b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80455c0,0,c0f78a60,268,c80455c0,...) at sleepq_switch+0x162 sleepq_wait(c8048b5c,0,ee134cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048b5c,c8048c74,c0f56cd1,74,c8048b64,...) at _cv_wait+0x260 usb_process(c8048b54,ee134d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8048b54,ee134d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee134d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc80458a0 sched_switch(c80458a0,0,104,1a3,9dc336db,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80458a0,0,c0f78a60,268,c80458a0,...) at sleepq_switch+0x162 sleepq_wait(c8048b2c,0,ee131cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048b2c,c8048c74,c0f56cd1,74,c8048b34,...) at _cv_wait+0x260 usb_process(c8048b24,ee131d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8048b24,ee131d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee131d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8045b80 sched_switch(c8045b80,0,104,1a3,d2fabf24,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8045b80,0,c0f78a60,268,c8045b80,...) at sleepq_switch+0x162 sleepq_wait(c8048afc,0,ee12ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048afc,c8048c74,c0f56cd1,74,c8048b04,...) at _cv_wait+0x260 usb_process(c8048af4,ee12ed28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8048af4,ee12ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ed60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8046000 sched_switch(c8046000,0,104,1a3,d2faad57,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8046000,0,c0f78a60,268,c8046000,...) at sleepq_switch+0x162 sleepq_wait(c8048acc,0,ee12bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048acc,c8048c74,c0f56cd1,74,c8048ad4,...) at _cv_wait+0x260 usb_process(c8048ac4,ee12bd28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8048ac4,ee12bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12bd60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc80462e0 sched_switch(c80462e0,0,104,1a3,d2fa9a05,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80462e0,0,c0f78a60,268,c80462e0,...) at sleepq_switch+0x162 sleepq_wait(c8041b5c,0,ee127cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8041b5c,c8041c74,c0f56cd1,74,c8041b64,...) at _cv_wait+0x260 usb_process(c8041b54,ee127d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8041b54,ee127d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee127d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc80465c0 sched_switch(c80465c0,0,104,1a3,9dc2c892,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80465c0,0,c0f78a60,268,c80465c0,...) at sleepq_switch+0x162 sleepq_wait(c8041b2c,0,ee124cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8041b2c,c8041c74,c0f56cd1,74,c8041b34,...) at _cv_wait+0x260 usb_process(c8041b24,ee124d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8041b24,ee124d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee124d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc80468a0 sched_switch(c80468a0,0,104,1a3,d296af35,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80468a0,0,c0f78a60,268,c80468a0,...) at sleepq_switch+0x162 sleepq_wait(c8041afc,0,ee121cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8041afc,c8041c74,c0f56cd1,74,c8041b04,...) at _cv_wait+0x260 usb_process(c8041af4,ee121d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8041af4,ee121d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee121d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8046b80 sched_switch(c8046b80,0,104,1a3,d2969c78,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8046b80,0,c0f78a60,268,c8046b80,...) at sleepq_switch+0x162 sleepq_wait(c8041acc,0,ee11ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8041acc,c8041c74,c0f56cd1,74,c8041ad4,...) at _cv_wait+0x260 usb_process(c8041ac4,ee11ed28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c8041ac4,ee11ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ed60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8035000 sched_switch(c8035000,0,104,1a3,d2968653,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8035000,0,c0f78a60,268,c8035000,...) at sleepq_switch+0x162 sleepq_wait(c803ab5c,0,ee117cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803ab5c,c803ac74,c0f56cd1,74,c803ab64,...) at _cv_wait+0x260 usb_process(c803ab54,ee117d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c803ab54,ee117d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee117d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc80352e0 sched_switch(c80352e0,0,104,1a3,9dc1ffeb,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80352e0,0,c0f78a60,268,c80352e0,...) at sleepq_switch+0x162 sleepq_wait(c803ab2c,0,ee114cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803ab2c,c803ac74,c0f56cd1,74,c803ab34,...) at _cv_wait+0x260 usb_process(c803ab24,ee114d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c803ab24,ee114d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee114d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc80355c0 sched_switch(c80355c0,0,104,1a3,d232e5a3,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80355c0,0,c0f78a60,268,c80355c0,...) at sleepq_switch+0x162 sleepq_wait(c803aafc,0,ee111cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803aafc,c803ac74,c0f56cd1,74,c803ab04,...) at _cv_wait+0x260 usb_process(c803aaf4,ee111d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c803aaf4,ee111d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee111d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc80358a0 sched_switch(c80358a0,0,104,1a3,d232d387,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80358a0,0,c0f78a60,268,c80358a0,...) at sleepq_switch+0x162 sleepq_wait(c803aacc,0,ee10ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803aacc,c803ac74,c0f56cd1,74,c803aad4,...) at _cv_wait+0x260 usb_process(c803aac4,ee10ed28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c803aac4,ee10ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ed60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8037000 sched_switch(c8037000,0,104,1a3,d232bd71,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8037000,0,c0f78a60,268,c8037000,...) at sleepq_switch+0x162 sleepq_wait(c802fb5c,0,ee107cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802fb5c,c802fc74,c0f56cd1,74,c802fb64,...) at _cv_wait+0x260 usb_process(c802fb54,ee107d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c802fb54,ee107d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee107d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc80372e0 sched_switch(c80372e0,0,104,1a3,9dc167ef,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80372e0,0,c0f78a60,268,c80372e0,...) at sleepq_switch+0x162 sleepq_wait(c802fb2c,0,ee104cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802fb2c,c802fc74,c0f56cd1,74,c802fb34,...) at _cv_wait+0x260 usb_process(c802fb24,ee104d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c802fb24,ee104d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee104d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc80375c0 sched_switch(c80375c0,0,104,1a3,d1ce5f9c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80375c0,0,c0f78a60,268,c80375c0,...) at sleepq_switch+0x162 sleepq_wait(c802fafc,0,ee101cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802fafc,c802fc74,c0f56cd1,74,c802fb04,...) at _cv_wait+0x260 usb_process(c802faf4,ee101d28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c802faf4,ee101d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee101d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc80378a0 sched_switch(c80378a0,0,104,1a3,d1ce4d88,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80378a0,0,c0f78a60,268,c80378a0,...) at sleepq_switch+0x162 sleepq_wait(c802facc,0,ee0fecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802facc,c802fc74,c0f56cd1,74,c802fad4,...) at _cv_wait+0x260 usb_process(c802fac4,ee0fed28,c0f6d330,3d8,c8038598,...) at usb_process+0x1a3 fork_exit(c091cfe0,c802fac4,ee0fed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fed60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7ed95c0 sched_switch(c7ed95c0,0,104,1a3,f3e68381,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ed95c0,0,c0f78a60,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c110a7a4,0,c0f65652,2,0,...) at sleepq_timedwait+0x6b _sleep(c110a7a4,0,0,c0f65652,64) at _sleep+0x36a pause(c0f65652,64,c0f32d70,111,0,...) at pause+0xa0 random_kthread(0,c7b52d28,c0f6d330,3d8,c7dcb000,...) at random_kthread+0x1ef fork_exit(c081ada0,0,c7b52d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b52d60, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7ed98a0 sched_switch(c7ed98a0,0,104,1a3,f9fc4c11,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ed98a0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c11079e8,5c,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(c11079e8,c1107948,25c,c0f65652,0,...) at _sleep+0x39c g_io_schedule_down(c7ed98a0,0,c0f671a1,6c,c7b4ed14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c7b4ed28,c0f6d330,3d8,c7dcb2cc,...) at g_down_procbody+0x9d fork_exit(c09d3e70,0,c7b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ed60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7ed9b80 sched_switch(c7ed9b80,0,104,1a3,fa4ee9d2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ed9b80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c11079e4,5c,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(c11079e4,c1107968,25c,c0f65652,0,...) at _sleep+0x39c g_io_schedule_up(c7ed9b80,0,c0f671a1,5f,c7b4bd14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c7b4bd28,c0f6d330,3d8,c7dcb2cc,...) at g_up_procbody+0x9d fork_exit(c09d3f10,0,c7b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4bd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7edb000 sched_switch(c7edb000,0,104,1a3,f9fa37a2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7edb000,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca7b5428,5c,c0f670e0,0,0,...) at sleepq_timedwait+0x6b _sleep(ca7b5428,c7d853e4,5c,c0f670e0,64,...) at _sleep+0x36a biowait(ca7b5428,c0f670e0,2,1,cb2cae00,...) at biowait+0x7d g_read_data(c7f97d80,40000,0,2000,0,...) at g_read_data+0x12c g_label_ufs_taste_common(0,c7b48c80,c09da208,c7f97d80,c7b48c04,...) at g_label_ufs_taste_common+0xd4 g_label_ufs_volume_taste(c7f97d80,c7b48c04,40,0,0,...) at g_label_ufs_volume_taste+0x1b g_label_taste(c10954c0,cb2cae00,0,229,cb463880,...) at g_label_taste+0x488 g_new_provider_event(cb2cae00,0,c0f66b2f,102,0,...) at g_new_provider_event+0xb6 g_run_events(c1118600,0,c0f671a1,79,c7b48d14,...) at g_run_events+0x335 g_event_procbody(0,c7b48d28,c0f6d330,3d8,c7dcb2cc,...) at g_event_procbody+0x90 fork_exit(c09d3fb0,0,c7b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b48d60, ebp = 0 --- Tracing command intr pid 12 tid 100078 td 0xca6d7b80 sched_switch(ca6d7b80,0,109,1a3,a2707aa2,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,ca6d7b80,...) at mi_switch+0x1ff ithread_loop(ca6d0340,ee324d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,ca6d0340,ee324d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee324d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc81818a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc8181b80 sched_switch(c8181b80,0,109,1a3,d1cb0f83,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c8181b80,...) at mi_switch+0x1ff ithread_loop(c7e14380,ee17dd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14380,ee17dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17dd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc80472e0 sched_switch(c80472e0,0,109,1a3,df1684aa,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c80472e0,...) at mi_switch+0x1ff ithread_loop(c7e14390,ee16dd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14390,ee16dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16dd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8047b80 sched_switch(c8047b80,0,109,1a3,c1d8b0c8,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c8047b80,...) at mi_switch+0x1ff ithread_loop(c7e143f0,ee161d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e143f0,ee161d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee161d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc8054000 sched_switch(c8054000,0,109,1a3,19a986f5,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c8054000,...) at mi_switch+0x1ff ithread_loop(c7e14430,ee159d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14430,ee159d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee159d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8056000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8047000 sched_switch(c8047000,0,109,1a3,f6df2843,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c8047000,...) at mi_switch+0x1ff ithread_loop(c7e144d0,ee11bd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e144d0,ee11bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11bd60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8035b80 sched_switch(c8035b80,0,109,1a3,f14af540,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c8035b80,...) at mi_switch+0x1ff ithread_loop(c7e14500,ee10bd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14500,ee10bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10bd60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8037b80 sched_switch(c8037b80,0,109,1a3,fc504b1c,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c8037b80,...) at mi_switch+0x1ff ithread_loop(c7e14530,ee0fbd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14530,ee0fbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fbd60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7edb2e0 sched_switch(c7edb2e0,0,109,1a3,fa4cb08f,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7edb2e0,...) at mi_switch+0x1ff ithread_loop(c7e14600,edfa5d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14600,edfa5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa5d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7edb5c0 sched_switch(c7edb5c0,0,109,1a3,e8f818a2,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7edb5c0,...) at mi_switch+0x1ff ithread_loop(c7e14610,edfa1d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14610,edfa1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa1d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7edb8a0 sched_switch(c7edb8a0,0,109,1a3,c3923535,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7edb8a0,...) at mi_switch+0x1ff ithread_loop(c7e14660,c7ba1d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14660,c7ba1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba1d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7edbb80 sched_switch(c7edbb80,0,109,1a3,1925ee6e,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7edbb80,...) at mi_switch+0x1ff ithread_loop(c7e14680,c7b70d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e14680,c7b70d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b70d60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc7fc0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc7fc05c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc7ed92e0 sched_switch(c7ed92e0,0,109,1a3,fa4d3d3e,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7ed92e0,...) at mi_switch+0x1ff ithread_loop(c7e146b0,c7b55d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e146b0,c7b55d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b55d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7dce5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc7dce8a0 sched_switch(c7dce8a0,0,109,1a3,83da07cf,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7dce8a0,...) at mi_switch+0x1ff ithread_loop(c7e147b0,c7b3fd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e147b0,c7b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3fd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dceb80 sched_switch(c7dceb80,0,109,1a3,f2668d34,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7dceb80,...) at mi_switch+0x1ff ithread_loop(c7e147c0,c7b3cd28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e147c0,c7b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e15000 sched_switch(c7e15000,0,109,1a3,f695a31e,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7e15000,...) at mi_switch+0x1ff ithread_loop(c7e147d0,c7b39d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e147d0,c7b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e152e0 sched_switch(c7e152e0,0,109,1a3,f5e41af,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7e152e0,...) at mi_switch+0x1ff ithread_loop(c7e147e0,c7b36d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e147e0,c7b36d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b36d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e155c0 sched_switch(c7e155c0,0,109,1a3,f9ea292b,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d653,557,c7e155c0,...) at mi_switch+0x1ff ithread_loop(c7e147f0,c7b33d28,c0f6d330,3d8,c7dcb598,...) at ithread_loop+0x1fb fork_exit(c0a16f10,c7e147f0,c7b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b33d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dcd000 sched_switch(c7dcd000,0,108,19e,f9fb49a4,...) at sched_switch+0x3fc mi_switch(108,0,c0f75122,3ca,c7dcd000,...) at mi_switch+0x1ff sched_idletd(0,c7b2fd28,c0f6d330,3d8,c7dcb864,...) at sched_idletd+0x17c fork_exit(c0a68af0,0,c7b2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2fd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dcd2e0 sched_switch(c7dcd2e0,0,108,19e,e91ad5a0,...) at sched_switch+0x3fc mi_switch(108,0,c0f75122,3ca,c7dcd2e0,...) at mi_switch+0x1ff sched_idletd(0,c7b2cd28,c0f6d330,3d8,c7dcb864,...) at sched_idletd+0x17c fork_exit(c0a68af0,0,c7b2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2cd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dcd5c0 sched_switch(c7dcd5c0,0,108,19e,f3e673bd,...) at sched_switch+0x3fc mi_switch(108,0,c0f75122,3ca,c7dcd5c0,...) at mi_switch+0x1ff sched_idletd(0,c7b29d28,c0f6d330,3d8,c7dcb864,...) at sched_idletd+0x17c fork_exit(c0a68af0,0,c7b29d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b29d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dcd8a0 sched_switch(c7dcd8a0,0,108,19e,f9f7bdb0,...) at sched_switch+0x3fc mi_switch(108,0,c0f75122,3ca,c7dcd8a0,...) at mi_switch+0x1ff sched_idletd(0,c7b26d28,c0f6d330,3d8,c7dcb864,...) at sched_idletd+0x17c fork_exit(c0a68af0,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dcdb80 sched_switch(c7dcdb80,0,104,1a3,913a4b73,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c7dcdb80,0,c0f78a60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7dcbb30,6c,c0f7b9a5,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7dcbb30,c7dcbbb8,16c,c0f7b9a5,0,...) at _sleep+0x385 kern_wait(c7dcdb80,ffffffff,c7b22c5c,0,0,...) at kern_wait+0x597 sys_wait4(c7dcdb80,c7b22cec,c0fc519c,c0f7b7e2,286,...) at sys_wait4+0x3b syscall(c7b22d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80601ff, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc7dce000 sched_switch(c7dce000,0,104,1a3,d1cc6e97,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dce000,0,c0f78a60,268,c7dce000,...) at sleepq_switch+0x162 sleepq_wait(c12875c0,0,c7b1fc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c12875c0,c12875a4,c0fa42b7,194,0,...) at _cv_wait+0x260 audit_worker(0,c7b1fd28,c0f6d330,3d8,c7dcc000,...) at audit_worker+0x84 fork_exit(c0c43c30,0,c7b1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1fd60, ebp = 0 --- Tracing command kernel pid 0 tid 2932214 td 0xca7078a0 sched_switch(ca7078a0,0,104,1a3,dc2d59ee,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7078a0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ca810a00,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(ca810a00,ca810a18,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(cac1f510,f2eb9d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,cac1f510,f2eb9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2eb9d60, ebp = 0 --- Tracing command kernel pid 0 tid 2932213 td 0xcb345000 sched_switch(cb345000,0,104,1a3,dc2d38ab,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb345000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ca810a00,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(ca810a00,ca810a18,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(cac1f510,f2eb6d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,cac1f510,f2eb6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2eb6d60, ebp = 0 --- Tracing command kernel pid 0 tid 2931705 td 0xcb0a02e0 sched_switch(cb0a02e0,0,104,1a3,dc2d282b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb0a02e0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ca810a00,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(ca810a00,ca810a18,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(cac1f510,f2eb3d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,cac1f510,f2eb3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2eb3d60, ebp = 0 --- Tracing command kernel pid 0 tid 2930174 td 0xcab04000 sched_switch(cab04000,0,104,1a3,dc2d48b9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab04000,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(ca810a00,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(ca810a00,ca810a18,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(cac1f510,f2eb0d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,cac1f510,f2eb0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2eb0d60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc81812e0 sched_switch(c81812e0,0,104,1a3,b14ad430,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81812e0,0,c0f78a60,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c110a7a4,0,c0f65652,2,0,...) at sleepq_timedwait+0x6b _sleep(c110a7a4,0,0,c0f65652,bb8) at _sleep+0x36a pause(c0f65652,bb8,126,124,c1107b88,...) at pause+0xa0 deadlkres(0,ee186d28,c0f6d330,3d8,c1107b00,...) at deadlkres+0x324 fork_exit(c09f62c0,0,ee186d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee186d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80478a0 sched_switch(c80478a0,0,104,1a3,f9e9b08d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80478a0,0,c0f78a60,268,c80478a0,...) at sleepq_switch+0x162 sleepq_wait(c8084540,0,c0f73dc1,c0f65652,0,...) at sleepq_wait+0x63 msleep_spin(c8084540,c8084558,c0f65652,0,c0f712f3,...) at msleep_spin+0x259 taskqueue_thread_loop(c808a49c,ee167d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a40,c808a49c,ee167d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee167d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fc02e0 sched_switch(c7fc02e0,0,104,1a3,a7d2272,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc02e0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f5e740,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(c7f5e740,c7f5e758,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(c112736c,c7b6ad28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,c112736c,c7b6ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc7fc08a0 sched_switch(c7fc08a0,0,104,1a3,bba1800c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc08a0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f5e7c0,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(c7f5e7c0,c7f5e7d8,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(c1287ba4,c7b64d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,c1287ba4,c7b64d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b64d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fc0b80 sched_switch(c7fc0b80,0,104,1a3,ec00d7cd,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc0b80,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f5e800,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(c7f5e800,c7f5e818,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(c1108498,c7b61d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,c1108498,c7b61d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b61d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e158a0 sched_switch(c7e158a0,0,104,1a3,ec00c579,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e158a0,0,c0f78a60,268,c7e158a0,...) at sleepq_switch+0x162 sleepq_wait(c7f5e840,0,c0f73dc1,c0f65652,0,...) at sleepq_wait+0x63 msleep_spin(c7f5e840,c7f5e858,c0f65652,0,c0f712f3,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d1bb8,c7b5ed28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a40,c10d1bb8,c7b5ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e15b80 sched_switch(c7e15b80,0,104,1a3,ec00b6fa,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e15b80,0,c0f78a60,268,c7e15b80,...) at sleepq_switch+0x162 sleepq_wait(c7f5e840,0,c0f73dc1,c0f65652,0,...) at sleepq_wait+0x63 msleep_spin(c7f5e840,c7f5e858,c0f65652,0,c0f712f3,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d1bb8,c7b5bd28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a40,c10d1bb8,c7b5bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7ed9000 sched_switch(c7ed9000,0,104,1a3,ec00a6c4,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ed9000,0,c0f78a60,268,c7ed9000,...) at sleepq_switch+0x162 sleepq_wait(c7f5e840,0,c0f73dc1,c0f65652,0,...) at sleepq_wait+0x63 msleep_spin(c7f5e840,c7f5e858,c0f65652,0,c0f712f3,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d1bb8,c7b58d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a40,c10d1bb8,c7b58d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b58d60, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc7dce2e0 sched_switch(c7dce2e0,0,104,1a3,afca6b4f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dce2e0,0,c0f78a60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7d9fc00,0,c0f65652,0,0,...) at sleepq_wait+0x63 _sleep(c7d9fc00,c7d9fc18,0,c0f65652,0,...) at _sleep+0x39c taskqueue_thread_loop(c1125d80,c7b45d28,c0f6d330,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a40,c1125d80,c7b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b45d60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1107dd0 sched_switch(c1107dd0,0,104,1a3,5d105323,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c1107dd0,0,c0f78a60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107b00,54,c0f759f5,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107b00,0,54,c0f759f5,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 328 MB: 313 297 281 265 249 233 217 201 185 169 153 137 121 105 89 73 57 41 25 9 Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xf2dcb5b8) at pcpu.h:244 #1 0xc0512349 in db_fncall (dummy1=0xc0a7720a, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf2dcb64c "`¶άς") at ../../../ddb/db_command.c:573 #2 0xc051277f in db_command (last_cmdp=0xc10cfd7c, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc0512834 in db_command_script (command=0xc10d0c88 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc0516c20 in db_script_exec (scriptname=0xc10d05e0 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc0516cb1 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc12a92c0, modif=0xf2dcb784 "") at ../../../ddb/db_script.c:375 #6 0xc0512741 in db_command (last_cmdp=0xc10cfd7c, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc051289a in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc051488d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc0a776a6 in kdb_trap (type=0x3, code=0x0, tf=0xf2dcb934) at ../../../kern/subr_kdb.c:629 #10 0xc0dab5eb in trap (frame=0xf2dcb934) at ../../../i386/i386/trap.c:711 #11 0xc0d94ecc in calltrap () at ../../../i386/i386/exception.s:169 #12 0xc0a7720a in kdb_enter (why=0xc0f73050 "panic", msg=0xc0f73050 "panic") at cpufunc.h:71 #13 0xc0a41d9c in panic (fmt=0xc0f796c7 "sleeping thread") at ../../../kern/kern_shutdown.c:633 #14 0xc0a873bf in propagate_priority (td=0xde17fb80) at ../../../kern/subr_turnstile.c:223 #15 0xc0a88847 in turnstile_wait (ts=0xcb281000, owner=0xde17fb80, queue=0x0) at ../../../kern/subr_turnstile.c:739 #16 0xc0a30e8c in _mtx_lock_sleep (m=0xd2924668, tid=0xcb32b8a0, opts=0x0, file=0xc0f8008b "../../../kern/vfs_bio.c", line=0x613) at ../../../kern/kern_mutex.c:472 #17 0xc0a30faf in _mtx_lock_flags (m=0xd2924668, opts=0x0, file=0xc0f8008b "../../../kern/vfs_bio.c", line=0x613) at ../../../kern/kern_mutex.c:212 #18 0xc0ac5716 in bqrelse (bp=0xe1a227e0) at ../../../kern/vfs_bio.c:1555 #19 0xc0ac62e9 in bdwrite (bp=0xe1a227e0) at ../../../kern/vfs_bio.c:1066 #20 0xc0c64c05 in ffs_update (vp=0xced382b8, waitfor=0x0) at ../../../ufs/ffs/ffs_inode.c:159 #21 0xc0c9559a in ufs_inactive (ap=0xf2dcbbc0) at ../../../ufs/ufs/ufs_inode.c:159 #22 0xc0dce795 in VOP_INACTIVE_APV (vop=0xc10bc760, a=0xf2dcbbc0) at vnode_if.c:1863 #23 0xc0ae17c1 in vinactive (vp=0xced382b8, td=0xcb32b8a0) at vnode_if.h:807 #24 0xc0ae430c in vputx (vp=0xced382b8, func=0x1) at ../../../kern/vfs_subr.c:2298 #25 0xc0ae4a50 in vrele (vp=0xced382b8) at ../../../kern/vfs_subr.c:2313 #26 0xc0aed655 in sys_fchdir (td=0xcb32b8a0, uap=0xf2dcbcec) at ../../../kern/vfs_syscalls.c:795 #27 0xc0daab43 in syscall (frame=0xf2dcbd28) at subr_syscall.c:135 #28 0xc0d94f31 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #29 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 20 #20 0xc0c64c05 in ffs_update (vp=0xced382b8, waitfor=0x0) at ../../../ufs/ffs/ffs_inode.c:159 159 bdwrite(bp); (kgdb) p *vp $1 = {v_type = VDIR, v_tag = 0xc0f69284 "ufs", v_op = 0xc10bc1a0, v_data = 0xd1926488, v_mount = 0xd61305a0, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xcdc9183c}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xca430f78}, v_hash = 0x3, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xced382e8}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc0f69284 "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc7d725a8}, lk_lock = 0xcb32b8a0, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x9, pcs = {0xc0a28a4e, 0xc0c8e3c1, 0xc0dcf915, 0xc0aefec8, 0xc0ae4206, 0xc0ae4a50, 0xc0aed655, 0xc0daab43, 0xc0d94f31, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc0f7ad18 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d6b1e0}, mtx_lock = 0x4}, v_vnlock = 0xced38310, v_holdcnt = 0x3, v_usecount = 0x0, v_iflag = 0x800, v_vflag = 0x0, v_writecount = 0x0, v_freelist = {tqe_next = 0xcbf6aae0, tqe_prev = 0xcef770f0}, v_bufobj = {bo_mtx = {lock_object = { lo_name = 0xc0f83ae9 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d70ba8}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe19a8840, tqh_last = 0xe19a8878}, bv_root = 0xe19a8840, bv_cnt = 0x1}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xced383d4}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_ops = 0xc10a9700, bo_bsize = 0x8000, bo_object = 0xcefb5940, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xced382b8, __bo_vnode = 0xced382b8}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) p *vp->v_mount $2 = {mnt_mtx = {lock_object = {lo_name = 0xc0f64e11 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d6b450}, mtx_lock = 0x4}, mnt_gen = 0x97, mnt_list = {tqe_next = 0xcc1a0870, tqe_prev = 0xca79b888}, mnt_op = 0xc10bbf00, mnt_vfc = 0xc10bbd60, mnt_vnodecovered = 0xd2a42d98, mnt_syncer = 0x0, mnt_ref = 0x4, mnt_nvnodelist = {tqh_first = 0xcdc91828, tqh_last = 0xced382cc}, mnt_nvnodelistsize = 0x2, mnt_writeopcount = 0x1, mnt_kern_flag = 0x6180004c, mnt_flag = 0x201000, mnt_opt = 0xd37489c0, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20030518, f_type = 0x35, f_flags = 0x201000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0xcd, f_bfree = 0xcb, f_bavail = 0xbb, f_files = 0x7e, f_ffree = 0x7c, f_syncwrites = 0x2, f_asyncwrites = 0x1, f_syncreads = 0x3, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x4f792ce6, 0x2ef89cab}}, f_charspare = '\0' , f_fstypename = "ufs", '\0' , f_mntfromname = "/dev/md10a", '\0' , f_mntonname = "/mnt10", '\0' }, mnt_cred = 0xcca5aa00, mnt_data = 0xca6aed00, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xcd811bdb, mnt_lockref = 0x0, mnt_secondary_writes = 0x1, mnt_secondary_accwrites = 0x2, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xc0f64e22 "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7d71088}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = {0xc0a28a4e, 0xc0acf5e7, 0xc0ad7ef3, 0xc0ad860f, 0xc0daab43, 0xc0d94f31, 0x0 }}}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 233758) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -1821,13 +1821,21 @@ softdep_flushworklist(oldmnt, countp, td) int count, error = 0; struct ufsmount *ump; + *countp = 0; + if (!MOUNTEDSOFTDEP(oldmnt)) + return (0); /* + * We set TDP_SOFTDEP to avoid recursively processing the worklist. + */ + if (td->td_pflags & TDP_SOFTDEP) + return (0); + td->td_pflags |= TDP_SOFTDEP; + /* * Alternately flush the block device associated with the mount * point and process any dependencies that the flushing * creates. We continue until no more worklist dependencies * are found. */ - *countp = 0; ump = VFSTOUFS(oldmnt); devvp = ump->um_devvp; while ((count = softdep_process_worklist(oldmnt, 1)) > 0) { @@ -1838,6 +1846,7 @@ softdep_flushworklist(oldmnt, countp, td) if (error) break; } + td->td_pflags &= ~TDP_SOFTDEP; return (error); } @@ -13459,7 +13468,16 @@ DB_SHOW_COMMAND(workhead, db_show_workhead) printf("\n"); } +void print_deplist(struct workhead *); +void +print_deplist(struct workhead *deps) +{ + + db_show_workhead((int)deps, 1, 0, 0); +} + + DB_SHOW_COMMAND(mkdirs, db_show_mkdirs) { struct jaddref *jaddref; Index: /usr/src/sys/ufs/ffs/ffs_vfsops.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_vfsops.c (revision 233758) +++ /usr/src/sys/ufs/ffs/ffs_vfsops.c (working copy) @@ -407,8 +407,6 @@ ffs_mount(struct mount *mp) vn_finished_write(mp); return (error); } - if (devvp->v_type == VCHR && devvp->v_rdev != NULL) - devvp->v_rdev->si_mountpt = mp; if (fs->fs_snapinum[0] != 0) ffs_snapshot_mount(mp); vn_finished_write(mp); @@ -1054,6 +1052,10 @@ ffs_mountfs(devvp, mp, td) } if (devvp->v_type == VCHR && devvp->v_rdev != NULL) devvp->v_rdev->si_mountpt = mp; + else + printf("mount2 %s: %s has NULL v_rdev\n", + mp->mnt_stat.f_mntonname, + mp->mnt_stat.f_mntfromname); if (fs->fs_snapinum[0] != 0) ffs_snapshot_mount(mp); fs->fs_fmod = 1; @@ -1301,6 +1303,9 @@ ffs_unmount(mp, mntflags) PICKUP_GIANT(); if (ump->um_devvp->v_type == VCHR && ump->um_devvp->v_rdev != NULL) ump->um_devvp->v_rdev->si_mountpt = NULL; + else + printf("unmount %s: %s has NULL v_rdev\n", + mp->mnt_stat.f_mntonname, mp->mnt_stat.f_mntfromname); vrele(ump->um_devvp); dev_rel(ump->um_dev); mtx_destroy(UFS_MTX(ump)); Index: /usr/src/sys/kern/vfs_default.c =================================================================== --- /usr/src/sys/kern/vfs_default.c (revision 233758) +++ /usr/src/sys/kern/vfs_default.c (working copy) @@ -611,6 +611,8 @@ vop_stdbmap(ap) return (0); } +void print_deplist(struct workhead *); + int vop_stdfsync(ap) struct vop_fsync_args /* { @@ -624,7 +626,7 @@ vop_stdfsync(ap) struct buf *bp; struct bufobj *bo; struct buf *nbp; - int error = 0; + int lockflags, error = 0; int maxretry = 1000; /* large, arbitrarily chosen */ bo = &vp->v_bufobj; @@ -642,11 +644,14 @@ loop1: * Flush all dirty buffers associated with a vnode. */ loop2: + lockflags = LK_EXCLUSIVE; + if (ap->a_waitfor != MNT_WAIT) + lockflags |= LK_NOWAIT; TAILQ_FOREACH_SAFE(bp, &bo->bo_dirty.bv_hd, b_bobufs, nbp) { if ((bp->b_vflags & BV_SCANNED) != 0) continue; bp->b_vflags |= BV_SCANNED; - if (BUF_LOCK(bp, LK_EXCLUSIVE | LK_NOWAIT, NULL)) + if (BUF_LOCK(bp, lockflags, BO_MTX(bo))) continue; BO_UNLOCK(bo); KASSERT(bp->b_bufobj == bo, @@ -679,8 +684,17 @@ loop2: * to write them out. */ TAILQ_FOREACH(bp, &bo->bo_dirty.bv_hd, b_bobufs) + { + if ((maxretry % 100) == 1 && + bp->b_dep.lh_first != 0) { + vn_printf(vp, + "sync fail deplist at: %d\n", + maxretry); + print_deplist(&bp->b_dep); + } if ((error = bp->b_error) == 0) continue; + } if (error == 0 && --maxretry >= 0) goto loop1; error = EAGAIN; -- Test scenario: crossmp.sh