GENERIC HEAD from 2012-02-06 20:23:21 UTC, r231114M, vmcore.268 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r231114M: Tue Feb 7 06:06:44 CET 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531644928 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 118512 free (1192 frags, 14665 blocks, 0.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 114631684 free (1996 frags, 14328711 blocks, 0.0% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 143506 free (4810 frags, 17337 blocks, 0.5% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 946650 free (366138 frags, 72564 blocks, 3.6% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 13821049 free (53537 frags, 1720939 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: usbus0. Starting Network: usbus1. Starting Network: usbus2. Starting Network: usbus3. Starting Network: usbus4. Starting Network: usbus5. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe191f3a0 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xcad07c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,2e687361,38323a63,a34,f27077e8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c1272528,11c,f2707878,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,cad07c00,c0fc381a,c7d72678,c0fc34ac,...) at _witness_debugger+0x25 witness_checkorder(cad07c00,9,c0fc34a3,11c,0,...) at witness_checkorder+0x86f _sx_xlock(cad07c00,0,c0fc34a3,11c,ca7e8910,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e191f340,ca7e8910,f27079f4,e241a3c0,f2707948,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(ca7e8910,f27079f4,23c0,f2707934,f2707938,...) at ufsdirhash_add+0x13 ufs_direnter(caa5f000,cacab000,f27079f4,f2707b84,e191f9c0,...) at ufs_direnter+0x7a9 ufs_mkdir(f2707c14,c0fe4a85,0,0,f2707bac,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10db7c0,f2707c14,f2707b84,f2707bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca75d5c0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(ca75d5c0,28404020,0,1c0,f2707d1c,...) at kern_mkdir+0x2e sys_mkdir(ca75d5c0,f2707cec,c0fdd90a,c0f9447e,202,...) at sys_mkdir+0x29 syscall(f2707d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817f743, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). Starting mountd. NFSv4 is disabled Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcad68724 ufs (ufs) @ kern/vfs_lookup.c:542 2nd 0xe19263c0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcadc7b38 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,3a632e73,a303632,0,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937b9,c1272198,877,f271733c,...) at kdb_backtrace+0x2a _witness_debugger(c0f937b9,cadc7b38,c0f8236c,c7d72610,c0f9b735,...) at _witness_debugger+0x25 witness_checkorder(cadc7b38,9,c0f9b72c,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cadc7b38,80100,cadc7ba4,0,0,...) at __lockmgr_args+0x834 ffs_lock(f2717460,60,0,80100,cadc7ae0,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10db7c0,f2717460,c7d6b1e0,c10ec7e0,cadc7ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cadc7ae0,80100,c0f9b72c,877,4,...) at _vn_lock+0x78 vget(cadc7ae0,80100,ca6c05c0,50,0,...) at vget+0xbb vfs_hash_get(ca7252d4,15edde,80000,ca6c05c0,f27175a4,...) at vfs_hash_get+0xed ffs_vgetf(ca7252d4,15edde,80000,f27175a4,1,...) at ffs_vgetf+0x49 softdep_sync_buf(cad686cc,e1926360,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(cad686cc,1,c1272188,cad687c4,c7d6e370,...) at ffs_syncvnode+0x24c ffs_truncate(cad686cc,200,0,880,c7fcf900,...) at ffs_truncate+0x827 ufs_direnter(cad686cc,cadc7ae0,f2717918,f2717bc0,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f2717bc0,c10dbd40,f2717b04,f2717a60,c0de2fe5,...) at ufs_makeinode+0x65d ufs_create(f2717b04,c0fe4c4b,0,0,f2717b80,...) at ufs_create+0x30 VOP_CREATE_APV(c10db7c0,f2717b04,f2717bc0,f2717a9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f2717b80,f2717c48,1b0,0,c7fcf900,...) at vn_open_cred+0x205 vn_open(f2717b80,f2717c48,1b0,ca76a6c8,4f30b449,...) at vn_open+0x3b kern_openat(ca6c05c0,ffffff9c,28839f60,0,a03,...) at kern_openat+0x1ec kern_open(ca6c05c0,28839f60,0,a02,1b0,...) at kern_open+0x35 sys_open(ca6c05c0,f2717cec,c0fdd90a,c0f9447e,206,...) at sys_open+0x30 syscall(f2717d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x283eada3, esp = 0xbfbfc50c, ebp = 0xbfbfc598 --- . Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcaa5f880 ufs (ufs) @ kern/vfs_mount.c:1249 2nd 0xca7dadf0 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1835 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,38313a63,a3533,c0aa70bc,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c1271d68,72b,f28309a0,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,ca7dadf0,c0f7a2c7,c7d72470,c0fbf919,...) at _witness_debugger+0x25 witness_checkorder(ca7dadf0,9,c0fbf910,72b,ca7dae5c,...) at witness_checkorder+0x86f __lockmgr_args(ca7dadf0,80400,ca7dae5c,0,0,...) at __lockmgr_args+0x834 vop_stdlock(f2830ac0,4,c0f8a0cb,80400,ca7dad98,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b14c0,f2830ac0,c12a59e0,c10ec7e0,ca7dad98,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca7dad98,80400,c0fbf910,72b,ca72587c,...) at _vn_lock+0x78 softdep_flushworklist(ca72587c,f2830b6c,cad582e0,5e0,0,...) at softdep_flushworklist+0x47 ffs_sync(ca72587c,1,f2830bc0,51a,c7c30000,...) at ffs_sync+0x2fd dounmount(ca72587c,8080000,cad582e0,49c,0,...) at dounmount+0x3f8 sys_unmount(cad582e0,f2830cec,c,c,206,...) at sys_unmount+0x421 syscall(f2830d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7e0b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 100704 files, 3682297 used, 114631684 free (1996 frags, 14328711 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 100704 files, 3682297 used, 114631684 free (1996 frags, 14328711 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Tue Feb 7 06:23:36 CET 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Feb 7 06:24:11 x4 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xe19591e0 bufwait (bufwait) @ ufs/ffs/ffs_softdep.c:12299 2nd 0xca73eb1c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2293 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,632e746f,3932323a,a000a33,c0f93b00,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c1271558,8f5,f28c43ec,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,ca73eb1c,c0fbf3b5,c7d72e30,c0fbf33f,...) at _witness_debugger+0x25 witness_checkorder(ca73eb1c,9,c0fbf336,8f5,0,...) at witness_checkorder+0x86f __lockmgr_args(ca73eb1c,80900,cb299e5c,0,0,...) at __lockmgr_args+0x834 ffs_copyonwrite(cb299d98,e1959180,0,e1959180,cb128d98,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(cb299e90,e1959180,f28c4570,f48,f28c4578,...) at ffs_geom_strategy+0xeb ufs_strategy(f28c45ac,c0fe4946,c0f8a0cb,e1959180,0,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c10db7c0,f28c45ac,cb128e90,c10ec840,cb128d98,...) at VOP_STRATEGY_APV+0xe5 bufstrategy(cb128e90,e1959180,645,e1959180,41038,...) at bufstrategy+0x61 bufwrite(e1959180,80900,cb128e90,0,0,...) at bufwrite+0x159 softdep_sync_buf(cb133414,e1954ba0,1,106,0,...) at softdep_sync_buf+0x7cc ffs_syncvnode(cb133414,1,c0a4a2bd,c1145b98,4,...) at ffs_syncvnode+0x24c ffs_truncate(cb133414,400,0,880,cb267b80,...) at ffs_truncate+0x827 ufs_direnter(cb133414,cb128d98,f28c49f4,f28c4b84,e1959180,...) at ufs_direnter+0x9a1 ufs_mkdir(f28c4c14,c0fe4a85,0,0,f28c4bac,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10db7c0,f28c4c14,f28c4b84,f28c4bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca6bf8a0,ffffff9c,bfbfef4b,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(ca6bf8a0,bfbfef4b,0,1f8,f28c4d1c,...) at kern_mkdir+0x2e sys_mkdir(ca6bf8a0,f28c4cec,c0fdd90a,c0f9447e,257,...) at sys_mkdir+0x29 syscall(f28c4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28194743, esp = 0xbfbfe7ec, ebp = 0xbfbfe888 --- lock order reversal: 1st 0xca73eb1c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:957 2nd 0xcb133058 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1623 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,a333236,c0000a00,5e8,c7d6e2a0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c1271420,657,f28d8704,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,cb133058,c0f8236c,c7d72610,c0fbf33f,...) at _witness_debugger+0x25 witness_checkorder(cb133058,9,c0fbf336,657,0,...) at witness_checkorder+0x86f __lockmgr_args(cb133058,80000,0,0,0,...) at __lockmgr_args+0x834 ffs_snapremove(cb133000,c0fbf257,c7dd25c0,1,c7d6bee0,...) at ffs_snapremove+0x11f ffs_truncate(cb133000,0,0,c00,0,...) at ffs_truncate+0x607 ufs_inactive(f28d8adc,c0fe4218,cb1330c4,cb1330c4,cb133000,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10db7c0,f28d8adc,c0f9b72c,96f,c10ec7a0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10db7c0,f28d8b10,c0f9b72c,8c6,0,...) at vinactive+0xb1 vputx(f28d8c3c,c0aff1e3,cb133000,ffffffdf,cb133000,...) at vputx+0x36c vput(cb133000,ffffffdf,cb133000,f28d8b94,0,...) at vput+0x10 kern_unlinkat(c818b8a0,ffffff9c,bfbfeaf6,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(c818b8a0,bfbfeaf6,0,f28d8d1c,c0dbecb7,...) at kern_unlink+0x2f sys_unlink(c818b8a0,f28d8cec,c0fdd90a,f28d8d80,246,...) at sys_unlink+0x22 syscall(f28d8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x2817eb5f, esp = 0xbfbfe82c, ebp = 0xbfbfe8a8 --- fsync: giving up on dirty 0xcb299d98: tag devfs, type VCHR usecount 1, writecount 0, refcount 10 mountedhere 0xca69bc00 flags () v_object 0xcb2c0480 ref 0 pages 46 lock type devfs: EXCL by thread 0xcadff2e0 (pid 2592) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb299d98: tag devfs, type VCHR usecount 1, writecount 0, refcount 10 mountedhere 0xca69bc00 flags () v_object 0xcb2c0480 ref 0 pages 46 lock type devfs: EXCL by thread 0xca759b80 (pid 2831) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb299d98: tag devfs, type VCHR usecount 1, writecount 0, refcount 10 mountedhere 0xca69bc00 flags () v_object 0xcb2c0480 ref 0 pages 46 lock type devfs: EXCL by thread 0xc818bb80 (pid 2855) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb299d98: tag devfs, type VCHR usecount 1, writecount 0, refcount 10 mountedhere 0xca69bc00 flags () v_object 0xcb2c0480 ref 0 pages 46 lock type devfs: EXCL by thread 0xcb3362e0 (pid 2869) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb299d98: tag devfs, type VCHR usecount 1, writecount 0, refcount 10 mountedhere 0xca69bc00 flags () v_object 0xcb2c0480 ref 0 pages 46 lock type devfs: EXCL by thread 0xcae02000 (pid 3223) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb299d98: tag devfs, type VCHR usecount 1, writecount 0, refcount 18 mountedhere 0xca69bc00 flags () v_object 0xcb2c0480 ref 0 pages 110 lock type devfs: EXCL by thread 0xcb336b80 (pid 3237) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a : : fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcad588a0 (pid 76967) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xca759000 (pid 76971) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb321b80 (pid 76985) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcab01000 (pid 76999) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb320000 (pid 77023) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb335000 (pid 77037) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb9882e0 (pid 77051) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb36d5c0 (pid 77065) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcbacbb80 (pid 77079) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcbacbb80 (pid 77079) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb36d5c0 (pid 77093) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcb36d5c0 (pid 77093) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcbacb000 (pid 77127) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcbacb000 (pid 77127) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xc818b8a0 (pid 77158) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcadff2e0 (pid 77596) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xd11f7000 (pid 77799) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xca75db80 (pid 77928) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xca75c000 (pid 77947) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcae02000 (pid 78505) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xcbacb2e0 (pid 78524) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcbf81570: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xca71ad00 flags () v_object 0xcd6a77e0 ref 0 pages 366 lock type devfs: EXCL by thread 0xca75c000 (pid 78846) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 12 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 50 lock type devfs: EXCL by thread 0xcb36f2e0 (pid 79087) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 20 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 114 lock type devfs: EXCL by thread 0xcb9898a0 (pid 79091) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 20 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 114 lock type devfs: EXCL by thread 0xcb320b80 (pid 79110) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 36 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 242 lock type devfs: EXCL by thread 0xcab01000 (pid 79114) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 255 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 2018 lock type devfs: EXCL by thread 0xcbacb5c0 (pid 79128) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 255 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 2018 lock type devfs: EXCL by thread 0xd11f7000 (pid 79147) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 255 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 2018 lock type devfs: EXCL by thread 0xd11f7000 (pid 79151) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 272 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 2130 lock type devfs: EXCL by thread 0xca7c38a0 (pid 79155) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c9e485 at ffs_sync+0x3d5 #5 0xc0b081a2 at vfs_write_suspend+0x122 #6 0xc0c8257d at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af06ab at vfs_donmount+0x12eb #9 0xc0af0d4f at sys_nmount+0x7f #10 0xc0dbecb7 at syscall+0x2c7 #11 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcf7bd15c: tag devfs, type VCHR usecount 1, writecount 0, refcount 221 mountedhere 0xcba90100 flags (VV_COPYONWRITE) v_object 0xcf9d2480 ref 0 pages 2162 lock type devfs: EXCL by thread 0xc818b8a0 (pid 79174) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ae64f5 at vop_stdlock+0x65 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3ad at ffs_sync+0x2fd #6 0xc0b081a2 at vfs_write_suspend+0x122 #7 0xc0c8257d at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af06ab at vfs_donmount+0x12eb #10 0xc0af0d4f at sys_nmount+0x7f #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 dev md5a lock order reversal: 1st 0xcc46f46c syncer (syncer) @ kern/vfs_subr.c:1767 2nd 0xcc86c880 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,a3736,c0a80dac,c11361f0,ca6c0b80,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c12728c0,877,ee31a9f8,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,cc86c880,c0f8236c,c7d72610,c0f9b735,...) at _witness_debugger+0x25 witness_checkorder(cc86c880,9,c0f9b72c,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cc86c880,80100,cc86c8ec,0,0,...) at __lockmgr_args+0x834 ffs_lock(ee31ab1c,c805fc30,6c2,80100,cc86c828,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10db7c0,ee31ab1c,c7d6b1e0,c10ec7e0,cc86c828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cc86c828,80100,c0f9b72c,877,4,...) at _vn_lock+0x78 vget(cc86c828,80100,c805fb80,428,caadc5a8,...) at vget+0xbb qsync(caadc5a8,0,c0fc27f0,5e0,c0f8a0cb,...) at qsync+0x19d ffs_sync(caadc5a8,3,2,dd9,caadc5a8,...) at ffs_sync+0x349 sync_fsync(ee31ac6c,c0fe45e3,cc46f4d8,ee31ac6c,cc46f414,...) at sync_fsync+0x156 VOP_FSYNC_APV(c10ca180,ee31ac6c,c0f9b72c,6e7,c805fb80,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c129f734,c129f720,3e8,78b,4e20,...) at sync_vnode+0x16b sched_sync(0,ee31ad28,c0f86430,3db,ca6bc588,...) at sched_sync+0x282 fork_exit(c0afb3b0,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- lock order reversal: 1st 0xcb547c94 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1629 2nd 0xc1127e44 proctree (proctree) @ kern/subr_prf.c:149 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,34313a63,ca000a39,cb993148,4ea,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c1270cf8,95,f28cc7dc,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,c1127e44,c0f8ac7e,c7d6a068,c0f905b9,...) at _witness_debugger+0x25 witness_checkorder(c1127e44,1,c0f905b0,95,0,...) at witness_checkorder+0x86f _sx_slock(c1127e44,0,c0f905b0,95,cadd4910,...) at _sx_slock+0xa0 uprintf(c0fc4016,caadc788,c0f33f54,17e,cb2d5000,...) at uprintf+0x42 chkiq(cdaa8658,1,cb88f300,0,c10dbd40,...) at chkiq+0x5e6 ufs_makeinode(f28ccbc0,c10dbd40,f28ccb04,f28cca60,c0de2fe5,...) at ufs_makeinode+0x16a ufs_create(f28ccb04,c0fe4c4b,0,0,f28ccb80,...) at ufs_create+0x30 VOP_CREATE_APV(c10db7c0,f28ccb04,f28ccbc0,f28cca9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f28ccb80,f28ccc48,1b0,0,cb88f300,...) at vn_open_cred+0x205 vn_open(f28ccb80,f28ccc48,1b0,cb156508,c1ba6010,...) at vn_open+0x3b kern_openat(ca6bf2e0,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ca6bf2e0,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ca6bf2e0,f28cccec,c0fdd90a,c0f7c819,206,...) at sys_open+0x30 syscall(f28ccd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x2819cda3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- lock order reversal: 1st 0xe1a52a80 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc1127e44 proctree (proctree) @ kern/subr_prf.c:149 KDB: stack backtrace: db_trace_self_wrapper(c0f8fd13,34313a63,f2000a39,c0a82a94,cb9888a0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94acb,c0f937a0,c1270778,95,f2796760,...) at kdb_backtrace+0x2a _witness_debugger(c0f937a0,c1127e44,c0f8ac7e,c7d6a068,c0f905b9,...) at Feb 7 08:04:32 _wix4 kernel: pid 7tne9598 (rw), uid 1s004 inumber 10 osn /mnt: filesyst_dem full ebugger+0x25 witness_checkorder(c1127e44,1,c0f905b0,95,0,...) at witness_checkorder+0x86f _sx_slock(c1127e44,0,c0f905b0,95,cadd4910,...) at _sx_slock+0xa0 uprintf(c0fc40b4,caadc788,c0f33f54,ee,e1a52a20,...) at uprintf+0x42 chkdq(cd56ed24,40,0,cb88f300,0,...) at chkdq+0x5e6 ffs_alloc(cd56ed24,1c8,0,8a98,0,...) at ffs_alloc+0x151 ffs_balloc_ufs2(d124c2b8,e40000,0,1000,cb88f300,...) at ffs_balloc_ufs2+0x1c6a ffs_write(f2796bac,c0fe4b81,d124c2b8,0,d124c2b8,...) at ffs_write+0x2bd VOP_WRITE_APV(c10db7c0,f2796bac,d124c2b8,280,0,...) at VOP_WRITE_APV+0x136 vn_write(cb156e38,f2796c44,cb88f300,0,ca7c32e0,...) at vn_write+0x2bc dofilewrite(f2796c44,ffffffff,ffffffff,0,f2796c20,...) at dofilewrite+0x95 kern_writev(ca7c32e0,4,f2796c44,f2796c64,1,...) at kern_writev+0x68 sys_write(ca7c32e0,f2796cec,c1137540,f2796c88,206,...) at sys_write+0x4f syscall(f2796d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a5313, esp = 0xbfbfd70c, ebp = 0xbfbfe7c8 --- Feb 7 08:06:44 x4 kernel: pid 79827 (rw), uid 1004 inumber 14 on /mnt: filesystem full Feb 7 08:09:20 x4 kernel: pid 80134 (rw), uid 1004 inumber 50 on /mnt: filesystem full Feb 7 08:13:29 x4 kernel: pid 80695 (rw), uid 1004 inumber 30 on /mnt: filesystem full panic: Bad tailq NEXT(0xc12a5b08->tqh_last) != NULL cpuid = 2 KDB: enter: panic [ thread pid 80690 tid 100251 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 80690 tid 100251 td 0xcb987b80 kdb_enter(c0f8bc98,c0f8bc98,c0de6adf,f29fe9f8,2,...) at kdb_enter+0x3a panic(c0de6adf,c12a5b08,c0fc3f59,5c9,0,...) at panic+0x1ac dqrele(cb4af414,cadd4900,c10dbd40,cb4af414,cc457740,...) at dqrele+0x14c ufs_prepare_reclaim(cb4af414,f29fea50,c0af9ddf,c10db7c0,cb993100,...) at ufs_prepare_reclaim+0x36 ufs_reclaim(f29fea8c,c0fe41d0,0,cb4af414,cb987b80,...) at ufs_reclaim+0x26 VOP_RECLAIM_APV(c10db7c0,f29fea8c,0,0,cb4af4d8,...) at VOP_RECLAIM_APV+0xc5 vgonel(cb4af4d8,0,c0f9b72c,a1a,0,...) at vgonel+0x1c4 vrecycle(cb4af414,cb987b80,41f8,1,0,...) at vrecycle+0x5d ufs_inactive(f29feb44,c0fe4218,cb4af4d8,cb4af4d8,cb4af414,...) at ufs_inactive+0x390 VOP_INACTIVE_APV(c10db7c0,f29feb44,c0f9b72c,96f,c10ec7a0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10db7c0,f29feb78,c0f9b72c,8c6,0,...) at vinactive+0xb1 vputx(f29fec40,c0afe096,cb4af414,ffffffdf,2,...) at vputx+0x36c vput(cb4af414,ffffffdf,2,f29febf8,bfbdf6b7,...) at vput+0x10 kern_rmdirat(cb987b80,ffffff9c,bfbdf6b7,0,f29fec6c,...) at kern_rmdirat+0x206 kern_rmdir(cb987b80,bfbdf6b7,0,f29fed1c,c0dbecb7,...) at kern_rmdir+0x27 sys_rmdir(cb987b80,f29fecec,c0fdd90a,c0fbd271,246,...) at sys_rmdir+0x22 syscall(f29fed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbdf24c, ebp = 0xbfbdf688 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x738000 curthread = 0xcb987000: pid 80678 "creat" curpcb = 0xf2a0ad80 fpcurthread = none idlethread = 0xc7dd28a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6a29000 curthread = 0xcb3352e0: pid 80683 "rw" curpcb = 0xf2955d80 fpcurthread = none idlethread = 0xc7dd25c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6a2c000 curthread = 0xcb987b80: pid 80690 "mkdir" curpcb = 0xf29fed80 fpcurthread = none idlethread = 0xc7dd22e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6a2f000 curthread = 0xca6c0b80: pid 19 "softdepflush" curpcb = 0xee320d80 fpcurthread = none idlethread = 0xc7dd2000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 80690 (mkdir) thread 0xcb987b80 (100251) exclusive sleep mutex dqhlock (dqhlock) r = 0 (0xc12a5ae8) locked @ ufs/ufs/ufs_quota.c:1481 exclusive lockmgr ufs (ufs) r = 0 (0xcb4af46c) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xd0ca0b38) locked @ kern/vfs_subr.c:2167 Process 80689 (rw) thread 0xca75db80 (100079) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19859a0) locked @ kern/vfs_bio.c:2658 exclusive lockmgr ufs (ufs) r = 0 (0xd13689dc) locked @ kern/vfs_vnops.c:640 Process 80687 (rw) thread 0xcb3208a0 (100232) exclusive sleep mutex page lock (page lock) r = 0 (0xc12a6500) locked @ kern/vfs_bio.c:1637 exclusive sleep mutex vm object (standard object) r = 0 (0xcf844990) locked @ kern/vfs_bio.c:1629 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1aa2620) locked @ ufs/ffs/ffs_softdep.c:6681 exclusive lockmgr ufs (ufs) r = 0 (0xccc56880) locked @ kern/vfs_subr.c:2167 Process 80683 (rw) thread 0xcb3352e0 (100213) exclusive sleep mutex page lock (page lock) r = 0 (0xc12a7200) locked @ kern/vfs_bio.c:1637 exclusive sleep mutex vm object (standard object) r = 0 (0xcc47a990) locked @ kern/vfs_bio.c:1629 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a9c160) locked @ ufs/ffs/ffs_softdep.c:6681 exclusive lockmgr ufs (ufs) r = 0 (0xcb9e69dc) locked @ kern/vfs_subr.c:2167 Process 80678 (creat) thread 0xcb987000 (100255) exclusive lockmgr bufwait (bufwait) r = 0 (0xe199a040) locked @ kern/vfs_bio.c:2658 exclusive lockmgr ufs (ufs) r = 0 (0xcfb79880) locked @ kern/vfs_lookup.c:542 Process 19 (softdepflush) thread 0xca6c0b80 (100077) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1953a20) locked @ kern/vfs_bio.c:2658 db:0:alllocks> show lockedvnods Locked vnodes 0xcfb79828: tag ufs, type VDIR usecount 2, writecount 0, refcount 4 mountedhere 0 flags () v_object 0xcf7921b0 ref 0 pages 2 lock type ufs: EXCL by thread 0xcb987000 (pid 80678) #0 0xc0a42124 at __lockmgr_args+0x5c4 #1 0xc0ca4091 at ffs_lock+0xa1 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0aeb8f6 at lookup+0x106 #5 0xc0aeceff at namei+0x6bf #6 0xc0b07af0 at vn_open_cred+0x90 #7 0xc0b0807b at vn_open+0x3b #8 0xc0b042dc at kern_openat+0x1ec #9 0xc0b04775 at kern_open+0x35 #10 0xc0b047b0 at sys_open+0x30 #11 0xc0dbecb7 at syscall+0x2c7 #12 0xc0da7fe1 at Xint0x80_syscall+0x21 ino 40, on dev md5a 0xccc56828: tag ufs, type VREG usecount 0, writecount 0, refcount 475 mountedhere 0 flags (VV_NOSYNC|VI_DOINGINACT) v_object 0xcf844990 ref 0 pages 3781 lock type ufs: EXCL by thread 0xcb3208a0 (pid 80687) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ca4091 at ffs_lock+0xa1 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0afb06b at vget+0xbb #5 0xc0aeaa7d at vfs_hash_get+0xed #6 0xc0c9d3e9 at ffs_vgetf+0x49 #7 0xc0c9d96e at ffs_vget+0x2e #8 0xc0cac163 at ufs_lookup_ino+0x8a3 #9 0xc0cac52a at ufs_lookup+0x2a #10 0xc0de1975 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3f46 at vfs_cache_lookup+0xe6 #12 0xc0de3195 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebedb at lookup+0x6eb #14 0xc0aeceff at namei+0x6bf #15 0xc0afefe1 at kern_unlinkat+0xa1 #16 0xc0aff25f at kern_unlink+0x2f #17 0xc0aff292 at sys_unlink+0x22 ino 16, on dev md5a 0xcb9e6984: tag ufs, type VREG usecount 0, writecount 0, refcount 660 mountedhere 0 flags (VV_NOSYNC|VI_DOINGINACT) v_object 0xcc47a990 ref 0 pages 5258 lock type ufs: EXCL by thread 0xcb3352e0 (pid 80683) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ca4091 at ffs_lock+0xa1 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0afb06b at vget+0xbb #5 0xc0aeaa7d at vfs_hash_get+0xed #6 0xc0c9d3e9 at ffs_vgetf+0x49 #7 0xc0c9d96e at ffs_vget+0x2e #8 0xc0cac163 at ufs_lookup_ino+0x8a3 #9 0xc0cac52a at ufs_lookup+0x2a #10 0xc0de1975 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3f46 at vfs_cache_lookup+0xe6 #12 0xc0de3195 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebedb at lookup+0x6eb #14 0xc0aeceff at namei+0x6bf #15 0xc0afefe1 at kern_unlinkat+0xa1 #16 0xc0aff25f at kern_unlink+0x2f #17 0xc0aff292 at sys_unlink+0x22 ino 23, on dev md5a 0xd1368984: tag ufs, type VREG usecount 1, writecount 1, refcount 143 mountedhere 0 flags () v_object 0xccd1b120 ref 0 pages 1128 lock type ufs: EXCL by thread 0xca75db80 (pid 80689) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ca4091 at ffs_lock+0xa1 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0b093f6 at vn_write+0x176 #5 0xc0aa9325 at dofilewrite+0x95 #6 0xc0aa9998 at kern_writev+0x68 #7 0xc0aa9aaf at sys_write+0x4f #8 0xc0dbecb7 at syscall+0x2c7 #9 0xc0da7fe1 at Xint0x80_syscall+0x21 ino 10, on dev md5a 0xd0ca0ae0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xccbcfbd0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb987b80 (pid 80690) #0 0xc0a42124 at __lockmgr_args+0x5c4 #1 0xc0ca4091 at ffs_lock+0xa1 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0aeb8f6 at lookup+0x106 #5 0xc0aeceff at namei+0x6bf #6 0xc0afdf10 at kern_rmdirat+0x80 #7 0xc0afe117 at kern_rmdir+0x27 #8 0xc0afe142 at sys_rmdir+0x22 #9 0xc0dbecb7 at syscall+0x2c7 #10 0xc0da7fe1 at Xint0x80_syscall+0x21 ino 98467, on dev md5a 0xcb4af414: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOOMED|VI_DOINGINACT) lock type ufs: EXCL by thread 0xcb987b80 (pid 80690) #0 0xc0a4277e at __lockmgr_args+0xc1e #1 0xc0ca4091 at ffs_lock+0xa1 #2 0xc0de2015 at VOP_LOCK1_APV+0xb5 #3 0xc0b085a8 at _vn_lock+0x78 #4 0xc0afb06b at vget+0xbb #5 0xc0aeaa7d at vfs_hash_get+0xed #6 0xc0c9d3e9 at ffs_vgetf+0x49 #7 0xc0c9d96e at ffs_vget+0x2e #8 0xc0cac163 at ufs_lookup_ino+0x8a3 #9 0xc0cac52a at ufs_lookup+0x2a #10 0xc0de1975 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3f46 at vfs_cache_lookup+0xe6 #12 0xc0de3195 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebedb at lookup+0x6eb #14 0xc0aeceff at namei+0x6bf #15 0xc0afdf10 at kern_rmdirat+0x80 #16 0xc0afe117 at kern_rmdir+0x27 #17 0xc0afe142 at sys_rmdir+0x22 ino 98468, on dev md5a db:0:lockedvnods> show mount 0xca725b50 /dev/ad4s1a on / (ufs) 0xca726000 devfs on /dev (devfs) 0xcaa605a8 /dev/ad4s1f on /home (ufs) 0xca7255a8 /dev/ad4s1d on /usr (ufs) 0xca7252d4 /dev/ad4s1e on /var (ufs) 0xca725000 procfs on /proc (procfs) 0xcaadc000 linprocfs on /usr/compat/linux/proc (linprocfs) 0xcaa602d4 /dev/label/tmp on /tmp (ufs) 0xcaadc5a8 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 80722 2291 2288 1001 S nanslp 0xc1129564 sleep 80690 80676 79041 1004 R+ CPU 2 mkdir 80689 80673 79041 1004 R+ rw 80688 80674 79041 1004 S+ nanslp 0xc1129564 creat 80687 80673 79041 1004 R+ rw 80686 80674 79041 1004 S+ nanslp 0xc1129564 creat 80684 80674 79041 1004 S+ nanslp 0xc1129564 creat 80683 80673 79041 1004 R+ CPU 1 rw 80682 80674 79041 1004 S+ nanslp 0xc1129564 creat 80680 80674 79041 1004 S+ nanslp 0xc1129564 creat 80678 80674 79041 1004 R+ CPU 0 creat 80676 80672 79041 1004 S+ wait 0xcb29d588 mkdir 80674 80671 79041 1004 S+ wait 0xd11ef588 creat 80673 80670 79041 1004 S+ wait 0xcac8fb10 rw 80672 79049 79041 1004 S+ nanslp 0xc1129564 mkdir 80671 79049 79041 1004 S+ nanslp 0xc1129564 creat 80670 79049 79041 1004 S+ nanslp 0xc1129564 rw 79049 79048 79041 1004 S+ wait 0xcaaee000 run 79048 79047 79041 1004 S+ wait 0xca7b984c run 79047 79041 79041 1004 S+ nanslp 0xc1129564 run 79041 79035 79041 1004 S+ wait 0xcb8bc84c sh 79035 79011 87542 0 S+ wait 0xcb98684c su 79024 0 0 0 DL mdwait 0xcb38f000 [md5] 79011 87542 87542 0 S+ wait 0xcb98484c sh 87542 2275 87542 0 S+ wait 0xcbac7588 sh 84482 84477 84482 1001 Ss+ ttyin 0xcba9d470 bash 84477 84447 84447 1001 S select 0xcb708224 sshd 84447 2091 84447 0 Ss select 0xcb59eea4 sshd 2292 2288 2288 1001 S piperd 0xcacb6000 awk 2291 2288 2288 1001 S wait 0xca7bb000 sh 2290 2289 2290 1001 Ss kqread 0xca738580 tail 2289 2281 2281 1001 S select 0xca7e3664 sshd 2288 2287 2288 1001 Ss wait 0xcadf684c sh 2287 2280 2280 1001 S select 0xca728324 sshd 2286 2285 2286 1001 Ss+ select 0xca6b2224 top 2285 2279 2279 1001 S select 0xca6b15e4 sshd 2281 2091 2281 0 Ss select 0xca7e3da4 sshd 2280 2091 2280 0 Ss select 0xca6b2be4 sshd 2279 2091 2279 0 Ss select 0xca6b24a4 sshd 2275 2271 2275 0 S+ wait 0xca7bb2c4 bash 2271 2270 2271 0 S+ pause 0xcab0f5e0 csh 2270 2167 2270 1001 S+ wait 0xcac9184c su 2260 1 2260 0 Ss+ ttyin 0xc7efda70 getty 2259 1 2259 0 Ss+ ttyin 0xc7efdc70 getty 2258 1 2258 0 Ss+ ttyin 0xc7efde70 getty 2257 1 2257 0 Ss+ ttyin 0xc8192070 getty 2256 1 2256 0 Ss+ ttyin 0xc8192270 getty 2255 1 2255 0 Ss+ ttyin 0xc8192470 getty 2254 1 2254 0 Ss+ ttyin 0xc7efc670 getty 2253 1 2253 0 Ss+ ttyin 0xc7efc470 getty 2252 1 2252 0 Ss+ ttyin 0xc7efc070 getty 2213 1 2213 0 Ss select 0xcac67a64 inetd 2181 1 2181 0 Ss nanslp 0xc1129564 watchdogd 2167 2166 2167 1001 Ss+ wait 0xcac8f000 bash 2166 2164 2164 1001 S select 0xca6b23e4 sshd 2164 2091 2164 0 Ss select 0xca7e3464 sshd 2111 1 2111 0 Ss nanslp 0xc1129564 cron 2103 1 2103 25 Ss pause 0xcadf5058 sendmail 2099 1 2099 0 Ss select 0xca6b1164 sendmail 2091 1 2091 0 Ss select 0xca6b1d24 sshd 2031 1 2031 0 Ss select 0xca6b17a4 moused 1953 1 1953 0 Ss select 0xcac67de4 ntpd 1853 1846 1846 0 S (threaded) nfsd 100142 S rpcsvc 0xca60fbd0 nfsd: service 100141 S rpcsvc 0xca60fc10 nfsd: service 100140 S rpcsvc 0xca60fc50 nfsd: service 100138 S rpcsvc 0xca6c80d0 nfsd: master 1846 1 1846 0 Ss select 0xca689de4 nfsd 1836 1 1836 0 Ss select 0xca6b1b64 mountd 1737 1 1737 0 Ss select 0xca7e30e4 rpcbind 1710 1 1710 0 Ss select 0xca6b2864 syslogd 1503 1 1503 0 Ss select 0xca6b2aa4 devd 19 0 0 0 RL CPU 3 [softdepflush] 18 0 0 0 DL vlruwt 0xca6bc2c4 [vnlru] 17 0 0 0 DL syncer 0xc129f734 [syncer] 16 0 0 0 DL psleep 0xc129f3c8 [bufdaemon] 9 0 0 0 DL pgzero 0xc12a78dc [pagezero] 8 0 0 0 DL psleep 0xc12a74c8 [vmdaemon] 7 0 0 0 DL psleep 0xc12a7490 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10edd54 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc12a1258 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc819a000 [ctl_thrd] 3 0 0 0 DL - 0xc7ff8c3c [fdc0] 2 0 0 0 SL - 0xc808e000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8065d34 [usbus5] 100057 D - 0xc8065d04 [usbus5] 100056 D - 0xc8065cd4 [usbus5] 100055 D - 0xc8065ca4 [usbus5] 100053 D - 0xc8058b5c [usbus4] 100052 D - 0xc8058b2c [usbus4] 100051 D - 0xc8058afc [usbus4] 100050 D - 0xc8058acc [usbus4] 100049 D - 0xc8054b5c [usbus3] 100048 D - 0xc8054b2c [usbus3] 100047 D - 0xc8054afc [usbus3] 100046 D - 0xc8054acc [usbus3] 100045 D - 0xc804bb5c [usbus2] 100044 D - 0xc804bb2c [usbus2] 100043 D - 0xc804bafc [usbus2] 100042 D - 0xc804bacc [usbus2] 100040 D - 0xc8045b5c [usbus1] 100039 D - 0xc8045b2c [usbus1] 100038 D - 0xc8045afc [usbus1] 100037 D - 0xc8045acc [usbus1] 100035 D - 0xc8038b5c [usbus0] 100034 D - 0xc8038b2c [usbus0] 100033 D - 0xc8038afc [usbus0] 100032 D - 0xc8038acc [usbus0] 14 0 0 0 DL - 0xc1128364 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc1125f68 [g_down] 100014 D - 0xc1125f64 [g_up] 100013 D - 0xc1125f5c [g_event] 12 0 0 0 WL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100023 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7dd0b10 [init] 10 0 0 0 DL audit_wo 0xc12a5160 [audit] 0 0 0 0 DLs (threaded) [kernel] 100078 D - 0xc7ee2340 [mca taskq] 100068 D - 0xc1128364 [deadlkres] 100061 D - 0xc7ee2640 [fw0_taskq] 100025 D - 0xc7ee2740 [thread taskq] 100022 D - 0xc7ee27c0 [kqueue taskq] 100021 D - 0xc7ee2800 [ffs_trim taskq] 100020 D - 0xc7ee2840 [acpi_task_2] 100019 D - 0xc7ee2840 [acpi_task_1] 100018 D - 0xc7ee2840 [acpi_task_0] 100016 D - 0xc7ee2880 [firmware taskq] 100000 D sched 0xc1126040 [swapper] 80693 80673 79041 1004 Z+ rw 80685 80673 79041 1004 Z+ rw 80694 80673 79041 1004 Z+ rw 80692 80673 79041 1004 Z+ rw 80695 80673 79041 1004 Z+ rw 80691 80673 79041 1004 Z+ rw 80696 80673 79041 1004 Z+ rw db:0:ps> allt Tracing command sleep pid 80722 tid 100165 td 0xcac755c0 sched_switch(cac755c0,0,104,1a3,2e8530cb,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac755c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a9b300,cac755c0,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,2711,...) at _sleep+0x34f kern_nanosleep(cac755c0,f2899c50,f2899c58,a,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cac755c0,f2899cec,c0fdd90a,c0f94e58,246,...) at sys_nanosleep+0x6f syscall(f2899d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816de27, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command mkdir pid 80690 tid 100251 td 0xcb987b80 kdb_enter(c0f8bc98,c0f8bc98,c0de6adf,f29fe9f8,2,...) at kdb_enter+0x3a panic(c0de6adf,c12a5b08,c0fc3f59,5c9,0,...) at panic+0x1ac dqrele(cb4af414,cadd4900,c10dbd40,cb4af414,cc457740,...) at dqrele+0x14c ufs_prepare_reclaim(cb4af414,f29fea50,c0af9ddf,c10db7c0,cb993100,...) at ufs_prepare_reclaim+0x36 ufs_reclaim(f29fea8c,c0fe41d0,0,cb4af414,cb987b80,...) at ufs_reclaim+0x26 VOP_RECLAIM_APV(c10db7c0,f29fea8c,0,0,cb4af4d8,...) at VOP_RECLAIM_APV+0xc5 vgonel(cb4af4d8,0,c0f9b72c,a1a,0,...) at vgonel+0x1c4 vrecycle(cb4af414,cb987b80,41f8,1,0,...) at vrecycle+0x5d ufs_inactive(f29feb44,c0fe4218,cb4af4d8,cb4af4d8,cb4af414,...) at ufs_inactive+0x390 VOP_INACTIVE_APV(c10db7c0,f29feb44,c0f9b72c,96f,c10ec7a0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10db7c0,f29feb78,c0f9b72c,8c6,0,...) at vinactive+0xb1 vputx(f29fec40,c0afe096,cb4af414,ffffffdf,2,...) at vputx+0x36c vput(cb4af414,ffffffdf,2,f29febf8,bfbdf6b7,...) at vput+0x10 kern_rmdirat(cb987b80,ffffff9c,bfbdf6b7,0,f29fec6c,...) at kern_rmdirat+0x206 kern_rmdir(cb987b80,bfbdf6b7,0,f29fed1c,c0dbecb7,...) at kern_rmdir+0x27 sys_rmdir(cb987b80,f29fecec,c0fdd90a,c0fbd271,246,...) at sys_rmdir+0x22 syscall(f29fed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbdf24c, ebp = 0xbfbdf688 --- Tracing command rw pid 80689 tid 100079 td 0xca75db80 sched_switch(ca75db80,0,104,1a3,66cc8a10,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ca75db80,0,c0f916c0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca73eb1c,60,c0fbf3b5,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca73eb1c,80900,cf7bd220,0,0,...) at __lockmgr_args+0xb3f ffs_copyonwrite(cf7bd15c,e19ac2c0,0,e18e8420,d1368984,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(cf7bd254,e18e8420,f26ff8d8,ca75db80,ccd1b120,...) at ffs_geom_strategy+0xa0 ufs_strategy(f26ff914,c0fe4946,ca75db80,e18e8420,4,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c10db7c0,f26ff914,c0f98c8a,c10ec840,d1368984,...) at VOP_STRATEGY_APV+0xe5 bufstrategy(d1368a7c,e18e8420,3a6,e19ac2c0,c5708310,...) at bufstrategy+0x61 bufwrite(e18e8420,3,f26ff9b4,c0ae47a7,e18e8420,...) at bufwrite+0x159 bawrite(e18e8420,e18e8528,18,3af,0,...) at bawrite+0x5c cluster_wbuild(d1368984,8000,8b,0,3,...) at cluster_wbuild+0x837 cluster_write(d1368984,e1985940,460000,0,7f,...) at cluster_write+0x203 ffs_write(f26ffbac,c0fe4b81,d1368984,0,d1368984,...) at ffs_write+0x52b VOP_WRITE_APV(c10db7c0,f26ffbac,d1368984,280,0,...) at VOP_WRITE_APV+0x136 vn_write(ca7693b8,f26ffc44,cb88f300,0,ca75db80,...) at vn_write+0x2bc dofilewrite(f26ffc44,ffffffff,ffffffff,0,f26ffc20,...) at dofilewrite+0x95 kern_writev(ca75db80,4,f26ffc44,f26ffc64,1,...) at kern_writev+0x68 sys_write(ca75db80,f26ffcec,c0fdd90a,c0f5a447,206,...) at sys_write+0x4f syscall(f26ffd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a5313, esp = 0xbfbfd70c, ebp = 0xbfbfe7c8 --- Tracing command creat pid 80688 tid 100175 td 0xc818bb80 sched_switch(c818bb80,0,104,1a3,a5900bb9,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c818bb80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1b59,c0a9b300,c818bb80,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,1b59,...) at _sleep+0x34f kern_nanosleep(c818bb80,f28d4c50,f28d4c58,7,0,...) at kern_nanosleep+0xc1 sys_nanosleep(c818bb80,f28d4cec,c,c,202,...) at sys_nanosleep+0x6f syscall(f28d4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command rw pid 80687 tid 100232 td 0xcb3208a0 sched_switch(cb3208a0,0,602,19e,66ce6168,...) at sched_switch+0x3ec mi_switch(602,0,c0f8c4df,cd,0,...) at mi_switch+0x1ff critical_exit(cb3208a0,0,0,c1270b88,0,...) at critical_exit+0xb5 ipi_bitmap_handler(8,28,28,c7d6b178,0,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0xc0aa70ac, esp = 0xf29a9600, ebp = 0xf29a9650 --- witness_checkorder(c12a7400,9,c0fc72d2,75a,0,...) at witness_checkorder+0x25c _mtx_lock_flags(c12a7400,0,c0fc72d2,75a,c4b444d8,...) at _mtx_lock_flags+0xcc vm_pageq_remove(c4b444d8,4,c0fc72d2,7c8,c4b444d8,...) at vm_pageq_remove+0x6d vm_page_free_toq(c4b444d8,f29a96e4,c0adc91a,c4b444d8,0,...) at vm_page_free_toq+0xa4 vm_page_free(c4b444d8,0,c0f98c8a,665,0,...) at vm_page_free+0x15 vfs_vmio_release(cf844990,0,c0f98c8a,573,c10c0658,...) at vfs_vmio_release+0xda brelse(e1aa25c0,0,c0fbf910,1a20,0,...) at brelse+0x420 trunc_dependencies(ffffffff,ffffffff,0,800,0,...) at trunc_dependencies+0x760 softdep_setup_freeblocks(cf98d828,0,0,800,e5,...) at softdep_setup_freeblocks+0x94d ffs_truncate(ccc56828,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f29a9adc,c0fe4218,ccc568ec,ccc568ec,ccc56828,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10db7c0,f29a9adc,c0f9b72c,96f,c10ec7a0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10db7c0,f29a9b10,c0f9b72c,8c6,0,...) at vinactive+0xb1 vputx(f29a9c3c,c0aff1e3,ccc56828,ffffffdf,ccc56828,...) at vputx+0x36c vput(ccc56828,ffffffdf,ccc56828,f29a9b94,4,...) at vput+0x10 kern_unlinkat(cb3208a0,ffffff9c,bfbfe738,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(cb3208a0,bfbfe738,0,f29a9d1c,c0dbecb7,...) at kern_unlink+0x2f sys_unlink(cb3208a0,f29a9cec,c0fdd90a,c0f7c819,202,...) at sys_unlink+0x22 syscall(f29a9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28192b5f, esp = 0xbfbfd70c, ebp = 0xbfbfe7c8 --- Tracing command creat pid 80686 tid 100170 td 0xca6bfb80 sched_switch(ca6bfb80,0,104,1a3,a4ecf2ff,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6bfb80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1b59,c0a9b300,ca6bfb80,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,1b59,...) at _sleep+0x34f kern_nanosleep(ca6bfb80,f28b9c50,f28b9c58,7,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca6bfb80,f28b9cec,c,c,202,...) at sys_nanosleep+0x6f syscall(f28b9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command creat pid 80684 tid 100264 td 0xcbacd8a0 sched_switch(cbacd8a0,0,104,1a3,a592d35a,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cbacd8a0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1389,c0a9b300,cbacd8a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,1389,...) at _sleep+0x34f kern_nanosleep(cbacd8a0,f2a25c50,f2a25c58,5,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cbacd8a0,f2a25cec,c,c,206,...) at sys_nanosleep+0x6f syscall(f2a25d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command rw pid 80683 tid 100213 td 0xcb3352e0 cpustop_handler(1,13,f2955580,c0dbf0b6,cb3352e0,...) at cpustop_handler+0x28 ipi_nmi_handler(cb3352e0,cb3352e0,f2955508,46,cb2cbb10,...) at ipi_nmi_handler+0x47 trap(f295558c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0aa4ef2, esp = 0xf29555cc, ebp = 0xf2955618 --- _isitmyx(c0f93b96,f295567c,c0aa70bc,0,c7d6b318,...) at _isitmyx+0x122 isitmychild(0,c7d6b318,f2955640,c0aa4f97,c0f93b96,...) at isitmychild+0x17 witness_checkorder(c12a7400,9,c0fc72d2,853,0,...) at witness_checkorder+0x26c _mtx_lock_flags(c12a7400,0,c0fc72d2,853,c3d67160,...) at _mtx_lock_flags+0xcc vm_page_unwire(c3d67160,0,c0f98c8a,665,0,...) at vm_page_unwire+0xb9 vfs_vmio_release(cc47a990,0,c0f98c8a,573,c10c0658,...) at vfs_vmio_release+0xb2 brelse(e1a9c100,0,c0fbf910,1a20,0,...) at brelse+0x420 trunc_dependencies(ffffffff,ffffffff,0,800,0,...) at trunc_dependencies+0x760 softdep_setup_freeblocks(ccdbb074,0,0,800,e5,...) at softdep_setup_freeblocks+0x94d ffs_truncate(cb9e6984,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2955adc,c0fe4218,cb9e6a48,cb9e6a48,cb9e6984,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10db7c0,f2955adc,c0f9b72c,96f,c10ec7a0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10db7c0,f2955b10,c0f9b72c,8c6,0,...) at vinactive+0xb1 vputx(f2955c3c,c0aff1e3,cb9e6984,ffffffdf,cb9e6984,...) at vputx+0x36c vput(cb9e6984,ffffffdf,cb9e6984,f2955b94,4,...) at vput+0x10 kern_unlinkat(cb3352e0,ffffff9c,bfbfe738,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(cb3352e0,bfbfe738,0,f2955d1c,c0dbecb7,...) at kern_unlink+0x2f sys_unlink(cb3352e0,f2955cec,c0fdd90a,c0f7c819,202,...) at sys_unlink+0x22 syscall(f2955d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28192b5f, esp = 0xbfbfd70c, ebp = 0xbfbfe7c8 --- Tracing command creat pid 80682 tid 100205 td 0xcb336b80 sched_switch(cb336b80,0,104,1a3,a5002352,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb336b80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2329,c0a9b300,cb336b80,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,2329,...) at _sleep+0x34f kern_nanosleep(cb336b80,f293dc50,f293dc58,9,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb336b80,f293dcec,c,c,206,...) at sys_nanosleep+0x6f syscall(f293dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command creat pid 80680 tid 100274 td 0xd11f7000 sched_switch(d11f7000,0,104,1a3,a5427f7c,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d11f7000,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1771,c0a9b300,d11f7000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,1771,...) at _sleep+0x34f kern_nanosleep(d11f7000,f2a43c50,f2a43c58,6,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d11f7000,f2a43cec,c,c,206,...) at sys_nanosleep+0x6f syscall(f2a43d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command creat pid 80678 tid 100255 td 0xcb987000 cpustop_handler(0,13,f2a0a694,c0dbf0b6,0,...) at cpustop_handler+0x28 ipi_nmi_handler(0,c7d6b7f8,f2a0a61c,c0aa4f97,cbac884c,...) at ipi_nmi_handler+0x47 trap(f2a0a6a0) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0aa4c3c, esp = 0xf2a0a6e0, ebp = 0xf2a0a6f8 --- witness_lock(c12a59e0,8,c0fbf910,847,0,...) at witness_lock+0x2c _mtx_lock_flags(c12a59e0,0,c0fbf910,847,f9,...) at _mtx_lock_flags+0x11c inodedep_lookup(f2a0a768,0,c0fbf910,125a,cb2d5000,...) at inodedep_lookup+0x119 softdep_setup_inomapdep(e1999fe0,cfc10c3c,f9,81b0,0,...) at softdep_setup_inomapdep+0x9a ffs_nodealloccg(cfc10c3c,0,28,0,81b0,...) at ffs_nodealloccg+0x58b ffs_hashalloc(28,0,81b0,0,c0c714a0,...) at ffs_hashalloc+0x85 ffs_valloc(cfb79828,81b0,cb88f300,f2a0a914,c10dbd40,...) at ffs_valloc+0x4d3 ufs_makeinode(f2a0abc0,c10dbd40,f2a0ab04,f2a0aa60,c0de2fe5,...) at ufs_makeinode+0xc3 ufs_create(f2a0ab04,c0fe4c4b,0,0,f2a0ab80,...) at ufs_create+0x30 VOP_CREATE_APV(c10db7c0,f2a0ab04,f2a0abc0,f2a0aa9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f2a0ab80,f2a0ac48,1b0,0,cb88f300,...) at vn_open_cred+0x205 vn_open(f2a0ab80,f2a0ac48,1b0,cb387690,c1ba6010,...) at vn_open+0x3b kern_openat(cb987000,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(cb987000,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(cb987000,f2a0acec,c0fdd90a,c0f7c819,206,...) at sys_open+0x30 syscall(f2a0ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x2819cda3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command mkdir pid 80676 tid 100197 td 0xcad59b80 sched_switch(cad59b80,0,104,1a3,a4df7ff9,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cad59b80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb29d588,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb29d588,cb29d610,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cad59b80,13b32,f2923c60,0,0,...) at kern_wait+0x626 sys_wait4(cad59b80,f2923cec,c,c,216,...) at sys_wait4+0x3b syscall(f2923d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811245b, esp = 0xbfbfe79c, ebp = 0xbfbfe7b8 --- Tracing command creat pid 80674 tid 100273 td 0xcb989b80 sched_switch(cb989b80,0,104,1a3,a4ee278a,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb989b80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d11ef588,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(d11ef588,d11ef610,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cb989b80,13b26,f2a40c60,0,0,...) at kern_wait+0x626 sys_wait4(cb989b80,f2a40cec,c,c,216,...) at sys_wait4+0x3b syscall(f2a40d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811245b, esp = 0xbfbfe79c, ebp = 0xbfbfe7b8 --- Tracing command rw pid 80673 tid 100130 td 0xcab242e0 sched_switch(cab242e0,0,104,1a3,31bf75e1,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab242e0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cac8fb10,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cac8fb10,cac8fb98,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cab242e0,13b2b,f27fcc60,0,0,...) at kern_wait+0x626 sys_wait4(cab242e0,f27fccec,c0fdd90a,c0f9440e,216,...) at sys_wait4+0x3b syscall(f27fcd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811245b, esp = 0xbfbfe7ac, ebp = 0xbfbfe7c8 --- Tracing command mkdir pid 80672 tid 100095 td 0xca7595c0 sched_switch(ca7595c0,0,104,1a3,52341541,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca7595c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b300,ca7595c0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,3e9,...) at _sleep+0x34f kern_nanosleep(ca7595c0,f2755c50,f2755c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca7595c0,f2755cec,c0fdd90a,c0f94a84,202,...) at sys_nanosleep+0x6f syscall(f2755d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command creat pid 80671 tid 100207 td 0xcb3365c0 sched_switch(cb3365c0,0,104,1a3,523487d6,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb3365c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b300,cb3365c0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,3e9,...) at _sleep+0x34f kern_nanosleep(cb3365c0,f2943c50,f2943c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb3365c0,f2943cec,c0fdd90a,c0f94a84,202,...) at sys_nanosleep+0x6f syscall(f2943d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command rw pid 80670 tid 100247 td 0xcb9888a0 sched_switch(cb9888a0,0,104,1a3,5218ca19,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb9888a0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b300,cb9888a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,3e9,...) at _sleep+0x34f kern_nanosleep(cb9888a0,f29d6c50,f29d6c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb9888a0,f29d6cec,c0fdd90a,c0f94a84,202,...) at sys_nanosleep+0x6f syscall(f29d6d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe79c, ebp = 0xbfbfe7c8 --- Tracing command run pid 79049 tid 100102 td 0xcab015c0 sched_switch(cab015c0,0,104,1a3,a431de58,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab015c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(caaee000,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(caaee000,caaee088,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cab015c0,13b1e,f276ac60,0,0,...) at kern_wait+0x626 sys_wait4(cab015c0,f276acec,c,c,216,...) at sys_wait4+0x3b syscall(f276ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811145b, esp = 0xbfbfe22c, ebp = 0xbfbfe248 --- Tracing command run pid 79048 tid 100119 td 0xca7c1b80 sched_switch(ca7c1b80,0,104,1a3,c804f8ef,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca7c1b80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7b984c,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7b984c,ca7b98d4,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(ca7c1b80,134c9,f27ccc60,0,0,...) at kern_wait+0x626 sys_wait4(ca7c1b80,f27cccec,c,c,216,...) at sys_wait4+0x3b syscall(f27ccd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811145b, esp = 0xbfbfe74c, ebp = 0xbfbfe768 --- Tracing command run pid 79047 tid 100225 td 0xcb36d2e0 sched_switch(cb36d2e0,0,104,1a3,612ff305,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb36d2e0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b300,cb36d2e0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,3e9,...) at _sleep+0x34f kern_nanosleep(cb36d2e0,f2994c50,f2994c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb36d2e0,f2994cec,c0fdd90a,c0f94a84,202,...) at sys_nanosleep+0x6f syscall(f2994d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28182e27, esp = 0xbfbfe73c, ebp = 0xbfbfe768 --- Tracing command sh pid 79041 tid 100221 td 0xcb36e000 sched_switch(cb36e000,0,104,1a3,c7ac99c4,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb36e000,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb8bc84c,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb8bc84c,cb8bc8d4,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cb36e000,ffffffff,f2988c60,2,0,...) at kern_wait+0x626 sys_wait4(cb36e000,f2988cec,c0fdd90a,c0f945b6,216,...) at sys_wait4+0x3b syscall(f2988d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817645b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command su pid 79035 tid 100233 td 0xcb3205c0 sched_switch(cb3205c0,0,104,1a3,c39a51c1,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb3205c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb98684c,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb98684c,cb9868d4,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cb3205c0,134c1,f29acc60,2,0,...) at kern_wait+0x626 sys_wait4(cb3205c0,f29accec,c,c,216,...) at sys_wait4+0x3b syscall(f29acd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2813245b, esp = 0xbfbfe2cc, ebp = 0xbfbfe2e8 --- Tracing command md5 pid 79024 tid 100217 td 0xcb36eb80 sched_switch(cb36eb80,0,104,1a3,668a0546,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb36eb80,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb38f000,5c,c0f28882,0,0,...) at sleepq_wait+0x63 _sleep(cb38f000,cb38f020,25c,c0f28882,0,...) at _sleep+0x39c md_kthread(cb38f000,f297cd28,c0f86430,3db,cb8bd588,...) at md_kthread+0x11a fork_exit(c0769330,cb38f000,f297cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf297cd60, ebp = 0 --- Tracing command sh pid 79011 tid 100238 td 0xcb31e5c0 sched_switch(cb31e5c0,0,104,1a3,439f2fa0,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb31e5c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb98484c,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb98484c,cb9848d4,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cb31e5c0,ffffffff,f29bbc60,2,0,...) at kern_wait+0x626 sys_wait4(cb31e5c0,f29bbcec,c,c,216,...) at sys_wait4+0x3b syscall(f29bbd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817645b, esp = 0xbfbfe80c, ebp = 0xbfbfe828 --- Tracing command sh pid 87542 tid 100261 td 0xcbacf2e0 sched_switch(cbacf2e0,0,104,1a3,b35ddbb5,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cbacf2e0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cbac7588,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cbac7588,cbac7610,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cbacf2e0,ffffffff,f2a1cc60,2,0,...) at kern_wait+0x626 sys_wait4(cbacf2e0,f2a1ccec,c0fdd90a,c0f945b6,216,...) at sys_wait4+0x3b syscall(f2a1cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817645b, esp = 0xbfbfe6bc, ebp = 0xbfbfe6d8 --- Tracing command bash pid 84482 tid 100262 td 0xcbacf000 sched_switch(cbacf000,0,104,1a3,9a979280,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cbacf000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,cba9d404,0,c0f8a0cb,cbacf000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cba9d470,0,f2a1faf0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cba9d470,cba9d404,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(cba9d400,cba9d470,f2a1fc44,1,0,...) at tty_wait+0x71 ttydisc_read(cba9d400,f2a1fc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cbade800,f2a1fc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7872a0,f2a1fc44,ca7e2b00,0,cbacf000,...) at devfs_read_f+0x7e dofileread(f2a1fc44,ffffffff,ffffffff,0,f2a1fc20,...) at dofileread+0x9e kern_readv(cbacf000,0,f2a1fc44,f2a1fc64,1,...) at kern_readv+0x68 sys_read(cbacf000,f2a1fcec,c0fdd90a,c0f944c6,246,...) at sys_read+0x4f syscall(f2a1fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28362333, esp = 0xbfbfdfcc, ebp = 0xbfbfdff8 --- Tracing command sshd pid 84477 tid 100128 td 0xcab248a0 sched_switch(cab248a0,0,104,1a3,9a9a365d,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab248a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,cb708210,0,c0f8a0cb,cab248a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb708224,0,f27f6a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb708224,cb708210,c0f93e10,6a4,cba46348,...) at _cv_wait_sig+0x260 seltdwait(cba46348,58,cba87000,cab248a0,f27f6acc,...) at seltdwait+0xa2 kern_select(cab248a0,c,288060b8,288060c0,0,0,20,cac912c4,0) at kern_select+0x655 sys_select(cab248a0,f27f6cec,c0fdd90a,c0f9472b,206,...) at sys_select+0x66 syscall(f27f6d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 84447 tid 100122 td 0xca7c12e0 sched_switch(ca7c12e0,0,104,1a3,8cd956e6,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7c12e0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,cb59ee90,0,c0f8a0cb,ca7c12e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb59eea4,0,f27d8abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb59eea4,cb59ee90,c0f93e10,6a4,f27d8b44,...) at _cv_wait_sig+0x260 seltdwait(cab0482c,c0f93e10,5a1,ca7c12e0,8,...) at seltdwait+0xa2 sys_poll(ca7c12e0,f27d8cec,c0fdd90a,c0f7c819,202,...) at sys_poll+0x321 syscall(f27d8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command awk pid 2292 tid 100096 td 0xca7592e0 sched_switch(ca7592e0,0,104,1a3,2df82ead,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(ca7592e0,0,c0f916c0,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cacb6000,5c,c0f9400f,100,0,...) at sleepq_wait_sig+0x17 _sleep(cacb6000,cacb6178,15c,c0f9400f,0,...) at _sleep+0x385 pipe_read(cad537a8,f2758c44,caddd980,0,ca7592e0,...) at pipe_read+0x417 dofileread(f2758c44,ffffffff,ffffffff,0,f2758c20,...) at dofileread+0x9e kern_readv(ca7592e0,0,f2758c44,f2758c64,1,...) at kern_readv+0x68 sys_read(ca7592e0,f2758cec,c0fdd90a,f2758d80,216,...) at sys_read+0x4f syscall(f2758d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c8333, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 2291 tid 100117 td 0xca7c22e0 sched_switch(ca7c22e0,0,104,1a3,2e111ec0,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca7c22e0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7bb000,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7bb000,ca7bb088,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(ca7c22e0,ffffffff,f27c1c60,2,0,...) at kern_wait+0x626 sys_wait4(ca7c22e0,f27c1cec,c0fdd90a,c0f945b6,216,...) at sys_wait4+0x3b syscall(f27c1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817645b, esp = 0xbfbfe94c, ebp = 0xbfbfe968 --- Tracing command tail pid 2290 tid 100084 td 0xca75cb80 sched_switch(ca75cb80,0,104,1a3,ff0f8645,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,68,...) at mi_switch+0x1ff sleepq_switch(ca75cb80,0,c0f916c0,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b300,ca75cb80,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca738580,68,c0f85fee,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(ca738580,ca738580,168,c0f85fee,3e9,...) at _sleep+0x34f kern_kevent(ca75cb80,4,0,1,f2713c44,...) at kern_kevent+0x374 sys_kevent(ca75cb80,f2713cec,c0fdd90a,c0dec837,286,...) at sys_kevent+0x19e syscall(f2713d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x28171d3b, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sshd pid 2289 tid 100107 td 0xcab005c0 sched_switch(cab005c0,0,104,1a3,2853eb63,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab005c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca7e3650,0,c0f8a0cb,cab005c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7e3664,0,f2784a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7e3664,ca7e3650,c0f93e10,6a4,ca7e5540,...) at _cv_wait_sig+0x260 seltdwait(ca7e5540,58,ca7e2080,cab005c0,f2784acc,...) at seltdwait+0xa2 kern_select(cab005c0,c,288060b8,288060c0,0,0,20,cab0f84c,0) at kern_select+0x655 sys_select(cab005c0,f2784cec,c0fdd90a,c0f9472b,206,...) at sys_select+0x66 syscall(f2784d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sh pid 2288 tid 100149 td 0xcad57b80 sched_switch(cad57b80,0,104,1a3,84e16499,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cad57b80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cadf684c,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cadf684c,cadf68d4,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cad57b80,ffffffff,f2836c60,2,0,...) at kern_wait+0x626 sys_wait4(cad57b80,f2836cec,c,c,216,...) at sys_wait4+0x3b syscall(f2836d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817645b, esp = 0xbfbfeb1c, ebp = 0xbfbfeb38 --- Tracing command sshd pid 2287 tid 100110 td 0xca7c3b80 sched_switch(ca7c3b80,0,104,1a3,1aa28bac,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7c3b80,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca728310,0,c0f8a0cb,ca7c3b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca728324,0,f278da58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca728324,ca728310,c0f93e10,6a4,ca76a8c0,...) at _cv_wait_sig+0x260 seltdwait(ca76a8c0,58,ca727a80,ca7c3b80,f278dacc,...) at seltdwait+0xa2 kern_select(ca7c3b80,c,288060b8,288060c0,0,0,20,cab0f000,0) at kern_select+0x655 sys_select(ca7c3b80,f278dcec,c0fdd90a,c0f9472b,206,...) at sys_select+0x66 syscall(f278dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command top pid 2286 tid 100139 td 0xcac76b80 sched_switch(cac76b80,0,104,1a3,2a76bdb5,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac76b80,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2817a20,c0a4a71a,ca6b2210,0,cac76b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6b2224,0,f2817a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6b2224,ca6b2210,3e9,6a4,cad534d0,...) at _cv_timedwait_sig+0x270 seltdwait(f2817c10,f2817c18,ca7e2280,cac76b80,1b314834,...) at seltdwait+0x8a kern_select(cac76b80,2,bfbfebac,0,0,f2817c5c,20,1,0) at kern_select+0x655 sys_select(cac76b80,f2817cec,c0fdd90a,c0f5a447,246,...) at sys_select+0x66 syscall(f2817d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fd2b3, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command sshd pid 2285 tid 100115 td 0xca7c28a0 sched_switch(ca7c28a0,0,104,1a3,2a7aa1d5,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7c28a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b15d0,0,c0f8a0cb,ca7c28a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b15e4,0,f27b9a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b15e4,ca6b15d0,c0f93e10,6a4,cad539d8,...) at _cv_wait_sig+0x260 seltdwait(cad539d8,58,c7fcf480,ca7c28a0,f27b9acc,...) at seltdwait+0xa2 kern_select(ca7c28a0,a,288060b8,288060c0,0,0,20,ca7bb588,0) at kern_select+0x655 sys_select(ca7c28a0,f27b9cec,c0fdd90a,c0f9472b,206,...) at sys_select+0x66 syscall(f27b9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 2281 tid 100150 td 0xcad578a0 sched_switch(cad578a0,0,104,1a3,814b1617,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad578a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca7e3d90,0,c0f8a0cb,cad578a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7e3da4,0,f2839abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7e3da4,ca7e3d90,c0f93e10,6a4,f2839b44,...) at _cv_wait_sig+0x260 seltdwait(cab0492c,c0f93e10,5a1,cad578a0,0,...) at seltdwait+0xa2 sys_poll(cad578a0,f2839cec,c0fdd90a,c0dec837,202,...) at sys_poll+0x321 syscall(f2839d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 2280 tid 100136 td 0xcab22000 sched_switch(cab22000,0,104,1a3,80ab8f76,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab22000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b2bd0,0,c0f8a0cb,cab22000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b2be4,0,f280eabc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b2be4,ca6b2bd0,c0f93e10,6a4,f280eb44,...) at _cv_wait_sig+0x260 seltdwait(ca6a3b2c,c0f93e10,5a1,cab22000,0,...) at seltdwait+0xa2 sys_poll(cab22000,f280ecec,c0fdd90a,c0dec837,202,...) at sys_poll+0x321 syscall(f280ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 2279 tid 100085 td 0xca6c05c0 sched_switch(ca6c05c0,0,104,1a3,7fd133f6,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c05c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b2490,0,c0f8a0cb,ca6c05c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b24a4,0,f2717abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b24a4,ca6b2490,c0f93e10,6a4,f2717b44,...) at _cv_wait_sig+0x260 seltdwait(cab0e52c,c0f93e10,5a1,ca6c05c0,0,...) at seltdwait+0xa2 sys_poll(ca6c05c0,f2717cec,c,c,202,...) at sys_poll+0x321 syscall(f2717d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command bash pid 2275 tid 100116 td 0xca7c25c0 sched_switch(ca7c25c0,0,104,1a3,e124b1e2,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca7c25c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7bb2c4,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7bb2c4,ca7bb34c,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(ca7c25c0,ffffffff,f27bdc60,6,0,...) at kern_wait+0x626 sys_wait4(ca7c25c0,f27bdcec,c0fdd90a,c0f944c6,216,...) at sys_wait4+0x3b syscall(f27bdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282cf45b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command csh pid 2271 tid 100108 td 0xcab002e0 sched_switch(cab002e0,0,104,1a3,5816b254,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cab002e0,0,c0f916c0,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cab0f5e0,74,c0e1302e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cab0f5e0,cab0f610,174,c0e1302e,0,...) at _sleep+0x385 kern_sigsuspend(cab002e0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cab002e0,f2787cec,c0fdd90a,c0f944c6,202,...) at sys_sigsuspend+0x4d syscall(f2787d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28195ccb, esp = 0xbfbfe58c, ebp = 0xbfbfe5f8 --- Tracing command su pid 2270 tid 100126 td 0xcab26000 sched_switch(cab26000,0,104,1a3,fc41dde4,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab26000,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cac9184c,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cac9184c,cac918d4,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cab26000,8df,f27f0c60,2,0,...) at kern_wait+0x626 sys_wait4(cab26000,f27f0cec,c,c,216,...) at sys_wait4+0x3b syscall(f27f0d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2813245b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command getty pid 2260 tid 100124 td 0xcac77000 sched_switch(cac77000,0,104,1a3,35b7f0db,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac77000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cac77000,cac77000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efda70,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efda70,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efda00,c7efda70,f27e9c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efda00,f27e9c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6500,f27e9c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cac69268,f27e9c44,c7db1e80,0,cac77000,...) at devfs_read_f+0x7e dofileread(f27e9c44,ffffffff,ffffffff,0,f27e9c20,...) at dofileread+0x9e kern_readv(cac77000,0,f27e9c44,f27e9c64,1,...) at kern_readv+0x68 sys_read(cac77000,f27e9cec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f27e9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2259 tid 100131 td 0xcab24000 sched_switch(cab24000,0,104,1a3,35a8c272,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab24000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cab24000,cab24000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efdc70,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efdc70,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efdc00,c7efdc70,f27ffc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efdc00,f27ffc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6600,f27ffc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca769c08,f27ffc44,c7db1e80,0,cab24000,...) at devfs_read_f+0x7e dofileread(f27ffc44,ffffffff,ffffffff,0,f27ffc20,...) at dofileread+0x9e kern_readv(cab24000,0,f27ffc44,f27ffc64,1,...) at kern_readv+0x68 sys_read(cab24000,f27ffcec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f27ffd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2258 tid 100152 td 0xcad572e0 sched_switch(cad572e0,0,104,1a3,35ba2a01,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad572e0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cad572e0,cad572e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efde70,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efde70,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efde00,c7efde70,f283fc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efde00,f283fc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6700,f283fc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cad53bd0,f283fc44,c7db1e80,0,cad572e0,...) at devfs_read_f+0x7e dofileread(f283fc44,ffffffff,ffffffff,0,f283fc20,...) at dofileread+0x9e kern_readv(cad572e0,0,f283fc44,f283fc64,1,...) at kern_readv+0x68 sys_read(cad572e0,f283fcec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f283fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2257 tid 100105 td 0xcab00b80 sched_switch(cab00b80,0,104,1a3,35b2d946,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab00b80,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cab00b80,cab00b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8192070,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8192070,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8192000,c8192070,f277dc44,1,0,...) at tty_wait+0x71 ttydisc_read(c8192000,f277dc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6800,f277dc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7e55e8,f277dc44,c7db1e80,0,cab00b80,...) at devfs_read_f+0x7e dofileread(f277dc44,ffffffff,ffffffff,0,f277dc20,...) at dofileread+0x9e kern_readv(cab00b80,0,f277dc44,f277dc64,1,...) at kern_readv+0x68 sys_read(cab00b80,f277dcec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f277dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2256 tid 100133 td 0xcab228a0 sched_switch(cab228a0,0,104,1a3,35a71482,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab228a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cab228a0,cab228a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8192270,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8192270,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8192200,c8192270,f2805c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8192200,f2805c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6900,f2805c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca787b60,f2805c44,c7db1e80,0,cab228a0,...) at devfs_read_f+0x7e dofileread(f2805c44,ffffffff,ffffffff,0,f2805c20,...) at dofileread+0x9e kern_readv(cab228a0,0,f2805c44,f2805c64,1,...) at kern_readv+0x68 sys_read(cab228a0,f2805cec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f2805d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2255 tid 100156 td 0xcac775c0 sched_switch(cac775c0,0,104,1a3,35bf92af,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac775c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cac775c0,cac775c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8192470,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8192470,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8192400,c8192470,f284bc44,1,0,...) at tty_wait+0x71 ttydisc_read(c8192400,f284bc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6a00,f284bc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7e5dc8,f284bc44,c7db1e80,0,cac775c0,...) at devfs_read_f+0x7e dofileread(f284bc44,ffffffff,ffffffff,0,f284bc20,...) at dofileread+0x9e kern_readv(cac775c0,0,f284bc44,f284bc64,1,...) at kern_readv+0x68 sys_read(cac775c0,f284bcec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f284bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2254 tid 100083 td 0xca75d000 sched_switch(ca75d000,0,104,1a3,35a19bec,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca75d000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,ca75d000,ca75d000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efc670,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efc670,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efc600,c7efc670,f270fc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efc600,f270fc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6b00,f270fc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cad53c78,f270fc44,c7db1e80,0,ca75d000,...) at devfs_read_f+0x7e dofileread(f270fc44,ffffffff,ffffffff,0,f270fc20,...) at dofileread+0x9e kern_readv(ca75d000,0,f270fc44,f270fc64,1,...) at kern_readv+0x68 sys_read(ca75d000,f270fcec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f270fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2253 tid 100101 td 0xcab018a0 sched_switch(cab018a0,0,104,1a3,35af7cec,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab018a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,cab018a0,cab018a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efc470,0,c0f964f0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efc470,c1127c10,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efc400,c7efc470,f2767c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efc400,f2767c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6c00,f2767c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7697e0,f2767c44,c7db1e80,0,cab018a0,...) at devfs_read_f+0x7e dofileread(f2767c44,ffffffff,ffffffff,0,f2767c20,...) at dofileread+0x9e kern_readv(cab018a0,0,f2767c44,f2767c64,1,...) at kern_readv+0x68 sys_read(cab018a0,f2767cec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f2767d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2252 tid 100158 td 0xcac768a0 sched_switch(cac768a0,0,104,1a3,2a8163c7,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac768a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,c7efc004,0,c0f8a0cb,cac768a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efc070,0,f2851af0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efc070,c7efc004,c0f95ec8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efc000,c7efc070,f2851c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efc000,f2851c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7e17d00,f2851c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cad53b28,f2851c44,c7db1e80,0,cac768a0,...) at devfs_read_f+0x7e dofileread(f2851c44,ffffffff,ffffffff,0,f2851c20,...) at dofileread+0x9e kern_readv(cac768a0,0,f2851c44,f2851c64,1,...) at kern_readv+0x68 sys_read(cac768a0,f2851cec,c0fdd90a,c0df1576,246,...) at sys_read+0x4f syscall(f2851d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 2213 tid 100088 td 0xca6c02e0 sched_switch(ca6c02e0,0,104,1a3,11d00066,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c02e0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,cac67a50,0,c0f8a0cb,ca6c02e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cac67a64,0,f2723a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cac67a64,cac67a50,c0f93e10,6a4,cabecb98,...) at _cv_wait_sig+0x260 seltdwait(cabecb98,58,c7db1e80,ca6c02e0,c7d6e6b0,...) at seltdwait+0xa2 kern_select(ca6c02e0,6,bfbfdfa0,0,0,0,20,c804484c,4) at kern_select+0x655 sys_select(ca6c02e0,f2723cec,c0fdd90a,c0f94623,206,...) at sys_select+0x66 syscall(f2723d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b82b3, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 2181 tid 100146 td 0xcad585c0 sched_switch(cad585c0,0,104,1a3,281bfc81,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cad585c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9b300,cad585c0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,ea61,...) at _sleep+0x34f kern_nanosleep(cad585c0,f282dc50,f282dc58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cad585c0,f282dcec,c0fdd90a,c0df1576,206,...) at sys_nanosleep+0x6f syscall(f282dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819de27, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 2167 tid 100134 td 0xcab225c0 sched_switch(cab225c0,0,104,1a3,e5ee4272,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab225c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cac8f000,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cac8f000,cac8f088,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(cab225c0,ffffffff,f2808c60,6,0,...) at kern_wait+0x626 sys_wait4(cab225c0,f2808cec,c0fdd90a,c0f944c6,216,...) at sys_wait4+0x3b syscall(f2808d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282cf45b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 2166 tid 100118 td 0xca7c2000 sched_switch(ca7c2000,0,104,1a3,1b151fce,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7c2000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b23d0,0,c0f8a0cb,ca7c2000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b23e4,0,f27c8a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b23e4,ca6b23d0,c0f93e10,6a4,ca7e52a0,...) at _cv_wait_sig+0x260 seltdwait(ca7e52a0,58,caddd480,ca7c2000,f27c8acc,...) at seltdwait+0xa2 kern_select(ca7c2000,c,288060b8,288060c0,0,0,20,ca7b9b10,0) at kern_select+0x655 sys_select(ca7c2000,f27c8cec,c0fdd90a,c0f9472b,206,...) at sys_select+0x66 syscall(f27c8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 2164 tid 100154 td 0xcac77b80 sched_switch(cac77b80,0,104,1a3,8b2e2c88,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac77b80,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca7e3450,0,c0f8a0cb,cac77b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7e3464,0,f2845abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7e3464,ca7e3450,c0f93e10,6a4,f2845b44,...) at _cv_wait_sig+0x260 seltdwait(ca6a3e2c,c0f93e10,5a1,cac77b80,8,...) at seltdwait+0xa2 sys_poll(cac77b80,f2845cec,c0fdd90a,c0f7c819,202,...) at sys_poll+0x321 syscall(f2845d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command cron pid 2111 tid 100148 td 0xcad58000 sched_switch(cad58000,0,104,1a3,29104c7c,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cad58000,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9b300,cad58000,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1129564,6c,c0f8d203,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1129564,0,16c,c0f8d203,ea61,...) at _sleep+0x34f kern_nanosleep(cad58000,f2833c50,f2833c58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cad58000,f2833cec,c0fdd90a,c0f94a84,206,...) at sys_nanosleep+0x6f syscall(f2833d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2818fe27, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 2103 tid 100157 td 0xcae028a0 sched_switch(cae028a0,0,104,1a3,de0671e7,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cae028a0,0,c0f916c0,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cadf5058,74,c0e1302e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cadf5058,cadf5088,174,c0e1302e,0,...) at _sleep+0x385 kern_sigsuspend(cae028a0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cae028a0,f284ecec,c0fdd90a,c0f944c6,202,...) at sys_sigsuspend+0x4d syscall(f284ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28348ccb, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 2099 tid 100081 td 0xca75d5c0 sched_switch(ca75d5c0,0,104,1a3,bb5e1667,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca75d5c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2707a20,c0a4a71a,ca6b1150,0,ca75d5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6b1164,0,f2707a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6b1164,ca6b1150,1389,6a4,ca76a150,...) at _cv_timedwait_sig+0x270 seltdwait(f2707c10,f2707c18,cac65c00,ca75d5c0,c0a46f5d,...) at seltdwait+0x8a kern_select(ca75d5c0,5,bfbfc510,0,0,f2707c5c,20,5,0) at kern_select+0x655 sys_select(ca75d5c0,f2707cec,c0fdd90a,c0f949e3,206,...) at sys_select+0x66 syscall(f2707d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f32b3, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 2091 tid 100153 td 0xcad57000 sched_switch(cad57000,0,104,1a3,8b6c503f,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad57000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b1d10,0,c0f8a0cb,cad57000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b1d24,0,f2842a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b1d24,ca6b1d10,c0f93e10,6a4,ca787380,...) at _cv_wait_sig+0x260 seltdwait(ca787380,58,c7db2080,cad57000,cac78488,...) at seltdwait+0xa2 kern_select(cad57000,9,2880c0b8,0,0,0,20,cadf5b10,a) at kern_select+0x655 sys_select(cad57000,f2842cec,c,c,206,...) at sys_select+0x66 syscall(f2842d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 2031 tid 100155 td 0xcac778a0 sched_switch(cac778a0,0,104,1a3,630ab45a,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac778a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b1790,0,c0f8a0cb,cac778a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b17a4,0,f2848a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b17a4,ca6b1790,c0f93e10,6a4,ca787bd0,...) at _cv_wait_sig+0x260 seltdwait(ca787bd0,58,c7db1e80,cac778a0,f6,...) at seltdwait+0xa2 kern_select(cac778a0,400,bfbfea04,0,0,0,20,cadf5588,1) at kern_select+0x655 sys_select(cac778a0,f2848cec,c0fdd90a,c0df1576,246,...) at sys_select+0x66 syscall(f2848d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c52b3, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1953 tid 100143 td 0xcad59000 sched_switch(cad59000,0,104,1a3,1b9919e9,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad59000,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,cac67dd0,0,c0f8a0cb,cad59000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cac67de4,0,f2824a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cac67de4,cac67dd0,c0f93e10,6a4,cabec188,...) at _cv_wait_sig+0x260 seltdwait(cabec188,58,c7db1e80,cad59000,0,...) at seltdwait+0xa2 kern_select(cad59000,1c,bfbfece8,0,0,0,20,cadf7b10,0) at kern_select+0x655 sys_select(cad59000,f2824cec,c0fdd90a,f2824d80,202,...) at sys_select+0x66 syscall(f2824d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283722b3, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1853 tid 100142 td 0xcad592e0 sched_switch(cad592e0,0,104,1a3,3bc7add2,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad592e0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2821be0,c0a4a71a,c803e780,0,cad592e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca60fbd0,0,f2821c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca60fbd0,c803e780,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2821d14,c0a2d468,c803e780,f2821d28,c0f86430,...) at svc_run_internal+0x356 svc_thread_start(c803e780,f2821d28,c0f86430,3db,cac6e2c4,...) at svc_thread_start+0x10 fork_exit(c0c4a1b0,c803e780,f2821d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1853 tid 100141 td 0xcad595c0 sched_switch(cad595c0,0,104,1a3,8455c16d,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cad595c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f281ebe0,c0a4a71a,c803e780,0,cad595c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca60fc10,0,f281ec18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca60fc10,c803e780,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f281ed14,c0a2d468,c803e780,f281ed28,c0f86430,...) at svc_run_internal+0x356 svc_thread_start(c803e780,f281ed28,c0f86430,3db,cac6e2c4,...) at svc_thread_start+0x10 fork_exit(c0c4a1b0,c803e780,f281ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1853 tid 100140 td 0xcab025c0 sched_switch(cab025c0,0,104,1a3,5a0a2bb6,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab025c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f281bbe0,c0a4a71a,c803e780,0,cab025c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca60fc50,0,f281bc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca60fc50,c803e780,1388,3b1,3e00014,...) at _cv_timedwait_sig+0x270 svc_run_internal(f281bd14,c0a2d468,c803e780,f281bd28,c0f86430,...) at svc_run_internal+0x356 svc_thread_start(c803e780,f281bd28,c0f86430,3db,cac6e2c4,...) at svc_thread_start+0x10 fork_exit(c0c4a1b0,c803e780,f281bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1853 tid 100138 td 0xcab028a0 sched_switch(cab028a0,0,104,1a3,778b9232,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab028a0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2814498,c0a4a71a,c803e780,0,cab028a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6c80d0,0,f28144d0,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6c80d0,c803e780,1388,3b1,f2814518,...) at _cv_timedwait_sig+0x270 svc_run_internal(cab02a50,14,c0fbae3a,c0f7dcfb,f2814810,...) at svc_run_internal+0x356 svc_run(c803e780,0,c0f7dcd6,19f,c7d6e370,...) at svc_run+0x7b nfsrvd_nfsd(cab028a0,f2814810,c,c10c0658,cab028a0,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(cab028a0,f2814cec,bfbfe870,cab028a0,f2814d1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(cab028a0,f2814cec,c0fdd90a,c0f949e3,206,...) at sys_nfssvc+0xeb syscall(f2814d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e890b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1846 tid 100132 td 0xcab22b80 sched_switch(cab22b80,0,104,1a3,5eb4a017,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab22b80,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca689dd0,0,c0f8a0cb,cab22b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca689de4,0,f2802a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca689de4,ca689dd0,c0f93e10,6a4,cac69380,...) at _cv_wait_sig+0x260 seltdwait(cac69380,58,c7db1e80,cab22b80,ca7c5ae0,...) at seltdwait+0xa2 kern_select(cab22b80,7,bfbfecb4,0,0,0,20,cac8f588,1) at kern_select+0x655 sys_select(cab22b80,f2802cec,c,c,202,...) at sys_select+0x66 syscall(f2802d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281922b3, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command mountd pid 1836 tid 100125 td 0xcab262e0 sched_switch(cab262e0,0,104,1a3,bdc03d29,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab262e0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b1b50,0,c0f8a0cb,cab262e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b1b64,0,f27eda58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b1b64,ca6b1b50,c0f93e10,6a4,cad53428,...) at _cv_wait_sig+0x260 seltdwait(cad53428,58,c7db1e80,cab262e0,478,...) at seltdwait+0xa2 kern_select(cab262e0,9,bfbfed04,0,0,0,20,cac91b10,bfbfed04) at kern_select+0x655 sys_select(cab262e0,f27edcec,c0fdd90a,c0f7bab7,206,...) at sys_select+0x66 syscall(f27edd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa2b3, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 1737 tid 100129 td 0xcab245c0 sched_switch(cab245c0,0,104,1a3,aa9785,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab245c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27f9a84,c0a4a71a,ca7e30d0,0,cab245c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7e30e4,0,f27f9abc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7e30e4,ca7e30d0,7531,6a4,f27f9b74,...) at _cv_timedwait_sig+0x270 seltdwait(f27f9c44,f27f9c4c,5a1,cab245c0,c7d6eac0,...) at seltdwait+0x8a sys_poll(cab245c0,f27f9cec,c0fdd90a,c0f94714,212,...) at sys_poll+0x321 syscall(f27f9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a14b, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 1710 tid 100137 td 0xcab02b80 sched_switch(cab02b80,0,104,1a3,3d80aaff,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab02b80,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b2850,0,c0f8a0cb,cab02b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b2864,0,f2811a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b2864,ca6b2850,c0f93e10,6a4,ca769818,...) at _cv_wait_sig+0x260 seltdwait(ca769818,58,c7db1e80,cab02b80,58,...) at seltdwait+0xa2 kern_select(cab02b80,9,2847f0ac,0,0,0,20,cac6e588,0) at kern_select+0x655 sys_select(cab02b80,f2811cec,c0fdd90a,c0fc05df,246,...) at sys_select+0x66 syscall(f2811d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a92b3, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 1503 tid 100089 td 0xca75c5c0 sched_switch(ca75c5c0,0,104,1a3,bd353a6e,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca75c5c0,0,c0f916c0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a71a,ca6b2a90,0,c0f8a0cb,ca75c5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b2aa4,0,f2727a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b2aa4,ca6b2a90,c0f93e10,6a4,cabec1c0,...) at _cv_wait_sig+0x260 seltdwait(cabec1c0,58,c7db1e80,ca75c5c0,c1272458,...) at seltdwait+0xa2 kern_select(ca75c5c0,5,bfbfe960,0,0,0,20,ca6be588,46) at kern_select+0x655 sys_select(ca75c5c0,f2727cec,c0fdd90a,c0dec837,206,...) at sys_select+0x66 syscall(f2727d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809152b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100077 td 0xca6c0b80 cpustop_handler(3,13,ee3209e8,c0dbf0b6,a5,...) at cpustop_handler+0x28 ipi_nmi_handler(a5,c10c0658,ee320a20,c0a42fc6,ca6bc000,...) at ipi_nmi_handler+0x47 trap(ee3209f4) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0aa6f5a, esp = 0xee320a34, ebp = 0xee320a84 --- witness_checkorder(c12a59e0,9,c0fbf910,27e4,0,...) at witness_checkorder+0x10a _mtx_lock_flags(c12a59e0,0,c0fbf910,27e4,caadc5a8,...) at _mtx_lock_flags+0xcc softdep_setup_blkfree(caadc5a8,e19539c0,19030,0,8,...) at softdep_setup_blkfree+0x33 ffs_blkfree_cg(19030,0,8000,2f,ee320bd4,...) at ffs_blkfree_cg+0x6e9 ffs_blkfree(cb993100,cb2d5000,cf7bd15c,19030,0,...) at ffs_blkfree+0x9e freework_freeblock(c12a59e0,0,c0fbf910,1d06,8,...) at freework_freeblock+0x5b9 handle_workitem_freeblocks(0,ee320c6c,2,6bb,ee320c70,...) at handle_workitem_freeblocks+0x27c process_worklist_item(c12a59e0,0,c0fbf910,5ea,ca6c0b80,...) at process_worklist_item+0x2c2 softdep_process_worklist(caadc5a8,0,c0fbf910,562,3e8,...) at softdep_process_worklist+0x88 softdep_flush(0,ee320d28,c0f86430,3db,ca6bc000,...) at softdep_flush+0x2b0 fork_exit(c0c995e0,0,ee320d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee320d60, ebp = 0 --- Tracing command vnlru pid 18 tid 100076 td 0xc805f8a0 sched_switch(c805f8a0,0,104,1a3,39a26ad3,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(c805f8a0,0,c0f916c0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca6bc2c4,60,c0f9c69d,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6bc2c4,c129f6f4,260,c0f9c69d,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31dd28,c0f86430,3db,ca6bc2c4,...) at vnlru_proc+0xe7 fork_exit(c0afc040,0,ee31dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31dd60, ebp = 0 --- Tracing command syncer pid 17 tid 100075 td 0xc805fb80 sched_switch(c805fb80,0,104,1a3,62f0f584,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805fb80,0,c0f916c0,28b,c805fb80,...) at sleepq_switch+0x162 sleepq_timedwait(c129f734,0,ee31ac78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c129f734,c129f720,3e8,78b,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee31ad28,c0f86430,3db,ca6bc588,...) at sched_sync+0x595 fork_exit(c0afb3b0,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100074 td 0xc8189000 sched_switch(c8189000,0,104,1a3,5f9d925f,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c8189000,0,c0f916c0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c129f3c8,54,c0f995d1,0,0,...) at sleepq_timedwait+0x6b _sleep(c129f3c8,c129f3d0,54,c0f995d1,3e8,...) at _sleep+0x36a buf_daemon(0,ee317d28,c0f86430,3db,ca6bc84c,...) at buf_daemon+0x175 fork_exit(c0adfba0,0,ee317d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee317d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100073 td 0xc81892e0 sched_switch(c81892e0,0,104,1a3,718be129,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81892e0,0,c0f916c0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a78dc,0,c0fc8e7e,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a78dc,c12a6380,0,c0fc8e7e,493e0,...) at _sleep+0x36a vm_pagezero(0,ee314d28,c0f86430,3db,ca6bcb10,...) at vm_pagezero+0xdc fork_exit(c0ce06d0,0,ee314d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee314d60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100072 td 0xc81895c0 sched_switch(c81895c0,0,104,1a3,dc8dfae,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,74,...) at mi_switch+0x1ff sleepq_switch(c81895c0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a74c8,74,c0f995d1,0,0,...) at sleepq_wait+0x63 _sleep(c12a74c8,c12a74cc,74,c0f995d1,0,...) at _sleep+0x39c vm_daemon(0,ee311d28,c0f86430,3db,ca6be000,...) at vm_daemon+0x59 fork_exit(c0cd9fe0,0,ee311d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee311d60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100071 td 0xc81898a0 sched_switch(c81898a0,0,104,1a3,6269a0f2,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c81898a0,0,c0f916c0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a7490,54,c0f995d1,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a7490,c12a6380,54,c0f995d1,1388,...) at _sleep+0x36a vm_pageout(0,ee30ed28,c0f86430,3db,c7dd12c4,...) at vm_pageout+0x2c7 fork_exit(c0cdb0a0,0,ee30ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee30ed60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100070 td 0xc8189b80 sched_switch(c8189b80,0,104,1a3,840bd2f6,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8189b80,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10edd54,5c,c0de7047,0,0,...) at sleepq_wait+0x63 _sleep(c10edd54,c10edd98,5c,c0de7047,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18bd28,c0f86430,3db,c7dd1588,...) at xpt_scanner_thread+0x47 fork_exit(c049d320,0,ee18bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18bd60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100069 td 0xc818a000 sched_switch(c818a000,0,104,1a3,c706df70,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818a000,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a1258,0,c0fafd1f,0,0,...) at sleepq_wait+0x63 _sleep(c12a1258,c12a1220,0,c0fafd1f,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee188d28,c0f86430,3db,c7dd184c,...) at sctp_iterator_thread+0x5c fork_exit(c0b8d740,0,ee188d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee188d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc818a5c0 sched_switch(c818a5c0,0,104,1a3,72fba44c,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c818a5c0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c819a000,5c,c0df1a52,0,0,...) at sleepq_wait+0x63 _sleep(c819a000,c819a000,5c,c0df1a52,0,...) at _sleep+0x39c ctl_work_thread(c819a000,ee182d28,c0f86430,3db,c7dd1b10,...) at ctl_work_thread+0x22f6 fork_exit(c04c6720,c819a000,ee182d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee182d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc818b000 sched_switch(c818b000,0,104,1a3,63d8e4cd,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c818b000,0,c0f916c0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c7ff8c3c,5c,c0f7e772,0,0,...) at sleepq_timedwait+0x6b _sleep(c7ff8c3c,c7ff8cf0,5c,c0f7e772,3e8,...) at _sleep+0x36a fdc_thread(c7ff8c00,ee179d28,c0f86430,3db,c8044000,...) at fdc_thread+0x27d fork_exit(c0d5f920,c7ff8c00,ee179d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee179d60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80525c0 sched_switch(c80525c0,0,104,1a3,840c0d14,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c80525c0,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c808e000,6c,c0f7e772,100,0,...) at sleepq_wait_sig+0x17 _sleep(c808e000,c8092488,16c,c0f7e772,0,...) at _sleep+0x385 fw_bus_probe_thread(c808e000,ee169d28,c0f86430,3db,c80442c4,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f0620,c808e000,ee169d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee169d60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc805c2e0 sched_switch(c805c2e0,0,104,1a3,72f67c11,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c2e0,0,c0f916c0,268,c805c2e0,...) at sleepq_switch+0x162 sleepq_wait(c8065d34,0,ee152cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8065d34,c8065e4c,c0f64e51,74,c8065d3c,...) at _cv_wait+0x260 usb_process(c8065d2c,ee152d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8065d2c,ee152d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee152d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc805c5c0 sched_switch(c805c5c0,0,104,1a3,d26dd285,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c5c0,0,c0f916c0,268,c805c5c0,...) at sleepq_switch+0x162 sleepq_wait(c8065d04,0,ee14fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8065d04,c8065e4c,c0f64e51,74,c8065d0c,...) at _cv_wait+0x260 usb_process(c8065cfc,ee14fd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8065cfc,ee14fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14fd60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc805c8a0 sched_switch(c805c8a0,0,104,1a3,728f8eea,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c8a0,0,c0f916c0,268,c805c8a0,...) at sleepq_switch+0x162 sleepq_wait(c8065cd4,0,ee14ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8065cd4,c8065e4c,c0f64e51,74,c8065cdc,...) at _cv_wait+0x260 usb_process(c8065ccc,ee14cd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8065ccc,ee14cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14cd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc805cb80 sched_switch(c805cb80,0,104,1a3,728f7c9c,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805cb80,0,c0f916c0,268,c805cb80,...) at sleepq_switch+0x162 sleepq_wait(c8065ca4,0,ee149cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8065ca4,c8065e4c,c0f64e51,74,c8065cac,...) at _cv_wait+0x260 usb_process(c8065c9c,ee149d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8065c9c,ee149d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee149d60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc805f2e0 sched_switch(c805f2e0,0,104,1a3,728f6602,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805f2e0,0,c0f916c0,268,c805f2e0,...) at sleepq_switch+0x162 sleepq_wait(c8058b5c,0,ee140cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058b5c,c8058c74,c0f64e51,74,c8058b64,...) at _cv_wait+0x260 usb_process(c8058b54,ee140d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8058b54,ee140d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee140d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc805f5c0 sched_switch(c805f5c0,0,104,1a3,502cb1b0,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805f5c0,0,c0f916c0,268,c805f5c0,...) at sleepq_switch+0x162 sleepq_wait(c8058b2c,0,ee13dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058b2c,c8058c74,c0f64e51,74,c8058b34,...) at _cv_wait+0x260 usb_process(c8058b24,ee13dd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8058b24,ee13dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13dd60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8050000 sched_switch(c8050000,0,104,1a3,6b961ee4,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8050000,0,c0f916c0,268,c8050000,...) at sleepq_switch+0x162 sleepq_wait(c8058afc,0,ee13acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058afc,c8058c74,c0f64e51,74,c8058b04,...) at _cv_wait+0x260 usb_process(c8058af4,ee13ad28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8058af4,ee13ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ad60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc80502e0 sched_switch(c80502e0,0,104,1a3,6b960e90,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80502e0,0,c0f916c0,268,c80502e0,...) at sleepq_switch+0x162 sleepq_wait(c8058acc,0,ee137cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058acc,c8058c74,c0f64e51,74,c8058ad4,...) at _cv_wait+0x260 usb_process(c8058ac4,ee137d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8058ac4,ee137d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee137d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc80505c0 sched_switch(c80505c0,0,104,1a3,6b95fa9b,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80505c0,0,c0f916c0,268,c80505c0,...) at sleepq_switch+0x162 sleepq_wait(c8054b5c,0,ee133cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054b5c,c8054c74,c0f64e51,74,c8054b64,...) at _cv_wait+0x260 usb_process(c8054b54,ee133d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8054b54,ee133d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee133d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc80508a0 sched_switch(c80508a0,0,104,1a3,502c36ac,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80508a0,0,c0f916c0,268,c80508a0,...) at sleepq_switch+0x162 sleepq_wait(c8054b2c,0,ee130cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054b2c,c8054c74,c0f64e51,74,c8054b34,...) at _cv_wait+0x260 usb_process(c8054b24,ee130d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8054b24,ee130d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee130d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8050b80 sched_switch(c8050b80,0,104,1a3,6b32c45b,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8050b80,0,c0f916c0,268,c8050b80,...) at sleepq_switch+0x162 sleepq_wait(c8054afc,0,ee12dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054afc,c8054c74,c0f64e51,74,c8054b04,...) at _cv_wait+0x260 usb_process(c8054af4,ee12dd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8054af4,ee12dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12dd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8051000 sched_switch(c8051000,0,104,1a3,6b32b2e9,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8051000,0,c0f916c0,268,c8051000,...) at sleepq_switch+0x162 sleepq_wait(c8054acc,0,ee12acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054acc,c8054c74,c0f64e51,74,c8054ad4,...) at _cv_wait+0x260 usb_process(c8054ac4,ee12ad28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8054ac4,ee12ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ad60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc80512e0 sched_switch(c80512e0,0,104,1a3,6b32a137,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80512e0,0,c0f916c0,268,c80512e0,...) at sleepq_switch+0x162 sleepq_wait(c804bb5c,0,ee126cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bb5c,c804bc74,c0f64e51,74,c804bb64,...) at _cv_wait+0x260 usb_process(c804bb54,ee126d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c804bb54,ee126d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee126d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc80515c0 sched_switch(c80515c0,0,104,1a3,1abdbabb,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80515c0,0,c0f916c0,268,c80515c0,...) at sleepq_switch+0x162 sleepq_wait(c804bb2c,0,ee123cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bb2c,c804bc74,c0f64e51,74,c804bb34,...) at _cv_wait+0x260 usb_process(c804bb24,ee123d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c804bb24,ee123d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee123d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc80518a0 sched_switch(c80518a0,0,104,1a3,6acf3f79,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80518a0,0,c0f916c0,268,c80518a0,...) at sleepq_switch+0x162 sleepq_wait(c804bafc,0,ee120cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bafc,c804bc74,c0f64e51,74,c804bb04,...) at _cv_wait+0x260 usb_process(c804baf4,ee120d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c804baf4,ee120d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee120d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8051b80 sched_switch(c8051b80,0,104,1a3,6acf2bf2,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8051b80,0,c0f916c0,268,c8051b80,...) at sleepq_switch+0x162 sleepq_wait(c804bacc,0,ee11dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bacc,c804bc74,c0f64e51,74,c804bad4,...) at _cv_wait+0x260 usb_process(c804bac4,ee11dd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c804bac4,ee11dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11dd60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8040000 sched_switch(c8040000,0,104,1a3,6acf1875,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8040000,0,c0f916c0,268,c8040000,...) at sleepq_switch+0x162 sleepq_wait(c8045b5c,0,ee116cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8045b5c,c8045c74,c0f64e51,74,c8045b64,...) at _cv_wait+0x260 usb_process(c8045b54,ee116d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8045b54,ee116d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee116d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc80402e0 sched_switch(c80402e0,0,104,1a3,1a19cf11,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80402e0,0,c0f916c0,268,c80402e0,...) at sleepq_switch+0x162 sleepq_wait(c8045b2c,0,ee113cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8045b2c,c8045c74,c0f64e51,74,c8045b34,...) at _cv_wait+0x260 usb_process(c8045b24,ee113d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8045b24,ee113d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee113d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc80405c0 sched_switch(c80405c0,0,104,1a3,6a6baaaf,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80405c0,0,c0f916c0,268,c80405c0,...) at sleepq_switch+0x162 sleepq_wait(c8045afc,0,ee110cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8045afc,c8045c74,c0f64e51,74,c8045b04,...) at _cv_wait+0x260 usb_process(c8045af4,ee110d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8045af4,ee110d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee110d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc80408a0 sched_switch(c80408a0,0,104,1a3,6a6b98d5,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80408a0,0,c0f916c0,268,c80408a0,...) at sleepq_switch+0x162 sleepq_wait(c8045acc,0,ee10dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8045acc,c8045c74,c0f64e51,74,c8045ad4,...) at _cv_wait+0x260 usb_process(c8045ac4,ee10dd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8045ac4,ee10dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10dd60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8043000 sched_switch(c8043000,0,104,1a3,6a6b8418,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8043000,0,c0f916c0,268,c8043000,...) at sleepq_switch+0x162 sleepq_wait(c8038b5c,0,ee106cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038b5c,c8038c74,c0f64e51,74,c8038b64,...) at _cv_wait+0x260 usb_process(c8038b54,ee106d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8038b54,ee106d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee106d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc80432e0 sched_switch(c80432e0,0,104,1a3,1a192560,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80432e0,0,c0f916c0,268,c80432e0,...) at sleepq_switch+0x162 sleepq_wait(c8038b2c,0,ee103cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038b2c,c8038c74,c0f64e51,74,c8038b34,...) at _cv_wait+0x260 usb_process(c8038b24,ee103d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8038b24,ee103d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee103d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc80435c0 sched_switch(c80435c0,0,104,1a3,6a077647,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80435c0,0,c0f916c0,268,c80435c0,...) at sleepq_switch+0x162 sleepq_wait(c8038afc,0,ee100cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038afc,c8038c74,c0f64e51,74,c8038b04,...) at _cv_wait+0x260 usb_process(c8038af4,ee100d28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8038af4,ee100d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee100d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc80438a0 sched_switch(c80438a0,0,104,1a3,6a07641e,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80438a0,0,c0f916c0,268,c80438a0,...) at sleepq_switch+0x162 sleepq_wait(c8038acc,0,ee0fdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038acc,c8038c74,c0f64e51,74,c8038ad4,...) at _cv_wait+0x260 usb_process(c8038ac4,ee0fdd28,c0f86430,3db,c8044588,...) at usb_process+0x1a3 fork_exit(c08fd220,c8038ac4,ee0fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fdd60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7ee05c0 sched_switch(c7ee05c0,0,104,1a3,5c2e8a4c,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee05c0,0,c0f916c0,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1128364,0,c0f7e772,2,0,...) at sleepq_timedwait+0x6b _sleep(c1128364,0,0,c0f7e772,64) at _sleep+0x36a pause(c0f7e772,64,c0f40c50,111,0,...) at pause+0xa0 random_kthread(0,c7b51d28,c0f86430,3db,c7dd0000,...) at random_kthread+0x1ef fork_exit(c0805700,0,c7b51d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b51d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7ee0b80 sched_switch(c7ee0b80,0,104,1a3,666b6841,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ee0b80,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1125f68,5c,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c1125f68,c1125ec8,25c,c0f7e772,0,...) at _sleep+0x39c g_io_schedule_down(c7ee0b80,0,c0f802c1,6c,c7b4bd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c7b4bd28,c0f86430,3db,c7dd02c4,...) at g_down_procbody+0x9d fork_exit(c09ee540,0,c7b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4bd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7ee1000 sched_switch(c7ee1000,0,104,1a3,668b4d65,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ee1000,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1125f64,5c,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c1125f64,c1125ee8,25c,c0f7e772,0,...) at _sleep+0x39c g_io_schedule_up(c7ee1000,0,c0f802c1,5f,c7b48d14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c7b48d28,c0f86430,3db,c7dd02c4,...) at g_up_procbody+0x9d fork_exit(c09ee5e0,0,c7b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b48d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7dd72e0 sched_switch(c7dd72e0,0,104,1a3,bd32d069,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7dd72e0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1125f5c,5c,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c1125f5c,c1125e8c,25c,c0f7e772,0,...) at _sleep+0x39c g_run_events(c11361c0,0,c0f802c1,79,c7b45d14,...) at g_run_events+0x54b g_event_procbody(0,c7b45d28,c0f86430,3db,c7dd02c4,...) at g_event_procbody+0x90 fork_exit(c09ee680,0,c7b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b45d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc818a8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc818ab80 sched_switch(c818ab80,0,109,1a3,6a042912,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c818ab80,...) at mi_switch+0x1ff ithread_loop(c817b810,ee17cd28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c817b810,ee17cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17cd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc80522e0 sched_switch(c80522e0,0,109,1a3,2a127b76,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c80522e0,...) at mi_switch+0x1ff ithread_loop(c817bc60,ee16cd28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c817bc60,ee16cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16cd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8052b80 sched_switch(c8052b80,0,109,1a3,5a9675a7,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c8052b80,...) at mi_switch+0x1ff ithread_loop(c803faa0,ee160d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c803faa0,ee160d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee160d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc805c000 sched_switch(c805c000,0,109,1a3,bdcbcff,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c805c000,...) at mi_switch+0x1ff ithread_loop(c803f210,ee158d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c803f210,ee158d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee158d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc805f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8052000 sched_switch(c8052000,0,109,1a3,8b366ae8,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c8052000,...) at mi_switch+0x1ff ithread_loop(c80238a0,ee11ad28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c80238a0,ee11ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ad60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8040b80 sched_switch(c8040b80,0,109,1a3,89ec89f2,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c8040b80,...) at mi_switch+0x1ff ithread_loop(c8023ab0,ee10ad28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c8023ab0,ee10ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ad60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8043b80 sched_switch(c8043b80,0,109,1a3,a6f6ae3,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c8043b80,...) at mi_switch+0x1ff ithread_loop(c803f080,ee0fad28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c803f080,ee0fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fad60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7ee12e0 sched_switch(c7ee12e0,0,109,1a3,281f0ac9,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7ee12e0,...) at mi_switch+0x1ff ithread_loop(c8023280,edfa4d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c8023280,edfa4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa4d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7ee15c0 sched_switch(c7ee15c0,0,109,1a3,3536f354,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7ee15c0,...) at mi_switch+0x1ff ithread_loop(c8023420,edfa0d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c8023420,edfa0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa0d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7ee18a0 sched_switch(c7ee18a0,0,109,1a3,5c47115c,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7ee18a0,...) at mi_switch+0x1ff ithread_loop(c8004930,c7ba0d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c8004930,c7ba0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba0d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7ee1b80 sched_switch(c7ee1b80,0,109,1a3,9da43afc,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7ee1b80,...) at mi_switch+0x1ff ithread_loop(c7da4490,c7b6fd28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da4490,c7b6fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6fd60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc7fcc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc7fcc5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xc7fcc8a0 sched_switch(c7fcc8a0,0,109,1a3,281f5417,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7fcc8a0,...) at mi_switch+0x1ff ithread_loop(c7da44c0,c7b63d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da44c0,c7b63d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b63d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7dd75c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc7dd78a0 sched_switch(c7dd78a0,0,109,1a3,62f0c7bf,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7dd78a0,...) at mi_switch+0x1ff ithread_loop(c7da4700,c7b3fd28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da4700,c7b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3fd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dd7b80 sched_switch(c7dd7b80,0,109,1a3,5c2e6786,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7dd7b80,...) at mi_switch+0x1ff ithread_loop(c7da4710,c7b3cd28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da4710,c7b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e1b000 sched_switch(c7e1b000,0,109,1a3,52186b69,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7e1b000,...) at mi_switch+0x1ff ithread_loop(c7da4720,c7b39d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da4720,c7b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e1b2e0 sched_switch(c7e1b2e0,0,109,1a3,63957f15,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7e1b2e0,...) at mi_switch+0x1ff ithread_loop(c7da4730,c7b36d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da4730,c7b36d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b36d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e1b5c0 sched_switch(c7e1b5c0,0,109,1a3,5ed5f082,...) at sched_switch+0x3ec mi_switch(109,0,c0f86753,554,c7e1b5c0,...) at mi_switch+0x1ff ithread_loop(c7da4740,c7b33d28,c0f86430,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f80,c7da4740,c7b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b33d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dd2000 sched_switch(c7dd2000,0,108,19e,66cd7d95,...) at sched_switch+0x3ec mi_switch(108,0,c0f8dd82,a09,c7dd2000,...) at mi_switch+0x1ff sched_idletd(0,c7b2fd28,c0f86430,3db,c7dd084c,...) at sched_idletd+0x2bf fork_exit(c0a81b90,0,c7b2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2fd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dd22e0 sched_switch(c7dd22e0,0,108,19e,66cbe8ba,...) at sched_switch+0x3ec mi_switch(108,0,c0f8dd82,a09,c7dd22e0,...) at mi_switch+0x1ff sched_idletd(0,c7b2cd28,c0f86430,3db,c7dd084c,...) at sched_idletd+0x2bf fork_exit(c0a81b90,0,c7b2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2cd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dd25c0 sched_switch(c7dd25c0,0,108,19e,6699de90,...) at sched_switch+0x3ec mi_switch(108,0,c0f8dd82,3be,c7dd25c0,...) at mi_switch+0x1ff sched_idletd(0,c7b29d28,c0f86430,3db,c7dd084c,...) at sched_idletd+0x19f fork_exit(c0a81b90,0,c7b29d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b29d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dd28a0 sched_switch(c7dd28a0,0,108,19e,65236a63,...) at sched_switch+0x3ec mi_switch(108,0,c0f8dd82,3be,c7dd28a0,...) at mi_switch+0x1ff sched_idletd(0,c7b26d28,c0f86430,3db,c7dd084c,...) at sched_idletd+0x19f fork_exit(c0a81b90,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dd2b80 sched_switch(c7dd2b80,0,104,1a3,8cd82aa0,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c7dd2b80,0,c0f916c0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f916c0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7dd0b10,6c,c0f945d7,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7dd0b10,c7dd0b98,16c,c0f945d7,0,...) at _sleep+0x385 kern_wait(c7dd2b80,ffffffff,c7b22c60,0,0,...) at kern_wait+0x626 sys_wait4(c7dd2b80,c7b22cec,c0fdd90a,c0f9440e,286,...) at sys_wait4+0x3b syscall(c7b22d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x8060f97, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc7dd7000 sched_switch(c7dd7000,0,104,1a3,6a058611,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dd7000,0,c0f916c0,268,c7dd7000,...) at sleepq_switch+0x162 sleepq_wait(c12a5160,0,c7b1fc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c12a5160,c12a5144,c0fbc8b7,194,0,...) at _cv_wait+0x260 audit_worker(0,c7b1fd28,c0f86430,3db,c7dd1000,...) at audit_worker+0x84 fork_exit(c0c5a500,0,c7b1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xca6c08a0 sched_switch(ca6c08a0,0,104,1a3,d4875937,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c08a0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2340,0,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2340,c7ee2358,0,c0f7e772,0,...) at _sleep+0x39c taskqueue_thread_loop(c13069e0,ee323d28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9ea00,c13069e0,ee323d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee323d60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc818a2e0 sched_switch(c818a2e0,0,104,1a3,a8cd22af,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818a2e0,0,c0f916c0,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1128364,0,c0f7e772,2,0,...) at sleepq_timedwait+0x6b _sleep(c1128364,0,0,c0f7e772,bb8) at _sleep+0x36a pause(c0f7e772,bb8,124,122,c11260c8,...) at pause+0xa0 deadlkres(0,ee185d28,c0f86430,3db,c1126040,...) at deadlkres+0x324 fork_exit(c0a10740,0,ee185d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee185d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80528a0 sched_switch(c80528a0,0,104,1a3,6094e7ac,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80528a0,0,c0f916c0,268,c80528a0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2640,0,c0f8ca01,c0f7e772,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2640,c7ee2658,c0f7e772,0,c0f8a0cb,...) at msleep_spin+0x259 taskqueue_thread_loop(c809249c,ee166d28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9ea00,c809249c,ee166d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee166d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fcc2e0 sched_switch(c7fcc2e0,0,104,1a3,c56cbf0,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fcc2e0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2740,0,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2740,c7ee2758,0,c0f7e772,0,...) at _sleep+0x39c taskqueue_thread_loop(c1144f2c,c7b69d28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9ea00,c1144f2c,c7b69d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b69d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fccb80 sched_switch(c7fccb80,0,104,1a3,8410c1ca,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fccb80,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee27c0,0,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c7ee27c0,c7ee27d8,0,c0f7e772,0,...) at _sleep+0x39c taskqueue_thread_loop(c11269b8,c7b60d28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9ea00,c11269b8,c7b60d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b60d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e1b8a0 sched_switch(c7e1b8a0,0,104,1a3,8410b007,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e1b8a0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2800,0,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2800,c7ee2818,0,c0f7e772,0,...) at _sleep+0x39c taskqueue_thread_loop(c12a5744,c7b5dd28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9ea00,c12a5744,c7b5dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e1bb80 sched_switch(c7e1bb80,0,104,1a3,84109c67,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e1bb80,0,c0f916c0,268,c7e1bb80,...) at sleepq_switch+0x162 sleepq_wait(c7ee2840,0,c0f8ca01,c0f7e772,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2840,c7ee2858,c0f7e772,0,c0f8a0cb,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f0fb8,c7b5ad28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9ea00,c10f0fb8,c7b5ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7ee0000 sched_switch(c7ee0000,0,104,1a3,84108d94,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee0000,0,c0f916c0,268,c7ee0000,...) at sleepq_switch+0x162 sleepq_wait(c7ee2840,0,c0f8ca01,c0f7e772,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2840,c7ee2858,c0f7e772,0,c0f8a0cb,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f0fb8,c7b57d28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9ea00,c10f0fb8,c7b57d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b57d60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7ee02e0 sched_switch(c7ee02e0,0,104,1a3,84107c5f,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee02e0,0,c0f916c0,268,c7ee02e0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2840,0,c0f8ca01,c0f7e772,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2840,c7ee2858,c0f7e772,0,c0f8a0cb,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f0fb8,c7b54d28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9ea00,c10f0fb8,c7b54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b54d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc7ee08a0 sched_switch(c7ee08a0,0,104,1a3,487b70e7,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee08a0,0,c0f916c0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2880,0,c0f7e772,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2880,c7ee2898,0,c0f7e772,0,...) at _sleep+0x39c taskqueue_thread_loop(c1143940,c7b4ed28,c0f86430,3db,c1126040,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9ea00,c1143940,c7b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1126310 sched_switch(c1126310,0,104,1a3,41cddb5d,...) at sched_switch+0x3ec mi_switch(104,0,c0f916c0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c1126310,0,c0f916c0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1126040,54,c0f8e694,0,0,...) at sleepq_timedwait+0x6b _sleep(c1126040,0,54,c0f8e694,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 331 MB: 316 300 284 268 252 236 220 204 188 172 156 140 124 108 92 76 60 44 28 12 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0xf29fe5f4) at pcpu.h:244 #1 0xc0510a39 in db_fncall (dummy1=0xc0a9012a, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf29fe688 "\234¿\237¿") at ../../../ddb/db_command.c:573 #2 0xc0510e6f in db_command (last_cmdp=0xc10ef17c, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc0510f24 in db_command_script (command=0xc10f0088 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc0515310 in db_script_exec (scriptname=0xc10ef9e0 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc05153a1 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc12d22e0, modif=0xf29fe7c0 "") at ../../../ddb/db_script.c:375 #6 0xc0510e31 in db_command (last_cmdp=0xc10ef17c, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc0510f8a in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc0512f7d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc0a905e6 in kdb_trap (type=0x3, code=0x0, tf=0xf29fe974) at ../../../kern/subr_kdb.c:629 #10 0xc0dbf6eb in trap (frame=0xf29fe974) at ../../../i386/i386/trap.c:722 #11 0xc0da7f7c in calltrap () at ../../../i386/i386/exception.s:168 #12 0xc0a9012a in kdb_enter (why=0xc0f8bc98 "panic", msg=0xc0f8bc98 "panic") at cpufunc.h:71 #13 0xc0a5affc in panic (fmt=0xc0de6adf "Bad tailq NEXT(%p->tqh_last) != NULL") at ../../../kern/kern_shutdown.c:633 #14 0xc0caf48c in dqrele (vp=0xcb4af414, dq=0xcadd4900) at ../../../ufs/ufs/ufs_quota.c:1499 #15 0xc0caad36 in ufs_prepare_reclaim (vp=0xcb4af414) at ../../../ufs/ufs/ufs_inode.c:188 #16 0xc0caad96 in ufs_reclaim (ap=0xf29fea8c) at ../../../ufs/ufs/ufs_inode.c:213 #17 0xc0ddfa85 in VOP_RECLAIM_APV (vop=0xc10dbd40, a=0xf29fea8c) at vnode_if.c:1926 #18 0xc0afac34 in vgonel (vp=0xcb4af414) at vnode_if.h:830 #19 0xc0afaedd in vrecycle (vp=0xcb4af414, td=0xcb987b80) at ../../../kern/vfs_subr.c:2589 #20 0xc0cab1d0 in ufs_inactive (ap=0xf29feb44) at ../../../ufs/ufs/ufs_inode.c:168 #21 0xc0ddfbd5 in VOP_INACTIVE_APV (vop=0xc10dbd40, a=0xf29feb44) at vnode_if.c:1863 #22 0xc0af9eb1 in vinactive (vp=0xcb4af414, td=0xcb987b80) at vnode_if.h:807 #23 0xc0afc9fc in vputx (vp=0xcb4af414, func=0x2) at ../../../kern/vfs_subr.c:2298 #24 0xc0afca70 in vput (vp=0xcb4af414) at ../../../kern/vfs_subr.c:2325 #25 0xc0afe096 in kern_rmdirat (td=0xcb987b80, fd=0xffffff9c, path=0xbfbdf6b7
, pathseg=UIO_USERSPACE) at ../../../kern/vfs_syscalls.c:3948 #26 0xc0afe117 in kern_rmdir (td=0xcb987b80, path=0xbfbdf6b7
, pathseg=UIO_USERSPACE) at ../../../kern/vfs_syscalls.c:3888 #27 0xc0afe142 in sys_rmdir (td=0xcb987b80, uap=0xf29fecec) at ../../../kern/vfs_syscalls.c:3881 #28 0xc0dbecb7 in syscall (frame=0xf29fed28) at subr_syscall.c:131 #29 0xc0da7fe1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:266 #30 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 14 #14 0xc0caf48c in dqrele (vp=0xcb4af414, dq=0xcadd4900) at ../../../ufs/ufs/ufs_quota.c:1499 1499 TAILQ_INSERT_TAIL(&dqfreelist, dq, dq_freelist); (kgdb) l 1494 if ((dq->dq_flags & DQ_MOD) != 0) { 1495 dq->dq_cnt++; 1496 DQH_UNLOCK(); 1497 goto sync; 1498 } 1499 TAILQ_INSERT_TAIL(&dqfreelist, dq, dq_freelist); 1500 DQH_UNLOCK(); 1501 } 1502 1503 /* (kgdb) p dqfreelist $1 = {tqh_first = 0xcadd4900, tqh_last = 0xcadd4908} (kgdb) p &dqfreelist $2 = (struct dqfreelist *) 0xc12a5b08 (kgdb) info loc No locals. (kgdb) up $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_snapshot.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_snapshot.c (revision 231114) +++ /usr/src/sys/ufs/ffs/ffs_snapshot.c (working copy) @@ -225,18 +225,10 @@ ffs_snapshot(mp, snapfile) ump = VFSTOUFS(mp); fs = ump->um_fs; sn = NULL; - /* - * At the moment, journaled soft updates cannot support - * taking snapshots. - */ - if (MOUNTEDSUJ(mp)) { - vfs_mount_error(mp, "%s: Snapshots are not yet supported when " - "running with journaled soft updates", fs->fs_fsmnt); - return (EOPNOTSUPP); - } MNT_ILOCK(mp); flag = mp->mnt_flag; MNT_IUNLOCK(mp); + /* * Need to serialize access to snapshot code per filesystem. */ -- Test scenario: suj19.sh