GENERIC HEAD from 2012-02-08 04:05:38 UTC, r231181M, vmcore.272 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r231181M: Thu Feb 9 08:11:50 CET 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531644928 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 118476 free (1204 frags, 14659 blocks, 0.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 114631672 free (2000 frags, 14328709 blocks, 0.0% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 143464 free (4808 frags, 17332 blocks, 0.5% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 945565 free (366117 frags, 72431 blocks, 3.6% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 13317717 free (53533 frags, 1658023 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: usbus0. Starting Network: usbus1. Starting Network: usbus2. Starting Network: usbus3. Starting Network: usbus4. Starting Network: usbus5. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe191f3a0 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc8194e00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,2e687361,38323a63,a34,f27397e8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a4b,c0f93880,c1271b88,11c,f2739878,...) at kdb_backtrace+0x2a _witness_debugger(c0f93880,c8194e00,c0fc38fa,c7d72678,c0fc358c,...) at _witness_debugger+0x25 witness_checkorder(c8194e00,9,c0fc3583,11c,0,...) at witness_checkorder+0x86f _sx_xlock(c8194e00,0,c0fc3583,11c,ca7b9ae0,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e191f340,ca7b9ae0,f27399f4,e241b110,f2739948,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(ca7b9ae0,f27399f4,3110,f2739934,f2739938,...) at ufsdirhash_add+0x13 ufs_direnter(ca823000,cac9b828,f27399f4,f2739b84,e191f9c0,...) at ufs_direnter+0x7a9 ufs_mkdir(f2739c14,c0fe4b65,0,0,f2739bac,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10dacc0,f2739c14,f2739b84,f2739bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca6bf8a0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(ca6bf8a0,28404020,0,1c0,f2739d1c,...) at kern_mkdir+0x2e sys_mkdir(ca6bf8a0,f2739cec,c0fdd9ea,c0f9455e,202,...) at sys_mkdir+0x29 syscall(f2739d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817f743, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). Starting mountd. NFSv4 is disabled Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcad611b4 ufs (ufs) @ kern/vfs_lookup.c:542 2nd 0xe19263c0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xcad60724 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,3a632e73,a323632,28412000,2842d790,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a4b,c0f93899,c12716f0,877,f280b334,...) at kdb_backtrace+0x2a _witness_debugger(c0f93899,cad60724,c0f8244c,c7d72610,c0f9b815,...) at _witness_debugger+0x25 witness_checkorder(cad60724,9,c0f9b80c,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cad60724,80100,cad60790,0,0,...) at __lockmgr_args+0x834 ffs_lock(f280b458,60,0,80100,cad606cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10dacc0,f280b458,c7d6b1e0,c10ebce0,cad606cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cad606cc,80100,c0f9b80c,877,4,...) at _vn_lock+0x78 vget(cad606cc,80100,cab1d8a0,50,0,...) at vget+0xbb vfs_hash_get(ca733000,15edde,80000,cab1d8a0,f280b59c,...) at vfs_hash_get+0xed ffs_vgetf(ca733000,15edde,80000,f280b59c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(cad6115c,e1926360,1,108,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(cad6115c,1,c12716e0,cad61254,c7d6e370,...) at ffs_syncvnode+0x24c ffs_truncate(cad6115c,200,0,880,c7fcfa80,...) at ffs_truncate+0x827 ufs_direnter(cad6115c,cad606cc,f280b918,f280bbc0,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f280bbc0,c10db240,f280bb04,f280ba60,c0de30b5,...) at ufs_makeinode+0x65d ufs_create(f280bb04,c0fe4d2b,0,0,f280bb80,...) at ufs_create+0x30 VOP_CREATE_APV(c10dacc0,f280bb04,f280bbc0,f280ba9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f280bb80,f280bc48,1b0,0,c7fcfa80,...) at vn_open_cred+0x205 vn_open(f280bb80,f280bc48,1b0,cac6f428,4f33749e,...) at vn_open+0x3b kern_openat(cab1d8a0,ffffff9c,28839f60,0,a03,...) at kern_openat+0x1ec kern_open(cab1d8a0,28839f60,0,a02,1b0,...) at kern_open+0x35 sys_open(cab1d8a0,f280bcec,c0fdd9ea,c0f9455e,206,...) at sys_open+0x30 syscall(f280bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x283eada3, esp = 0xbfbfc50c, ebp = 0xbfbfc598 --- . Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcaa55880 ufs (ufs) @ kern/vfs_mount.c:1249 2nd 0xca7d3b38 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1838 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,38313a63,a3833,c0aa703c,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a4b,c0f93880,c12712c0,72e,f28939a0,...) at kdb_backtrace+0x2a _witness_debugger(c0f93880,ca7d3b38,c0f7a3a7,c7d72470,c0fbf9f9,...) at _witness_debugger+0x25 witness_checkorder(ca7d3b38,9,c0fbf9f0,72e,ca7d3ba4,...) at witness_checkorder+0x86f __lockmgr_args(ca7d3b38,80400,ca7d3ba4,0,0,...) at __lockmgr_args+0x834 vop_stdlock(f2893ac0,4,c0f8a1ab,80400,ca7d3ae0,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b09c0,f2893ac0,c12a4ee0,c10ebce0,ca7d3ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca7d3ae0,80400,c0fbf9f0,72e,ca7335a8,...) at _vn_lock+0x78 softdep_flushworklist(ca7335a8,f2893b6c,cac76000,5e9,0,...) at softdep_flushworklist+0x47 ffs_sync(ca7335a8,1,f2893bc0,51a,c7c30000,...) at ffs_sync+0x32d dounmount(ca7335a8,8080000,cac76000,49c,0,...) at dounmount+0x3f8 sys_unmount(cac76000,f2893cec,c,c,206,...) at sys_unmount+0x421 syscall(f2893d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7e0b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xca7f3b38 syncer (syncer) @ kern/vfs_subr.c:1767 2nd 0xca7d4b38 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1536 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,3335313a,c0000a36,246,c7d6b998,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a4b,c0f93880,c1271e18,600,ee31aa5c,...) at kdb_backtrace+0x2a _witness_debugger(c0f93880,ca7d4b38,c0f7a3a7,c7d72470,c0fc28d9,...) at _witness_debugger+0x25 witness_checkorder(ca7d4b38,9,c0fc28d0,600,ca7d4ba4,...) at witness_checkorder+0x86f __lockmgr_args(ca7d4b38,80400,ca7d4ba4,0,0,...) at __lockmgr_args+0x834 vop_stdlock(ee31ab7c,c0aa4c0a,c1271e28,80400,ca7d4ae0,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b09c0,ee31ab7c,ee31ab9c,c10ebce0,ca7d4ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca7d4ae0,80400,c0fc28d0,600,c0f8a1ab,...) at _vn_lock+0x78 ffs_sync(ca7332d4,3,2,dd9,ca7332d4,...) at ffs_sync+0x3f7 sync_fsync(ee31ac6c,c0fe46c3,ca7f3ba4,ee31ac6c,ca7f3ae0,...) at sync_fsync+0x156 VOP_FSYNC_APV(c10c9680,ee31ac6c,c0f9b80c,6e7,c8060b80,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c129ec34,c129ec20,3e8,78b,4e20,...) at sync_vnode+0x16b sched_sync(0,ee31ad28,c0f86510,3db,ca6bc588,...) at sched_sync+0x282 fork_exit(c0afb330,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 100706 files, 3682309 used, 114631672 free (2000 frags, 14328709 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 100706 files, 3682309 used, 114631672 free (2000 frags, 14328709 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Thu Feb 9 08:28:38 CET 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Feb 9 08:28:59 x4 su: pho to root on /dev/pts/1 lock order reversal: 1st 0xe1972340 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xca74b01c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2293 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,632e746f,3932323a,a33,c0f8c5bf,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a4b,c0f93880,c1270bb8,8f5,f28a23ec,...) at kdb_backtrace+0x2a _witness_debugger(c0f93880,ca74b01c,c0fbf495,c7d72e30,c0fbf41f,...) at _witness_debugger+0x25 witness_checkorder(ca74b01c,9,c0fbf416,8f5,0,...) at witness_checkorder+0x86f __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0x834 ffs_copyonwrite(cb290c3c,e19722e0,e19722e0,0,0,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(cb290d34,e19722e0,0,e19722e0,60000,...) at ffs_geom_strategy+0xeb bufwrite(e19722e0,0,c0fc28d0,7de,0) at bufwrite+0x159 ffs_bufwrite(e19722e0,cb1e5800,100,8000,0,...) at ffs_bufwrite+0x290 ffs_update(cb246000,1,cb2460f8,0,0,...) at ffs_update+0x2dc softdep_sync_buf(cb290984,e196e380,1,108,0,...) at softdep_sync_buf+0x86f ffs_syncvnode(cb290984,1,c0a4a23d,c1145098,4,...) at ffs_syncvnode+0x24c ffs_truncate(cb290984,400,0,880,cadce800,...) at ffs_truncate+0x827 ufs_direnter(cb290984,cb246000,f28a29f4,f28a2b84,e1972480,...) at ufs_direnter+0x9a1 ufs_mkdir(f28a2c14,c0fe4b65,0,0,f28a2bac,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10dacc0,f28a2c14,f28a2b84,f28a2bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(cac72000,ffffff9c,bfbfef4b,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(cac72000,bfbfef4b,0,1f8,f28a2d1c,...) at kern_mkdir+0x2e sys_mkdir(cac72000,f28a2cec,c11356c0,f28a2d80,257,...) at sys_mkdir+0x29 syscall(f28a2d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28194743, esp = 0xbfbfe78c, ebp = 0xbfbfe828 --- lock order reversal: 1st 0xca74b01c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:965 2nd 0xcb246df0 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1623 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,a333236,c7000a00,c7d6e370,c,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a4b,c0f93880,c1270978,657,f28ba704,...) at kdb_backtrace+0x2a _witness_debugger(c0f93880,cb246df0,c0f8244c,c7d72610,c0fbf41f,...) at _witness_debugger+0x25 witness_checkorder(cb246df0,9,c0fbf416,657,0,...) at witness_checkorder+0x86f __lockmgr_args(cb246df0,80000,0,0,0,...) at __lockmgr_args+0x834 ffs_snapremove(cb246d98,c0fbf337,c7d6bee0,c7d6e370,4,...) at ffs_snapremove+0x11f ffs_truncate(cb246d98,0,0,c00,0,...) at ffs_truncate+0x607 ufs_inactive(f28baadc,c0fe42f8,cb246e5c,cb246e5c,cb246d98,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f28baadc,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f28bab10,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f28bac3c,c0aff163,cb246d98,ffffffdf,cb246d98,...) at vputx+0x36c vput(cb246d98,ffffffdf,cb246d98,f28bab94,0,...) at vput+0x10 kern_unlinkat(cb1348a0,ffffff9c,bfbfeabe,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(cb1348a0,bfbfeabe,0,f28bad1c,c0dbed87,...) at kern_unlink+0x2f sys_unlink(cb1348a0,f28bacec,c0fdd9ea,c0f94572,246,...) at sys_unlink+0x22 syscall(f28bad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x2817eb5f, esp = 0xbfbfe7fc, ebp = 0xbfbfe878 --- fsync: giving up on dirty 0xcb290c3c: tag devfs, type VCHR usecount 1, writecount 0, refcount 12 mountedhere 0xca6c6300 flags () v_object 0xcac7a360 ref 0 pages 62 lock type devfs: EXCL by thread 0xcb31b000 (pid 2656) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ae6475 at vop_stdlock+0x65 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3fd at ffs_sync+0x32d #6 0xc0b08122 at vfs_write_suspend+0x122 #7 0xc0c824fd at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af062b at vfs_donmount+0x12eb #10 0xc0af0ccf at sys_nmount+0x7f #11 0xc0dbed87 at syscall+0x2c7 #12 0xc0da80b1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb290c3c: tag devfs, type VCHR usecount 1, writecount 0, refcount 12 mountedhere 0xca6c6300 flags () v_object 0xcac7a360 ref 0 pages 62 lock type devfs: EXCL by thread 0xcb31b000 (pid 2656) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ae6475 at vop_stdlock+0x65 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0c9e4c7 at ffs_sync+0x3f7 #5 0xc0b08122 at vfs_write_suspend+0x122 #6 0xc0c824fd at ffs_snapshot+0xced #7 0xc0ca0937 at ffs_mount+0x1ca7 #8 0xc0af062b at vfs_donmount+0x12eb #9 0xc0af0ccf at sys_nmount+0x7f #10 0xc0dbed87 at syscall+0x2c7 #11 0xc0da80b1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xcb290c3c: tag devfs, type VCHR usecount 1, writecount 0, refcount 17 mountedhere 0xca6c6300 flags () v_object 0xcac7a360 ref 0 pages 102 lock type devfs: EXCL by thread 0xca7695c0 (pid 2660) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ae6475 at vop_stdlock+0x65 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0c99417 at softdep_flushworklist+0x47 #5 0xc0c9e3fd at ffs_sync+0x32d #6 0xc0b08122 at vfs_write_suspend+0x122 #7 0xc0c824fd at ffs_snapshot+0xced #8 0xc0ca0937 at ffs_mount+0x1ca7 #9 0xc0af062b at vfs_donmount+0x12eb #10 0xc0af0ccf at sys_nmount+0x7f #11 0xc0dbed87 at syscall+0x2c7 #12 0xc0da80b1 at Xint0x80_syscall+0x21 dev md5a Kernel page fault with the following non-sleepable locks held: exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc12a4ee0) locked @ ufs/ffs/ffs_softdep.c:4455 KDB: stack backtrace: db_trace_self_wrapper(c0f8fdf3,c7d70c10,f2775794,0,c0f93c76,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a94a30,2,ffffffff,c127008c,f2775824,...) at kdb_backtrace+0x2a _witness_debugger(c0f931ac,f2775838,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0fddab7,c0f93c76,caaea2c4,...) at witness_warn+0x1fe trap(f27758c4) at trap+0x195 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0xc0c9b624, esp = 0xf2775904, ebp = 0xf2775920 --- softdep_prelink(c12a4ee0,0,c0fbf9f0,1167,cd9c115c,...) at softdep_prelink+0x54 softdep_setup_mkdir(cd9df5e4,cd9df570,cadce800,0,c10eba40,...) at softdep_setup_mkdir+0x1b8 ufs_mkdir(f2775c14,c0fe4b65,0,0,f2775bac,...) at ufs_mkdir+0x311 VOP_MKDIR_APV(c10dacc0,f2775c14,f2775b84,f2775bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca765b80,ffffff9c,bfbdae7b,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(ca765b80,bfbdae7b,0,1f8,f2775d1c,...) at kern_mkdir+0x2e sys_mkdir(ca765b80,f2775cec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f2775d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbdaa2c, ebp = 0xbfbdae58 --- Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0xc fault code = supervisor read, page not present instruction pointer = 0x20:0xc0c9b624 stack pointer = 0x28:0xf2775904 frame pointer = 0x28:0xf2775920 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 2514 (mkdir) [ thread pid 2514 tid 100105 ] Stopped at softdep_prelink+0x54: movl 0xc(%ebx),%eax db> run pho db:0:pho> bt Tracing pid 2514 tid 100105 td 0xca765b80 softdep_prelink(c12a4ee0,0,c0fbf9f0,1167,cd9c115c,...) at softdep_prelink+0x54 softdep_setup_mkdir(cd9df5e4,cd9df570,cadce800,0,c10eba40,...) at softdep_setup_mkdir+0x1b8 ufs_mkdir(f2775c14,c0fe4b65,0,0,f2775bac,...) at ufs_mkdir+0x311 VOP_MKDIR_APV(c10dacc0,f2775c14,f2775b84,f2775bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca765b80,ffffff9c,bfbdae7b,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(ca765b80,bfbdae7b,0,1f8,f2775d1c,...) at kern_mkdir+0x2e sys_mkdir(ca765b80,f2775cec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f2775d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbdaa2c, ebp = 0xbfbdae58 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x738b00 curthread = 0xca765b80: pid 2514 "mkdir" curpcb = 0xf2775d80 fpcurthread = none idlethread = 0xc7dd28a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6a29b00 curthread = 0xca768000: pid 2515 "mkdir" curpcb = 0xf2772d80 fpcurthread = none idlethread = 0xc7dd25c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6a2cb00 curthread = 0xc8189000: pid 16 "bufdaemon" curpcb = 0xee317d80 fpcurthread = none idlethread = 0xc7dd22e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6a2fb00 curthread = 0xca7ea000: pid 2513 "mkdir" curpcb = 0xf27dfd80 fpcurthread = none idlethread = 0xc7dd2000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 2721 (umount) thread 0xcb4e72e0 (100210) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1980040) locked @ kern/vfs_bio.c:2658 exclusive lockmgr ufs (ufs) r = 0 (0xcdaed058) locked @ kern/vfs_subr.c:2167 Process 2523 (mkdir) thread 0xcab1fb80 (100163) exclusive lockmgr ufs (ufs) r = 0 (0xcbf7d880) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcd6ef310) locked @ kern/vfs_lookup.c:542 Process 2522 (mkdir) thread 0xcb0bc2e0 (100182) exclusive lockmgr ufs (ufs) r = 0 (0xcbf86b38) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xce5121b4) locked @ kern/vfs_lookup.c:542 Process 2521 (mkdir) thread 0xcab0c8a0 (100140) exclusive lockmgr ufs (ufs) r = 0 (0xcd6eb9dc) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcd6eb46c) locked @ kern/vfs_lookup.c:542 Process 2520 (mkdir) thread 0xcab06000 (100184) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a24f40) locked @ kern/vfs_bio.c:1911 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a78d80) locked @ ufs/ffs/ffs_softdep.c:13181 exclusive lockmgr ufs (ufs) r = 0 (0xcce7edf0) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcce81058) locked @ kern/vfs_lookup.c:542 Process 2519 (mkdir) thread 0xcab062e0 (100148) exclusive lockmgr ufs (ufs) r = 0 (0xcda06310) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcda0646c) locked @ kern/vfs_subr.c:2167 Process 2518 (mkdir) thread 0xcab065c0 (100147) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19f8440) locked @ kern/vfs_bio.c:1911 exclusive lockmgr bufwait (bufwait) r = 0 (0xe19c3f60) locked @ ufs/ffs/ffs_softdep.c:13181 exclusive lockmgr ufs (ufs) r = 0 (0xcba055c8) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcba28880) locked @ kern/vfs_lookup.c:542 Process 2517 (mkdir) thread 0xcab068a0 (100146) exclusive lockmgr ufs (ufs) r = 0 (0xcd9859dc) locked @ kern/vfs_subr.c:2279 Process 2516 (mkdir) thread 0xca7682e0 (100091) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1981f20) locked @ ufs/ffs/ffs_softdep.c:13181 exclusive lockmgr ufs (ufs) r = 0 (0xcd65e9dc) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcd65eb38) locked @ kern/vfs_lookup.c:542 Process 2515 (mkdir) thread 0xca768000 (100104) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a5ff60) locked @ kern/vfs_bio.c:2658 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a85080) locked @ kern/vfs_bio.c:1911 exclusive lockmgr ufs (ufs) r = 0 (0xca75e880) locked @ ufs/ffs/ffs_vfsops.c:1639 exclusive lockmgr ufs (ufs) r = 0 (0xcb63d310) locked @ kern/vfs_lookup.c:542 Process 2514 (mkdir) thread 0xca765b80 (100105) exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc12a4ee0) locked @ ufs/ffs/ffs_softdep.c:4455 exclusive lockmgr ufs (ufs) r = 0 (0xcd9c1058) locked @ ufs/ffs/ffs_vfsops.c:1639 exclusive lockmgr ufs (ufs) r = 0 (0xcd9c11b4) locked @ kern/vfs_lookup.c:542 Process 2513 (mkdir) thread 0xca7ea000 (100123) exclusive lockmgr ufs (ufs) r = 0 (0xcd9fe880) locked @ ufs/ffs/ffs_vfsops.c:1639 exclusive lockmgr ufs (ufs) r = 0 (0xcd9fe9dc) locked @ kern/vfs_lookup.c:542 Process 2512 (mkdir) thread 0xcab1f8a0 (100116) exclusive lockmgr ufs (ufs) r = 0 (0xcd9a1310) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcd9a146c) locked @ kern/vfs_subr.c:2167 Process 2511 (mkdir) thread 0xcab1e5c0 (100129) exclusive lockmgr ufs (ufs) r = 0 (0xcd93a46c) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcd8aa5c8) locked @ kern/vfs_lookup.c:542 Process 2510 (mkdir) thread 0xcac768a0 (100154) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a19fc0) locked @ kern/vfs_bio.c:1911 exclusive lockmgr bufwait (bufwait) r = 0 (0xe19796a0) locked @ ufs/ffs/ffs_vnops.c:262 exclusive lockmgr snaplk (snaplk) r = 0 (0xca74b01c) locked @ ufs/ffs/ffs_snapshot.c:2293 exclusive lockmgr ufs (ufs) r = 0 (0xcd9cf058) locked @ kern/vfs_lookup.c:542 Process 2509 (mkdir) thread 0xcac76000 (100157) exclusive lockmgr ufs (ufs) r = 0 (0xcd77b880) locked @ kern/vfs_lookup.c:542 Process 2508 (mkdir) thread 0xca7688a0 (100088) exclusive lockmgr ufs (ufs) r = 0 (0xcda04724) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcda04880) locked @ kern/vfs_subr.c:2167 Process 2507 (mkdir) thread 0xca6bfb80 (100090) exclusive lockmgr ufs (ufs) r = 0 (0xcbf7dc94) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xcd6df1b4) locked @ kern/vfs_lookup.c:542 Process 2506 (mkdir) thread 0xcb0bcb80 (100179) exclusive lockmgr ufs (ufs) r = 0 (0xcc30f46c) locked @ kern/vfs_subr.c:2167 exclusive lockmgr ufs (ufs) r = 0 (0xce51b5c8) locked @ kern/vfs_lookup.c:542 Process 2505 (mkdir) thread 0xcac765c0 (100155) exclusive lockmgr ufs (ufs) r = 0 (0xcd98546c) locked @ ufs/ffs/ffs_vfsops.c:1639 exclusive lockmgr ufs (ufs) r = 0 (0xcd9855c8) locked @ kern/vfs_lookup.c:542 Process 2495 (creat) thread 0xca7ea8a0 (100099) exclusive lockmgr ufs (ufs) r = 0 (0xcd986b38) locked @ ufs/ffs/ffs_vfsops.c:1639 exclusive lockmgr ufs (ufs) r = 0 (0xcb245880) locked @ kern/vfs_lookup.c:542 Process 16 (bufdaemon) thread 0xc8189000 (100074) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1970e20) locked @ kern/vfs_bio.c:2325 exclusive sleep mutex buf queue lock (buf queue lock) r = 0 (0xc129e914) locked @ kern/vfs_bio.c:2303 db:0:alllocks> show lockedvnods Locked vnodes 0xcb245828: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcd7e6510 ref 0 pages 0 lock type ufs: EXCL by thread 0xca7ea8a0 (pid 2495) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0b07a70 at vn_open_cred+0x90 #7 0xc0b07ffb at vn_open+0x3b #8 0xc0b0425c at kern_openat+0x1ec #9 0xc0b046f5 at kern_open+0x35 #10 0xc0b04730 at sys_open+0x30 #11 0xc0dbed87 at syscall+0x2c7 #12 0xc0da80b1 at Xint0x80_syscall+0x21 ino 196609, on dev md5a 0xce56cae0: tag ufs, type VREG usecount 2, writecount 0, refcount 346 mountedhere 0 flags (VV_SYSTEM|VV_MD) v_object 0xce3f8cf0 ref 0 pages 2464 lock type snaplk: EXCL by thread 0xcac768a0 (pid 2510) with exclusive waiters pending #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0c80882 at ffs_copyonwrite+0x2c2 #2 0xc0c9dafb at ffs_geom_strategy+0xeb #3 0xc0adee59 at bufwrite+0x159 #4 0xc0c9d170 at ffs_bufwrite+0x290 #5 0xc0ae072c at bawrite+0x5c #6 0xc0c719c7 at ffs_nodealloccg+0x5a7 #7 0xc0c70685 at ffs_hashalloc+0x85 #8 0xc0c710e3 at ffs_valloc+0x4d3 #9 0xc0cb6fc9 at ufs_mkdir+0xa9 #10 0xc0de2565 at VOP_MKDIR_APV+0xc5 #11 0xc0afe361 at kern_mkdirat+0x291 #12 0xc0afe43e at kern_mkdir+0x2e #13 0xc0afe469 at sys_mkdir+0x29 #14 0xc0dbed87 at syscall+0x2c7 #15 0xc0da80b1 at Xint0x80_syscall+0x21 ino 5, on dev md5a 0xcce81000: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcbe0aea0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab06000 (pid 2520) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 133245, on dev md5a 0xcce7ed98: tag ufs, type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcbe0ae10 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab06000 (pid 2520) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 133246, on dev md5a 0xcba28828: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xce3bb750 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab065c0 (pid 2518) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 7796, on dev md5a 0xcba05570: tag ufs, type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcc5b41b0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab065c0 (pid 2518) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 205149, on dev md5a 0xcdaed000: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcba6a240 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb4e72e0 (pid 2721) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0c9e316 at ffs_sync+0x246 #6 0xc0b00770 at sys_sync+0x110 #7 0xc0dbed87 at syscall+0x2c7 #8 0xc0da80b1 at Xint0x80_syscall+0x21 ino 196795, on dev md5a 0xcd65eae0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcd64ae10 ref 0 pages 0 lock type ufs: EXCL by thread 0xca7682e0 (pid 2516) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 74350, on dev md5a 0xcd65e984: tag ufs, type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcd64aea0 ref 0 pages 0 lock type ufs: EXCL by thread 0xca7682e0 (pid 2516) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 74352, on dev md5a 0xcd6df15c: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcd81d7e0 ref 0 pages 0 lock type ufs: EXCL by thread 0xca6bfb80 (pid 2507) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 210675, on dev md5a 0xcd6ef2b8: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcd77f480 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab1fb80 (pid 2523) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 210678, on dev md5a 0xcbf7dc3c: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcdd8a240 ref 0 pages 0 lock type ufs: EXCL by thread 0xca6bfb80 (pid 2507) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 210712, on dev md5a 0xcd77b828: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcd70db40 ref 0 pages 0 lock type ufs: EXCL by thread 0xcac76000 (pid 2509) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 205541, on dev md5a 0xcbf7d828: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcd77f3f0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab1fb80 (pid 2523) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 210572, on dev md5a 0xcd6eb414: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcddce750 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab0c8a0 (pid 2521) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 210759, on dev md5a 0xcd6eb984: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcd732090 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab0c8a0 (pid 2521) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 210764, on dev md5a 0xce51b570: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcb445e10 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb0bcb80 (pid 2506) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 3308, on dev md5a 0xcc30f414: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcb445ab0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb0bcb80 (pid 2506) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 202717, on dev md5a 0xce51215c: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xce42acf0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb0bc2e0 (pid 2522) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 74591, on dev md5a 0xcbf86ae0: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcd782900 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb0bc2e0 (pid 2522) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 74594, on dev md5a 0xcd8aa570: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc740bd0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab1e5c0 (pid 2511) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 9366, on dev md5a 0xcd93a414: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) lock type ufs: EXCL by thread 0xcab1e5c0 (pid 2511) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 9371, on dev md5a 0xcd986ae0: tag ufs, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xca7ea8a0 (pid 2495) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0c9d549 at ffs_vgetf+0x189 #2 0xc0c9d98e at ffs_vget+0x2e #3 0xc0c71110 at ffs_valloc+0x500 #4 0xc0cb4033 at ufs_makeinode+0xc3 #5 0xc0cb48f0 at ufs_create+0x30 #6 0xc0de30b5 at VOP_CREATE_APV+0xc5 #7 0xc0b07be5 at vn_open_cred+0x205 #8 0xc0b07ffb at vn_open+0x3b #9 0xc0b0425c at kern_openat+0x1ec #10 0xc0b046f5 at kern_open+0x35 #11 0xc0b04730 at sys_open+0x30 #12 0xc0dbed87 at syscall+0x2c7 #13 0xc0da80b1 at Xint0x80_syscall+0x21 ino 210904, on dev md5a 0xcd9a1414: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc4b6630 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab1f8a0 (pid 2512) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135793, on dev md5a 0xcd9a12b8: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) lock type ufs: EXCL by thread 0xcab1f8a0 (pid 2512) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 135794, on dev md5a 0xcd9cf000: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc5795a0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcac768a0 (pid 2510) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afe18b at kern_mkdirat+0xbb #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135807, on dev md5a 0xcda06414: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc4ee000 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab062e0 (pid 2519) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 68086, on dev md5a 0xcda062b8: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) lock type ufs: EXCL by thread 0xcab062e0 (pid 2519) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 68092, on dev md5a 0xcda04828: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc4ee750 ref 0 pages 0 lock type ufs: EXCL by thread 0xca7688a0 (pid 2508) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afde90 at kern_rmdirat+0x80 #7 0xc0afe097 at kern_rmdir+0x27 #8 0xc0afe0c2 at sys_rmdir+0x22 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135818, on dev md5a 0xcda046cc: tag ufs, type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOINGINACT) lock type ufs: EXCL by thread 0xca7688a0 (pid 2508) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afafeb at vget+0xbb #5 0xc0aea9fd at vfs_hash_get+0xed #6 0xc0c9d409 at ffs_vgetf+0x49 #7 0xc0c9d98e at ffs_vget+0x2e #8 0xc0cac1d3 at ufs_lookup_ino+0x8a3 #9 0xc0cac59a at ufs_lookup+0x2a #10 0xc0de1a45 at VOP_CACHEDLOOKUP_APV+0xc5 #11 0xc0ae3ec6 at vfs_cache_lookup+0xe6 #12 0xc0de3265 at VOP_LOOKUP_APV+0xe5 #13 0xc0aebe5b at lookup+0x6eb #14 0xc0aece7f at namei+0x6bf #15 0xc0afde90 at kern_rmdirat+0x80 #16 0xc0afe097 at kern_rmdir+0x27 #17 0xc0afe0c2 at sys_rmdir+0x22 ino 135820, on dev md5a 0xcd985984: tag ufs, type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_DOINGINACT) v_object 0xcc3d0090 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab068a0 (pid 2517) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0afc876 at vputx+0x266 #5 0xc0afd0c0 at vrele+0x10 #6 0xc0b04030 at kern_chdir+0x220 #7 0xc0b04062 at sys_chdir+0x22 #8 0xc0dbed87 at syscall+0x2c7 #9 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135894, on dev md5a 0xcb63d2b8: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcbaaeab0 ref 0 pages 0 lock type ufs: EXCL by thread 0xca768000 (pid 2515) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afe18b at kern_mkdirat+0xbb #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135900, on dev md5a 0xcd985570: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc3d0ea0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcac765c0 (pid 2505) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afe18b at kern_mkdirat+0xbb #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135901, on dev md5a 0xcd9fe984: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc4c3d80 ref 0 pages 0 lock type ufs: EXCL by thread 0xca7ea000 (pid 2513) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afe18b at kern_mkdirat+0xbb #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135902, on dev md5a 0xcd9c115c: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags () v_object 0xcc4e82d0 ref 0 pages 0 lock type ufs: EXCL by thread 0xca765b80 (pid 2514) #0 0xc0a420a4 at __lockmgr_args+0x5c4 #1 0xc0ca40a1 at ffs_lock+0xa1 #2 0xc0de20e5 at VOP_LOCK1_APV+0xb5 #3 0xc0b08528 at _vn_lock+0x78 #4 0xc0aeb876 at lookup+0x106 #5 0xc0aece7f at namei+0x6bf #6 0xc0afe18b at kern_mkdirat+0xbb #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 2823, on dev md5a 0xca75e828: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags () lock type ufs: EXCL by thread 0xca768000 (pid 2515) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0c9d549 at ffs_vgetf+0x189 #2 0xc0c9d98e at ffs_vget+0x2e #3 0xc0c71110 at ffs_valloc+0x500 #4 0xc0cb6fc9 at ufs_mkdir+0xa9 #5 0xc0de2565 at VOP_MKDIR_APV+0xc5 #6 0xc0afe361 at kern_mkdirat+0x291 #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135903, on dev md5a 0xcd985414: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xcac765c0 (pid 2505) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0c9d549 at ffs_vgetf+0x189 #2 0xc0c9d98e at ffs_vget+0x2e #3 0xc0c71110 at ffs_valloc+0x500 #4 0xc0cb6fc9 at ufs_mkdir+0xa9 #5 0xc0de2565 at VOP_MKDIR_APV+0xc5 #6 0xc0afe361 at kern_mkdirat+0x291 #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135904, on dev md5a 0xcd9fe828: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xca7ea000 (pid 2513) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0c9d549 at ffs_vgetf+0x189 #2 0xc0c9d98e at ffs_vget+0x2e #3 0xc0c71110 at ffs_valloc+0x500 #4 0xc0cb6fc9 at ufs_mkdir+0xa9 #5 0xc0de2565 at VOP_MKDIR_APV+0xc5 #6 0xc0afe361 at kern_mkdirat+0x291 #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 135905, on dev md5a 0xcd9c1000: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xca765b80 (pid 2514) #0 0xc0a426fe at __lockmgr_args+0xc1e #1 0xc0c9d549 at ffs_vgetf+0x189 #2 0xc0c9d98e at ffs_vget+0x2e #3 0xc0c71110 at ffs_valloc+0x500 #4 0xc0cb6fc9 at ufs_mkdir+0xa9 #5 0xc0de2565 at VOP_MKDIR_APV+0xc5 #6 0xc0afe361 at kern_mkdirat+0x291 #7 0xc0afe43e at kern_mkdir+0x2e #8 0xc0afe469 at sys_mkdir+0x29 #9 0xc0dbed87 at syscall+0x2c7 #10 0xc0da80b1 at Xint0x80_syscall+0x21 ino 2825, on dev md5a db:0:lockedvnods> show mount 0xca733b50 /dev/ad4s1a on / (ufs) 0xca734000 devfs on /dev (devfs) 0xca73387c /dev/ad4s1f on /home (ufs) 0xca7332d4 /dev/ad4s1d on /usr (ufs) 0xca733000 /dev/ad4s1e on /var (ufs) 0xcaa6a5a8 procfs on /proc (procfs) 0xcaa6a2d4 linprocfs on /usr/compat/linux/proc (linprocfs) 0xcb0a9000 /dev/label/tmp on /tmp (ufs) 0xcaa6a000 /dev/md5a on /mnt (ufs) 0xcb3d5000 /dev/md6 on /mnt2 (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 2738 2248 2246 1001 S nanslp 0xc1128a64 sleep 2721 2453 2351 0 D+ snaplk 0xca74b01c umount 2718 0 0 0 DL mdwait 0xcb5e2800 [md6] 2523 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2522 2496 2477 1004 R+ mkdir 2521 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2520 2496 2477 1004 D+ biowr 0xe1a24ee0 mkdir 2519 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2518 2496 2477 1004 D+ biowr 0xe19f83e0 mkdir 2517 2496 2477 1004 D+ getblk 0xe1a5ff60 mkdir 2516 2496 2477 1004 D+ jwait 0xcd3ac7c0 mkdir 2515 2496 2477 1004 R+ CPU 1 mkdir 2514 2496 2477 1004 R+ CPU 0 mkdir 2513 2496 2477 1004 R+ CPU 3 mkdir 2512 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2511 2496 2477 1004 R+ mkdir 2510 2496 2477 1004 D+ biowr 0xe1a19f60 mkdir 2509 2496 2477 1004 R+ mkdir 2508 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2507 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2506 2496 2477 1004 D+ snaplk 0xca74b01c mkdir 2505 2496 2477 1004 R+ mkdir 2504 2497 2477 1004 R+ swap 2503 2497 2477 1004 R+ swap 2502 2497 2477 1004 R+ swap 2501 2497 2477 1004 R+ swap 2500 2497 2477 1004 R+ swap 2499 2497 2477 1004 R+ swap 2498 2494 2477 1004 R+ creat 2497 2493 2477 1004 SW+ wait 0xcaff0b10 swap 2496 2492 2477 1004 SW+ wait 0xcb12e588 mkdir 2495 2494 2477 1004 R+ creat 2494 2491 2477 1004 SW+ wait 0xcb12e000 creat 2493 2490 2477 1004 S+ nanslp 0xc1128a64 swap 2492 2490 2477 1004 S+ nanslp 0xc1128a64 mkdir 2491 2490 2477 1004 S+ nanslp 0xc1128a64 creat 2490 2489 2477 1004 SW+ wait 0xcafed588 run 2489 2477 2477 1004 SW+ wait 0xca7e32c4 run 2477 2471 2477 1004 S+ nanslp 0xc1128a64 run 2471 2453 2351 0 SW+ wait 0xcab02b10 su 2466 0 0 0 RL [md5] 2453 2351 2351 0 SW+ wait 0xca7cab10 sh 2351 2301 2351 0 SW+ wait 0xcb12e2c4 sh 2301 2296 2301 0 SW+ wait 0xca7e0b10 bash 2296 2280 2296 0 SW+ pause 0xcaff0058 csh 2280 2268 2280 1001 SW+ wait 0xcab05b10 su 2268 2267 2268 1001 SWs+ wait 0xcb12d2c4 bash 2267 2265 2265 1001 S select 0xca6b14e4 sshd 2265 2091 2265 0 Ss select 0xca736be4 sshd 2249 2246 2246 1001 S piperd 0xca79b190 awk 2248 2246 2246 1001 S wait 0xcafed2c4 sh 2247 2243 2247 1001 Ss+ select 0xcad4c9e4 top 2246 2242 2246 1001 SWs wait 0xca7e3b10 sh 2245 2244 2245 1001 Ss kqread 0xca745500 tail 2244 2238 2238 1001 S select 0xcadc32e4 sshd 2243 2237 2237 1001 S select 0xca7dad24 sshd 2242 2236 2236 1001 S select 0xca736724 sshd 2238 2091 2238 0 Ss select 0xca6b13a4 sshd 2237 2091 2237 0 Ss select 0xca7da564 sshd 2236 2091 2236 0 Ss select 0xca6b2be4 sshd 2235 1 2235 0 Ss+ ttyin 0xc7efda70 getty 2234 1 2234 0 Ss+ ttyin 0xc7efdc70 getty 2233 1 2233 0 Ss+ ttyin 0xc7efde70 getty 2232 1 2232 0 Ss+ ttyin 0xc8192070 getty 2231 1 2231 0 Ss+ ttyin 0xc8192270 getty 2230 1 2230 0 Ss+ ttyin 0xc8192470 getty 2229 1 2229 0 Ss+ ttyin 0xc7efc670 getty 2228 1 2228 0 Ss+ ttyin 0xc7efc470 getty 2227 1 2227 0 Ss+ ttyin 0xc7efc070 getty 2188 1 2188 0 Ss select 0xcad4c624 inetd 2156 1 2156 0 Ss nanslp 0xc1128a64 watchdogd 2111 1 2111 0 SWs nanslp 0xc1128a64 cron 2103 1 2103 25 SWs pause 0xca7ca31c sendmail 2099 1 2099 0 Ss select 0xcadc3124 sendmail 2091 1 2091 0 Ss select 0xca6b1aa4 sshd 2031 1 2031 0 Ss select 0xca736364 moused 1953 1 1953 0 Ss select 0xcad4b2a4 ntpd 1853 1846 1846 0 S (threaded) nfsd 100151 S rpcsvc 0xca799890 nfsd: service 100150 S rpcsvc 0xca799c10 nfsd: service 100149 S rpcsvc 0xcabe6010 nfsd: service 100145 S rpcsvc 0xca60fe10 nfsd: master 1846 1 1846 0 Ss select 0xcad4b3e4 nfsd 1836 1 1836 0 Ss select 0xca6b16a4 mountd 1737 1 1737 0 Ss select 0xca736124 rpcbind 1710 1 1710 0 Ss select 0xca689ca4 syslogd 1503 1 1503 0 Ss select 0xca6b1024 devd 19 0 0 0 DL snaplk 0xca74b01c [softdepflush] 18 0 0 0 DL vlruwt 0xca6bc2c4 [vnlru] 17 0 0 0 DL syncer 0xc129ec34 [syncer] 16 0 0 0 RL CPU 2 [bufdaemon] 9 0 0 0 DL pgzero 0xc12a6ddc [pagezero] 8 0 0 0 DL psleep 0xc12a69c8 [vmdaemon] 7 0 0 0 DL psleep 0xc12a6990 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10ed254 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc12a0758 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc819a000 [ctl_thrd] 3 0 0 0 RL [fdc0] 2 0 0 0 SL - 0xc8090000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8066d34 [usbus5] 100057 D - 0xc8066d04 [usbus5] 100056 D - 0xc8066cd4 [usbus5] 100055 D - 0xc8066ca4 [usbus5] 100053 D - 0xc8058b5c [usbus4] 100052 D - 0xc8058b2c [usbus4] 100051 D - 0xc8058afc [usbus4] 100050 D - 0xc8058acc [usbus4] 100049 D - 0xc8054b5c [usbus3] 100048 D - 0xc8054b2c [usbus3] 100047 D - 0xc8054afc [usbus3] 100046 D - 0xc8054acc [usbus3] 100045 D - 0xc804cb5c [usbus2] 100044 D - 0xc804cb2c [usbus2] 100043 D - 0xc804cafc [usbus2] 100042 D - 0xc804cacc [usbus2] 100040 D - 0xc8048b5c [usbus1] 100039 D - 0xc8048b2c [usbus1] 100038 D - 0xc8048afc [usbus1] 100037 D - 0xc8048acc [usbus1] 100035 D - 0xc803ab5c [usbus0] 100034 D - 0xc803ab2c [usbus0] 100033 D - 0xc803aafc [usbus0] 100032 D - 0xc803aacc [usbus0] 14 0 0 0 DL - 0xc1127864 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc1125468 [g_down] 100014 D - 0xc1125464 [g_up] 100013 D - 0xc112545c [g_event] 12 0 0 0 WL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100023 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7dd0b10 [init] 10 0 0 0 DL audit_wo 0xc12a4660 [audit] 0 0 0 0 DLs (threaded) [kernel] 100078 D - 0xc7ee2340 [mca taskq] 100068 D - 0xc1127864 [deadlkres] 100061 D - 0xc7ee2640 [fw0_taskq] 100025 D - 0xc7ee2740 [thread taskq] 100022 D - 0xc7ee27c0 [kqueue taskq] 100021 D - 0xc7ee2800 [ffs_trim taskq] 100020 D - 0xc7ee2840 [acpi_task_2] 100019 D - 0xc7ee2840 [acpi_task_1] 100018 D - 0xc7ee2840 [acpi_task_0] 100016 D - 0xc7ee2880 [firmware taskq] 100000 D sched 0xc1125540 [swapper] db:0:ps> allt Tracing command sleep pid 2738 tid 100191 td 0xcb31b5c0 sched_switch(cb31b5c0,0,104,1a3,c7fe5ae5,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb31b5c0,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a9b280,cb31b5c0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1128a64,6c,c0f8d2e3,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1128a64,0,16c,c0f8d2e3,2711,...) at _sleep+0x34f kern_nanosleep(cb31b5c0,f290dc50,f290dc58,a,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb31b5c0,f290dcec,c0fdd9ea,c0f94f38,246,...) at sys_nanosleep+0x6f syscall(f290dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816de27, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command umount pid 2721 tid 100210 td 0xcb4e72e0 sched_switch(cb4e72e0,0,104,1a3,27146bd5,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb4e72e0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_copyonwrite(cb290c3c,e197ffe0,e197ffe0,0,0,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(cb290d34,e197ffe0,e5,e197ffe0,60000,...) at ffs_geom_strategy+0xeb bufwrite(e197ffe0,0,c0fc28d0,7de,0) at bufwrite+0x159 ffs_bufwrite(e197ffe0,cbebb600,100,8000,0,...) at ffs_bufwrite+0x290 ffs_update(cdaed000,2,c0fc3051,130,0,...) at ffs_update+0x2dc ffs_syncvnode(cdaed000,2,cb4e72e0,5db,c0f8a1ab,...) at ffs_syncvnode+0x442 ffs_sync(caa6a000,2,2,9b,caa6a000,...) at ffs_sync+0x29f sys_sync(cb4e72e0,f2948cec,c,c,246,...) at sys_sync+0x110 syscall(f2948d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (36, FreeBSD ELF32, sys_sync), eip = 0x280e7d8b, esp = 0xbfbfe83c, ebp = 0xbfbfe8a8 --- Tracing command md6 pid 2718 tid 100221 td 0xcb4e62e0 sched_switch(cb4e62e0,0,104,1a3,e3d3a98b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb4e62e0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb5e2800,5c,c0f28962,0,0,...) at sleepq_wait+0x63 _sleep(cb5e2800,cb5e2820,25c,c0f28962,0,...) at _sleep+0x39c md_kthread(cb5e2800,f296dd28,c0f86510,3db,cb4e32c4,...) at md_kthread+0x11a fork_exit(c07692a0,cb5e2800,f296dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf296dd60, ebp = 0 --- Tracing command mkdir pid 2523 tid 100163 td 0xcab1fb80 sched_switch(cab1fb80,0,104,1a3,27241f53,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab1fb80,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,61496,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,61496,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f28a57c8,...) at freework_freeblock+0x5b9 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cbf6bd98,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cbf7d828,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f28a5b44,c0fe42f8,cbf7d8ec,cbf7d8ec,cbf7d828,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f28a5b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f28a5b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f28a5c40,c0afe016,cbf7d828,ffffffdf,2,...) at vputx+0x36c vput(cbf7d828,ffffffdf,2,f28a5bf8,bfbe9857,...) at vput+0x10 kern_rmdirat(cab1fb80,ffffff9c,bfbe9857,0,f28a5c6c,...) at kern_rmdirat+0x206 kern_rmdir(cab1fb80,bfbe9857,0,f28a5d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab1fb80,f28a5cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f28a5d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbe93ec, ebp = 0xbfbe9828 --- Tracing command mkdir pid 2522 tid 100182 td 0xcb0bc2e0 sched_switch(cb0bc2e0,0,104,1a3,263a4f01,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb0bc2e0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(e19ec620,60,c0f84104,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e19ec620,81900,cb290d34,c0f84104,60,...) at __lockmgr_args+0xb3f getblk(cb290c3c,1012c0,0,8000,0,...) at getblk+0x167 breadn(cb290c3c,1012c0,0,8000,0,...) at breadn+0x44 bread(cb290c3c,1012c0,0,8000,0,...) at bread+0x4c ffs_update(cbf86ae0,0,0,800,c10eb920,...) at ffs_update+0x192 ffs_truncate(cbf86ae0,0,0,c00,0,...) at ffs_truncate+0x88b ufs_inactive(f28deb44,c0fe42f8,cbf86ba4,cbf86ba4,cbf86ae0,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f28deb44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f28deb78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f28dec40,c0afe016,cbf86ae0,ffffffdf,2,...) at vputx+0x36c vput(cbf86ae0,ffffffdf,2,f28debf8,bfbed817,...) at vput+0x10 kern_rmdirat(cb0bc2e0,ffffff9c,bfbed817,0,f28dec6c,...) at kern_rmdirat+0x206 kern_rmdir(cb0bc2e0,bfbed817,0,f28ded1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cb0bc2e0,f28decec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f28ded28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbed3ac, ebp = 0xbfbed7e8 --- Tracing command mkdir pid 2521 tid 100140 td 0xcab0c8a0 sched_switch(cab0c8a0,0,104,1a3,2712046c,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab0c8a0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,61210,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,61210,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f28227c8,...) at freework_freeblock+0x5b9 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cd6e6a6c,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cd6eb984,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2822b44,c0fe42f8,cd6eba48,cd6eba48,cd6eb984,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f2822b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f2822b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f2822c40,c0afe016,cd6eb984,ffffffdf,2,...) at vputx+0x36c vput(cd6eb984,ffffffdf,2,f2822bf8,bfbea517,...) at vput+0x10 kern_rmdirat(cab0c8a0,ffffff9c,bfbea517,0,f2822c6c,...) at kern_rmdirat+0x206 kern_rmdir(cab0c8a0,bfbea517,0,f2822d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab0c8a0,f2822cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2822d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbea0ac, ebp = 0xbfbea4e8 --- Tracing command mkdir pid 2520 tid 100184 td 0xcab06000 sched_switch(cab06000,0,104,1a3,272e6870,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cab06000,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e1a24ee0,5c,c0f9911a,0,0,...) at sleepq_wait+0x63 _sleep(e1a24ee0,c7d859ac,5c,c0f9911a,0,...) at _sleep+0x39c bwait(e1a24ee0,5c,c0f9911a,e1a24ee0,f28ed6f0,...) at bwait+0x6f bufwait(e1a24ee0,e1a24ee0,e5,e1a24ee0,e6844a80,...) at bufwait+0x48 bufwrite(e1a24ee0,0,c0fc28d0,7de,0) at bufwrite+0x165 ffs_bufwrite(e1a24ee0,0,c0fbf9f0,cd5,c0aa4c0a,...) at ffs_bufwrite+0x290 softdep_process_journal(cb374800,0,f28ed7f0,c0c97062,c12a4ee0,...) at softdep_process_journal+0x7c8 jwait(c12a4ee0,0,c0fbf9f0,1aa7,c0f98d6a,...) at jwait+0x66 trunc_dependencies(ffffffff,ffffffff,0,800,0,...) at trunc_dependencies+0x302 softdep_setup_freeblocks(ccec42b8,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0x95d ffs_truncate(cce7ed98,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f28edb44,c0fe42f8,cce7ee5c,cce7ee5c,cce7ed98,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f28edb44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f28edb78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f28edc40,c0afe016,cce7ed98,ffffffdf,2,...) at vputx+0x36c vput(cce7ed98,ffffffdf,2,f28edbf8,bfbf1397,...) at vput+0x10 kern_rmdirat(cab06000,ffffff9c,bfbf1397,0,f28edc6c,...) at kern_rmdirat+0x206 kern_rmdir(cab06000,bfbf1397,0,f28edd1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab06000,f28edcec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f28edd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbf0f2c, ebp = 0xbfbf1368 --- Tracing command mkdir pid 2519 tid 100148 td 0xcab062e0 sched_switch(cab062e0,0,104,1a3,25cd6c3b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab062e0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,22569,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,22569,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f28557c8,...) at freework_freeblock+0x658 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cd9af000,0,0,800,8,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cda062b8,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2855b44,c0fe42f8,cda0637c,cda0637c,cda062b8,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f2855b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f2855b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f2855c40,c0afe016,cda062b8,ffffffdf,2,...) at vputx+0x36c vput(cda062b8,ffffffdf,2,f2855bf8,bfbd3bd7,...) at vput+0x10 kern_rmdirat(cab062e0,ffffff9c,bfbd3bd7,0,f2855c6c,...) at kern_rmdirat+0x206 kern_rmdir(cab062e0,bfbd3bd7,0,f2855d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab062e0,f2855cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2855d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbd376c, ebp = 0xbfbd3ba8 --- Tracing command mkdir pid 2518 tid 100147 td 0xcab065c0 sched_switch(cab065c0,0,104,1a3,26d7a8c0,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cab065c0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e19f83e0,5c,c0f9911a,0,0,...) at sleepq_wait+0x63 _sleep(e19f83e0,c7d8504c,5c,c0f9911a,0,...) at _sleep+0x39c bwait(e19f83e0,5c,c0f9911a,e19f83e0,f28516f0,...) at bwait+0x6f bufwait(e19f83e0,e19f83e0,e5,e19f83e0,e5a8bfe0,...) at bufwait+0x48 bufwrite(e19f83e0,0,c0fc28d0,7de,c8037e40) at bufwrite+0x165 ffs_bufwrite(e19f83e0,0,c0fbf9f0,cd5,c0aa4c0a,...) at ffs_bufwrite+0x290 softdep_process_journal(cb3dd280,0,f28517f0,c0c97062,c12a4ee0,...) at softdep_process_journal+0x7c8 jwait(c12a4ee0,0,c0fbf9f0,1aa7,c0f98d6a,...) at jwait+0x66 trunc_dependencies(ffffffff,ffffffff,0,800,0,...) at trunc_dependencies+0x302 softdep_setup_freeblocks(ce40389c,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0x95d ffs_truncate(cba05570,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2851b44,c0fe42f8,cba05634,cba05634,cba05570,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f2851b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f2851b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f2851c40,c0afe016,cba05570,ffffffdf,2,...) at vputx+0x36c vput(cba05570,ffffffdf,2,f2851bf8,bfbf28d7,...) at vput+0x10 kern_rmdirat(cab065c0,ffffff9c,bfbf28d7,0,f2851c6c,...) at kern_rmdirat+0x206 kern_rmdir(cab065c0,bfbf28d7,0,f2851d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab065c0,f2851cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2851d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbf246c, ebp = 0xbfbf28a8 --- Tracing command mkdir pid 2517 tid 100146 td 0xcab068a0 sched_switch(cab068a0,0,104,1a3,296caa56,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab068a0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(e1a5ff60,60,c0f84104,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1a5ff60,81900,cb290d34,c0f84104,60,...) at __lockmgr_args+0xb3f getblk(cb290c3c,200a80,0,8000,0,...) at getblk+0x167 breadn(cb290c3c,200a80,0,8000,0,...) at breadn+0x44 bread(cb290c3c,200a80,0,8000,0,...) at bread+0x4c ffs_update(cd985984,0,1,f284db08,c126fdd8,...) at ffs_update+0x192 ufs_inactive(f284db60,c0fe42f8,cd985a48,cd985a48,cd985984,...) at ufs_inactive+0x37a VOP_INACTIVE_APV(c10dacc0,f284db60,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(cd985a48,0,c0f9b80c,8e8,0,...) at vinactive+0xb1 vputx(f284dc58,c0b04030,cd985984,c0f9ce27,34d,...) at vputx+0x36c vrele(cd985984,c0f9ce27,34d,34a,cadc8300,...) at vrele+0x10 kern_chdir(cab068a0,bfbe0a9b,0,f284dd1c,c0dbed87,...) at kern_chdir+0x220 sys_chdir(cab068a0,f284dcec,c0fdd9ea,c0fc131a,202,...) at sys_chdir+0x22 syscall(f284dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280fbeeb, esp = 0xbfbe064c, ebp = 0xbfbe0a78 --- Tracing command mkdir pid 2516 tid 100091 td 0xca7682e0 sched_switch(ca7682e0,0,104,1a3,27320b38,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(ca7682e0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cd3ac7c0,54,c0fc181e,0,0,...) at sleepq_wait+0x63 _sleep(cd3ac7c0,c12a4ee0,54,c0fc181e,0,...) at _sleep+0x39c wait_worklist(ca5c4a00,0,f27357f0,c0c97062,c12a4ee0,...) at wait_worklist+0x31 jwait(c12a4ee0,0,c0fbf9f0,1aa7,c0f98d6a,...) at jwait+0x83 trunc_dependencies(ffffffff,ffffffff,0,800,0,...) at trunc_dependencies+0x302 softdep_setup_freeblocks(cd5437b4,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0x95d ffs_truncate(cd65e984,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2735b44,c0fe42f8,cd65ea48,cd65ea48,cd65e984,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f2735b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f2735b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f2735c40,c0afe016,cd65e984,ffffffdf,2,...) at vputx+0x36c vput(cd65e984,ffffffdf,2,f2735bf8,bfbf1c17,...) at vput+0x10 kern_rmdirat(ca7682e0,ffffff9c,bfbf1c17,0,f2735c6c,...) at kern_rmdirat+0x206 kern_rmdir(ca7682e0,bfbf1c17,0,f2735d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(ca7682e0,f2735cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2735d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbf17ac, ebp = 0xbfbf1be8 --- Tracing command mkdir pid 2515 tid 100104 td 0xca768000 cpustop_handler(1,13,f277283c,c0dbf186,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,1f4334a,c0a4a880,caaea588,...) at ipi_nmi_handler+0x47 trap(f2772848) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a4a872, esp = 0xf2772888, ebp = 0xf27728a4 --- _mtx_lock_sleep(c12a4ee0,ca768000,0,c0fbf9f0,2d39,...) at _mtx_lock_sleep+0xa2 _mtx_lock_flags(c12a4ee0,0,c0fbf9f0,2d39,caa6a000,...) at _mtx_lock_flags+0xff softdep_update_inodeblock(cd87b3a0,e1a5ff00,0,8000,0,...) at softdep_update_inodeblock+0xed ffs_update(ca75e828,0,18,200,cadce800,...) at ffs_update+0x1db ufs_mkdir(f2772c14,c0fe4b65,0,0,f2772bac,...) at ufs_mkdir+0x922 VOP_MKDIR_APV(c10dacc0,f2772c14,f2772b84,f2772bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca768000,ffffff9c,bfbee88b,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(ca768000,bfbee88b,0,1f8,f2772d1c,...) at kern_mkdir+0x2e sys_mkdir(ca768000,f2772cec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f2772d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbee43c, ebp = 0xbfbee868 --- Tracing command mkdir pid 2514 tid 100105 td 0xca765b80 softdep_prelink(c12a4ee0,0,c0fbf9f0,1167,cd9c115c,...) at softdep_prelink+0x54 softdep_setup_mkdir(cd9df5e4,cd9df570,cadce800,0,c10eba40,...) at softdep_setup_mkdir+0x1b8 ufs_mkdir(f2775c14,c0fe4b65,0,0,f2775bac,...) at ufs_mkdir+0x311 VOP_MKDIR_APV(c10dacc0,f2775c14,f2775b84,f2775bac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca765b80,ffffff9c,bfbdae7b,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(ca765b80,bfbdae7b,0,1f8,f2775d1c,...) at kern_mkdir+0x2e sys_mkdir(ca765b80,f2775cec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f2775d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbdaa2c, ebp = 0xbfbdae58 --- Tracing command mkdir pid 2513 tid 100123 td 0xca7ea000 cpustop_handler(3,13,f27df890,c0dbf186,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,17ecac2,c0a4a880,ca7e2000,...) at ipi_nmi_handler+0x47 trap(f27df89c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a4a872, esp = 0xf27df8dc, ebp = 0xf27df8f8 --- _mtx_lock_sleep(c12a4ee0,ca7ea000,0,c0fbf9f0,1167,...) at _mtx_lock_sleep+0xa2 _mtx_lock_flags(c12a4ee0,0,c0fbf9f0,1167,cd9fe984,...) at _mtx_lock_flags+0xff softdep_setup_mkdir(cda0a6cc,cda0a658,cadce800,0,c10eba40,...) at softdep_setup_mkdir+0xc5 ufs_mkdir(f27dfc14,c0fe4b65,0,0,f27dfbac,...) at ufs_mkdir+0x311 VOP_MKDIR_APV(c10dacc0,f27dfc14,f27dfb84,f27dfbac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca7ea000,ffffff9c,bfbdb6db,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(ca7ea000,bfbdb6db,0,1f8,f27dfd1c,...) at kern_mkdir+0x2e sys_mkdir(ca7ea000,f27dfcec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f27dfd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbdb28c, ebp = 0xbfbdb6b8 --- Tracing command mkdir pid 2512 tid 100116 td 0xcab1f8a0 sched_switch(cab1f8a0,0,104,1a3,27208462,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab1f8a0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,41dc5,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,41dc5,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f279c7c8,...) at freework_freeblock+0x658 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cd9af984,0,0,800,8,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cd9a12b8,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f279cb44,c0fe42f8,cd9a137c,cd9a137c,cd9a12b8,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f279cb44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f279cb78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f279cc40,c0afe016,cd9a12b8,ffffffdf,2,...) at vputx+0x36c vput(cd9a12b8,ffffffdf,2,f279cbf8,bfbd3bd7,...) at vput+0x10 kern_rmdirat(cab1f8a0,ffffff9c,bfbd3bd7,0,f279cc6c,...) at kern_rmdirat+0x206 kern_rmdir(cab1f8a0,bfbd3bd7,0,f279cd1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab1f8a0,f279ccec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f279cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbd376c, ebp = 0xbfbd3ba8 --- Tracing command mkdir pid 2511 tid 100129 td 0xcab1e5c0 sched_switch(cab1e5c0,0,104,1a3,20408270,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cab1e5c0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,3206,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,3206,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f27ff7c8,...) at freework_freeblock+0x658 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cd9484fc,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cd93a414,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f27ffb44,c0fe42f8,cd93a4d8,cd93a4d8,cd93a414,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f27ffb44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f27ffb78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f27ffc40,c0afe016,cd93a414,ffffffdf,2,...) at vputx+0x36c vput(cd93a414,ffffffdf,2,f27ffbf8,bfbd3bd7,...) at vput+0x10 kern_rmdirat(cab1e5c0,ffffff9c,bfbd3bd7,0,f27ffc6c,...) at kern_rmdirat+0x206 kern_rmdir(cab1e5c0,bfbd3bd7,0,f27ffd1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cab1e5c0,f27ffcec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f27ffd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbd376c, ebp = 0xbfbd3ba8 --- Tracing command mkdir pid 2510 tid 100154 td 0xcac768a0 sched_switch(cac768a0,0,104,1a3,270f19f4,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cac768a0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e1a19f60,5c,c0f9911a,0,0,...) at sleepq_wait+0x63 _sleep(e1a19f60,c7d8595c,5c,c0f9911a,0,...) at _sleep+0x39c bwait(e1a19f60,5c,c0f9911a,e1a19f60,f288a5a8,...) at bwait+0x6f bufwait(e1a19f60,e1a19f60,e5,e1a19f60,e64ebfe0,...) at bufwait+0x48 bufwrite(e1a19f60,0,c0fc28d0,7de,0) at bufwrite+0x165 ffs_bufwrite(e1a19f60,0,c0fbf9f0,cd5,4c,...) at ffs_bufwrite+0x290 softdep_process_journal(cb0bae00,cb0bae00,f288a6c8,c0c99c43,c12a4ee0,...) at softdep_process_journal+0x7c8 jwait(c12a4ee0,0,c0fbf9f0,2f0b,0,...) at jwait+0x66 softdep_sync_buf(ce56cae0,e1979640,1,108,0,...) at softdep_sync_buf+0x203 ffs_syncvnode(ce56cae0,11,0,8000,c7db2000,...) at ffs_syncvnode+0x24c ffs_copyonwrite(cb290c3c,e1a3c980,e1a3c980,4,0,...) at ffs_copyonwrite+0x71e ffs_geom_strategy(cb290d34,e1a3c980,3a6,e1a3c980,41f8,...) at ffs_geom_strategy+0xeb bufwrite(e1a3c980,0,c0fc28d0,7de,c0fbf9f0) at bufwrite+0x159 ffs_bufwrite(e1a3c980,cb2c9000,f288a884,c0c719c7,e1a3c980,...) at ffs_bufwrite+0x290 bawrite(e1a3c980,cd9e3a6c,21281,41f8,0,...) at bawrite+0x5c ffs_nodealloccg(cd9e3a6c,2,20000,0,41f8,...) at ffs_nodealloccg+0x5a7 ffs_hashalloc(20000,0,41f8,0,c0c71420,...) at ffs_hashalloc+0x85 ffs_valloc(cd9cf000,41f8,cadce800,f288a9f0,c10eba40,...) at ffs_valloc+0x4d3 ufs_mkdir(f288ac14,c0fe4b65,0,0,f288abac,...) at ufs_mkdir+0xa9 VOP_MKDIR_APV(c10dacc0,f288ac14,f288ab84,f288abac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(cac768a0,ffffff9c,bfbf33eb,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(cac768a0,bfbf33eb,0,1f8,f288ad1c,...) at kern_mkdir+0x2e sys_mkdir(cac768a0,f288acec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f288ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbf2f9c, ebp = 0xbfbf33c8 --- Tracing command mkdir pid 2509 tid 100157 td 0xcac76000 sched_switch(cac76000,0,104,1a3,2468240f,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cac76000,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(e19d2ca0,60,c0f84104,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e19d2ca0,81900,cd77b920,c0f84104,60,...) at __lockmgr_args+0xb3f getblk(cd77b828,0,0,1000,0,...) at getblk+0x167 breadn(cd77b828,0,0,1000,0,...) at breadn+0x44 bread(cd77b828,0,0,1000,0,...) at bread+0x4c ffs_blkatoff(cd77b828,0,0,0,f2893a00,...) at ffs_blkatoff+0xd1 ufs_lookup_ino(cd77b828,f2893be4,f2893bf8,0,f2893a44,...) at ufs_lookup_ino+0x38e ufs_lookup(f2893a6c,c0fe492b,cd77b828,cd77b828,f2893bf8,...) at ufs_lookup+0x2a VOP_CACHEDLOOKUP_APV(c10dacc0,f2893a6c,f2893bf8,0,0,...) at VOP_CACHEDLOOKUP_APV+0xc5 vfs_cache_lookup(f2893b08,c0f9c514,0,80000,f2893bb8,...) at vfs_cache_lookup+0xe6 VOP_LOOKUP_APV(c10dacc0,f2893b08,c0f9ac1c,2da,c0f9ac1c,...) at VOP_LOOKUP_APV+0xe5 lookup(f2893bb8,c0f9ac1c,10e,dc,cd77b790,...) at lookup+0x6eb namei(f2893bb8,0,cd77b6cc,f2893bbc,bfbe4bd7,...) at namei+0x6bf kern_rmdirat(cac76000,ffffff9c,bfbe4bd7,0,f2893c6c,...) at kern_rmdirat+0x80 kern_rmdir(cac76000,bfbe4bd7,0,f2893d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cac76000,f2893cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2893d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbe476c, ebp = 0xbfbe4ba8 --- Tracing command mkdir pid 2508 tid 100088 td 0xca7688a0 sched_switch(ca7688a0,0,104,1a3,25f3e38e,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ca7688a0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,41d8c,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,41d8c,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f27297c8,...) at freework_freeblock+0x658 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cda0c5e4,0,0,800,8,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cda046cc,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2729b44,c0fe42f8,cda04790,cda04790,cda046cc,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f2729b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f2729b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f2729c40,c0afe016,cda046cc,ffffffdf,2,...) at vputx+0x36c vput(cda046cc,ffffffdf,2,f2729bf8,bfbd3bd7,...) at vput+0x10 kern_rmdirat(ca7688a0,ffffff9c,bfbd3bd7,0,f2729c6c,...) at kern_rmdirat+0x206 kern_rmdir(ca7688a0,bfbd3bd7,0,f2729d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(ca7688a0,f2729cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2729d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbd376c, ebp = 0xbfbd3ba8 --- Tracing command mkdir pid 2507 tid 100090 td 0xca6bfb80 sched_switch(ca6bfb80,0,104,1a3,26cc6412,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ca6bfb80,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,612a3,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,612a3,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f27317c8,...) at freework_freeblock+0x5b9 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cb1383a0,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cbf7dc3c,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f2731b44,c0fe42f8,cbf7dd00,cbf7dd00,cbf7dc3c,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f2731b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f2731b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f2731c40,c0afe016,cbf7dc3c,ffffffdf,2,...) at vputx+0x36c vput(cbf7dc3c,ffffffdf,2,f2731bf8,bfbf1397,...) at vput+0x10 kern_rmdirat(ca6bfb80,ffffff9c,bfbf1397,0,f2731c6c,...) at kern_rmdirat+0x206 kern_rmdir(ca6bfb80,bfbf1397,0,f2731d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(ca6bfb80,f2731cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f2731d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbf0f2c, ebp = 0xbfbf1368 --- Tracing command mkdir pid 2506 tid 100179 td 0xcb0bcb80 sched_switch(cb0bcb80,0,104,1a3,26515358,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb0bcb80,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,6143b,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,6143b,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,f28d57c8,...) at freework_freeblock+0x5b9 handle_workitem_freeblocks(c12a4ee0,0,c0fbf9f0,1992,0,...) at handle_workitem_freeblocks+0x27c softdep_setup_freeblocks(cc062488,0,0,800,c10eb920,...) at softdep_setup_freeblocks+0xa06 ffs_truncate(cc30f414,0,0,c00,0,...) at ffs_truncate+0x861 ufs_inactive(f28d5b44,c0fe42f8,cc30f4d8,cc30f4d8,cc30f414,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10dacc0,f28d5b44,c0f9b80c,96f,c10ebca0,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10dacc0,f28d5b78,c0f9b80c,8c6,0,...) at vinactive+0xb1 vputx(f28d5c40,c0afe016,cc30f414,ffffffdf,2,...) at vputx+0x36c vput(cc30f414,ffffffdf,2,f28d5bf8,bfbf4ad7,...) at vput+0x10 kern_rmdirat(cb0bcb80,ffffff9c,bfbf4ad7,0,f28d5c6c,...) at kern_rmdirat+0x206 kern_rmdir(cb0bcb80,bfbf4ad7,0,f28d5d1c,c0dbed87,...) at kern_rmdir+0x27 sys_rmdir(cb0bcb80,f28d5cec,c0fdd9ea,c0fbd351,246,...) at sys_rmdir+0x22 syscall(f28d5d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (137, FreeBSD ELF32, sys_rmdir), eip = 0x280fb9cb, esp = 0xbfbf466c, ebp = 0xbfbf4aa8 --- Tracing command mkdir pid 2505 tid 100155 td 0xcac765c0 sched_switch(cac765c0,0,602,19e,2f6e1969,...) at sched_switch+0x3ec mi_switch(602,0,c0f8c5bf,cd,cac765c0,...) at mi_switch+0x1ff critical_exit(c1305e40,0,2,c12a4ee0,0,...) at critical_exit+0xb5 lapic_handle_timer(f288d854) at lapic_handle_timer+0xa5 Xtimerint() at Xtimerint+0x20 --- interrupt, eip = 0xc0a4a872, esp = 0xf288d894, ebp = 0xf288d8b0 --- _mtx_lock_sleep(c12a4ee0,cac765c0,0,c0fbf9f0,4bd,...) at _mtx_lock_sleep+0xa2 _mtx_lock_flags(c12a4ee0,0,c0fbf9f0,4bd,ca5c2c40,...) at _mtx_lock_flags+0xff workitem_alloc(3c,c10d8348,2,41f8,2,...) at workitem_alloc+0x3d newjaddref(c,0,2,41f8,cd985570,...) at newjaddref+0x4e softdep_setup_mkdir(cd96d0e8,cd96d074,cadce800,0,c10eba40,...) at softdep_setup_mkdir+0x98 ufs_mkdir(f288dc14,c0fe4b65,0,0,f288dbac,...) at ufs_mkdir+0x311 VOP_MKDIR_APV(c10dacc0,f288dc14,f288db84,f288dbac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(cac765c0,ffffff9c,bfbe38ab,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(cac765c0,bfbe38ab,0,1f8,f288dd1c,...) at kern_mkdir+0x2e sys_mkdir(cac765c0,f288dcec,c0fdd9ea,c0fbd351,246,...) at sys_mkdir+0x29 syscall(f288dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28195743, esp = 0xbfbe345c, ebp = 0xbfbe3888 --- Tracing command swap pid 2504 tid 100183 td 0xca7e42e0 sched_switch(ca7e42e0,0,602,19e,20fbf006,...) at sched_switch+0x3ec mi_switch(602,0,c0f8c5bf,cd,0,...) at mi_switch+0x1ff critical_exit(ca7e42e0,0,0,28800000,1000,...) at critical_exit+0xb5 ipi_bitmap_handler(3b,3b,3b,4f3375e1,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049144, esp = 0xbfbfe7c0, ebp = 0xbfbfe7d8 --- Tracing command swap pid 2503 tid 100128 td 0xca7e9000 sched_switch(ca7e9000,0,207,19e,143b3efb,...) at sched_switch+0x3ec mi_switch(207,0,c0f9213e,d6,c1305e40,...) at mi_switch+0x1ff ast(f27f3d28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 2502 tid 100115 td 0xca765000 sched_switch(ca765000,0,602,19e,2750edae,...) at sched_switch+0x3ec mi_switch(602,0,c0f8c5bf,cd,c,...) at mi_switch+0x1ff critical_exit(ca765000,0,3,28800000,1000,...) at critical_exit+0xb5 ipi_bitmap_handler(3b,3b,3b,4f3375e3,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x804914a, esp = 0xbfbfe7c0, ebp = 0xbfbfe7d8 --- Tracing command swap pid 2501 tid 100100 td 0xca7ea5c0 sched_switch(ca7ea5c0,0,207,19e,f7819ea0,...) at sched_switch+0x3ec mi_switch(207,0,c0f9213e,d6,c1305e40,...) at mi_switch+0x1ff ast(f275bd28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 2500 tid 100127 td 0xca7e92e0 sched_switch(ca7e92e0,0,602,19e,27571118,...) at sched_switch+0x3ec mi_switch(602,0,c0f8c5bf,cd,4,...) at mi_switch+0x1ff critical_exit(ca7e92e0,0,1,28800000,1000,...) at critical_exit+0xb5 ipi_bitmap_handler(3b,3b,3b,4f3375e9,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049144, esp = 0xbfbfe7c0, ebp = 0xbfbfe7d8 --- Tracing command swap pid 2499 tid 100106 td 0xca7658a0 sched_switch(ca7658a0,0,602,19e,27524e61,...) at sched_switch+0x3ec mi_switch(602,0,c0f8c5bf,cd,8,...) at mi_switch+0x1ff critical_exit(ca7658a0,0,2,28800000,1000,...) at critical_exit+0xb5 ipi_bitmap_handler(3b,3b,3b,4f3375e0,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049144, esp = 0xbfbfe7c0, ebp = 0xbfbfe7d8 --- Tracing command creat pid 2498 tid 100097 td 0xca6bf000 sched_switch(ca6bf000,0,207,19e,25e97439,...) at sched_switch+0x3ec mi_switch(207,0,c0f9213e,d6,c1305e40,...) at mi_switch+0x1ff ast(f274fd28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 2497 tid 100152 td 0xcac77000 Tracing command mkdir pid 2496 tid 100175 td 0xcb1328a0 Tracing command creat pid 2495 tid 100099 td 0xca7ea8a0 sched_switch(ca7ea8a0,0,104,1a3,211a2be4,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ca7ea8a0,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(e1a185c0,60,c0f84104,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1a185c0,81900,cb290d34,c0f84104,60,...) at __lockmgr_args+0xb3f getblk(cb290c3c,301d00,0,8000,0,...) at getblk+0x167 breadn(cb290c3c,301d00,0,8000,0,...) at breadn+0x44 bread(cb290c3c,301d00,0,8000,0,...) at bread+0x4c ffs_vgetf(caa6a000,337d8,80000,f2757914,0,...) at ffs_vgetf+0x3ab ffs_vget(caa6a000,337d8,80000,f2757914,c0c71420,...) at ffs_vget+0x2e ffs_valloc(cb245828,81b0,cadce800,f2757914,c10db240,...) at ffs_valloc+0x500 ufs_makeinode(f2757bc0,c10db240,f2757b04,f2757a60,c0de30b5,...) at ufs_makeinode+0xc3 ufs_create(f2757b04,c0fe4d2b,0,0,f2757b80,...) at ufs_create+0x30 VOP_CREATE_APV(c10dacc0,f2757b04,f2757bc0,f2757a9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f2757b80,f2757c48,1b0,0,cadce800,...) at vn_open_cred+0x205 vn_open(f2757b80,f2757c48,1b0,ca797658,c1ba6010,...) at vn_open+0x3b kern_openat(ca7ea8a0,ffffff9c,bfbfe748,0,602,...) at kern_openat+0x1ec kern_open(ca7ea8a0,bfbfe748,0,601,1b0,...) at kern_open+0x35 sys_open(ca7ea8a0,f2757cec,c0fdd9ea,c0f7c8f9,206,...) at sys_open+0x30 syscall(f2757d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x2819cda3, esp = 0xbfbfe6fc, ebp = 0xbfbfe718 --- Tracing command creat pid 2494 tid 100177 td 0xcb1322e0 Tracing command swap pid 2493 tid 100143 td 0xcac775c0 sched_switch(cac775c0,0,104,1a3,20e829d3,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac775c0,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b280,cac775c0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1128a64,6c,c0f8d2e3,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1128a64,0,16c,c0f8d2e3,3e9,...) at _sleep+0x34f kern_nanosleep(cac775c0,f282bc50,f282bc58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cac775c0,f282bcec,c0fdd9ea,c0f94b64,202,...) at sys_nanosleep+0x6f syscall(f282bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe7ac, ebp = 0xbfbfe7d8 --- Tracing command mkdir pid 2492 tid 100125 td 0xca7e98a0 sched_switch(ca7e98a0,0,104,1a3,9233a29,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca7e98a0,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b280,ca7e98a0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1128a64,6c,c0f8d2e3,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1128a64,0,16c,c0f8d2e3,3e9,...) at _sleep+0x34f kern_nanosleep(ca7e98a0,f27e7c50,f27e7c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca7e98a0,f27e7cec,c0fdd9ea,c0f94b64,202,...) at sys_nanosleep+0x6f syscall(f27e7d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe7ac, ebp = 0xbfbfe7d8 --- Tracing command creat pid 2491 tid 100120 td 0xcab1eb80 sched_switch(cab1eb80,0,104,1a3,945a6a4,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab1eb80,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b280,cab1eb80,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1128a64,6c,c0f8d2e3,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1128a64,0,16c,c0f8d2e3,3e9,...) at _sleep+0x34f kern_nanosleep(cab1eb80,f27a8c50,f27a8c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cab1eb80,f27a8cec,c0fdd9ea,c0f94b64,202,...) at sys_nanosleep+0x6f syscall(f27a8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28183e27, esp = 0xbfbfe7ac, ebp = 0xbfbfe7d8 --- Tracing command run pid 2490 tid 100159 td 0xcac728a0 Tracing command run pid 2489 tid 100121 td 0xcab1e8a0 Tracing command run pid 2477 tid 100162 td 0xcac72000 sched_switch(cac72000,0,104,1a3,97126c3,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac72000,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b280,cac72000,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1128a64,6c,c0f8d2e3,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1128a64,0,16c,c0f8d2e3,3e9,...) at _sleep+0x34f kern_nanosleep(cac72000,f28a2c50,f28a2c58,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cac72000,f28a2cec,c0fdd9ea,c0f94b64,202,...) at sys_nanosleep+0x6f syscall(f28a2d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28182e27, esp = 0xbfbfe75c, ebp = 0xbfbfe788 --- Tracing command su pid 2471 tid 100137 td 0xcab0b2e0 Tracing command md5 pid 2466 tid 100119 td 0xcab1f000 sched_switch(cab1f000,0,104,1a3,26cf6fc9,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cab1f000,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb0ab000,5c,c0f28962,0,0,...) at sleepq_wait+0x63 _sleep(cb0ab000,cb0ab020,25c,c0f28962,0,...) at _sleep+0x39c md_kthread(cb0ab000,f27a5d28,c0f86510,3db,ca7e384c,...) at md_kthread+0x11a fork_exit(c07692a0,cb0ab000,f27a5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf27a5d60, ebp = 0 --- Tracing command sh pid 2453 tid 100087 td 0xca6c0000 Tracing command sh pid 2351 tid 100176 td 0xcb1325c0 Tracing command bash pid 2301 tid 100124 td 0xca7e9b80 Tracing command csh pid 2296 tid 100156 td 0xcac762e0 Tracing command su pid 2280 tid 100141 td 0xcac77b80 Tracing command bash pid 2268 tid 100181 td 0xcb0bc5c0 Tracing command sshd pid 2267 tid 100178 td 0xcb132000 sched_switch(cb132000,0,104,1a3,c40bfad6,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb132000,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca6b14d0,0,c0f8a1ab,cb132000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b14e4,0,f28d2a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b14e4,ca6b14d0,c0f93ef0,6a4,ca777070,...) at _cv_wait_sig+0x260 seltdwait(ca777070,58,ca735d80,cb132000,f28d2acc,...) at seltdwait+0xa2 kern_select(cb132000,c,288060b8,288060c0,0,0,20,cb12db10,0) at kern_select+0x655 sys_select(cb132000,f28d2cec,c0fdd9ea,c0f9480b,206,...) at sys_select+0x66 syscall(f28d2d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 2265 tid 100103 td 0xc818b2e0 sched_switch(c818b2e0,0,104,1a3,f3fd5e81,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818b2e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca736bd0,0,c0f8a1ab,c818b2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca736be4,0,f2768abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca736be4,ca736bd0,c0f93ef0,6a4,f2768b44,...) at _cv_wait_sig+0x260 seltdwait(cabe482c,c0f93ef0,5a1,c818b2e0,8,...) at seltdwait+0xa2 sys_poll(c818b2e0,f2768cec,c0fdd9ea,c0f7c8f9,202,...) at sys_poll+0x321 syscall(f2768d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command awk pid 2249 tid 100080 td 0xca6c05c0 sched_switch(ca6c05c0,0,104,1a3,c7576019,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(ca6c05c0,0,c0f917a0,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca79b190,5c,c0f940ef,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca79b190,ca79b308,15c,c0f940ef,0,...) at _sleep+0x385 pipe_read(cac6faf0,f2703c44,c7fcf480,0,ca6c05c0,...) at pipe_read+0x417 dofileread(f2703c44,ffffffff,ffffffff,0,f2703c20,...) at dofileread+0x9e kern_readv(ca6c05c0,0,f2703c44,f2703c64,1,...) at kern_readv+0x68 sys_read(ca6c05c0,f2703cec,f2703cb4,f2703d80,216,...) at sys_read+0x4f syscall(f2703d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c8333, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 2248 tid 100160 td 0xcac725c0 sched_switch(cac725c0,0,104,1a3,c7d18d28,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac725c0,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cafed2c4,6c,c0f946b7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cafed2c4,cafed34c,16c,c0f946b7,0,...) at _sleep+0x385 kern_wait(cac725c0,ffffffff,f289cc60,2,0,...) at kern_wait+0x626 sys_wait4(cac725c0,f289ccec,c0fdd9ea,c0f94696,216,...) at sys_wait4+0x3b syscall(f289cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817645b, esp = 0xbfbfe94c, ebp = 0xbfbfe968 --- Tracing command top pid 2247 tid 100113 td 0xca7655c0 sched_switch(ca7655c0,0,104,1a3,f2787011,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7655c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2793a20,c0a4a69a,cad4c9d0,0,ca7655c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cad4c9e4,0,f2793a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cad4c9e4,cad4c9d0,3e9,6a4,cadd5230,...) at _cv_timedwait_sig+0x270 seltdwait(f2793c10,f2793c18,cad4a600,ca7655c0,1b383248,...) at seltdwait+0x8a kern_select(ca7655c0,2,bfbfebac,0,0,f2793c5c,20,1,0) at kern_select+0x655 sys_select(ca7655c0,f2793cec,c11356c0,f2793c88,246,...) at sys_select+0x66 syscall(f2793d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fd2b3, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command sh pid 2246 tid 100118 td 0xcab1f2e0 Tracing command tail pid 2245 tid 100092 td 0xca6bf8a0 sched_switch(ca6bf8a0,0,104,1a3,1289f7b6,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,68,...) at mi_switch+0x1ff sleepq_switch(ca6bf8a0,0,c0f917a0,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a9b280,ca6bf8a0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca745500,68,c0f860ce,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(ca745500,ca745500,168,c0f860ce,3e9,...) at _sleep+0x34f kern_kevent(ca6bf8a0,4,0,1,f2739c44,...) at kern_kevent+0x374 sys_kevent(ca6bf8a0,f2739cec,c0fdd9ea,c0dec8f7,286,...) at sys_kevent+0x19e syscall(f2739d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x28171d3b, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sshd pid 2244 tid 100138 td 0xcab0b000 sched_switch(cab0b000,0,104,1a3,587c7d5,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab0b000,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,cadc32d0,0,c0f8a1ab,cab0b000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cadc32e4,0,f281ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cadc32e4,cadc32d0,c0f93ef0,6a4,cac6f658,...) at _cv_wait_sig+0x260 seltdwait(cac6f658,58,cadce600,cab0b000,f281bacc,...) at seltdwait+0xa2 kern_select(cab0b000,c,288060b8,288060c0,0,0,20,cab0284c,0) at kern_select+0x655 sys_select(cab0b000,f281bcec,c0fdd9ea,c0f9480b,206,...) at sys_select+0x66 syscall(f281bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 2243 tid 100136 td 0xcab1d000 sched_switch(cab1d000,0,104,1a3,f2782916,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab1d000,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca7dad10,0,c0f8a1ab,cab1d000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7dad24,0,f2814a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7dad24,ca7dad10,c0f93ef0,6a4,cac6f428,...) at _cv_wait_sig+0x260 seltdwait(cac6f428,58,cad4a480,cab1d000,f2814acc,...) at seltdwait+0xa2 kern_select(cab1d000,a,288060b8,288060c0,0,0,20,cac0f588,0) at kern_select+0x655 sys_select(cab1d000,f2814cec,c0fdd9ea,c0f9480b,206,...) at sys_select+0x66 syscall(f2814d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 2242 tid 100171 td 0xcb1345c0 sched_switch(cb1345c0,0,104,1a3,c5545a6e,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1345c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca736710,0,c0f8a1ab,cb1345c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca736724,0,f28bda58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca736724,ca736710,c0f93ef0,6a4,cace3a10,...) at _cv_wait_sig+0x260 seltdwait(cace3a10,58,ca735780,cb1345c0,cadd22b8,...) at seltdwait+0xa2 kern_select(cb1345c0,c,288060b8,288060c0,0,0,20,cb1302c4,0) at kern_select+0x655 sys_select(cb1345c0,f28bdcec,c0fdd9ea,c0f9480b,206,...) at sys_select+0x66 syscall(f28bdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 2238 tid 100117 td 0xcab1f5c0 sched_switch(cab1f5c0,0,104,1a3,c523d689,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab1f5c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca6b1390,0,c0f8a1ab,cab1f5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b13a4,0,f279fabc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b13a4,ca6b1390,c0f93ef0,6a4,f279fb44,...) at _cv_wait_sig+0x260 seltdwait(ca7f202c,c0f93ef0,5a1,cab1f5c0,0,...) at seltdwait+0xa2 sys_poll(cab1f5c0,f279fcec,c0fdd9ea,c0dec8f7,202,...) at sys_poll+0x321 syscall(f279fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 2237 tid 100158 td 0xcac72b80 sched_switch(cac72b80,0,104,1a3,c8609e84,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac72b80,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca7da550,0,c0f8a1ab,cac72b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7da564,0,f2896abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7da564,ca7da550,c0f93ef0,6a4,f2896b44,...) at _cv_wait_sig+0x260 seltdwait(ca7f2c2c,c0f93ef0,5a1,cac72b80,0,...) at seltdwait+0xa2 sys_poll(cac72b80,f2896cec,c,c,202,...) at sys_poll+0x321 syscall(f2896d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 2236 tid 100142 td 0xcac778a0 sched_switch(cac778a0,0,104,1a3,c52658d7,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac778a0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca6b2bd0,0,c0f8a1ab,cac778a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b2be4,0,f2828abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b2be4,ca6b2bd0,c0f93ef0,6a4,f2828b44,...) at _cv_wait_sig+0x260 seltdwait(c7db852c,c0f93ef0,5a1,cac778a0,0,...) at seltdwait+0xa2 sys_poll(cac778a0,f2828cec,c0fdd9ea,c0dec8f7,202,...) at sys_poll+0x321 syscall(f2828d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2847014b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command getty pid 2235 tid 100169 td 0xcb134b80 sched_switch(cb134b80,0,104,1a3,3f1cd7dd,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb134b80,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,cb134b80,cb134b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efda70,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efda70,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efda00,c7efda70,f28b7c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efda00,f28b7c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6500,f28b7c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cabf03f0,f28b7c44,c7db1e80,0,cb134b80,...) at devfs_read_f+0x7e dofileread(f28b7c44,ffffffff,ffffffff,0,f28b7c20,...) at dofileread+0x9e kern_readv(cb134b80,0,f28b7c44,f28b7c64,1,...) at kern_readv+0x68 sys_read(cb134b80,f28b7cec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f28b7d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2234 tid 100168 td 0xcb135000 sched_switch(cb135000,0,104,1a3,3f0a0d37,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb135000,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,cb135000,cb135000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efdc70,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efdc70,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efdc00,c7efdc70,f28b4c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efdc00,f28b4c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6600,f28b4c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cac6f888,f28b4c44,c7db1e80,0,cb135000,...) at devfs_read_f+0x7e dofileread(f28b4c44,ffffffff,ffffffff,0,f28b4c20,...) at dofileread+0x9e kern_readv(cb135000,0,f28b4c44,f28b4c64,1,...) at kern_readv+0x68 sys_read(cb135000,f28b4cec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f28b4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2233 tid 100167 td 0xcb1352e0 sched_switch(cb1352e0,0,104,1a3,3f27016e,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1352e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,cb1352e0,cb1352e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efde70,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efde70,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efde00,c7efde70,f28b1c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efde00,f28b1c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6700,f28b1c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cadd53f0,f28b1c44,c7db1e80,0,cb1352e0,...) at devfs_read_f+0x7e dofileread(f28b1c44,ffffffff,ffffffff,0,f28b1c20,...) at dofileread+0x9e kern_readv(cb1352e0,0,f28b1c44,f28b1c64,1,...) at kern_readv+0x68 sys_read(cb1352e0,f28b1cec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f28b1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2232 tid 100130 td 0xcab1e2e0 sched_switch(cab1e2e0,0,104,1a3,3f124f70,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab1e2e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,cab1e2e0,cab1e2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8192070,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8192070,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8192000,c8192070,f2802c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8192000,f2802c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6800,f2802c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cac6f150,f2802c44,c7db1e80,0,cab1e2e0,...) at devfs_read_f+0x7e dofileread(f2802c44,ffffffff,ffffffff,0,f2802c20,...) at dofileread+0x9e kern_readv(cab1e2e0,0,f2802c44,f2802c64,1,...) at kern_readv+0x68 sys_read(cab1e2e0,f2802cec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f2802d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2231 tid 100133 td 0xcab1d8a0 sched_switch(cab1d8a0,0,104,1a3,3f19a81b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab1d8a0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,cab1d8a0,cab1d8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8192270,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8192270,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8192200,c8192270,f280bc44,1,0,...) at tty_wait+0x71 ttydisc_read(c8192200,f280bc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6900,f280bc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca778b28,f280bc44,c7db1e80,0,cab1d8a0,...) at devfs_read_f+0x7e dofileread(f280bc44,ffffffff,ffffffff,0,f280bc20,...) at dofileread+0x9e kern_readv(cab1d8a0,0,f280bc44,f280bc64,1,...) at kern_readv+0x68 sys_read(cab1d8a0,f280bcec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f280bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2230 tid 100084 td 0xca7692e0 sched_switch(ca7692e0,0,104,1a3,3f2eaefc,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7692e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,ca7692e0,ca7692e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8192470,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8192470,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8192400,c8192470,f2718c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8192400,f2718c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6a00,f2718c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cabf0268,f2718c44,c7db1e80,0,ca7692e0,...) at devfs_read_f+0x7e dofileread(f2718c44,ffffffff,ffffffff,0,f2718c20,...) at dofileread+0x9e kern_readv(ca7692e0,0,f2718c44,f2718c64,1,...) at kern_readv+0x68 sys_read(ca7692e0,f2718cec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f2718d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2229 tid 100126 td 0xca7e95c0 sched_switch(ca7e95c0,0,104,1a3,3f0cc78d,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7e95c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,ca7e95c0,ca7e95c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efc670,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efc670,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efc600,c7efc670,f27ebc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efc600,f27ebc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6b00,f27ebc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cace3888,f27ebc44,c7db1e80,0,ca7e95c0,...) at devfs_read_f+0x7e dofileread(f27ebc44,ffffffff,ffffffff,0,f27ebc20,...) at dofileread+0x9e kern_readv(ca7e95c0,0,f27ebc44,f27ebc64,1,...) at kern_readv+0x68 sys_read(ca7e95c0,f27ebcec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f27ebd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2228 tid 100102 td 0xc818b5c0 sched_switch(c818b5c0,0,104,1a3,3f20144e,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818b5c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,c818b5c0,c818b5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efc470,0,c0f965d0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efc470,c1127110,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efc400,c7efc470,f2764c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efc400,f2764c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7fa6c00,f2764c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cadd5070,f2764c44,c7db1e80,0,c818b5c0,...) at devfs_read_f+0x7e dofileread(f2764c44,ffffffff,ffffffff,0,f2764c20,...) at dofileread+0x9e kern_readv(c818b5c0,0,f2764c44,f2764c64,1,...) at kern_readv+0x68 sys_read(c818b5c0,f2764cec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f2764d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2227 tid 100079 td 0xca769b80 sched_switch(ca769b80,0,104,1a3,401a3ed7,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca769b80,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,c7efc004,0,c0f8a1ab,ca769b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7efc070,0,f26ffaf0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7efc070,c7efc004,c0f95fa8,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7efc000,c7efc070,f26ffc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7efc000,f26ffc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7e17d00,f26ffc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cac6f0e0,f26ffc44,c7db1e80,0,ca769b80,...) at devfs_read_f+0x7e dofileread(f26ffc44,ffffffff,ffffffff,0,f26ffc20,...) at dofileread+0x9e kern_readv(ca769b80,0,f26ffc44,f26ffc64,1,...) at kern_readv+0x68 sys_read(ca769b80,f26ffcec,c0fdd9ea,c0df1636,246,...) at sys_read+0x4f syscall(f26ffd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6333, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 2188 tid 100166 td 0xcb0bb8a0 sched_switch(cb0bb8a0,0,104,1a3,141666da,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb0bb8a0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,cad4c610,0,c0f8a1ab,cb0bb8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cad4c624,0,f28aea58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cad4c624,cad4c610,c0f93ef0,6a4,cace3bd0,...) at _cv_wait_sig+0x260 seltdwait(cace3bd0,58,c7db1e80,cb0bb8a0,c7d6e6b0,...) at seltdwait+0xa2 kern_select(cb0bb8a0,6,bfbfdfa0,0,0,0,20,cafec000,4) at kern_select+0x655 sys_select(cb0bb8a0,f28aecec,c0fdd9ea,c0f94703,206,...) at sys_select+0x66 syscall(f28aed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b82b3, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 2156 tid 100132 td 0xcab1db80 sched_switch(cab1db80,0,104,1a3,8607282e,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab1db80,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9b280,cab1db80,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1128a64,6c,c0f8d2e3,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1128a64,0,16c,c0f8d2e3,ea61,...) at _sleep+0x34f kern_nanosleep(cab1db80,f2808c50,f2808c58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cab1db80,f2808cec,c0fdd9ea,c0df1636,206,...) at sys_nanosleep+0x6f syscall(f2808d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819de27, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command cron pid 2111 tid 100131 td 0xcab1e000 Tracing command sendmail pid 2103 tid 100093 td 0xca6bf5c0 Tracing command sendmail pid 2099 tid 100134 td 0xcab1d5c0 sched_switch(cab1d5c0,0,104,1a3,8af807bc,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab1d5c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f280ea20,c0a4a69a,cadc3110,0,cab1d5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cadc3124,0,f280ea58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cadc3124,cadc3110,1389,6a4,cace3b60,...) at _cv_timedwait_sig+0x270 seltdwait(f280ec10,f280ec18,c7fcf500,cab1d5c0,c0a46edd,...) at seltdwait+0x8a kern_select(cab1d5c0,5,bfbfc510,0,0,f280ec5c,20,5,0) at kern_select+0x655 sys_select(cab1d5c0,f280ecec,c0fdd9ea,c0f94ac3,206,...) at sys_select+0x66 syscall(f280ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f32b3, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 2091 tid 100122 td 0xca7ea2e0 sched_switch(ca7ea2e0,0,104,1a3,f1062c0f,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7ea2e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca6b1a90,0,c0f8a1ab,ca7ea2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b1aa4,0,f27dba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b1aa4,ca6b1a90,c0f93ef0,6a4,cace3700,...) at _cv_wait_sig+0x260 seltdwait(cace3700,58,ca735e80,ca7ea2e0,cabe3828,...) at seltdwait+0xa2 kern_select(ca7ea2e0,9,2880c0b8,0,0,0,20,ca7e22c4,a) at kern_select+0x655 sys_select(ca7ea2e0,f27dbcec,c,c,206,...) at sys_select+0x66 syscall(f27dbd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d72b3, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 2031 tid 100139 td 0xcab0cb80 sched_switch(cab0cb80,0,104,1a3,2c5c9d44,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab0cb80,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca736350,0,c0f8a1ab,cab0cb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca736364,0,f281fa58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca736364,ca736350,c0f93ef0,6a4,ca7dcc08,...) at _cv_wait_sig+0x260 seltdwait(ca7dcc08,58,c7db1e80,cab0cb80,f6,...) at seltdwait+0xa2 kern_select(cab0cb80,400,bfbfea04,0,0,0,20,cac0f2c4,1) at kern_select+0x655 sys_select(cab0cb80,f281fcec,c0fdd9ea,c0df1636,246,...) at sys_select+0x66 syscall(f281fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c52b3, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1953 tid 100101 td 0xc818b8a0 sched_switch(c818b8a0,0,104,1a3,e5d631a2,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818b8a0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,cad4b290,0,c0f8a1ab,c818b8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cad4b2a4,0,f2760a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cad4b2a4,cad4b290,c0f93ef0,6a4,ca7973b8,...) at _cv_wait_sig+0x260 seltdwait(ca7973b8,58,c7db1e80,c818b8a0,0,...) at seltdwait+0xa2 kern_select(c818b8a0,1c,bfbfece8,0,0,0,20,ca7c9588,0) at kern_select+0x655 sys_select(c818b8a0,f2760cec,c0fdd9ea,f2760d80,202,...) at sys_select+0x66 syscall(f2760d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283722b3, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1853 tid 100151 td 0xca7e45c0 sched_switch(ca7e45c0,0,104,1a3,5fb82e28,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7e45c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2862be0,c0a4a69a,c8028780,0,ca7e45c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca799890,0,f2862c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca799890,c8028780,1388,3b1,bfbfecdc,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2862d14,c0a2d3e8,c8028780,f2862d28,c0f86510,...) at svc_run_internal+0x356 svc_thread_start(c8028780,f2862d28,c0f86510,3db,cab02588,...) at svc_thread_start+0x10 fork_exit(c0c4a130,c8028780,f2862d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1853 tid 100150 td 0xca7e48a0 sched_switch(ca7e48a0,0,104,1a3,c40946e2,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7e48a0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f285fbe0,c0a4a69a,c8028780,0,ca7e48a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca799c10,0,f285fc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca799c10,c8028780,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f285fd14,c0a2d3e8,c8028780,f285fd28,c0f86510,...) at svc_run_internal+0x356 svc_thread_start(c8028780,f285fd28,c0f86510,3db,cab02588,...) at svc_thread_start+0x10 fork_exit(c0c4a130,c8028780,f285fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1853 tid 100149 td 0xca7e4b80 sched_switch(ca7e4b80,0,104,1a3,f33f38b2,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7e4b80,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f285cbe0,c0a4a69a,c8028780,0,ca7e4b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cabe6010,0,f285cc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cabe6010,c8028780,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f285cd14,c0a2d3e8,c8028780,f285cd28,c0f86510,...) at svc_run_internal+0x356 svc_thread_start(c8028780,f285cd28,c0f86510,3db,cab02588,...) at svc_thread_start+0x10 fork_exit(c0c4a130,c8028780,f285cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1853 tid 100145 td 0xcab06b80 sched_switch(cab06b80,0,104,1a3,bd375be9,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab06b80,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2849498,c0a4a69a,c8028780,0,cab06b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca60fe10,0,f28494d0,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca60fe10,c8028780,1388,3b1,f2849518,...) at _cv_timedwait_sig+0x270 svc_run_internal(cab06d30,14,c0fbaf1a,c0f7dddb,f2849810,...) at svc_run_internal+0x356 svc_run(c8028780,0,c0f7ddb6,19f,2821d56c,...) at svc_run+0x7b nfsrvd_nfsd(cab06b80,f2849810,c,c1271bb0,0,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(cab06b80,f2849cec,bfbfe870,cab06b80,f2849d1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(cab06b80,f2849cec,c0fdd9ea,c0f94ac3,206,...) at sys_nfssvc+0xeb syscall(f2849d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e890b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1846 tid 100089 td 0xca7685c0 sched_switch(ca7685c0,0,104,1a3,259af6d6,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7685c0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,cad4b3d0,0,c0f8a1ab,ca7685c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cad4b3e4,0,f272da58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cad4b3e4,cad4b3d0,c0f93ef0,6a4,cabf0620,...) at _cv_wait_sig+0x260 seltdwait(cabf0620,58,c7db1e80,ca7685c0,ca75f910,...) at seltdwait+0xa2 kern_select(ca7685c0,7,bfbfecb4,0,0,0,20,ca6be588,1) at kern_select+0x655 sys_select(ca7685c0,f272dcec,c,c,202,...) at sys_select+0x66 syscall(f272dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281922b3, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command mountd pid 1836 tid 100135 td 0xcab1d2e0 sched_switch(cab1d2e0,0,104,1a3,e094af99,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab1d2e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca6b1690,0,c0f8a1ab,cab1d2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b16a4,0,f2811a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b16a4,ca6b1690,c0f93ef0,6a4,cace30e0,...) at _cv_wait_sig+0x260 seltdwait(cace30e0,58,c7db1e80,cab1d2e0,478,...) at seltdwait+0xa2 kern_select(cab1d2e0,9,bfbfed04,0,0,0,20,cac0f84c,bfbfed04) at kern_select+0x655 sys_select(cab1d2e0,f2811cec,c0fdd9ea,c0f7bb97,206,...) at sys_select+0x66 syscall(f2811d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa2b3, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 1737 tid 100114 td 0xca7652e0 sched_switch(ca7652e0,0,104,1a3,4f01afea,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7652e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2796a84,c0a4a69a,ca736110,0,ca7652e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca736124,0,f2796abc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca736124,ca736110,7531,6a4,f2796b74,...) at _cv_timedwait_sig+0x270 seltdwait(f2796c44,f2796c4c,5a1,ca7652e0,c7d6eac0,...) at seltdwait+0x8a sys_poll(ca7652e0,f2796cec,c0fdd9ea,c0f947f4,212,...) at sys_poll+0x321 syscall(f2796d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a14b, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 1710 tid 100144 td 0xcac772e0 sched_switch(cac772e0,0,104,1a3,eb26cdac,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac772e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca689c90,0,c0f8a1ab,cac772e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca689ca4,0,f282ea58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca689ca4,ca689c90,c0f93ef0,6a4,ca7dc7a8,...) at _cv_wait_sig+0x260 seltdwait(ca7dc7a8,58,c7db1e80,cac772e0,8,...) at seltdwait+0xa2 kern_select(cac772e0,9,2847f0ac,0,0,0,20,cab052c4,0) at kern_select+0x655 sys_select(cac772e0,f282ecec,c0fdd9ea,c0f945a6,246,...) at sys_select+0x66 syscall(f282ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a92b3, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 1503 tid 100081 td 0xca6c02e0 sched_switch(ca6c02e0,0,104,1a3,ce6673b8,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c02e0,0,c0f917a0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4a69a,ca6b1010,0,c0f8a1ab,ca6c02e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6b1024,0,f2707a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6b1024,ca6b1010,c0f93ef0,6a4,ca777038,...) at _cv_wait_sig+0x260 seltdwait(ca777038,58,c7db1e80,ca6c02e0,c12719b0,...) at seltdwait+0xa2 kern_select(ca6c02e0,5,bfbfe960,0,0,0,20,c804584c,32) at kern_select+0x655 sys_select(ca6c02e0,f2707cec,c0fdd9ea,c0dec8f7,206,...) at sys_select+0x66 syscall(f2707d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809152b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100077 td 0xca6c0b80 sched_switch(ca6c0b80,0,104,1a3,26b808b8,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ca6c0b80,0,c0f917a0,268,60,...) at sleepq_switch+0x162 sleepq_wait(ca74b01c,60,c0fbf495,4,0,...) at sleepq_wait+0x63 __lockmgr_args(ca74b01c,80900,cb290d00,0,0,...) at __lockmgr_args+0xb3f ffs_snapblkfree(cb2c9000,cb290c3c,61303,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(cb1d0700,cb2c9000,cb290c3c,61303,0,...) at ffs_blkfree+0x59 freework_freeblock(c12a4ee0,0,c0fbf9f0,1d0c,e5,...) at freework_freeblock+0x5b9 handle_workitem_freeblocks(0,ee320c6c,2,6be,ee320c70,...) at handle_workitem_freeblocks+0x27c process_worklist_item(c12a4ee0,0,c0fbf9f0,5ed,ca6c0b80,...) at process_worklist_item+0x2c2 softdep_process_worklist(caa6a000,0,c0fbf9f0,565,3e8,...) at softdep_process_worklist+0x88 softdep_flush(0,ee320d28,c0f86510,3db,ca6bc000,...) at softdep_flush+0x2b0 fork_exit(c0c995e0,0,ee320d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee320d60, ebp = 0 --- Tracing command vnlru pid 18 tid 100076 td 0xc80608a0 sched_switch(c80608a0,0,104,1a3,20b294bd,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(c80608a0,0,c0f917a0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca6bc2c4,60,c0f9c77d,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6bc2c4,c129ebf4,260,c0f9c77d,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31dd28,c0f86510,3db,ca6bc2c4,...) at vnlru_proc+0xe7 fork_exit(c0afbfc0,0,ee31dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31dd60, ebp = 0 --- Tracing command syncer pid 17 tid 100075 td 0xc8060b80 sched_switch(c8060b80,0,104,1a3,8647b63,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8060b80,0,c0f917a0,28b,c8060b80,...) at sleepq_switch+0x162 sleepq_timedwait(c129ec34,0,ee31ac78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c129ec34,c129ec20,3e8,78b,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee31ad28,c0f86510,3db,ca6bc588,...) at sched_sync+0x595 fork_exit(c0afb330,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100074 td 0xc8189000 cpustop_handler(2,13,ee317b84,c0dbf186,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,1925c2e,c0a4a875,ca6bc84c,...) at ipi_nmi_handler+0x47 trap(ee317b90) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a4a880, esp = 0xee317bd0, ebp = 0xee317bec --- _mtx_lock_sleep(c12a4ee0,c8189000,0,c0fbf9f0,32e6,...) at _mtx_lock_sleep+0xb0 _mtx_lock_flags(c12a4ee0,0,c0fbf9f0,32e6,e1970dc0,...) at _mtx_lock_flags+0xff softdep_count_dependencies(e1970dc0,0,c0f98d6a,922,0,...) at softdep_count_dependencies+0x30 flushbufqueues(d4,c0f8a1ab,ca6bc8d4,391,391,...) at flushbufqueues+0x450 buf_do_flush(ca6bc84c,0,c0f98d6a,8ac,64,...) at buf_do_flush+0x19 buf_daemon(0,ee317d28,c0f86510,3db,ca6bc84c,...) at buf_daemon+0xea fork_exit(c0adfb20,0,ee317d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee317d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100073 td 0xc81892e0 sched_switch(c81892e0,0,104,1a3,d9f517a0,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81892e0,0,c0f917a0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a6ddc,0,c0fc8f5e,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a6ddc,c12a5880,0,c0fc8f5e,493e0,...) at _sleep+0x36a vm_pagezero(0,ee314d28,c0f86510,3db,ca6bcb10,...) at vm_pagezero+0xdc fork_exit(c0ce07e0,0,ee314d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee314d60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100072 td 0xc81895c0 sched_switch(c81895c0,0,104,1a3,5f4a3451,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,74,...) at mi_switch+0x1ff sleepq_switch(c81895c0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a69c8,74,c0f996b1,0,0,...) at sleepq_wait+0x63 _sleep(c12a69c8,c12a69cc,74,c0f996b1,0,...) at _sleep+0x39c vm_daemon(0,ee311d28,c0f86510,3db,ca6be000,...) at vm_daemon+0x59 fork_exit(c0cda0f0,0,ee311d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee311d60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100071 td 0xc81898a0 sched_switch(c81898a0,0,104,1a3,f20a4811,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c81898a0,0,c0f917a0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a6990,54,c0f996b1,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a6990,c12a5880,54,c0f996b1,1388,...) at _sleep+0x36a vm_pageout(0,ee30ed28,c0f86510,3db,c7dd12c4,...) at vm_pageout+0x2c7 fork_exit(c0cdb1b0,0,ee30ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee30ed60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100070 td 0xc8189b80 sched_switch(c8189b80,0,104,1a3,5044dff3,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8189b80,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10ed254,5c,c0de7107,0,0,...) at sleepq_wait+0x63 _sleep(c10ed254,c10ed298,5c,c0de7107,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18bd28,c0f86510,3db,c7dd1588,...) at xpt_scanner_thread+0x47 fork_exit(c049d300,0,ee18bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18bd60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100069 td 0xc818a000 sched_switch(c818a000,0,104,1a3,86a715d0,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818a000,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a0758,0,c0fafdff,0,0,...) at sleepq_wait+0x63 _sleep(c12a0758,c12a0720,0,c0fafdff,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee188d28,c0f86510,3db,c7dd184c,...) at sctp_iterator_thread+0x5c fork_exit(c0b8d6c0,0,ee188d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee188d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc818a5c0 sched_switch(c818a5c0,0,104,1a3,3df987ca,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c818a5c0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c819a000,5c,c0df1b12,0,0,...) at sleepq_wait+0x63 _sleep(c819a000,c819a000,5c,c0df1b12,0,...) at _sleep+0x39c ctl_work_thread(c819a000,ee182d28,c0f86510,3db,c7dd1b10,...) at ctl_work_thread+0x22f6 fork_exit(c04c6700,c819a000,ee182d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee182d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc818b000 sched_switch(c818b000,0,104,1a3,eb3208a4,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c818b000,0,c0f917a0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c817a23c,5c,c0f7e852,0,0,...) at sleepq_timedwait+0x6b _sleep(c817a23c,c817a2f0,5c,c0f7e852,3e8,...) at _sleep+0x36a fdc_thread(c817a200,ee179d28,c0f86510,3db,c8045000,...) at fdc_thread+0x27d fork_exit(c0d5fa30,c817a200,ee179d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee179d60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80525c0 sched_switch(c80525c0,0,104,1a3,50451791,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c80525c0,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8090000,6c,c0f7e852,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8090000,c8094488,16c,c0f7e852,0,...) at _sleep+0x385 fw_bus_probe_thread(c8090000,ee169d28,c0f86510,3db,c80452c4,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f0590,c8090000,ee169d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee169d60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc805d2e0 sched_switch(c805d2e0,0,104,1a3,3df4406c,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805d2e0,0,c0f917a0,268,c805d2e0,...) at sleepq_switch+0x162 sleepq_wait(c8066d34,0,ee152cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8066d34,c8066e4c,c0f64f31,74,c8066d3c,...) at _cv_wait+0x260 usb_process(c8066d2c,ee152d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8066d2c,ee152d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee152d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc805d5c0 sched_switch(c805d5c0,0,104,1a3,80046b63,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805d5c0,0,c0f917a0,268,c805d5c0,...) at sleepq_switch+0x162 sleepq_wait(c8066d04,0,ee14fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8066d04,c8066e4c,c0f64f31,74,c8066d0c,...) at _cv_wait+0x260 usb_process(c8066cfc,ee14fd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8066cfc,ee14fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14fd60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc805d8a0 sched_switch(c805d8a0,0,104,1a3,3d8dcf7b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805d8a0,0,c0f917a0,268,c805d8a0,...) at sleepq_switch+0x162 sleepq_wait(c8066cd4,0,ee14ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8066cd4,c8066e4c,c0f64f31,74,c8066cdc,...) at _cv_wait+0x260 usb_process(c8066ccc,ee14cd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8066ccc,ee14cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14cd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc805db80 sched_switch(c805db80,0,104,1a3,3d8dbdc9,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805db80,0,c0f917a0,268,c805db80,...) at sleepq_switch+0x162 sleepq_wait(c8066ca4,0,ee149cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8066ca4,c8066e4c,c0f64f31,74,c8066cac,...) at _cv_wait+0x260 usb_process(c8066c9c,ee149d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8066c9c,ee149d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee149d60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc80602e0 sched_switch(c80602e0,0,104,1a3,3d8da973,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80602e0,0,c0f917a0,268,c80602e0,...) at sleepq_switch+0x162 sleepq_wait(c8058b5c,0,ee140cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058b5c,c8058c74,c0f64f31,74,c8058b64,...) at _cv_wait+0x260 usb_process(c8058b54,ee140d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8058b54,ee140d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee140d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc80605c0 sched_switch(c80605c0,0,104,1a3,692958a4,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80605c0,0,c0f917a0,268,c80605c0,...) at sleepq_switch+0x162 sleepq_wait(c8058b2c,0,ee13dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058b2c,c8058c74,c0f64f31,74,c8058b34,...) at _cv_wait+0x260 usb_process(c8058b24,ee13dd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8058b24,ee13dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13dd60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8050000 sched_switch(c8050000,0,104,1a3,3d29bf17,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8050000,0,c0f917a0,268,c8050000,...) at sleepq_switch+0x162 sleepq_wait(c8058afc,0,ee13acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058afc,c8058c74,c0f64f31,74,c8058b04,...) at _cv_wait+0x260 usb_process(c8058af4,ee13ad28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8058af4,ee13ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ad60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc80502e0 sched_switch(c80502e0,0,104,1a3,3d29a9ae,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80502e0,0,c0f917a0,268,c80502e0,...) at sleepq_switch+0x162 sleepq_wait(c8058acc,0,ee137cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8058acc,c8058c74,c0f64f31,74,c8058ad4,...) at _cv_wait+0x260 usb_process(c8058ac4,ee137d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8058ac4,ee137d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee137d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc80505c0 sched_switch(c80505c0,0,104,1a3,3d298f79,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80505c0,0,c0f917a0,268,c80505c0,...) at sleepq_switch+0x162 sleepq_wait(c8054b5c,0,ee133cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054b5c,c8054c74,c0f64f31,74,c8054b64,...) at _cv_wait+0x260 usb_process(c8054b54,ee133d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8054b54,ee133d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee133d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc80508a0 sched_switch(c80508a0,0,104,1a3,660caa44,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80508a0,0,c0f917a0,268,c80508a0,...) at sleepq_switch+0x162 sleepq_wait(c8054b2c,0,ee130cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054b2c,c8054c74,c0f64f31,74,c8054b34,...) at _cv_wait+0x260 usb_process(c8054b24,ee130d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8054b24,ee130d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee130d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8050b80 sched_switch(c8050b80,0,104,1a3,3764d331,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8050b80,0,c0f917a0,268,c8050b80,...) at sleepq_switch+0x162 sleepq_wait(c8054afc,0,ee12dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054afc,c8054c74,c0f64f31,74,c8054b04,...) at _cv_wait+0x260 usb_process(c8054af4,ee12dd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8054af4,ee12dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12dd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8051000 sched_switch(c8051000,0,104,1a3,3764c14c,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8051000,0,c0f917a0,268,c8051000,...) at sleepq_switch+0x162 sleepq_wait(c8054acc,0,ee12acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8054acc,c8054c74,c0f64f31,74,c8054ad4,...) at _cv_wait+0x260 usb_process(c8054ac4,ee12ad28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8054ac4,ee12ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ad60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc80512e0 sched_switch(c80512e0,0,104,1a3,3764ae91,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80512e0,0,c0f917a0,268,c80512e0,...) at sleepq_switch+0x162 sleepq_wait(c804cb5c,0,ee126cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804cb5c,c804cc74,c0f64f31,74,c804cb64,...) at _cv_wait+0x260 usb_process(c804cb54,ee126d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c804cb54,ee126d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee126d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc80515c0 sched_switch(c80515c0,0,104,1a3,64de8c34,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80515c0,0,c0f917a0,268,c80515c0,...) at sleepq_switch+0x162 sleepq_wait(c804cb2c,0,ee123cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804cb2c,c804cc74,c0f64f31,74,c804cb34,...) at _cv_wait+0x260 usb_process(c804cb24,ee123d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c804cb24,ee123d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee123d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc80518a0 sched_switch(c80518a0,0,104,1a3,37010c96,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80518a0,0,c0f917a0,268,c80518a0,...) at sleepq_switch+0x162 sleepq_wait(c804cafc,0,ee120cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804cafc,c804cc74,c0f64f31,74,c804cb04,...) at _cv_wait+0x260 usb_process(c804caf4,ee120d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c804caf4,ee120d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee120d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8051b80 sched_switch(c8051b80,0,104,1a3,3700f61b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8051b80,0,c0f917a0,268,c8051b80,...) at sleepq_switch+0x162 sleepq_wait(c804cacc,0,ee11dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804cacc,c804cc74,c0f64f31,74,c804cad4,...) at _cv_wait+0x260 usb_process(c804cac4,ee11dd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c804cac4,ee11dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11dd60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8041000 sched_switch(c8041000,0,104,1a3,3700e0f3,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8041000,0,c0f917a0,268,c8041000,...) at sleepq_switch+0x162 sleepq_wait(c8048b5c,0,ee116cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048b5c,c8048c74,c0f64f31,74,c8048b64,...) at _cv_wait+0x260 usb_process(c8048b54,ee116d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8048b54,ee116d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee116d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc80412e0 sched_switch(c80412e0,0,104,1a3,63b086a0,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80412e0,0,c0f917a0,268,c80412e0,...) at sleepq_switch+0x162 sleepq_wait(c8048b2c,0,ee113cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048b2c,c8048c74,c0f64f31,74,c8048b34,...) at _cv_wait+0x260 usb_process(c8048b24,ee113d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8048b24,ee113d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee113d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc80415c0 sched_switch(c80415c0,0,104,1a3,369d44a0,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80415c0,0,c0f917a0,268,c80415c0,...) at sleepq_switch+0x162 sleepq_wait(c8048afc,0,ee110cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048afc,c8048c74,c0f64f31,74,c8048b04,...) at _cv_wait+0x260 usb_process(c8048af4,ee110d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8048af4,ee110d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee110d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc80418a0 sched_switch(c80418a0,0,104,1a3,369d3294,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80418a0,0,c0f917a0,268,c80418a0,...) at sleepq_switch+0x162 sleepq_wait(c8048acc,0,ee10dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8048acc,c8048c74,c0f64f31,74,c8048ad4,...) at _cv_wait+0x260 usb_process(c8048ac4,ee10dd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c8048ac4,ee10dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10dd60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8044000 sched_switch(c8044000,0,104,1a3,369d1c77,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8044000,0,c0f917a0,268,c8044000,...) at sleepq_switch+0x162 sleepq_wait(c803ab5c,0,ee106cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803ab5c,c803ac74,c0f64f31,74,c803ab64,...) at _cv_wait+0x260 usb_process(c803ab54,ee106d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c803ab54,ee106d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee106d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc80442e0 sched_switch(c80442e0,0,104,1a3,61c27a5c,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80442e0,0,c0f917a0,268,c80442e0,...) at sleepq_switch+0x162 sleepq_wait(c803ab2c,0,ee103cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803ab2c,c803ac74,c0f64f31,74,c803ab34,...) at _cv_wait+0x260 usb_process(c803ab24,ee103d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c803ab24,ee103d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee103d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc80445c0 sched_switch(c80445c0,0,104,1a3,3638a1a5,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80445c0,0,c0f917a0,268,c80445c0,...) at sleepq_switch+0x162 sleepq_wait(c803aafc,0,ee100cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803aafc,c803ac74,c0f64f31,74,c803ab04,...) at _cv_wait+0x260 usb_process(c803aaf4,ee100d28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c803aaf4,ee100d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee100d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc80448a0 sched_switch(c80448a0,0,104,1a3,36388efc,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80448a0,0,c0f917a0,268,c80448a0,...) at sleepq_switch+0x162 sleepq_wait(c803aacc,0,ee0fdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803aacc,c803ac74,c0f64f31,74,c803aad4,...) at _cv_wait+0x260 usb_process(c803aac4,ee0fdd28,c0f86510,3db,c8045588,...) at usb_process+0x1a3 fork_exit(c08fd190,c803aac4,ee0fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fdd60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7ee05c0 sched_switch(c7ee05c0,0,104,1a3,567cdb26,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee05c0,0,c0f917a0,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1127864,0,c0f7e852,2,0,...) at sleepq_timedwait+0x6b _sleep(c1127864,0,0,c0f7e852,64) at _sleep+0x36a pause(c0f7e852,64,c0f40d30,111,0,...) at pause+0xa0 random_kthread(0,c7b51d28,c0f86510,3db,c7dd0000,...) at random_kthread+0x1ef fork_exit(c0805670,0,c7b51d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b51d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7ee0b80 sched_switch(c7ee0b80,0,104,1a3,2732754b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ee0b80,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1125468,5c,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c1125468,c11253c8,25c,c0f7e852,0,...) at _sleep+0x39c g_io_schedule_down(c7ee0b80,0,c0f803a1,6c,c7b4bd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c7b4bd28,c0f86510,3db,c7dd02c4,...) at g_down_procbody+0x9d fork_exit(c09ee4c0,0,c7b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4bd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7ee1000 sched_switch(c7ee1000,0,104,1a3,26fcc08a,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ee1000,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1125464,5c,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c1125464,c11253e8,25c,c0f7e852,0,...) at _sleep+0x39c g_io_schedule_up(c7ee1000,0,c0f803a1,5f,c7b48d14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c7b48d28,c0f86510,3db,c7dd02c4,...) at g_up_procbody+0x9d fork_exit(c09ee560,0,c7b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b48d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7dd72e0 sched_switch(c7dd72e0,0,104,1a3,d9e28d99,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7dd72e0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c112545c,5c,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c112545c,c112538c,25c,c0f7e852,0,...) at _sleep+0x39c g_run_events(c11356c0,0,c0f803a1,79,c7b45d14,...) at g_run_events+0x54b g_event_procbody(0,c7b45d28,c0f86510,3db,c7dd02c4,...) at g_event_procbody+0x90 fork_exit(c09ee600,0,c7b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b45d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc818a8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc818ab80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100063 td 0xc80522e0 sched_switch(c80522e0,0,109,1a3,401a002d,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c80522e0,...) at mi_switch+0x1ff ithread_loop(c817bc60,ee16cd28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c817bc60,ee16cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16cd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8052b80 sched_switch(c8052b80,0,109,1a3,2687858c,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c8052b80,...) at mi_switch+0x1ff ithread_loop(c8081a50,ee160d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c8081a50,ee160d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee160d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc805d000 sched_switch(c805d000,0,109,1a3,d7eee801,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c805d000,...) at mi_switch+0x1ff ithread_loop(c80811e0,ee158d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c80811e0,ee158d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee158d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8060000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8052000 sched_switch(c8052000,0,109,1a3,5b3a912f,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c8052000,...) at mi_switch+0x1ff ithread_loop(c802d870,ee11ad28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c802d870,ee11ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ad60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8041b80 sched_switch(c8041b80,0,109,1a3,55c19c38,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c8041b80,...) at mi_switch+0x1ff ithread_loop(c801c6b0,ee10ad28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c801c6b0,ee10ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ad60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8044b80 sched_switch(c8044b80,0,109,1a3,cf3e07f,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c8044b80,...) at mi_switch+0x1ff ithread_loop(c801c930,ee0fad28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c801c930,ee0fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fad60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7ee12e0 sched_switch(c7ee12e0,0,109,1a3,2518de8f,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7ee12e0,...) at mi_switch+0x1ff ithread_loop(c8005b70,edfa4d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c8005b70,edfa4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa4d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7ee15c0 sched_switch(c7ee15c0,0,109,1a3,fd27babc,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7ee15c0,...) at mi_switch+0x1ff ithread_loop(c801c060,edfa0d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c801c060,edfa0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa0d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7ee18a0 sched_switch(c7ee18a0,0,109,1a3,28626e80,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7ee18a0,...) at mi_switch+0x1ff ithread_loop(c8005550,c7ba0d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c8005550,c7ba0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba0d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7ee1b80 sched_switch(c7ee1b80,0,109,1a3,5d3efb11,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7ee1b80,...) at mi_switch+0x1ff ithread_loop(c7da4490,c7b6fd28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da4490,c7b6fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6fd60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc7fcc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc7fcc5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xc7fcc8a0 sched_switch(c7fcc8a0,0,109,1a3,25198ae4,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7fcc8a0,...) at mi_switch+0x1ff ithread_loop(c7da44c0,c7b63d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da44c0,c7b63d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b63d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7dd75c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc7dd78a0 sched_switch(c7dd78a0,0,109,1a3,13f76c66,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7dd78a0,...) at mi_switch+0x1ff ithread_loop(c7da4700,c7b3fd28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da4700,c7b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3fd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dd7b80 sched_switch(c7dd7b80,0,109,1a3,2f6e95c5,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7dd7b80,...) at mi_switch+0x1ff ithread_loop(c7da4710,c7b3cd28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da4710,c7b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e1b000 sched_switch(c7e1b000,0,109,1a3,567c8b1e,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7e1b000,...) at mi_switch+0x1ff ithread_loop(c7da4720,c7b39d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da4720,c7b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e1b2e0 sched_switch(c7e1b2e0,0,109,1a3,25222a4b,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7e1b2e0,...) at mi_switch+0x1ff ithread_loop(c7da4730,c7b36d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da4730,c7b36d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b36d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e1b5c0 sched_switch(c7e1b5c0,0,109,1a3,b2a0c174,...) at sched_switch+0x3ec mi_switch(109,0,c0f86833,554,c7e1b5c0,...) at mi_switch+0x1ff ithread_loop(c7da4740,c7b33d28,c0f86510,3db,c7dd0588,...) at ithread_loop+0x1fb fork_exit(c0a30f00,c7da4740,c7b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b33d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dd2000 sched_switch(c7dd2000,0,108,19e,b744e9c4,...) at sched_switch+0x3ec mi_switch(108,0,c0f8de62,3be,c7dd2000,...) at mi_switch+0x1ff sched_idletd(0,c7b2fd28,c0f86510,3db,c7dd084c,...) at sched_idletd+0x19f fork_exit(c0a81b10,0,c7b2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2fd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dd22e0 sched_switch(c7dd22e0,0,108,19e,751bac12,...) at sched_switch+0x3ec mi_switch(108,0,c0f8de62,3be,c7dd22e0,...) at mi_switch+0x1ff sched_idletd(0,c7b2cd28,c0f86510,3db,c7dd084c,...) at sched_idletd+0x19f fork_exit(c0a81b10,0,c7b2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2cd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dd25c0 sched_switch(c7dd25c0,0,108,19e,d3c6f0a1,...) at sched_switch+0x3ec mi_switch(108,0,c0f8de62,3be,c7dd25c0,...) at mi_switch+0x1ff sched_idletd(0,c7b29d28,c0f86510,3db,c7dd084c,...) at sched_idletd+0x19f fork_exit(c0a81b10,0,c7b29d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b29d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dd28a0 sched_switch(c7dd28a0,0,108,19e,b41ce32e,...) at sched_switch+0x3ec mi_switch(108,0,c0f8de62,3be,c7dd28a0,...) at mi_switch+0x1ff sched_idletd(0,c7b26d28,c0f86510,3db,c7dd084c,...) at sched_idletd+0x19f fork_exit(c0a81b10,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dd2b80 sched_switch(c7dd2b80,0,104,1a3,8990fe30,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c7dd2b80,0,c0f917a0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f917a0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7dd0b10,6c,c0f946b7,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7dd0b10,c7dd0b98,16c,c0f946b7,0,...) at _sleep+0x385 kern_wait(c7dd2b80,ffffffff,c7b22c60,0,0,...) at kern_wait+0x626 sys_wait4(c7dd2b80,c7b22cec,c0fdd9ea,c0f944ee,286,...) at sys_wait4+0x3b syscall(c7b22d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x8060f97, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc7dd7000 sched_switch(c7dd7000,0,104,1a3,3636b122,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dd7000,0,c0f917a0,268,c7dd7000,...) at sleepq_switch+0x162 sleepq_wait(c12a4660,0,c7b1fc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c12a4660,c12a4644,c0fbc997,194,0,...) at _cv_wait+0x260 audit_worker(0,c7b1fd28,c0f86510,3db,c7dd1000,...) at audit_worker+0x84 fork_exit(c0c5a480,0,c7b1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xca6c08a0 sched_switch(ca6c08a0,0,104,1a3,d9dde689,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c08a0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2340,0,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2340,c7ee2358,0,c0f7e852,0,...) at _sleep+0x39c taskqueue_thread_loop(c1305ee0,ee323d28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9e980,c1305ee0,ee323d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee323d60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc818a2e0 sched_switch(c818a2e0,0,104,1a3,b87505fc,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c818a2e0,0,c0f917a0,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1127864,0,c0f7e852,2,0,...) at sleepq_timedwait+0x6b _sleep(c1127864,0,0,c0f7e852,bb8) at _sleep+0x36a pause(c0f7e852,bb8,124,122,c11255c8,...) at pause+0xa0 deadlkres(0,ee185d28,c0f86510,3db,c1125540,...) at deadlkres+0x324 fork_exit(c0a106c0,0,ee185d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee185d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80528a0 sched_switch(c80528a0,0,104,1a3,25072913,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80528a0,0,c0f917a0,268,c80528a0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2640,0,c0f8cae1,c0f7e852,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2640,c7ee2658,c0f7e852,0,c0f8a1ab,...) at msleep_spin+0x259 taskqueue_thread_loop(c809449c,ee166d28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9e980,c809449c,ee166d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee166d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fcc2e0 sched_switch(c7fcc2e0,0,104,1a3,d86c0ff9,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fcc2e0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2740,0,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2740,c7ee2758,0,c0f7e852,0,...) at _sleep+0x39c taskqueue_thread_loop(c114442c,c7b69d28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9e980,c114442c,c7b69d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b69d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fccb80 sched_switch(c7fccb80,0,104,1a3,50490c8d,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fccb80,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee27c0,0,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c7ee27c0,c7ee27d8,0,c0f7e852,0,...) at _sleep+0x39c taskqueue_thread_loop(c1125eb8,c7b60d28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9e980,c1125eb8,c7b60d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b60d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e1b8a0 sched_switch(c7e1b8a0,0,104,1a3,5048fb41,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e1b8a0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2800,0,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2800,c7ee2818,0,c0f7e852,0,...) at _sleep+0x39c taskqueue_thread_loop(c12a4c44,c7b5dd28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9e980,c12a4c44,c7b5dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e1bb80 sched_switch(c7e1bb80,0,104,1a3,5048e7e3,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e1bb80,0,c0f917a0,268,c7e1bb80,...) at sleepq_switch+0x162 sleepq_wait(c7ee2840,0,c0f8cae1,c0f7e852,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2840,c7ee2858,c0f7e852,0,c0f8a1ab,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f04b8,c7b5ad28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9e980,c10f04b8,c7b5ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7ee0000 sched_switch(c7ee0000,0,104,1a3,5048d929,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee0000,0,c0f917a0,268,c7ee0000,...) at sleepq_switch+0x162 sleepq_wait(c7ee2840,0,c0f8cae1,c0f7e852,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2840,c7ee2858,c0f7e852,0,c0f8a1ab,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f04b8,c7b57d28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9e980,c10f04b8,c7b57d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b57d60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7ee02e0 sched_switch(c7ee02e0,0,104,1a3,5048c99e,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee02e0,0,c0f917a0,268,c7ee02e0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2840,0,c0f8cae1,c0f7e852,0,...) at sleepq_wait+0x63 msleep_spin(c7ee2840,c7ee2858,c0f7e852,0,c0f8a1ab,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f04b8,c7b54d28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0x8f fork_exit(c0a9e980,c10f04b8,c7b54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b54d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc7ee08a0 sched_switch(c7ee08a0,0,104,1a3,13d0f01b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ee08a0,0,c0f917a0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7ee2880,0,c0f7e852,0,0,...) at sleepq_wait+0x63 _sleep(c7ee2880,c7ee2898,0,c0f7e852,0,...) at _sleep+0x39c taskqueue_thread_loop(c1142e40,c7b4ed28,c0f86510,3db,c1125540,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a9e980,c1142e40,c7b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1125810 sched_switch(c1125810,0,104,1a3,5f3b315b,...) at sched_switch+0x3ec mi_switch(104,0,c0f917a0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c1125810,0,c0f917a0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1125540,54,c0f8e774,0,0,...) at sleepq_timedwait+0x6b _sleep(c1125540,0,54,c0f8e774,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 274 MB: 259 243 227 211 195 179 163 147 131 115 99 83 67 51 35 19 3 Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xf2775500) at pcpu.h:244 #1 0xc0510a19 in db_fncall (dummy1=0xc0c9b624, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf2775594 "¿Uw¿") at ../../../ddb/db_command.c:573 #2 0xc0510e4f in db_command (last_cmdp=0xc10ee67c, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc0510f04 in db_command_script (command=0xc10ef588 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc05152f0 in db_script_exec (scriptname=0xc10eeee0 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc0515381 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc12d17e0, modif=0xf27756cc "") at ../../../ddb/db_script.c:375 #6 0xc0510e11 in db_command (last_cmdp=0xc10ee67c, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc0510f6a in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc0512f5d in db_trap (type=0xc, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc0a90566 in kdb_trap (type=0xc, code=0x0, tf=0xf27758c4) at ../../../kern/subr_kdb.c:629 #10 0xc0dbe83f in trap_fatal (frame=0xf27758c4, eva=0xc) at ../../../i386/i386/trap.c:966 #11 0xc0dbf2f3 in trap (frame=0xf27758c4) at ../../../i386/i386/trap.c:352 #12 0xc0da804c in calltrap () at ../../../i386/i386/exception.s:168 #13 0xc0c9b624 in softdep_prelink (dvp=0xcd9c115c, vp=0x0) at ../../../ufs/ffs/ffs_softdep.c:2889 #14 0xc0c9ba28 in softdep_setup_mkdir (dp=0xcd9df5e4, ip=0xcd9df570) at ../../../ufs/ffs/ffs_softdep.c:4472 #15 0xc0cb7231 in ufs_mkdir (ap=0xf2775c14) at ../../../ufs/ufs/ufs_vnops.c:1903 #16 0xc0de2565 in VOP_MKDIR_APV (vop=0xc10db240, a=0xf2775c14) at vnode_if.c:1534 #17 0xc0afe361 in kern_mkdirat (td=0xca765b80, fd=0xffffff9c, path=0xbfbdae7b
, segflg=UIO_USERSPACE, mode=Variable "mode" is not available. ) at vnode_if.h:665 #18 0xc0afe43e in kern_mkdir (td=0xca765b80, path=0xbfbdae7b
, segflg=UIO_USERSPACE, mode=0x1f8) at ../../../kern/vfs_syscalls.c:3796 #19 0xc0afe469 in sys_mkdir (td=0xca765b80, uap=0xf2775cec) at ../../../kern/vfs_syscalls.c:3775 #20 0xc0dbed87 in syscall (frame=0xf2775d28) at subr_syscall.c:131 #21 0xc0da80b1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:266 #22 0x00000033 in ?? () (kgdb) f 13 #13 0xc0c9b624 in softdep_prelink (dvp=0xcd9c115c, vp=0x0) at ../../../ufs/ffs/ffs_softdep.c:2889 2889 if (journal_space(ump, 0) || IS_SNAPSHOT_V(vp)) (kgdb) l 2884 /* 2885 * Nothing to do if we have sufficient journal space. 2886 * If we currently hold the snapshot lock, we must avoid 2887 * handling other resources that could cause deadlock. 2888 */ 2889 if (journal_space(ump, 0) || IS_SNAPSHOT_V(vp)) 2890 return; 2891 stat_journal_low++; 2892 FREE_LOCK(&lk); 2893 if (vp) (kgdb) p *dvp $3 = {v_type = VDIR, v_tag = 0xc0f8244c "ufs", v_op = 0xc10dacc0, v_data = 0xcd9df5e4, v_mount = 0xcaa6a000, v_nmntvnodes = {tqe_next = 0xca75e828, tqe_prev = 0xcd9fe998}, v_un = { vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0xcd222ae0, le_prev = 0xca44440c}, v_hash = 0xb07, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xcb268d80, tqh_last = 0xcb268d90}, v_cache_dd = 0xcb268d80, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = { lo_name = 0xc0f8244c "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc7d72610}, lk_lock = 0xca765b80, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = { depth = 0xb, pcs = {0xc0a420a4, 0xc0ca40a1, 0xc0de20e5, 0xc0b08528, 0xc0aeb876, 0xc0aece7f, 0xc0afe18b, 0xc0afe43e, 0xc0afe469, 0xc0dbed87, 0xc0da80b1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc0f93a58 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d6b1e0}, mtx_lock = 0x4}, v_vnlock = 0xcd9c11b4, v_holdcnt = 0x3, v_usecount = 0x2, v_iflag = 0x0, v_vflag = 0x0, v_writecount = 0x0, v_freelist = {tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_mtx = {lock_object = { lo_name = 0xc0f9c752 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d70c10}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xcd9c1268}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xe1a0b3c0, tqh_last = 0xe1a0b3f8}, bv_root = 0xe1a0b3c0, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_ops = 0xc10c7f40, bo_bsize = 0x8000, bo_object = 0xcc4e82d0, bo_synclist = {le_next = 0xcd9fea7c, le_prev = 0xcd98580c}, bo_private = 0xcd9c115c, __bo_vnode = 0xcd9c115c}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) p *dvp->v_mount $4 = {mnt_mtx = {lock_object = {lo_name = 0xc0f7e011 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d6b450}, mtx_lock = 0x4}, mnt_gen = 0x1, mnt_list = { tqe_next = 0xcb3d5000, tqe_prev = 0xcb0a9018}, mnt_op = 0xc10daa60, mnt_vfc = 0xc10da8c0, mnt_vnodecovered = 0xcac9cae0, mnt_syncer = 0xcb2906cc, mnt_ref = 0x6d7d, mnt_nvnodelist = { tqh_first = 0xcb290984, tqh_last = 0xcd9c1014}, mnt_nvnodelistsize = 0x6d65, mnt_writeopcount = 0x7, mnt_kern_flag = 0x60000044, mnt_flag = 0x100001100, mnt_noasync = 0x1, mnt_opt = 0xcad511b0, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20030518, f_type = 0x35, f_flags = 0x100001000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x7bfa5, f_bfree = 0x7a93b, f_bavail = 0x70a8a, f_files = 0x3fffe, f_ffree = 0x3f17a, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_spare = { 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x4f3375de, 0xdcfc31d6}}, f_charspare = '\0' , f_fstypename = "ufs", '\0' , f_mntfromname = "/dev/md5a", '\0' , f_mntonname = "/mnt", '\0' }, mnt_cred = 0xcad4a780, mnt_data = 0xcb1d0700, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0xcafef900, mnt_label = 0x0, mnt_hashseed = 0xdfb05dfc, mnt_lockref = 0x2, mnt_secondary_writes = 0xe, mnt_secondary_accwrites = 0xad6e1, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xc0f7e022 "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7d710f0}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = {0xc0a426fe, 0xc0ae7dd7, 0xc0af066e, 0xc0af0ccf, 0xc0dbed87, 0xc0da80b1, 0x0 }}}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 231181) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -1003,6 +1003,9 @@ MTX_SYSINIT(softdep_lock, &lk, "Softdep Lock", MTX #define BUF_AREC(bp) lockallowrecurse(&(bp)->b_lock) #define BUF_NOREC(bp) lockdisablerecurse(&(bp)->b_lock) +#define IS_SNAPSHOT_I(ip) ((ip)->i_flags & SF_SNAPSHOT) +#define IS_SNAPSHOT_V(vp) (VTOI(vp)->i_flags & SF_SNAPSHOT) + /* * Worklist queue management. * These routines require that the lock be held. @@ -2827,7 +2830,12 @@ softdep_prealloc(vp, waitok) { struct ufsmount *ump; - if (DOINGSUJ(vp) == 0) + /* + * Nothing to do if we are not running journaled soft updates. + * If we currently hold the snapshot lock, we must avoid handling + * other resources that could cause deadlock. + */ + if (DOINGSUJ(vp) == 0 || IS_SNAPSHOT_V(vp)) return (0); ump = VFSTOUFS(vp->v_mount); ACQUIRE_LOCK(&lk); @@ -2873,7 +2881,12 @@ softdep_prelink(dvp, vp) ump = VFSTOUFS(dvp->v_mount); mtx_assert(&lk, MA_OWNED); - if (journal_space(ump, 0)) + /* + * Nothing to do if we have sufficient journal space. + * If we currently hold the snapshot lock, we must avoid + * handling other resources that could cause deadlock. + */ + if (journal_space(ump, 0) || IS_SNAPSHOT_V(vp)) return; stat_journal_low++; FREE_LOCK(&lk); @@ -4304,11 +4317,15 @@ inodedep_lookup_ip(ip) struct inode *ip; { struct inodedep *inodedep; + int dflags; KASSERT(ip->i_nlink >= ip->i_effnlink, ("inodedep_lookup_ip: bad delta")); - (void) inodedep_lookup(UFSTOVFS(ip->i_ump), ip->i_number, - DEPALLOC, &inodedep); + dflags = DEPALLOC; + if (IS_SNAPSHOT_I(ip)) + dflags |= NODELAY; + (void) inodedep_lookup(UFSTOVFS(ip->i_ump), ip->i_number, dflags, + &inodedep); inodedep->id_nlinkdelta = ip->i_nlink - ip->i_effnlink; return (inodedep); @@ -4696,7 +4713,7 @@ softdep_setup_inomapdep(bp, ip, newinum, mode) * the cylinder group map from which it was allocated. */ ACQUIRE_LOCK(&lk); - if ((inodedep_lookup(mp, newinum, DEPALLOC|NODELAY, &inodedep))) + if ((inodedep_lookup(mp, newinum, DEPALLOC | NODELAY, &inodedep))) panic("softdep_setup_inomapdep: dependency %p for new" "inode already exists", inodedep); bmsafemap = bmsafemap_lookup(mp, bp, ino_to_cg(fs, newinum)); @@ -5437,6 +5454,7 @@ softdep_setup_allocindir_page(ip, lbn, bp, ptrno, struct allocindir *aip; struct pagedep *pagedep; struct mount *mp; + int dflags; if (lbn != nbp->b_lblkno) panic("softdep_setup_allocindir_page: lbn %jd != lblkno %jd", @@ -5444,7 +5462,10 @@ softdep_setup_allocindir_page(ip, lbn, bp, ptrno, ASSERT_VOP_LOCKED(ITOV(ip), "softdep_setup_allocindir_page"); mp = UFSTOVFS(ip->i_ump); aip = newallocindir(ip, ptrno, newblkno, oldblkno, lbn); - (void) inodedep_lookup(mp, ip->i_number, DEPALLOC, &inodedep); + dflags = DEPALLOC; + if (IS_SNAPSHOT_I(ip)) + dflags |= NODELAY; + (void) inodedep_lookup(mp, ip->i_number, dflags, &inodedep); /* * If we are allocating a directory page, then we must * allocate an associated pagedep to track additions and @@ -5474,11 +5495,15 @@ softdep_setup_allocindir_meta(nbp, ip, bp, ptrno, struct inodedep *inodedep; struct allocindir *aip; ufs_lbn_t lbn; + int dflags; lbn = nbp->b_lblkno; ASSERT_VOP_LOCKED(ITOV(ip), "softdep_setup_allocindir_meta"); aip = newallocindir(ip, ptrno, newblkno, 0, lbn); - inodedep_lookup(UFSTOVFS(ip->i_ump), ip->i_number, DEPALLOC, &inodedep); + dflags = DEPALLOC; + if (IS_SNAPSHOT_I(ip)) + dflags |= NODELAY; + inodedep_lookup(UFSTOVFS(ip->i_ump), ip->i_number, dflags, &inodedep); WORKLIST_INSERT(&nbp->b_dep, &aip->ai_block.nb_list); if (setup_allocindir_phase2(bp, ip, inodedep, aip, lbn)) panic("softdep_setup_allocindir_meta: Block already existed"); @@ -6085,11 +6110,7 @@ softdep_journal_freeblocks(ip, cred, length, flags struct mount *mp; ufs2_daddr_t extblocks, datablocks; ufs_lbn_t tmpval, lbn, lastlbn; - int frags; - int lastoff, iboff; - int allocblock; - int error, i; - int needj; + int frags, lastoff, iboff, allocblock, needj, dflags, error, i; fs = ip->i_fs; mp = UFSTOVFS(ip->i_ump); @@ -6107,7 +6128,10 @@ softdep_journal_freeblocks(ip, cred, length, flags * we don't need to journal the block frees. The canceled journals * for the allocations will suffice. */ - inodedep_lookup(mp, ip->i_number, DEPALLOC, &inodedep); + dflags = DEPALLOC; + if (IS_SNAPSHOT_I(ip)) + dflags |= NODELAY; + inodedep_lookup(mp, ip->i_number, dflags, &inodedep); if ((inodedep->id_state & (UNLINKED | DEPCOMPLETE)) == UNLINKED && length == 0) needj = 0; @@ -6232,7 +6256,7 @@ softdep_journal_freeblocks(ip, cred, length, flags *((struct ufs2_dinode *)bp->b_data + ino_to_fsbo(fs, ip->i_number)) = *ip->i_din2; ACQUIRE_LOCK(&lk); - (void) inodedep_lookup(mp, ip->i_number, DEPALLOC, &inodedep); + (void) inodedep_lookup(mp, ip->i_number, dflags, &inodedep); if ((inodedep->id_state & IOSTARTED) != 0) panic("softdep_setup_freeblocks: inode busy"); /* @@ -6310,7 +6334,7 @@ softdep_journal_freeblocks(ip, cred, length, flags } ACQUIRE_LOCK(&lk); - inodedep_lookup(mp, ip->i_number, DEPALLOC, &inodedep); + inodedep_lookup(mp, ip->i_number, dflags, &inodedep); TAILQ_INSERT_TAIL(&inodedep->id_freeblklst, freeblks, fb_next); freeblks->fb_state |= DEPCOMPLETE | ONDEPLIST; /* @@ -6398,7 +6422,7 @@ softdep_setup_freeblocks(ip, length, flags) struct fs *fs; ufs2_daddr_t extblocks, datablocks; struct mount *mp; - int i, delay, error; + int i, delay, error, dflags; ufs_lbn_t tmpval; ufs_lbn_t lbn; @@ -6463,7 +6487,10 @@ softdep_setup_freeblocks(ip, length, flags) * Find and eliminate any inode dependencies. */ ACQUIRE_LOCK(&lk); - (void) inodedep_lookup(mp, ip->i_number, DEPALLOC, &inodedep); + dflags = DEPALLOC; + if (IS_SNAPSHOT_I(ip)) + dflags |= NODELAY; + (void) inodedep_lookup(mp, ip->i_number, dflags, &inodedep); if ((inodedep->id_state & IOSTARTED) != 0) panic("softdep_setup_freeblocks: inode busy"); /* @@ -8026,7 +8053,7 @@ softdep_setup_directory_add(bp, dp, diroffset, new dap->da_pagedep = pagedep; LIST_INSERT_HEAD(&pagedep->pd_diraddhd[DIRADDHASH(offset)], dap, da_pdlist); - inodedep_lookup(mp, newinum, DEPALLOC, &inodedep); + inodedep_lookup(mp, newinum, DEPALLOC | NODELAY, &inodedep); /* * If we're journaling, link the diradd into the jaddref so it * may be completed after the journal entry is written. Otherwise, @@ -8628,8 +8655,7 @@ newdirrem(bp, dp, ip, isrmdir, prevdirremp) * the number of freefile and freeblks structures. */ ACQUIRE_LOCK(&lk); - if (!(ip->i_flags & SF_SNAPSHOT) && - dep_current[D_DIRREM] > max_softdeps / 2) + if (!IS_SNAPSHOT_I(ip) && dep_current[D_DIRREM] > max_softdeps / 2) (void) request_cleanup(ITOV(dp)->v_mount, FLUSH_BLOCKS); FREE_LOCK(&lk); dirrem = malloc(sizeof(struct dirrem), @@ -8863,11 +8889,11 @@ softdep_setup_directory_change(bp, dp, ip, newinum /* * Lookup the jaddref for this journal entry. We must finish * initializing it and make the diradd write dependent on it. - * If we're not journaling Put it on the id_bufwait list if the inode - * is not yet written. If it is written, do the post-inode write - * processing to put it on the id_pendinghd list. + * If we're not journaling, put it on the id_bufwait list if the + * inode is not yet written. If it is written, do the post-inode + * write processing to put it on the id_pendinghd list. */ - inodedep_lookup(mp, newinum, DEPALLOC, &inodedep); + inodedep_lookup(mp, newinum, DEPALLOC | NODELAY, &inodedep); if (MOUNTEDSUJ(mp)) { jaddref = (struct jaddref *)TAILQ_LAST(&inodedep->id_inoreflst, inoreflst); @@ -8909,9 +8935,13 @@ softdep_change_linkcnt(ip) struct inode *ip; /* the inode with the increased link count */ { struct inodedep *inodedep; + int dflags; ACQUIRE_LOCK(&lk); - inodedep_lookup(UFSTOVFS(ip->i_ump), ip->i_number, DEPALLOC, &inodedep); + dflags = DEPALLOC; + if (IS_SNAPSHOT_I(ip)) + dflags |= NODELAY; + inodedep_lookup(UFSTOVFS(ip->i_ump), ip->i_number, dflags, &inodedep); if (ip->i_nlink < ip->i_effnlink) panic("softdep_change_linkcnt: bad delta"); inodedep->id_nlinkdelta = ip->i_nlink - ip->i_effnlink; @@ -12541,22 +12571,25 @@ softdep_request_cleanup(fs, vp, cred, resource) ufs2_daddr_t needed; int error; - mp = vp->v_mount; - ump = VFSTOUFS(mp); - mtx_assert(UFS_MTX(ump), MA_OWNED); - if (resource == FLUSH_BLOCKS_WAIT) - stat_cleanup_blkrequests += 1; - else - stat_cleanup_inorequests += 1; - /* * If we are being called because of a process doing a * copy-on-write, then it is not safe to process any * worklist items as we will recurse into the copyonwrite * routine. This will result in an incoherent snapshot. + * If the vnode that we hold is a snapshot, we must avoid + * handling other resources that could cause deadlock. */ - if (curthread->td_pflags & TDP_COWINPROGRESS) + if ((curthread->td_pflags & TDP_COWINPROGRESS) || IS_SNAPSHOT_V(vp)) return (0); + + if (resource == FLUSH_BLOCKS_WAIT) + stat_cleanup_blkrequests += 1; + else + stat_cleanup_inorequests += 1; + + mp = vp->v_mount; + ump = VFSTOUFS(mp); + mtx_assert(UFS_MTX(ump), MA_OWNED); UFS_UNLOCK(ump); error = ffs_update(vp, 1); if (error != 0) { Index: /usr/src/sys/ufs/ffs/ffs_vnops.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_vnops.c (revision 231181) +++ /usr/src/sys/ufs/ffs/ffs_vnops.c (working copy) @@ -216,8 +216,10 @@ ffs_syncvnode(struct vnode *vp, int waitfor) struct buf *bp; struct buf *nbp; ufs_lbn_t lbn; - int error, wait, passes; + int error, wait, passes, noupdate; + noupdate = waitfor & NO_INO_UPDT; + waitfor &= ~NO_INO_UPDT; ip = VTOI(vp); ip->i_flag &= ~IN_NEEDSYNC; bo = &vp->v_bufobj; @@ -300,7 +302,10 @@ next: } if (waitfor != MNT_WAIT) { BO_UNLOCK(bo); - return (ffs_update(vp, waitfor)); + if (noupdate) + return (0); + else + return (ffs_update(vp, waitfor)); } /* Drain IO to see if we're done. */ bufobj_wwait(bo, 0, 0); @@ -317,7 +322,7 @@ next: */ if (bo->bo_dirty.bv_cnt > 0) { /* Write the inode after sync passes to flush deps. */ - if (wait && DOINGSOFTDEP(vp)) { + if (wait && DOINGSOFTDEP(vp) && noupdate == 0) { BO_UNLOCK(bo); ffs_update(vp, MNT_WAIT); BO_LOCK(bo); @@ -332,7 +337,9 @@ next: #endif } BO_UNLOCK(bo); - error = ffs_update(vp, MNT_WAIT); + error = 0; + if (noupdate == 0) + error = ffs_update(vp, MNT_WAIT); if (DOINGSUJ(vp)) softdep_journal_fsync(VTOI(vp)); return (error); @@ -718,15 +725,6 @@ ffs_write(ap) vnode_pager_setsize(vp, ip->i_size); break; } - /* - * If the buffer is not valid we have to clear out any - * garbage data from the pages instantiated for the buffer. - * If we do not, a failed uiomove() during a write can leave - * the prior contents of the pages exposed to a userland - * mmap(). XXX deal with uiomove() errors a better way. - */ - if ((bp->b_flags & B_CACHE) == 0 && fs->fs_bsize <= xfersize) - vfs_bio_clrbuf(bp); if (ioflag & IO_DIRECT) bp->b_flags |= B_DIRECT; if ((ioflag & (IO_SYNC|IO_INVAL)) == (IO_SYNC|IO_INVAL)) @@ -743,6 +741,20 @@ ffs_write(ap) error = uiomove((char *)bp->b_data + blkoffset, (int)xfersize, uio); + /* + * If the buffer is not already filled and we encounter an + * error while trying to fill it, we have to clear out any + * garbage data from the pages instantiated for the buffer. + * If we do not, a failed uiomove() during a write can leave + * the prior contents of the pages exposed to a userland + * mmap(). Note that we need only clear buffers with a + * transfer size equal to the block size because buffers with + * a shorter transfer size were cleared above by the call to + * UFS_BALLOC() with the BA_CLRBUF flag set. + */ + if (error != 0 && (bp->b_flags & B_CACHE) == 0 && + fs->fs_bsize == xfersize) + vfs_bio_clrbuf(bp); if ((ioflag & (IO_VMIO|IO_DIRECT)) && (LIST_EMPTY(&bp->b_dep))) { bp->b_flags |= B_RELBUF; Index: /usr/src/sys/ufs/ffs/ffs_extern.h =================================================================== --- /usr/src/sys/ufs/ffs/ffs_extern.h (revision 231181) +++ /usr/src/sys/ufs/ffs/ffs_extern.h (working copy) @@ -167,6 +167,13 @@ void softdep_freework(struct workhead *); #define FLUSH_INODES_WAIT 2 #define FLUSH_BLOCKS 3 #define FLUSH_BLOCKS_WAIT 4 +/* + * Flag to ffs_syncinode() to request flushing of data only, + * but skip the ffs_update() on the inode itself. Used to avoid + * deadlock when flushing snapshot inodes while holding snaplk. + * Avoid bit conflicts with MNT_WAIT values in sys/mount.h + */ +#define NO_INO_UPDT 0x10 int ffs_rdonly(struct inode *); Index: /usr/src/sys/ufs/ffs/ffs_snapshot.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_snapshot.c (revision 231181) +++ /usr/src/sys/ufs/ffs/ffs_snapshot.c (working copy) @@ -225,18 +225,10 @@ ffs_snapshot(mp, snapfile) ump = VFSTOUFS(mp); fs = ump->um_fs; sn = NULL; - /* - * At the moment, journaled soft updates cannot support - * taking snapshots. - */ - if (MOUNTEDSUJ(mp)) { - vfs_mount_error(mp, "%s: Snapshots are not yet supported when " - "running with journaled soft updates", fs->fs_fsmnt); - return (EOPNOTSUPP); - } MNT_ILOCK(mp); flag = mp->mnt_flag; MNT_IUNLOCK(mp); + /* * Need to serialize access to snapshot code per filesystem. */ @@ -1902,7 +1894,7 @@ retry: bawrite(cbp); if ((vtype == VDIR || dopersistence) && ip->i_effnlink > 0) - (void) ffs_syncvnode(vp, MNT_WAIT); + (void) ffs_syncvnode(vp, MNT_WAIT|NO_INO_UPDT); continue; } /* @@ -1913,7 +1905,7 @@ retry: bawrite(cbp); if ((vtype == VDIR || dopersistence) && ip->i_effnlink > 0) - (void) ffs_syncvnode(vp, MNT_WAIT); + (void) ffs_syncvnode(vp, MNT_WAIT|NO_INO_UPDT); break; } savedcbp = cbp; @@ -1931,7 +1923,7 @@ retry: bawrite(savedcbp); if ((vtype == VDIR || dopersistence) && VTOI(vp)->i_effnlink > 0) - (void) ffs_syncvnode(vp, MNT_WAIT); + (void) ffs_syncvnode(vp, MNT_WAIT|NO_INO_UPDT); } /* * If we have been unable to allocate a block in which to do @@ -2395,7 +2387,7 @@ ffs_copyonwrite(devvp, bp) bawrite(cbp); if ((devvp == bp->b_vp || bp->b_vp->v_type == VDIR || dopersistence) && ip->i_effnlink > 0) - (void) ffs_syncvnode(vp, MNT_WAIT); + (void) ffs_syncvnode(vp, MNT_WAIT|NO_INO_UPDT); else launched_async_io = 1; continue; @@ -2408,7 +2400,7 @@ ffs_copyonwrite(devvp, bp) bawrite(cbp); if ((devvp == bp->b_vp || bp->b_vp->v_type == VDIR || dopersistence) && ip->i_effnlink > 0) - (void) ffs_syncvnode(vp, MNT_WAIT); + (void) ffs_syncvnode(vp, MNT_WAIT|NO_INO_UPDT); else launched_async_io = 1; break; @@ -2428,7 +2420,7 @@ ffs_copyonwrite(devvp, bp) bawrite(savedcbp); if ((devvp == bp->b_vp || bp->b_vp->v_type == VDIR || dopersistence) && VTOI(vp)->i_effnlink > 0) - (void) ffs_syncvnode(vp, MNT_WAIT); + (void) ffs_syncvnode(vp, MNT_WAIT|NO_INO_UPDT); else launched_async_io = 1; } @@ -2478,7 +2470,7 @@ ffs_sync_snap(mp, waitfor) } TAILQ_FOREACH(ip, &sn->sn_head, i_nextsnap) { vp = ITOV(ip); - ffs_syncvnode(vp, waitfor); + ffs_syncvnode(vp, waitfor|NO_INO_UPDT); } lockmgr(&sn->sn_lock, LK_RELEASE, NULL); } -- Test scenario: suj26.sh