GENERIC HEAD from 2013-02-27 08:34:32 UTC, r247393M, vmcore.543 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r247393M: Wed Feb 27 23:14:25 CET 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3531583488 (3367 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 627053 free (1221 frags, 78229 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 113556 free (5260 frags, 13537 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 42559092 free (1244 frags, 5319731 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 1162100 free (125500 frags, 129575 blocks, 1.2% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 10562254 free (65566 frags, 1312086 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Feb 27 23:29:48 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe191d660 bufwait (bufwait) @ kern/vfs_bio.c:2676 2nd 0xca782200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c1087694,e191d600,f3f487e8,c0a7fc97,cab124f8,...) at db_trace_self_wrapper+0x2d/frame 0xf3f487a8 kdb_backtrace(c108a76e,ca782200,c10bc2e1,c7d86540,c10bbf26,...) at kdb_backtrace+0x30/frame 0xf3f48810 witness_checkorder(ca782200,9,c10bbf1d,11c,0,...) at witness_checkorder+0xbad/frame 0xf3f48860 _sx_xlock(ca782200,0,c10bbf1d,11c,c7fd8800,...) at _sx_xlock+0x75/frame 0xf3f48890 ufsdirhash_add(ca72eb40,f3f48988,135c,f3f48910,f3f48914,...) at ufsdirhash_add+0x4a/frame 0xf3f488c0 ufs_direnter(cab12438,cad66168,f3f48988,f3f48b68,e1921220,...) at ufs_direnter+0x63b/frame 0xf3f48940 ufs_mkdir(f3f48c00,c10e1329,c10b5c06,cab12438,f3f48bfc,...) at ufs_mkdir+0x884/frame 0xf3f48ae0 VOP_MKDIR_APV(c11e1340,f3f48c00,f3f48b68,f3f48b90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xf3f48b10 kern_mkdirat(ca7415e0,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1ef/frame 0xf3f48c24 sys_mkdir(ca7415e0,f3f48cc8,14,c1085875,7b3,...) at sys_mkdir+0x31/frame 0xf3f48c40 syscall(f3f48d08) at syscall+0x2ed/frame 0xf3f48cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f48cfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28173f03, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcaf13304 ufs (ufs) @ kern/vfs_lookup.c:516 2nd 0xe1925ba0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xcaf13034 ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c1087694,0,1,f3f58388,0,...) at db_trace_self_wrapper+0x2d/frame 0xf3f582b8 kdb_backtrace(c108a787,caf13034,c1072cdc,c7d864d8,c109390c,...) at kdb_backtrace+0x30/frame 0xf3f58320 witness_checkorder(caf13034,9,c1093903,880,caf130a0,...) at witness_checkorder+0xbad/frame 0xf3f58370 __lockmgr_args(caf13034,80100,caf130a0,0,0,...) at __lockmgr_args+0x87c/frame 0xf3f58450 ffs_lock(f3f584d8,c137a648,c7d7f1e0,c7d84a70,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf3f58490 VOP_LOCK1_APV(c11e1340,f3f584d8,200246,c13a6400,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf3f584c0 _vn_lock(caf13000,80100,c1093903,880,c1092b79,...) at _vn_lock+0xca/frame 0xf3f58500 vget(caf13000,80100,c807b8d0,57,0,...) at vget+0x77/frame 0xf3f58538 vfs_hash_get(ca70dbb0,15eeb0,80000,c807b8d0,f3f58618,...) at vfs_hash_get+0xff/frame 0xf3f58564 ffs_vgetf(ca70dbb0,15eeb0,80000,f3f58618,1,...) at ffs_vgetf+0x47/frame 0xf3f585c0 softdep_sync_buf(caf132d0,e1925b40,1,107,0,...) at softdep_sync_buf+0x977/frame 0xf3f58628 ffs_syncvnode(caf132d0,1,0,f3f586e4,c0adfddf,...) at ffs_syncvnode+0x2a3/frame 0xf3f58680 ffs_truncate(caf132d0,200,0,880,ca70ec00,...) at ffs_truncate+0x6c8/frame 0xf3f58838 ufs_direnter(caf132d0,caf13000,f3f588f8,f3f58bc8,0,...) at ufs_direnter+0x7ed/frame 0xf3f588b8 ufs_makeinode(f3f58bb4,f3f58bc8) at ufs_makeinode+0x537/frame 0xf3f58a2c ufs_create(f3f58b18,c10e0d17,c10b5c06,ca70dbc0,2,...) at ufs_create+0x2f/frame 0xf3f58a40 VOP_CREATE_APV(c11e1340,f3f58b18,f3f58bc8,f3f58aa8,c11f5cb8,...) at VOP_CREATE_APV+0x124/frame 0xf3f58a70 vn_open_cred(f3f58b88,f3f58bfc,1b0,0,ca70ec00,ca7547e0) at vn_open_cred+0x2cf/frame 0xf3f58b40 vn_open(f3f58b88,f3f58bfc,1b0,ca7547e0,0,...) at vn_open+0x3b/frame 0xf3f58b60 kern_openat(c807b8d0,ffffff9c,28c57f60,0,a02,1b0) at kern_openat+0x1e4/frame 0xf3f58c20 sys_open(c807b8d0,f3f58cc8,f3f58d08,1,1,...) at sys_open+0x38/frame 0xf3f58c40 syscall(f3f58d08) at syscall+0x2ed/frame 0xf3f58cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f58cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28414197, esp = 0xbfbfb50c, ebp = 0xbfbfb598 --- . Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xca7a35d4 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xca71373c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c1087694,0,33,c1072cdc,650,...) at db_trace_self_wrapper+0x2d/frame 0xf3f7c848 kdb_backtrace(c108a76e,ca71373c,c107e7fd,c7d86338,c10b8617,...) at kdb_backtrace+0x30/frame 0xf3f7c8b0 witness_checkorder(ca71373c,9,c10b860e,74a,ca7137a8,...) at witness_checkorder+0xbad/frame 0xf3f7c900 __lockmgr_args(ca71373c,80400,ca7137a8,0,0,0,c10b860e,74a) at __lockmgr_args+0x87c/frame 0xf3f7c9e0 vop_stdlock(f3f7ca58,632,4,f3f7ca54,c0a7fc97,...) at vop_stdlock+0x53/frame 0xf3f7ca10 VOP_LOCK1_APV(c11a70d8,f3f7ca58,4,f3f7ca80,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf3f7ca40 _vn_lock(ca713708,80400,c10b860e,74a,f3f7cac0,...) at _vn_lock+0xca/frame 0xf3f7ca80 softdep_flushworklist(cab082ec,f3f7cb14,ca7412f0,62d,0,...) at softdep_flushworklist+0x6e/frame 0xf3f7cac0 ffs_sync(cab082ec,1,f3f7cb70,50e,ca721400,...) at ffs_sync+0x2e5/frame 0xf3f7cb48 dounmount(cab082ec,8080000,ca7412f0,493,0,...) at dounmount+0x3d2/frame 0xf3f7cb98 sys_unmount(ca7412f0,f3f7ccc8,f3f7cd08,1,1,...) at sys_unmount+0x3dd/frame 0xf3f7cc40 syscall(f3f7cd08) at syscall+0x2ed/frame 0xf3f7ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f7ccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Feb 27 23:30:07 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 27510 files, 75754889 used, 42559092 free (1244 frags, 5319731 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 27510 files, 75754889 used, 42559092 free (1244 frags, 5319731 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Wed Feb 27 23:34:12 CET 2013 FreeBSD/i386 (x4.osted.lan) (console) login: 20130227 23:34:13 all: marcus.sh lock order reversal: 1st 0xc13a63ec buf queue lock (buf queue lock) @ kern/vfs_bio.c:2323 2nd 0xca70d000 struct mount mtx (struct mount mtx) @ kern/vfs_mount.c:433 KDB: stack backtrace: db_trace_self_wrapper(c1087694,eea4db20,c0ab82a1,c123da90,14,...) at db_trace_self_wrapper+0x2d/frame 0xeea4dac0 kdb_backtrace(c108a76e,ca70d000,c106f0a6,c7d7f5f0,c1092f1c,...) at kdb_backtrace+0x30/frame 0xeea4db24 witness_checkorder(ca70d000,9,c1092f13,1b1,0,...) at witness_checkorder+0xbad/frame 0xeea4db74 __mtx_lock_flags(ca70d010,0,c1092f13,1b1,eea4dc28,...) at __mtx_lock_flags+0x98/frame 0xeea4dba8 vfs_ref(ca70d000,c11c0df0,eea4dc28,eea4dc2c,eea4dc10,...) at vfs_ref+0x2e/frame 0xeea4dbc8 vop_stdgetwritemount(eea4dc28,c10e16a1,c137af90,c7d84a08,200,...) at vop_stdgetwritemount+0x1e/frame 0xeea4dbe0 VOP_GETWRITEMOUNT_APV(c11a70d8,eea4dc28,ca7dd660,8,c11f6108,...) at VOP_GETWRITEMOUNT_APV+0x118/frame 0xeea4dc10 vn_start_write(ca7dd5a0,eea4dc8c,2,936,0,...) at vn_start_write+0x3c/frame 0xeea4dc48 flushbufqueues(ca628b40,0,c1090c8e,8c0,3e8,...) at flushbufqueues+0x33a/frame 0xeea4dcac buf_daemon(0,eea4dd08,c107cf30,3d7,0,...) at buf_daemon+0x109/frame 0xeea4dccc fork_exit(c0b1da40,0,eea4dd08) at fork_exit+0x7f/frame 0xeea4dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea4dcf4 --- trap 0, eip = 0, esp = 0xeea4dd40, ebp = 0 --- lock order reversal: 1st 0xcab12034 syncer (syncer) @ kern/vfs_subr.c:1795 2nd 0xcaf9a19c ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c1087694,c123db1c,0,0,c7ef08d0,...) at db_trace_self_wrapper+0x2d/frame 0xeea53938 kdb_backtrace(c108a76e,caf9a19c,c1072cdc,c7d864d8,c109390c,...) at kdb_backtrace+0x30/frame 0xeea539a0 witness_checkorder(caf9a19c,9,c1093903,880,caf9a208,...) at witness_checkorder+0xbad/frame 0xeea539f0 __lockmgr_args(caf9a19c,80500,caf9a208,0,0,...) at __lockmgr_args+0x87c/frame 0xeea53ad0 ffs_lock(eea53b58,0,c7d848d0,246,c7d848d0,...) at ffs_lock+0xad/frame 0xeea53b10 VOP_LOCK1_APV(c11e1340,eea53b58,246,c13a660c,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xeea53b40 _vn_lock(caf9a168,80500,c1093903,880,c13a661c,...) at _vn_lock+0xca/frame 0xeea53b80 vget(caf9a168,80500,c950d000,12bb,cab08010,...) at vget+0x77/frame 0xeea53bb8 vfs_msync(cab08000,2,2,e7a,0,...) at vfs_msync+0xa0/frame 0xeea53bfc sync_fsync(eea53ca8,c10e1204,80400,c1093903,703,...) at sync_fsync+0x130/frame 0xeea53c28 VOP_FSYNC_APV(c11c16f0,eea53ca8,c1093903,703,4e20,...) at VOP_FSYNC_APV+0x124/frame 0xeea53c58 sched_sync(0,eea53d08,c107cf30,3d7,0,...) at sched_sync+0x38f/frame 0xeea53ccc fork_exit(c0b39c80,0,eea53d08) at fork_exit+0x7f/frame 0xeea53cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea53cf4 --- trap 0, eip = 0, esp = 0xeea53d40, ebp = 0 --- 20130228 00:06:23 all: marcus.sh 20130228 00:38:25 all: marcus.sh 20130228 01:10:10 all: marcus.sh 20130228 01:40:22 all: marcus.sh 20130228 02:11:58 all: marcus.sh 20130228 02:43:37 all: marcus.sh 20130228 03:15:50 all: marcus.sh Feb 28 03:36:51 x4 kernel: pid 51635 (symlink), uid 1004 inumber 98365 on /mnt: out of inodes 20130228 03:46:45 all: marcus.sh 20130228 04:19:04 all: marcus.sh 20130228 04:52:04 all: marcus.sh 20130228 05:22:48 all: marcus.sh 20130228 05:54:27 all: marcus.sh Feb 28 06:08:24 x4 kernel: pid 81268 (openat), uid 1004 inumber 65574 on /mnt: out of inodes 20130228 06:24:57 all: marcus.sh 20130228 06:57:04 all: marcus.sh 20130228 07:14:28 all: marcus.sh 20130228 07:15:10 all: flock_open_close.sh lock order reversal: 1st 0xe1a831a0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 2nd 0xca8cc91c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2298 KDB: stack backtrace: db_trace_self_wrapper(c1087694,c0cf8bbf,ca8cc058,0,c10bca44,...) at db_trace_self_wrapper+0x2d/frame 0xf46bf6e8 kdb_backtrace(c108a76e,ca8cc91c,c10b8175,c7d86cf8,c10b7d97,...) at kdb_backtrace+0x30/frame 0xf46bf750 witness_checkorder(ca8cc91c,9,c10b7d8e,8fa,cc10e4d8,...) at witness_checkorder+0xbad/frame 0xf46bf7a0 __lockmgr_args(ca8cc91c,80900,cc10e4d8,0,0,...) at __lockmgr_args+0x87c/frame 0xf46bf87c ffs_copyonwrite(cc10e438,e1a83140,e1a83140,41c0,0,...) at ffs_copyonwrite+0x1d1/frame 0xf46bf8ec ffs_geom_strategy(cc10e4f8,e1a83140,f46bf944,cc10e2d0,f46bf9a0,...) at ffs_geom_strategy+0xbf/frame 0xf46bf908 ufs_strategy(f46bf9a0,c10e163b,d0609000,e1a83140,e1a83140,...) at ufs_strategy+0xce/frame 0xf46bf958 VOP_STRATEGY_APV(c11e1340,f46bf9a0,cb5471bc,c2a11550,c11f5f98,...) at VOP_STRATEGY_APV+0x132/frame 0xf46bf988 bufstrategy(cc10e390,e1a83140,c1090c8e,f64,c1090c8e,...) at bufstrategy+0x50/frame 0xf46bf9b8 bufwrite(e1a83140,e1a83140,1,107,0,...) at bufwrite+0x16c/frame 0xf46bf9e8 ffs_syncvnode(cc10e2d0,1,0,cc10e2d0,0,...) at ffs_syncvnode+0x35b/frame 0xf46bfa40 ffs_fsync(f46bfab8,c10e1204,c0b22658,0,cc10e2dc,...) at ffs_fsync+0x26/frame 0xf46bfa68 VOP_FSYNC_APV(c11e1340,f46bfab8,400800c,0,0,...) at VOP_FSYNC_APV+0x124/frame 0xf46bfa98 ufs_remove(f46bfc00,c10e1252,c11f6108,cc10e2d0,f46bfbfc,...) at ufs_remove+0xdb/frame 0xf46bfae0 VOP_REMOVE_APV(c11e1340,f46bfc00,cc10e5a0,f46bfbd0,0,...) at VOP_REMOVE_APV+0x14a/frame 0xf46bfb10 kern_unlinkat(d0609000,ffffff9c,bfbfdac2,0,0) at kern_unlinkat+0x25a/frame 0xf46bfc24 sys_unlink(d0609000,f46bfcc8,c10da553,d6,1,...) at sys_unlink+0x32/frame 0xf46bfc40 syscall(f46bfd08) at syscall+0x2ed/frame 0xf46bfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf46bfcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28173493, esp = 0xbfbfd7fc, ebp = 0xbfbfd884 --- lock order reversal: 1st 0xca8cc91c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xcc10e5d4 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1627 KDB: stack backtrace: db_trace_self_wrapper(c1087694,f46bf738,0,6919f00,f,...) at db_trace_self_wrapper+0x2d/frame 0xf46bf670 kdb_backtrace(c108a76e,cc10e5d4,c1072cdc,c7d864d8,c10b7d97,...) at kdb_backtrace+0x30/frame 0xf46bf6d8 witness_checkorder(cc10e5d4,9,c10b7d8e,65b,0,...) at witness_checkorder+0xbad/frame 0xf46bf728 __lockmgr_args(cc10e5d4,80000,0,0,0,...) at __lockmgr_args+0x87c/frame 0xf46bf808 ffs_snapremove(cc10e5a0,c10b7c5f,c1375898,c11b6c64,246,...) at ffs_snapremove+0x118/frame 0xf46bf868 ffs_truncate(cc10e5a0,0,0,c00,0,...) at ffs_truncate+0x293/frame 0xf46bfa20 ufs_inactive(f46bfaa8,c10e14c5,c1093903,9d0,c11f3010,...) at ufs_inactive+0x1fc/frame 0xf46bfa50 VOP_INACTIVE_APV(c11e1340,f46bfaa8,c1093903,9d0,f46bfac8,...) at VOP_INACTIVE_APV+0x124/frame 0xf46bfa80 vinactive(cc10e5a0,d0609000,c1093903,8ce,cc10e650,...) at vinactive+0x191/frame 0xf46bfac8 vputx(cc10e5a0,ffffffdf,cc10e5a0,f46bfbd0,0,...) at vputx+0x38a/frame 0xf46bfb10 kern_unlinkat(d0609000,ffffff9c,bfbfdac2,0,0) at kern_unlinkat+0x29f/frame 0xf46bfc24 sys_unlink(d0609000,f46bfcc8,c10da553,d6,1,...) at sys_unlink+0x32/frame 0xf46bfc40 syscall(f46bfd08) at syscall+0x2ed/frame 0xf46bfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf46bfcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28173493, esp = 0xbfbfd7fc, ebp = 0xbfbfd884 --- 20130228 07:20:45 all: fts.sh lock order reversal: 1st 0xcb17642c filedesc structure (filedesc structure) @ kern/kern_descrip.c:840 2nd 0xcad87034 ufs (ufs) @ kern/vfs_subr.c:4401 KDB: stack backtrace: db_trace_self_wrapper(c1087694,63736564,2e706972,34383a63,c7000a30,...) at db_trace_self_wrapper+0x2d/frame 0xf403b8e8 kdb_backtrace(c108a76e,cad87034,c1072cdc,c7d864d8,c109390c,...) at kdb_backtrace+0x30/frame 0xf403b950 witness_checkorder(cad87034,9,c1093903,1131,cad870a0,...) at witness_checkorder+0xbad/frame 0xf403b9a0 __lockmgr_args(cad87034,80400,cad870a0,0,0,...) at __lockmgr_args+0x87c/frame 0xf403ba80 ffs_lock(f403bb08,ca7f5694,c0b22658,cad87034,f403bb08,...) at ffs_lock+0xad/frame 0xf403bac0 VOP_LOCK1_APV(c11e1340,f403bb08,cbc1b01c,0,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf403baf0 _vn_lock(cad87000,80400,c1093903,1131) at _vn_lock+0xca/frame 0xf403bb2c vfs_knllock(cad87000,0,c107c840,72f,caf0e3f0,...) at vfs_knllock+0x29/frame 0xf403bb44 knlist_remove_kq(0,0) at knlist_remove_kq+0x87/frame 0xf403bb68 knlist_remove(cbc1b01c,caf0e3f0,0) at knlist_remove+0x1f/frame 0xf403bb78 filt_vfsdetach(caf0e3f0,0,c107c840,839,c11b8ffc,...) at filt_vfsdetach+0x2f/frame 0xf403bb94 knote_fdclose(ca7f55e0,3,c107c0e8,47b,0,...) at knote_fdclose+0xde/frame 0xf403bbc0 closefp(ca7ac2a0,ca7f55e0,1,91,cb17642c,...) at closefp+0x6d/frame 0xf403bbf0 do_dup(5,3,ca7f5834) at do_dup+0x29b/frame 0xf403bc28 sys_dup2(ca7f55e0,f403bcc8,14,c1085875,7b3,...) at sys_dup2+0x2d/frame 0xf403bc40 syscall(f403bd08) at syscall+0x2ed/frame 0xf403bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf403bcfc --- syscall (90, FreeBSD ELF32, sys_dup2), eip = 0x2810b8a7, esp = 0xbfbfdb60, ebp = 0xbfbfdb98 --- 20130228 08:20:50 all: nullfs6.sh 20130228 08:20:51 all: isofs.sh 20130228 08:21:00 all: md3.sh 20130228 08:31:32 all: trim.sh Feb 28 08:33:29 x4 kernel: pid 8989 (mkdir), uid 1004 inumber 8 on /mnt: filesystem full Feb 28 08:48:57 x4 kernel: pid 13991 (mkdir), uid 1004 inumber 15554 on /mnt: out of inodes 20130228 09:06:02 all: inversion.sh 20130228 09:36:04 all: nullfs12.sh 20130228 09:36:05 all: rename7.sh 20130228 09:37:26 all: quota9.sh lock order reversal: 1st 0xcab09448 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:714 2nd 0xcbaa2000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:720 KDB: stack backtrace: db_trace_self_wrapper(c1087694,a30,c1093903,cbaa2000,ca7452f0,...) at db_trace_self_wrapper+0x2d/frame 0xf3f38948 kdb_backtrace(c108a76e,cbaa2000,c106f0a6,c7d7f5f0,c10bca4d,...) at kdb_backtrace+0x30/frame 0xf3f389ac witness_checkorder(cbaa2000,9,c10bca44,2d0,0,...) at witness_checkorder+0xbad/frame 0xf3f389fc __mtx_lock_flags(cbaa2010,0,c10bca44,2d0,cab09458,...) at __mtx_lock_flags+0x98/frame 0xf3f38a30 quotaoff_inchange(0,0,c10bca44,2ec) at quotaoff_inchange+0x8c/frame 0xf3f38a5c quotaoff(ca7452f0,cbaa2000,0,ca7452f0,cab09400,...) at quotaoff+0xc0/frame 0xf3f38a80 ffs_flushfiles(cbaa2000,a,ca7452f0,cab0941c,f3f38b00,...) at ffs_flushfiles+0x7d/frame 0xf3f38ac4 softdep_flushfiles(cbaa2000,2,ca7452f0,0,0,...) at softdep_flushfiles+0x18f/frame 0xf3f38b00 ffs_unmount(cbaa2000,8080000,f3f38b70,50e,cf2efd00,...) at ffs_unmount+0x1d5/frame 0xf3f38b48 dounmount(cbaa2000,8080000,ca7452f0,493,0,...) at dounmount+0x413/frame 0xf3f38b98 sys_unmount(ca7452f0,f3f38cc8,c10da553,d6,1,...) at sys_unmount+0x3dd/frame 0xf3f38c40 syscall(f3f38d08) at syscall+0x2ed/frame 0xf3f38cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f38cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd0b4, ebp = 0xbfbfd180 --- 20130228 09:37:29 all: softupdate.sh Feb 28 10:07:38 x4 kernel: pid 79005 (mkdir), uid 0 inumber 63098 on /mnt: out of inodes Feb 28 10:09:24 x4 su: pho to root on /dev/pts/2 lock order reversal: 1st 0xcaf7f250 vm object (vm object) @ vm/vm_pageout.c:966 2nd 0xca70dbb0 struct mount mtx (struct mount mtx) @ kern/vfs_mount.c:433 KDB: stack backtrace: db_trace_self_wrapper(c1087694,c950e000,e18e1dc0,e18e1dc0,1,...) at db_trace_self_wrapper+0x2d/frame 0xeea44a98 kdb_backtrace(c108a76e,ca70dbb0,c106f0a6,c7d7f5f0,c1092f1c,...) at kdb_backtrace+0x30/frame 0xeea44afc witness_checkorder(ca70dbb0,9,c1092f13,1b1,0,...) at witness_checkorder+0xbad/frame 0xeea44b4c __mtx_lock_flags(ca70dbc0,0,c1092f13,1b1,eea44c00,...) at __mtx_lock_flags+0x98/frame 0xeea44b80 vfs_ref(ca70dbb0,c11c0df0,eea44c00,eea44c04,eea44be8,...) at vfs_ref+0x2e/frame 0xeea44ba0 vop_stdgetwritemount(eea44c00,c10e16a1,8,c10d9012,12ac,...) at vop_stdgetwritemount+0x1e/frame 0xeea44bb8 VOP_GETWRITEMOUNT_APV(c11e1340,eea44c00,c13fdd00,8,c11f6108,...) at VOP_GETWRITEMOUNT_APV+0x118/frame 0xeea44be8 vn_start_write(caf12e10,eea44c64,2,483,1f4,...) at vn_start_write+0x3c/frame 0xeea44c20 vm_pageout(0,eea44d08,c107cf30,3d7,0,...) at vm_pageout+0xb52/frame 0xeea44ccc fork_exit(c0d26790,0,eea44d08) at fork_exit+0x7f/frame 0xeea44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea44cf4 --- trap 0, eip = 0, esp = 0xeea44d40, ebp = 0 --- Expensive timeout(9) function: 0xc0d0c6b0(0) 0.074963990 s 20130228 11:59:17 all: extattr.sh 20130228 11:59:25 all: suj24.sh 20130228 11:59:25 all: nullfs9.sh 20130228 11:59:26 all: umountf6.sh Feb 28 11:59:35 x4 mountd[574]: can't delete exports for /mnt16: Invalid argument Feb 28 11:59:35 x4 mountd[574]: can't delete exports for /mnt5: Invalid argument Feb 28 11:59:36 x4 mountd[574]: can't delete exports for /mnt7: Invalid argument Feb 28 11:59:36 x4 mountd[574]: can't delete exports for /mnt9: Invalid argument Feb 28 11:59:37 x4 mountd[574]: can't delete exports for /mnt5: Invalid argument dev = md19a, block = 640, fs = /mnt19 panic: ffs_blkfree_cg: freeing free frag cpuid = 2 KDB: enter: panic [ thread pid 93777 tid 100227 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 93777 tid 100227 td 0xcb173000 kdb_enter(c10833b1,c10833b1,c10b7736,f41bc8a0,280,...) at kdb_enter+0x3d/frame 0xf41bc848 vpanic(f41bc8a0,f41bc90c,c0cbc31e,c10b7736,ca720778,...) at vpanic+0x142/frame 0xf41bc888 panic(c10b7736,ca720778,280,0,ce1d50d4,...) at panic+0x12/frame 0xf41bc894 ffs_blkfree_cg(cceb0e10,280,0,1000,6,...) at ffs_blkfree_cg+0x72e/frame 0xf41bc90c ffs_blkfree(ca727b00,ce1d5000,cceb0e10,280,0,...) at ffs_blkfree+0xa5/frame 0xf41bc948 freework_freeblock(c13aa7cc,0,c10b860e,1dd4,c109529c,...) at freework_freeblock+0x667/frame 0xf41bc9b0 handle_workitem_freeblocks(0,f41bca40,2,6da,ca727b00,...) at handle_workitem_freeblocks+0x197/frame 0xf41bca00 process_worklist_item(1,0,c10b860e,609,512f389a,...) at process_worklist_item+0x29d/frame 0xf41bca54 softdep_process_worklist(ce19fbb0,1,ce19fbb0,f41bcb18,f41bcac0,...) at softdep_process_worklist+0x7c/frame 0xf41bca80 softdep_flushworklist(ce19fbb0,f41bcb14,cb173000,62d,0,...) at softdep_flushworklist+0x43/frame 0xf41bcac0 ffs_sync(ce19fbb0,1,f41bcb70,50e,cf2fe080,...) at ffs_sync+0x2e5/frame 0xf41bcb48 dounmount(ce19fbb0,8080000,cb173000,493,0,...) at dounmount+0x3d2/frame 0xf41bcb98 sys_unmount(cb173000,f41bccc8,c10da553,d6,1,...) at sys_unmount+0x3dd/frame 0xf41bcc40 syscall(f41bcd08) at syscall+0x2ed/frame 0xf41bccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf41bccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x629f00 curthread = 0xc7dde8d0: pid 11 "idle: cpu0" curpcb = 0xc7b25d60 fpcurthread = none idlethread = 0xc7dde8d0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6919f00 curthread = 0xcaca12f0: pid 93815 "umount" curpcb = 0xf48abd60 fpcurthread = none idlethread = 0xc7dde5e0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x691cf00 curthread = 0xcb173000: pid 93777 "umount" curpcb = 0xf41bcd60 fpcurthread = none idlethread = 0xc7dde2f0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x691ff00 curthread = 0xcb6955e0: pid 93820 "umount" curpcb = 0xf4487d60 fpcurthread = none idlethread = 0xc7dde000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 93823 (umount) thread 0xcb87f5e0 (100299) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1b58480) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xccd3146c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcd0b5cdc) locked @ kern/vfs_mount.c:1236 Process 93822 (umount) thread 0xcd6c9bc0 (100837) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a40e20) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xcca0919c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xccbe0b74) locked @ kern/vfs_mount.c:1236 Process 93821 (umount) thread 0xcf3712f0 (100743) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1b5efc0) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xccc8d5d4) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcc39946c) locked @ kern/vfs_mount.c:1236 Process 93820 (umount) thread 0xcb6955e0 (100421) exclusive lockmgr ufs (ufs) r = 0 (0xcbe2e73c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcca1019c) locked @ kern/vfs_mount.c:1236 Process 93819 (umount) thread 0xcd6ca5e0 (100834) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19aebc0) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xcdd2246c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcc3c8a0c) locked @ kern/vfs_mount.c:1236 Process 93818 (umount) thread 0xce2b5000 (100802) exclusive lockmgr ufs (ufs) r = 0 (0xcec5173c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcffe38a4) locked @ kern/vfs_mount.c:1236 Process 93815 (umount) thread 0xcaca12f0 (100675) exclusive lockmgr ufs (ufs) r = 0 (0xcd6ea73c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xd03c7304) locked @ kern/vfs_mount.c:1236 Process 93812 (umount) thread 0xcb6ad000 (100528) exclusive lockmgr bufwait (bufwait) r = 0 (0xe199fe80) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xcf69373c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcbd468a4) locked @ kern/vfs_mount.c:1236 Process 93804 (find) thread 0xcdab32f0 (100500) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93803 (find) thread 0xcb6952f0 (100422) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93801 (find) thread 0xcb98a2f0 (100289) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93798 (find) thread 0xcbdedbc0 (100204) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93795 (umount) thread 0xcbc505e0 (100194) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1abc140) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xcca9919c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xca7bda0c) locked @ kern/vfs_mount.c:1236 Process 93793 (find) thread 0xcd381000 (100511) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93791 (find) thread 0xcd8c6bc0 (100325) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93790 (find) thread 0xcdc48000 (100566) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93789 (find) thread 0xcd8cbbc0 (100314) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93788 (find) thread 0xcd3812f0 (100510) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93787 (find) thread 0xce2b38d0 (100804) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93786 (find) thread 0xcb8468d0 (100532) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93779 (umount) thread 0xcb842000 (100572) exclusive lockmgr ufs (ufs) r = 0 (0xccfe35d4) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcb574a0c) locked @ kern/vfs_mount.c:1236 Process 93777 (umount) thread 0xcb173000 (100227) exclusive sleep mutex FFS (FFS Lock) r = 0 (0xca727b48) locked @ ufs/ffs/ffs_alloc.c:2117 exclusive sleep mutex Giant (Giant) r = 0 (0xc13f7324) locked @ kern/vfs_mount.c:1155 exclusive lockmgr bufwait (bufwait) r = 0 (0xe198c820) locked @ kern/vfs_bio.c:1943 exclusive lockmgr ufs (ufs) r = 0 (0xcbb83e44) locked @ kern/vfs_mount.c:1236 Process 93768 (umount) thread 0xcbe662f0 (100277) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a4f820) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xcd14246c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xce163304) locked @ kern/vfs_mount.c:1236 Process 93764 (umount) thread 0xce2a8000 (100817) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19d9cc0) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xd035d8a4) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xce724e44) locked @ kern/vfs_mount.c:1236 Process 93763 (umount) thread 0xcab138d0 (100611) exclusive lockmgr ufs (ufs) r = 0 (0xcd4e573c) locked @ kern/vfs_subr.c:2176 exclusive lockmgr ufs (ufs) r = 0 (0xcc4d5cdc) locked @ kern/vfs_mount.c:1236 Process 93754 (find) thread 0xcf16d000 (100655) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93746 (find) thread 0xcddee000 (100698) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93742 (mount) thread 0xce2adbc0 (100808) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19958c0) locked @ kern/vfs_bio.c:1943 Process 93739 (find) thread 0xce7febc0 (100586) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 93738 (find) thread 0xcb98a5e0 (100288) shared lockmgr ufs (ufs) r = 0 (0xca3d3cdc) locked @ kern/vfs_lookup.c:516 Process 92789 (md18) thread 0xcb6ba8d0 (100415) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a882e0) locked @ kern/vfs_bio.c:1943 exclusive lockmgr ufs (ufs) r = 0 (0xce57173c) locked @ dev/md/md.c:618 Process 92777 (md17) thread 0xcc2aa000 (100484) exclusive lockmgr ufs (ufs) r = 0 (0xce77de44) locked @ dev/md/md.c:618 Process 92753 (md15) thread 0xcb98abc0 (100319) exclusive lockmgr ufs (ufs) r = 0 (0xcc9b1b74) locked @ dev/md/md.c:618 Process 92729 (md13) thread 0xcac9e8d0 (100678) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1a1ab20) locked @ kern/vfs_bio.c:2676 exclusive lockmgr ufs (ufs) r = 0 (0xd035446c) locked @ dev/md/md.c:618 Process 92717 (md12) thread 0xcf3715e0 (100742) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1938020) locked @ kern/vfs_bio.c:1943 exclusive lockmgr ufs (ufs) r = 0 (0xcd3bfe44) locked @ dev/md/md.c:618 Process 92705 (md11) thread 0xcc28e000 (100482) exclusive lockmgr ufs (ufs) r = 0 (0xd07bc19c) locked @ dev/md/md.c:618 Process 92669 (md8) thread 0xd63752f0 (100857) exclusive lockmgr ufs (ufs) r = 0 (0xce72da0c) locked @ dev/md/md.c:618 Process 92657 (md7) thread 0xca7c7000 (100631) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1ba33c0) locked @ kern/vfs_bio.c:1943 exclusive lockmgr ufs (ufs) r = 0 (0xcb40746c) locked @ dev/md/md.c:618 Process 92633 (md5) thread 0xcbc242f0 (100154) exclusive lockmgr ufs (ufs) r = 0 (0xcad8719c) locked @ dev/md/md.c:618 db:0:alllocks> show lockedvnods Locked vnodes 0xca3d3ca8: tag ufs, type VDIR usecount 212, writecount 0, refcount 215 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xca7264a0 ref 0 pages 1 lock type ufs: SHARED (count 15) with exclusive waiters pending #0 0xc0a77510 at __lockmgr_args+0xf60 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b27c07 at lookup+0xf7 #5 0xc0b2772d at namei+0x47d #6 0xc0b3fbf2 at kern_readlinkat+0x92 #7 0xc0b3fab0 at sys_readlink+0x40 #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 2, on dev ada0s1a 0xcca10168: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xcbaa2000 flags (VI_ACTIVE) v_object 0xcda264a0 ref 0 pages 1 lock type ufs: EXCL by thread 0xcb6955e0 (pid 93820, umount, tid 100421) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 70658, on dev ada0s1a 0xcbd46870: tag ufs, type VDIR usecount 1, writecount 0, refcount 6 mountedhere 0xce19f8c4 flags (VI_ACTIVE) v_object 0xcbfd7d4c ref 0 pages 0 lock type ufs: EXCL by thread 0xcb6ad000 (pid 93812, umount, tid 100528) with shared waiters pending #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 117765, on dev ada0s1a 0xcc3c89d8: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xcba908c4 flags (VI_ACTIVE) v_object 0xd1e89e74 ref 0 pages 1 lock type ufs: EXCL by thread 0xcd6ca5e0 (pid 93819, umount, tid 100834) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 13, on dev ada0s1a 0xcffe3870: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xcbd95bb0 flags (VI_ACTIVE) v_object 0xd1e89784 ref 0 pages 0 lock type ufs: EXCL by thread 0xce2b5000 (pid 93818, umount, tid 100802) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 47107, on dev ada0s1a 0xcc4d5ca8: tag ufs, type VDIR usecount 1, writecount 0, refcount 11 mountedhere 0xca70c2ec flags (VI_ACTIVE) v_object 0xcbfd72e4 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab138d0 (pid 93763, umount, tid 100611) with shared waiters pending #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 70687, on dev ada0s1a 0xcc399438: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xcbd94bb0 flags (VI_ACTIVE) v_object 0xcf3c8128 ref 0 pages 0 lock type ufs: EXCL by thread 0xcf3712f0 (pid 93821, umount, tid 100743) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 117766, on dev ada0s1a 0xce724e10: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xcbd942ec flags (VI_ACTIVE) v_object 0xcf3c8094 ref 0 pages 0 lock type ufs: EXCL by thread 0xce2a8000 (pid 93764, umount, tid 100817) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 164867, on dev ada0s1a 0xce1632d0: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xce1a02ec flags (VI_ACTIVE) v_object 0xcf3c8250 ref 0 pages 0 lock type ufs: EXCL by thread 0xcbe662f0 (pid 93768, umount, tid 100277) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 141315, on dev ada0s1a 0xcbb83e10: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xce19fbb0 flags (VI_ACTIVE) v_object 0xcf3c8940 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb173000 (pid 93777, umount, tid 100227) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 164868, on dev ada0s1a 0xca7bd9d8: tag ufs, type VDIR usecount 1, writecount 0, refcount 4 mountedhere 0xcba902ec flags (VI_ACTIVE) v_object 0xcf3c89d4 ref 0 pages 1 lock type ufs: EXCL by thread 0xcbc505e0 (pid 93795, umount, tid 100194) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 164865, on dev ada0s1a 0xd03c72d0: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xcc4fe8c4 flags (VI_ACTIVE) v_object 0xcf3c865c ref 0 pages 1 lock type ufs: EXCL by thread 0xcaca12f0 (pid 93815, umount, tid 100675) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 141314, on dev ada0s1a 0xcd0b5ca8: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xcba90bb0 flags (VI_ACTIVE) v_object 0xcf3c8b90 ref 0 pages 1 lock type ufs: EXCL by thread 0xcb87f5e0 (pid 93823, umount, tid 100299) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 164866, on dev ada0s1a 0xcb5749d8: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xcbd958c4 flags (VI_ACTIVE) v_object 0xcf3c8de0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcb842000 (pid 93779, umount, tid 100572) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 12, on dev ada0s1a 0xccbe0b40: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xcba90000 flags (VI_ACTIVE) v_object 0xcf3c8c24 ref 0 pages 1 lock type ufs: EXCL by thread 0xcd6c9bc0 (pid 93822, umount, tid 100837) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b2bac9 at dounmount+0x99 #5 0xc0b2b9ed at sys_unmount+0x3dd #6 0xc0ea728d at syscall+0x2ed #7 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 47106, on dev ada0s1a 0xcad87168: tag ufs, type VREG usecount 1, writecount 1, refcount 24 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xcc7dcc24 ref 0 pages 2544 lock type ufs: EXCL by thread 0xcbc242f0 (pid 92633, md5, tid 100154) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194249, on dev ada0s1e 0xcb407438: tag ufs, type VREG usecount 1, writecount 1, refcount 24 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xd1ed265c ref 0 pages 2544 lock type ufs: EXCL by thread 0xca7c7000 (pid 92657, md7, tid 100631) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194261, on dev ada0s1e 0xce72d9d8: tag ufs, type VREG usecount 1, writecount 1, refcount 25 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xd1e4e534 ref 0 pages 2548 lock type ufs: EXCL by thread 0xd63752f0 (pid 92669, md8, tid 100857) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194262, on dev ada0s1e 0xd07bc168: tag ufs, type VREG usecount 1, writecount 1, refcount 638 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xcd178de0 ref 0 pages 2544 lock type ufs: EXCL by thread 0xcc28e000 (pid 92705, md11, tid 100482) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194266, on dev ada0s1e 0xcd3bfe10: tag ufs, type VREG usecount 1, writecount 1, refcount 638 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xcf205000 ref 0 pages 2544 lock type ufs: EXCL by thread 0xcf3715e0 (pid 92717, md12, tid 100742) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194267, on dev ada0s1e 0xd0354438: tag ufs, type VREG usecount 1, writecount 1, refcount 635 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xccf1e378 ref 0 pages 2532 lock type ufs: EXCL by thread 0xcac9e8d0 (pid 92729, md13, tid 100678) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194268, on dev ada0s1e 0xcc9b1b40: tag ufs, type VREG usecount 1, writecount 1, refcount 639 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xd071b4a0 ref 0 pages 2548 lock type ufs: EXCL by thread 0xcb98abc0 (pid 92753, md15, tid 100319) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194270, on dev ada0s1e 0xce77de10: tag ufs, type VREG usecount 1, writecount 1, refcount 638 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xccf61094 ref 0 pages 2544 lock type ufs: EXCL by thread 0xcc2aa000 (pid 92777, md17, tid 100484) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194272, on dev ada0s1e 0xce571708: tag ufs, type VREG usecount 1, writecount 1, refcount 637 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xd0e5f940 ref 0 pages 2540 lock type ufs: EXCL by thread 0xcb6ba8d0 (pid 92789, md18, tid 100415) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc077a430 at mdstart_vnode+0x3c0 #5 0xc077b56a at md_kthread+0x1aa #6 0xc0a62abf at fork_exit+0x7f #7 0xc0e8fa64 at fork_trampoline+0x8 ino 6194273, on dev ada0s1e 0xcd4e5708: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xd2520250 ref 0 pages 3 lock type ufs: EXCL by thread 0xcab138d0 (pid 93763, umount, tid 100611) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 9, on dev md14a 0xd035d870: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xd071b378 ref 0 pages 3 lock type ufs: EXCL by thread 0xce2a8000 (pid 93764, umount, tid 100817) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 9, on dev md17a 0xcd142438: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd12ecb8 ref 0 pages 1 lock type ufs: EXCL by thread 0xcbe662f0 (pid 93768, umount, tid 100277) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 4, on dev md18a 0xccfe35a0: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcc94ade0 ref 0 pages 5 lock type ufs: EXCL by thread 0xcb842000 (pid 93779, umount, tid 100572) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 11, on dev md8a 0xcca99168: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd12fafc ref 0 pages 1 lock type ufs: EXCL by thread 0xcbc505e0 (pid 93795, umount, tid 100194) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 7, on dev md5a 0xcec51708: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd12d094 ref 0 pages 1 lock type ufs: EXCL by thread 0xce2b5000 (pid 93818, umount, tid 100802) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 4, on dev md13a 0xcf693708: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xd1e4e1bc ref 0 pages 1 lock type ufs: EXCL by thread 0xcb6ad000 (pid 93812, umount, tid 100528) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 7, on dev md11a 0xcbe2e708: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd11f1bc ref 0 pages 1 lock type ufs: EXCL by thread 0xcb6955e0 (pid 93820, umount, tid 100421) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 8, on dev md10a 0xcd6ea708: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xd1b2f9d4 ref 0 pages 1 lock type ufs: EXCL by thread 0xcaca12f0 (pid 93815, umount, tid 100675) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 6, on dev md6a 0xcca09168: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xd279bde0 ref 0 pages 3 lock type ufs: EXCL by thread 0xcd6c9bc0 (pid 93822, umount, tid 100837) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 5, on dev md9a 0xcdd22438: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcf3ec65c ref 0 pages 1 lock type ufs: EXCL by thread 0xcd6ca5e0 (pid 93819, umount, tid 100834) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 4, on dev md12a 0xccc8d5a0: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd023d4c ref 0 pages 1 lock type ufs: EXCL by thread 0xcf3712f0 (pid 93821, umount, tid 100743) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 7, on dev md16a 0xccd31438: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb5dc8ac ref 0 pages 1 lock type ufs: EXCL by thread 0xcb87f5e0 (pid 93823, umount, tid 100299) #0 0xc0a77675 at __lockmgr_args+0x10c5 #1 0xc0ced82d at ffs_lock+0xad #2 0xc0ecd3a2 at VOP_LOCK1_APV+0x112 #3 0xc0b44fea at _vn_lock+0xca #4 0xc0b32dd7 at vget+0x77 #5 0xc0cebee2 at ffs_sync+0x222 #6 0xc0b2be02 at dounmount+0x3d2 #7 0xc0b2b9ed at sys_unmount+0x3dd #8 0xc0ea728d at syscall+0x2ed #9 0xc0e8fa51 at Xint0x80_syscall+0x21 ino 4, on dev md7a db:0:lockedvnods> show mount 0xca70cbb0 /dev/ad4s1a on / (ufs) 0xca70d000 devfs on /dev (devfs) 0xcab085d8 /dev/ad4s1f on /home (ufs) 0xcab08000 /dev/ad4s1d on /usr (ufs) 0xca70dbb0 /dev/ad4s1e on /var (ufs) 0xca70d8c4 procfs on /proc (procfs) 0xca70d5d8 /dev/label/tmp on /tmp (ufs) 0xca70c2ec /dev/md14a on /mnt14 (ufs) 0xcbd942ec /dev/md17a on /mnt17 (ufs) 0xce1a02ec /dev/md18a on /mnt18 (ufs) 0xce19fbb0 /dev/md19a on /mnt19 (ufs) 0xcbd958c4 /dev/md8a on /mnt8 (ufs) 0xcba902ec /dev/md5a on /mnt5 (ufs) 0xcbd95bb0 /dev/md13a on /mnt13 (ufs) 0xce19f8c4 /dev/md11a on /mnt11 (ufs) 0xcbaa2000 /dev/md10a on /mnt10 (ufs) 0xcc4fe8c4 /dev/md6a on /mnt6 (ufs) 0xcba90000 /dev/md9a on /mnt9 (ufs) 0xcba908c4 /dev/md12a on /mnt12 (ufs) 0xcbd94bb0 /dev/md16a on /mnt16 (ufs) 0xcba90bb0 /dev/md7a on /mnt7 (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 93823 92809 91633 0 D+ biowr 0xe1b58420 umount 93822 92813 91633 0 R+ umount 93821 92829 91633 0 L+ *Giant 0xcb6b9e00 umount 93820 92815 91633 0 R+ CPU 3 umount 93819 92819 91633 0 D+ biowr 0xe19aeb60 umount 93818 92823 91633 0 D+ bo_wwait 0xcec51814 umount 93815 92807 91633 0 R+ CPU 1 umount 93812 92817 91633 0 D+ biowr 0xe199fe20 umount 93804 92806 91633 0 D+ ufs 0xcbd468a4 find 93803 92830 91633 0 D+ ufs 0xcc4d5cdc find 93801 92826 91633 0 D+ ufs 0xcbd468a4 find 93798 92828 91633 0 D+ ufs 0xcbd468a4 find 93795 92805 91633 0 D+ biowr 0xe1abc0e0 umount 93793 92818 91633 0 D+ ufs 0xcc4d5cdc find 93791 92882 91633 0 D+ ufs 0xcc4d5cdc find 93790 92814 91633 0 D+ ufs 0xcbd468a4 find 93789 92812 91633 0 D+ ufs 0xcbd468a4 find 93788 92824 91633 0 D+ ufs 0xcc4d5cdc find 93787 92832 91633 0 D+ ufs 0xcc4d5cdc find 93786 92808 91633 0 D+ ufs 0xcc4d5cdc find 93779 92811 91633 0 D+ bo_wwait 0xccfe36ac umount 93777 92885 91633 0 RL+ CPU 2 umount 93768 92833 91633 0 D+ biowr 0xe1a4f7c0 umount 93764 92831 91633 0 D+ biowr 0xe19d9c60 umount 93763 92825 91633 0 L+ *Giant 0xcb6b9e00 umount 93754 92822 91633 0 D+ ufs 0xcc4d5cdc find 93746 92887 91633 0 D+ ufs 0xcc4d5cdc find 93742 92827 91633 0 D+ biowr 0xe1995860 mount 93739 92810 91633 0 D+ ufs 0xcc4d5cdc find 93738 92816 91633 0 D+ ufs 0xcc4d5cdc find 93165 834 831 1001 S nanslp 0xc12303a0 sleep 92887 92616 91633 0 S+ wait 0xccb7f000 sh 92885 92616 91633 0 S+ wait 0xcbdaeb40 sh 92882 92616 91633 0 S+ wait 0xcedc45a0 sh 92833 92616 91633 0 S+ wait 0xce7f35a0 sh 92832 92616 91633 0 S+ wait 0xcc6d72d0 sh 92831 92616 91633 0 S+ wait 0xcc27c870 sh 92830 92616 91633 0 S+ wait 0xcc46f5a0 sh 92829 92616 91633 0 S+ wait 0xcc275870 sh 92828 92616 91633 0 S+ wait 0xccbc6000 sh 92827 92616 91633 0 S+ wait 0xcb14d5a0 sh 92826 92616 91633 0 S+ wait 0xd0608870 sh 92825 92616 91633 0 S+ wait 0xcc4c2000 sh 92824 92616 91633 0 S+ wait 0xcc4b8b40 sh 92823 92616 91633 0 S+ wait 0xcbe805a0 sh 92822 92616 91633 0 S+ wait 0xd6370000 sh 92819 92616 91633 0 S+ wait 0xcaec3870 sh 92818 92616 91633 0 S+ wait 0xcf0fa870 sh 92817 92616 91633 0 S+ wait 0xccb7f2d0 sh 92816 92616 91633 0 S+ wait 0xcd838b40 sh 92815 92616 91633 0 S+ wait 0xcd8b55a0 sh 92814 92616 91633 0 S+ wait 0xcdde1000 sh 92813 92616 91633 0 S+ wait 0xcddd8870 sh 92812 92616 91633 0 S+ wait 0xcbe54b40 sh 92811 92616 91633 0 S+ wait 0xcbdfe2d0 sh 92810 92616 91633 0 S+ wait 0xcc282b40 sh 92809 92616 91633 0 S+ wait 0xcbc6eb40 sh 92808 92616 91633 0 S+ wait 0xcc2892d0 sh 92807 92616 91633 0 S+ wait 0xcc439b40 sh 92806 92616 91633 0 S+ wait 0xcbdfeb40 sh 92805 92616 91633 0 S+ wait 0xcc41db40 sh 92801 0 0 0 DL mdwait 0xca861800 [md19] 92789 0 0 0 DL biord 0xe1a88280 [md18] 92777 0 0 0 DL getblk 0xe1a1ab20 [md17] 92765 0 0 0 DL mdwait 0xca869000 [md16] 92753 0 0 0 DL getblk 0xe1a1ab20 [md15] 92741 0 0 0 DL mdwait 0xca8a6000 [md14] 92729 0 0 0 DL biowr 0xe1a1aac0 [md13] 92717 0 0 0 DL biord 0xe1937fc0 [md12] 92705 0 0 0 DL getblk 0xe1a1ab20 [md11] 92693 0 0 0 DL mdwait 0xca863000 [md10] 92681 0 0 0 DL mdwait 0xca8a6800 [md9] 92669 0 0 0 DL getblk 0xe1a1ab20 [md8] 92657 0 0 0 DL biord 0xe1ba3360 [md7] 92645 0 0 0 DL mdwait 0xca866800 [md6] 92633 0 0 0 DL getblk 0xe1a1ab20 [md5] 92616 91633 91633 0 S+ pause 0xcc6ebb98 sh 91633 79462 91633 0 S+ wait 0xcdde35a0 sh 79462 79459 79462 0 S+ wait 0xccbc62d0 bash 79459 79458 79459 0 SW+ pause 0xcae8b5f8 csh 79458 3148 79458 1001 SW+ wait 0xcacb8000 su 3148 3147 3148 1001 SWs+ wait 0xcbe56870 bash 3147 3145 3145 1001 S select 0xcc6463e4 sshd 3145 735 3145 0 Ss select 0xcd8b62e4 sshd 1447 1 1447 0 Ss+ ttyin 0xc80ba270 getty 1446 1 1446 0 Ss+ ttyin 0xc80ba470 getty 1445 1 1445 0 Ss+ ttyin 0xc7f07070 getty 1444 1 1444 0 Ss+ ttyin 0xc7f07270 getty 1443 1 1443 0 Ss+ ttyin 0xc7f07470 getty 1442 1 1442 0 Ss+ ttyin 0xc7f07670 getty 1441 1 1441 0 Ss+ ttyin 0xc7f07870 getty 1440 1 1440 0 Ss+ ttyin 0xc7f07a70 getty 1439 1 1439 0 Ss+ ttyin 0xc7f07c70 getty 1422 1 1422 0 Ss select 0xcaeea064 inetd 1397 1 1397 0 Ss nanslp 0xc12303a0 watchdogd 835 831 831 1001 S piperd 0xcbc114c8 awk 834 831 831 1001 S wait 0xca629b40 sh 833 832 833 1001 Ss kqread 0xca73d580 tail 832 825 825 1001 S select 0xca61fe64 sshd 831 830 831 1001 SWs wait 0xcb156b40 sh 830 824 824 1001 S select 0xca7406e4 sshd 829 828 829 1001 Ss+ select 0xca7e9de4 top 828 822 822 1001 S select 0xca7403e4 sshd 825 735 825 0 Ss select 0xca7e92e4 sshd 824 735 824 0 Ss select 0xca7e97a4 sshd 822 735 822 0 Ss select 0xca7e98e4 sshd 807 804 807 0 S+ ttyin 0xca566270 bash 804 803 804 0 SW+ pause 0xcaeeb5f8 csh 803 798 803 1001 SW+ wait 0xca7e5870 su 798 797 798 1001 SWs+ wait 0xca7e72d0 bash 797 795 795 1001 S select 0xca7404a4 sshd 795 735 795 0 Ss select 0xca7e9ea4 sshd 746 1 746 0 Ss nanslp 0xc12303a0 cron 741 1 741 25 SWs pause 0xcaeeb8c8 sendmail 738 1 738 0 Ss select 0xca7e9824 sendmail 735 1 735 0 Ss select 0xca789c24 sshd 720 685 685 0 S select 0xca7e96a4 winbindd 702 1 702 0 Ss select 0xca7e9724 moused 701 683 683 0 S select 0xca78a124 smbd 685 1 685 0 Ss select 0xca78a0a4 winbindd 683 1 683 0 Ss select 0xca7e9464 smbd 681 1 681 0 Ss select 0xca78a0e4 nmbd 657 1 657 0 Ss select 0xca789764 ntpd 602 596 596 0 S (threaded) nfsd 100119 S rpcsvc 0xca6ee9d0 nfsd: service 100118 S rpcsvc 0xca6ef5d0 nfsd: service 100117 S rpcsvc 0xca6eea10 nfsd: service 100100 S rpcsvc 0xca60ed10 nfsd: master 596 1 596 0 Ss select 0xca7898a4 nfsd 594 590 590 0 S select 0xca7402e4 nfsuserd 593 590 590 0 S select 0xca7897e4 nfsuserd 592 590 590 0 S select 0xca7e9024 nfsuserd 591 590 590 0 S select 0xca7897a4 nfsuserd 590 1 590 0 SWs pause 0xca7865f8 nfsuserd 574 1 574 0 Ds ufs 0xca3d3cdc mountd 541 1 541 0 Ss select 0xca7893e4 rpcbind 526 1 526 0 Ss select 0xca7891a4 syslogd 423 1 423 0 Ss select 0xca789be4 devd 18 0 0 0 DL sdflush 0xc13aa830 [softdepflush] 17 0 0 0 DL syncer 0xc13a6654 [syncer] 16 0 0 0 DL vlruwt 0xca628870 [vnlru] 9 0 0 0 DL psleep 0xc13a63e8 [bufdaemon] 8 0 0 0 DL pgzero 0xc13ab134 [pagezero] 7 0 0 0 DL psleep 0xc13aad00 [vmdaemon] 6 0 0 0 DL psleep 0xc13feb84 [pagedaemon] 5 0 0 0 DL ccb_scan 0xc11fbe24 [xpt_thrd] 4 0 0 0 DL waiting_ 0xc13fa870 [sctp_iterator] 3 0 0 0 DL ctl_work 0xc80bc000 [ctl_thrd] 2 0 0 0 DL - 0xc801423c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8081d34 [usbus5] 100057 D - 0xc8081d04 [usbus5] 100056 D - 0xc8081cd4 [usbus5] 100055 D - 0xc8081ca4 [usbus5] 100053 D - 0xc8074b5c [usbus4] 100052 D - 0xc8074b2c [usbus4] 100051 D - 0xc8074afc [usbus4] 100050 D - 0xc8074acc [usbus4] 100049 D - 0xc806eb5c [usbus3] 100048 D - 0xc806eb2c [usbus3] 100047 D - 0xc806eafc [usbus3] 100046 D - 0xc806eacc [usbus3] 100045 D - 0xc8067b5c [usbus2] 100044 D - 0xc8067b2c [usbus2] 100043 D - 0xc8067afc [usbus2] 100042 D - 0xc8067acc [usbus2] 100040 D - 0xc8062b5c [usbus1] 100039 D - 0xc8062b2c [usbus1] 100038 D - 0xc8062afc [usbus1] 100037 D - 0xc8062acc [usbus1] 100035 D - 0xc8056b5c [usbus0] 100034 D - 0xc8056b2c [usbus0] 100033 D - 0xc8056afc [usbus0] 100032 D - 0xc8056acc [usbus0] 14 0 0 0 DL - 0xc122f2c0 [yarrow] 13 0 0 0 DL (threaded) [geom] 100016 D - 0xc13f6994 [g_down] 100015 D - 0xc13f6990 [g_up] 100014 D - 0xc13f698c [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100023 I [swi5: fast taskq] 100021 I [swi6: Giant taskq] 100020 I [swi6: task queue] 100019 I [swi2: cambio] 100012 I [swi1: netisr 0] 100011 I [swi3: vm] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7ddcb40 [init] 10 0 0 0 DL audit_wo 0xc13fd638 [audit] 0 0 0 0 DLs (threaded) [kernel] 100066 D - 0xc122f2c0 [deadlkres] 100065 D - 0xca33b580 [mca taskq] 100027 D - 0xc7fdf4c0 [acpi_task_2] 100026 D - 0xc7fdf4c0 [acpi_task_1] 100025 D - 0xc7fdf4c0 [acpi_task_0] 100024 D - 0xc7f62280 [kqueue taskq] 100022 D - 0xc7f62300 [thread taskq] 100018 D - 0xc7f623c0 [ffs_trim taskq] 100013 D - 0xc7d7a7c0 [firmware taskq] 100000 D sched 0xc13f6a14 [swapper] db:0:ps> allt Tracing command umount pid 93823 tid 100299 td 0xcb87f5e0 sched_switch(cb87f5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf42a288c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf42a28c0 sleepq_switch(cb87f5e0,0,c1088efd,26d,cb87f5e0,...) at sleepq_switch+0x1b9/frame 0xf42a28f4 sleepq_wait(e1b58420,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf42a2918 _sleep(e1b58420,c7d99074,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf42a2970 bwait(e1b58420,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf42a299c bufwrite(e1b58420,0,c10bb239,826,d042b3c0) at bufwrite+0x240/frame 0xf42a29cc ffs_bufwrite(e1b58420,caf2a000,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf42a29f0 ffs_update(ccd31438,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf42a2a68 ffs_syncvnode(ccd31438,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf42a2ac0 ffs_sync(cba90bb0,1,f42a2b70,50e,cf14a300,...) at ffs_sync+0x23e/frame 0xf42a2b48 dounmount(cba90bb0,8080000,cb87f5e0,493,0,...) at dounmount+0x3d2/frame 0xf42a2b98 sys_unmount(cb87f5e0,f42a2cc8,f42a2d08,1,1,...) at sys_unmount+0x3dd/frame 0xf42a2c40 syscall(f42a2d08) at syscall+0x2ed/frame 0xf42a2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf42a2cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93822 tid 100837 td 0xcd6c9bc0 sched_switch(cd6c9bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a9188c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4a918c0 sleepq_switch(cd6c9bc0,0,c1088efd,26d,cd6c9bc0,...) at sleepq_switch+0x1b9/frame 0xf4a918f4 sleepq_wait(e1a40dc0,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf4a91918 _sleep(e1a40dc0,c7d9909c,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf4a91970 bwait(e1a40dc0,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf4a9199c bufwrite(e1a40dc0,0,c10bb239,826,ce1c9d98) at bufwrite+0x240/frame 0xf4a919cc ffs_bufwrite(e1a40dc0,cc4acc00,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf4a919f0 ffs_update(cca09168,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf4a91a68 ffs_syncvnode(cca09168,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf4a91ac0 ffs_sync(cba90000,1,f4a91b70,50e,cf31e800,...) at ffs_sync+0x23e/frame 0xf4a91b48 dounmount(cba90000,8080000,cd6c9bc0,493,0,...) at dounmount+0x3d2/frame 0xf4a91b98 sys_unmount(cd6c9bc0,f4a91cc8,8,c1083a9c,db,...) at sys_unmount+0x3dd/frame 0xf4a91c40 syscall(f4a91d08) at syscall+0x2ed/frame 0xf4a91cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a91cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93821 tid 100743 td 0xcf3712f0 sched_switch(cf3712f0,0,103,1ae,0,...) at sched_switch+0x4b4/frame 0xf4977814 mi_switch(103,0,c1089ad0,2e6,afcb,...) at mi_switch+0x1c9/frame 0xf4977848 turnstile_wait(cb6b9e00,cb173000,0,c7d82440,c13795c8,...) at turnstile_wait+0x3b4/frame 0xf4977878 __mtx_lock_sleep(c13f7334,cf3712f0,c1084095,c1084095,101,...) at __mtx_lock_sleep+0x28e/frame 0xf49778e4 __mtx_lock_flags(c13f7334,0,c1084095,101,0,...) at __mtx_lock_flags+0xfd/frame 0xf4977918 _sleep(e1b5ef60,c7d997e0,5c,c1091116,0,...) at _sleep+0x3d4/frame 0xf4977970 bwait(e1b5ef60,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf497799c bufwrite(e1b5ef60,0,c10bb239,826,cfd25258) at bufwrite+0x240/frame 0xf49779cc ffs_bufwrite(e1b5ef60,cca61100,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf49779f0 ffs_update(ccc8d5a0,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf4977a68 ffs_syncvnode(ccc8d5a0,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf4977ac0 ffs_sync(cbd94bb0,1,f4977b70,50e,cf14be80,...) at ffs_sync+0x23e/frame 0xf4977b48 dounmount(cbd94bb0,8080000,cf3712f0,493,0,...) at dounmount+0x3d2/frame 0xf4977b98 sys_unmount(cf3712f0,f4977cc8,14,c1085875,7b3,...) at sys_unmount+0x3dd/frame 0xf4977c40 syscall(f4977d08) at syscall+0x2ed/frame 0xf4977cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4977cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93820 tid 100421 td 0xcb6955e0 cpustop_handler(3,13,f4487854,c0ea5e7b,f44877b0,...) at cpustop_handler+0x2f/frame 0xf4487708 ipi_nmi_handler(f44877b0,c0ab780b,0,1,0,...) at ipi_nmi_handler+0x37/frame 0xf4487718 trap(f4487860) at trap+0x3b/frame 0xf4487854 calltrap() at calltrap+0x6/frame 0xf4487854 --- trap 0x13, eip = 0xc0a80220, esp = 0xf44878a0, ebp = 0xf44878f4 --- _mtx_lock_spin_cookie(c124cb88,cb6955e0,0,228,0,...) at _mtx_lock_spin_cookie+0x140/frame 0xf44878f4 __mtx_lock_spin_flags(c124cb88,0,c1089ad0,228,c13f7334,...) at __mtx_lock_spin_flags+0x101/frame 0xf4487924 turnstile_trywait(c13f7324,c7d864d8,c7d7e1a0,c7d864d8,c1376e98,...) at turnstile_trywait+0x43/frame 0xf4487948 __mtx_lock_sleep(c13f7334,cb6955e0,c1084095,c1084095,101,...) at __mtx_lock_sleep+0x1b9/frame 0xf44879b4 __mtx_lock_flags(c13f7334,0,c1084095,101,0,...) at __mtx_lock_flags+0xfd/frame 0xf44879e8 _sleep(cbe2e814,cbe2e7c8,5d,c10913c4,0,...) at _sleep+0x3d4/frame 0xf4487a40 bufobj_wwait(cbe2e7c8,0,0,12b,0,...) at bufobj_wwait+0x6a/frame 0xf4487a68 ffs_syncvnode(cbe2e708,1,0,62d,0,...) at ffs_syncvnode+0x3d5/frame 0xf4487ac0 ffs_sync(cbaa2000,1,f4487b70,50e,cf32e880,...) at ffs_sync+0x23e/frame 0xf4487b48 dounmount(cbaa2000,8080000,cb6955e0,493,0,...) at dounmount+0x3d2/frame 0xf4487b98 sys_unmount(cb6955e0,f4487cc8,7b3,0,f4487cc4,...) at sys_unmount+0x3dd/frame 0xf4487c40 syscall(f4487d08) at syscall+0x2ed/frame 0xf4487cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4487cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93819 tid 100834 td 0xcd6ca5e0 sched_switch(cd6ca5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a8888c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4a888c0 sleepq_switch(cd6ca5e0,0,c1088efd,26d,cd6ca5e0,...) at sleepq_switch+0x1b9/frame 0xf4a888f4 sleepq_wait(e19aeb60,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf4a88918 _sleep(e19aeb60,c7d990c4,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf4a88970 bwait(e19aeb60,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf4a8899c bufwrite(e19aeb60,0,c10bb239,826,cbb8a078) at bufwrite+0x240/frame 0xf4a889cc ffs_bufwrite(e19aeb60,cea7d300,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf4a889f0 ffs_update(cdd22438,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf4a88a68 ffs_syncvnode(cdd22438,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf4a88ac0 ffs_sync(cba908c4,1,f4a88b70,50e,cf31e800,...) at ffs_sync+0x23e/frame 0xf4a88b48 dounmount(cba908c4,8080000,cd6ca5e0,493,0,...) at dounmount+0x3d2/frame 0xf4a88b98 sys_unmount(cd6ca5e0,f4a88cc8,14,c1085875,7b3,...) at sys_unmount+0x3dd/frame 0xf4a88c40 syscall(f4a88d08) at syscall+0x2ed/frame 0xf4a88cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a88cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93818 tid 100802 td 0xce2b5000 sched_switch(ce2b5000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a2895c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4a28990 sleepq_switch(ce2b5000,0,c1088efd,26d,ce2b5000,...) at sleepq_switch+0x1b9/frame 0xf4a289c4 sleepq_wait(cec51814,5d,c10913c4,0,0,...) at sleepq_wait+0x48/frame 0xf4a289e8 _sleep(cec51814,cec517c8,5d,c10913c4,0,...) at _sleep+0x34e/frame 0xf4a28a40 bufobj_wwait(cec517c8,0,0,12b,0,...) at bufobj_wwait+0x6a/frame 0xf4a28a68 ffs_syncvnode(cec51708,1,0,62d,0,...) at ffs_syncvnode+0x3d5/frame 0xf4a28ac0 ffs_sync(cbd95bb0,1,f4a28b70,50e,cf14bd00,...) at ffs_sync+0x23e/frame 0xf4a28b48 dounmount(cbd95bb0,8080000,ce2b5000,493,0,...) at dounmount+0x3d2/frame 0xf4a28b98 sys_unmount(ce2b5000,f4a28cc8,c10da553,d6,1,...) at sys_unmount+0x3dd/frame 0xf4a28c40 syscall(f4a28d08) at syscall+0x2ed/frame 0xf4a28cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a28cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93815 tid 100675 td 0xcaca12f0 cpustop_handler(1,13,f48ab864,c0ea5e7b,d2e02bcc,...) at cpustop_handler+0x2f/frame 0xf48ab718 ipi_nmi_handler(d2e02bcc,4af,691ac8,ffffff,afcb,...) at ipi_nmi_handler+0x37/frame 0xf48ab728 trap(f48ab870) at trap+0x3b/frame 0xf48ab864 calltrap() at calltrap+0x6/frame 0xf48ab864 --- trap 0x13, eip = 0xc0a806b7, esp = 0xf48ab8b0, ebp = 0xf48ab918 --- thread_lock_flags_(caca12f0,0,c1089ad0,2db,afcb,...) at thread_lock_flags_+0xa7/frame 0xf48ab918 turnstile_wait(cb6b9e00,cb173000,0,c7d864d8,c1374fa8,...) at turnstile_wait+0x2db/frame 0xf48ab948 __mtx_lock_sleep(c13f7334,caca12f0,c1084095,c1084095,101,...) at __mtx_lock_sleep+0x28e/frame 0xf48ab9b4 __mtx_lock_flags(c13f7334,0,c1084095,101,0,...) at __mtx_lock_flags+0xfd/frame 0xf48ab9e8 _sleep(cd6ea814,cd6ea7c8,5d,c10913c4,0,...) at _sleep+0x3d4/frame 0xf48aba40 bufobj_wwait(cd6ea7c8,0,0,12b,0,...) at bufobj_wwait+0x6a/frame 0xf48aba68 ffs_syncvnode(cd6ea708,1,0,62d,0,...) at ffs_syncvnode+0x3d5/frame 0xf48abac0 ffs_sync(cc4fe8c4,1,f48abb70,50e,cf14bc00,...) at ffs_sync+0x23e/frame 0xf48abb48 dounmount(cc4fe8c4,8080000,caca12f0,493,0,...) at dounmount+0x3d2/frame 0xf48abb98 sys_unmount(caca12f0,f48abcc8,7b3,0,f48abcc4,...) at sys_unmount+0x3dd/frame 0xf48abc40 syscall(f48abd08) at syscall+0x2ed/frame 0xf48abcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf48abcfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93812 tid 100528 td 0xcb6ad000 sched_switch(cb6ad000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf461888c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf46188c0 sleepq_switch(cb6ad000,0,c1088efd,26d,cb6ad000,...) at sleepq_switch+0x1b9/frame 0xf46188f4 sleepq_wait(e199fe20,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf4618918 _sleep(e199fe20,c7d991b4,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf4618970 bwait(e199fe20,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf461899c bufwrite(e199fe20,0,c10bb239,826,cab65258) at bufwrite+0x240/frame 0xf46189cc ffs_bufwrite(e199fe20,ceaa8b00,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf46189f0 ffs_update(cf693708,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf4618a68 ffs_syncvnode(cf693708,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf4618ac0 ffs_sync(ce19f8c4,1,f4618b70,50e,cf14bb00,...) at ffs_sync+0x23e/frame 0xf4618b48 dounmount(ce19f8c4,8080000,cb6ad000,493,0,...) at dounmount+0x3d2/frame 0xf4618b98 sys_unmount(cb6ad000,f4618cc8,f4618d08,1,1,...) at sys_unmount+0x3dd/frame 0xf4618c40 syscall(f4618d08) at syscall+0x2ed/frame 0xf4618cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4618cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command find pid 93804 tid 100500 td 0xcdab32f0 sched_switch(cdab32f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf45c4660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf45c4694 sleepq_switch(cdab32f0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf45c46c8 sleepq_wait(cbd468a4,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf45c46ec sleeplk(cbd46910,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf45c4728 __lockmgr_args(cbd468a4,200100,cbd46910,0,0,...) at __lockmgr_args+0x612/frame 0xf45c4808 ffs_lock(f45c4890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf45c4848 VOP_LOCK1_APV(c11e1340,f45c4890,0,f45c4904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf45c4878 _vn_lock(cbd46870,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf45c48b8 vget(cbd46870,200100,cdab32f0,29d,c11f3010,...) at vget+0x77/frame 0xf45c48f0 cache_lookup(ca3d3ca8,f45c4b5c,f45c4b70,0,0,...) at cache_lookup+0x5a8/frame 0xf45c4950 vfs_cache_lookup(f45c4a00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf45c4998 VOP_LOOKUP_APV(c11e1340,f45c4a00,f45c4b70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf45c49c8 lookup(f45c4b30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf45c4a28 namei(f45c4b30,ffffffdf,cd616600,0,cdab32f0,...) at namei+0x47d/frame 0xf45c4ab0 kern_statat_vnhook(cdab32f0,200,ffffff9c,28804538,0,...) at kern_statat_vnhook+0xbd/frame 0xf45c4bb0 sys_lstat(cdab32f0,f45c4cc8,7b3,0,f45c4cc4,...) at sys_lstat+0x4d/frame 0xf45c4c40 syscall(f45c4d08) at syscall+0x2ed/frame 0xf45c4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45c4cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93803 tid 100422 td 0xcb6952f0 sched_switch(cb6952f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf448b660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf448b694 sleepq_switch(cb6952f0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf448b6c8 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf448b6ec sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf448b728 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf448b808 ffs_lock(f448b890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf448b848 VOP_LOCK1_APV(c11e1340,f448b890,0,f448b904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf448b878 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf448b8b8 vget(cc4d5ca8,200100,cb6952f0,29d,c11f3010,...) at vget+0x77/frame 0xf448b8f0 cache_lookup(ca3d3ca8,f448bb5c,f448bb70,0,0,...) at cache_lookup+0x5a8/frame 0xf448b950 vfs_cache_lookup(f448ba00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf448b998 VOP_LOOKUP_APV(c11e1340,f448ba00,f448bb70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf448b9c8 lookup(f448bb30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf448ba28 namei(f448bb30,ffffffdf,cd616600,0,cb6952f0,...) at namei+0x47d/frame 0xf448bab0 kern_statat_vnhook(cb6952f0,200,ffffff9c,28804778,0,...) at kern_statat_vnhook+0xbd/frame 0xf448bbb0 sys_lstat(cb6952f0,f448bcc8,f448bc8c,c0a64f80,c123c590,...) at sys_lstat+0x4d/frame 0xf448bc40 syscall(f448bd08) at syscall+0x2ed/frame 0xf448bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf448bcfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93801 tid 100289 td 0xcb98a2f0 sched_switch(cb98a2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4284660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4284694 sleepq_switch(cb98a2f0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf42846c8 sleepq_wait(cbd468a4,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf42846ec sleeplk(cbd46910,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf4284728 __lockmgr_args(cbd468a4,200100,cbd46910,0,0,...) at __lockmgr_args+0x612/frame 0xf4284808 ffs_lock(f4284890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf4284848 VOP_LOCK1_APV(c11e1340,f4284890,0,f4284904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf4284878 _vn_lock(cbd46870,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf42848b8 vget(cbd46870,200100,cb98a2f0,29d,c11f3010,...) at vget+0x77/frame 0xf42848f0 cache_lookup(ca3d3ca8,f4284b5c,f4284b70,0,0,...) at cache_lookup+0x5a8/frame 0xf4284950 vfs_cache_lookup(f4284a00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf4284998 VOP_LOOKUP_APV(c11e1340,f4284a00,f4284b70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf42849c8 lookup(f4284b30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf4284a28 namei(f4284b30,ffffffdf,cd616600,0,cb98a2f0,...) at namei+0x47d/frame 0xf4284ab0 kern_statat_vnhook(cb98a2f0,200,ffffff9c,28804538,0,...) at kern_statat_vnhook+0xbd/frame 0xf4284bb0 sys_lstat(cb98a2f0,f4284cc8,7b3,0,f4284cc4,...) at sys_lstat+0x4d/frame 0xf4284c40 syscall(f4284d08) at syscall+0x2ed/frame 0xf4284cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4284cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93798 tid 100204 td 0xcbdedbc0 sched_switch(cbdedbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf416e660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf416e694 sleepq_switch(cbdedbc0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf416e6c8 sleepq_wait(cbd468a4,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf416e6ec sleeplk(cbd46910,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf416e728 __lockmgr_args(cbd468a4,200100,cbd46910,0,0,...) at __lockmgr_args+0x612/frame 0xf416e808 ffs_lock(f416e890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf416e848 VOP_LOCK1_APV(c11e1340,f416e890,0,f416e904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf416e878 _vn_lock(cbd46870,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf416e8b8 vget(cbd46870,200100,cbdedbc0,29d,c11f3010,...) at vget+0x77/frame 0xf416e8f0 cache_lookup(ca3d3ca8,f416eb5c,f416eb70,0,0,...) at cache_lookup+0x5a8/frame 0xf416e950 vfs_cache_lookup(f416ea00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf416e998 VOP_LOOKUP_APV(c11e1340,f416ea00,f416eb70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf416e9c8 lookup(f416eb30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf416ea28 namei(f416eb30,ffffffdf,cd616600,0,cbdedbc0,...) at namei+0x47d/frame 0xf416eab0 kern_statat_vnhook(cbdedbc0,200,ffffff9c,28804538,0,...) at kern_statat_vnhook+0xbd/frame 0xf416ebb0 sys_lstat(cbdedbc0,f416ecc8,7b3,0,f416ecc4,...) at sys_lstat+0x4d/frame 0xf416ec40 syscall(f416ed08) at syscall+0x2ed/frame 0xf416ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf416ecfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command umount pid 93795 tid 100194 td 0xcbc505e0 sched_switch(cbc505e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf414e88c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf414e8c0 sleepq_switch(cbc505e0,0,c1088efd,26d,cbc505e0,...) at sleepq_switch+0x1b9/frame 0xf414e8f4 sleepq_wait(e1abc0e0,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf414e918 _sleep(e1abc0e0,c7d99984,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf414e970 bwait(e1abc0e0,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf414e99c bufwrite(e1abc0e0,0,c10bb239,826,ccd43d20) at bufwrite+0x240/frame 0xf414e9cc ffs_bufwrite(e1abc0e0,d04fcd00,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf414e9f0 ffs_update(cca99168,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf414ea68 ffs_syncvnode(cca99168,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf414eac0 ffs_sync(cba902ec,1,f414eb70,50e,cf31e780,...) at ffs_sync+0x23e/frame 0xf414eb48 dounmount(cba902ec,8080000,cbc505e0,493,0,...) at dounmount+0x3d2/frame 0xf414eb98 sys_unmount(cbc505e0,f414ecc8,c10da553,d6,1,...) at sys_unmount+0x3dd/frame 0xf414ec40 syscall(f414ed08) at syscall+0x2ed/frame 0xf414ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf414ecfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command find pid 93793 tid 100511 td 0xcd381000 sched_switch(cd381000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf45e5660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf45e5694 sleepq_switch(cd381000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf45e56c8 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf45e56ec sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf45e5728 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf45e5808 ffs_lock(f45e5890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf45e5848 VOP_LOCK1_APV(c11e1340,f45e5890,0,f45e5904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf45e5878 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf45e58b8 vget(cc4d5ca8,200100,cd381000,29d,c11f3010,...) at vget+0x77/frame 0xf45e58f0 cache_lookup(ca3d3ca8,f45e5b5c,f45e5b70,0,0,...) at cache_lookup+0x5a8/frame 0xf45e5950 vfs_cache_lookup(f45e5a00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf45e5998 VOP_LOOKUP_APV(c11e1340,f45e5a00,f45e5b70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf45e59c8 lookup(f45e5b30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf45e5a28 namei(f45e5b30,ffffffdf,cd616600,0,cd381000,...) at namei+0x47d/frame 0xf45e5ab0 kern_statat_vnhook(cd381000,200,ffffff9c,28804778,0,...) at kern_statat_vnhook+0xbd/frame 0xf45e5bb0 sys_lstat(cd381000,f45e5cc8,f45e5d08,1,1,...) at sys_lstat+0x4d/frame 0xf45e5c40 syscall(f45e5d08) at syscall+0x2ed/frame 0xf45e5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45e5cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93791 tid 100325 td 0xcd8c6bc0 sched_switch(cd8c6bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf432b660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf432b694 sleepq_switch(cd8c6bc0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf432b6c8 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf432b6ec sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf432b728 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf432b808 ffs_lock(f432b890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf432b848 VOP_LOCK1_APV(c11e1340,f432b890,0,f432b904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf432b878 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf432b8b8 vget(cc4d5ca8,200100,cd8c6bc0,29d,c11f3010,...) at vget+0x77/frame 0xf432b8f0 cache_lookup(ca3d3ca8,f432bb5c,f432bb70,0,0,...) at cache_lookup+0x5a8/frame 0xf432b950 vfs_cache_lookup(f432ba00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf432b998 VOP_LOOKUP_APV(c11e1340,f432ba00,f432bb70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf432b9c8 lookup(f432bb30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf432ba28 namei(f432bb30,ffffffdf,cd616600,0,cd8c6bc0,...) at namei+0x47d/frame 0xf432bab0 kern_statat_vnhook(cd8c6bc0,200,ffffff9c,28804778,0,...) at kern_statat_vnhook+0xbd/frame 0xf432bbb0 sys_lstat(cd8c6bc0,f432bcc8,8,c1083a9c,db,...) at sys_lstat+0x4d/frame 0xf432bc40 syscall(f432bd08) at syscall+0x2ed/frame 0xf432bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf432bcfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93790 tid 100566 td 0xcdc48000 sched_switch(cdc48000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf471d660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf471d694 sleepq_switch(cdc48000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf471d6c8 sleepq_wait(cbd468a4,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf471d6ec sleeplk(cbd46910,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf471d728 __lockmgr_args(cbd468a4,200100,cbd46910,0,0,...) at __lockmgr_args+0x612/frame 0xf471d808 ffs_lock(f471d890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf471d848 VOP_LOCK1_APV(c11e1340,f471d890,0,f471d904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf471d878 _vn_lock(cbd46870,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf471d8b8 vget(cbd46870,200100,cdc48000,29d,c11f3010,...) at vget+0x77/frame 0xf471d8f0 cache_lookup(ca3d3ca8,f471db5c,f471db70,0,0,...) at cache_lookup+0x5a8/frame 0xf471d950 vfs_cache_lookup(f471da00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf471d998 VOP_LOOKUP_APV(c11e1340,f471da00,f471db70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf471d9c8 lookup(f471db30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf471da28 namei(f471db30,ffffffdf,cd616600,0,cdc48000,...) at namei+0x47d/frame 0xf471dab0 kern_statat_vnhook(cdc48000,200,ffffff9c,28804538,0,...) at kern_statat_vnhook+0xbd/frame 0xf471dbb0 sys_lstat(cdc48000,f471dcc8,f471dd08,1,1,...) at sys_lstat+0x4d/frame 0xf471dc40 syscall(f471dd08) at syscall+0x2ed/frame 0xf471dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf471dcfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93789 tid 100314 td 0xcd8cbbc0 sched_switch(cd8cbbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf430a660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf430a694 sleepq_switch(cd8cbbc0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf430a6c8 sleepq_wait(cbd468a4,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf430a6ec sleeplk(cbd46910,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf430a728 __lockmgr_args(cbd468a4,200100,cbd46910,0,0,...) at __lockmgr_args+0x612/frame 0xf430a808 ffs_lock(f430a890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf430a848 VOP_LOCK1_APV(c11e1340,f430a890,0,f430a904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf430a878 _vn_lock(cbd46870,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf430a8b8 vget(cbd46870,200100,cd8cbbc0,29d,c11f3010,...) at vget+0x77/frame 0xf430a8f0 cache_lookup(ca3d3ca8,f430ab5c,f430ab70,0,0,...) at cache_lookup+0x5a8/frame 0xf430a950 vfs_cache_lookup(f430aa00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf430a998 VOP_LOOKUP_APV(c11e1340,f430aa00,f430ab70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf430a9c8 lookup(f430ab30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf430aa28 namei(f430ab30,ffffffdf,cd616600,0,cd8cbbc0,...) at namei+0x47d/frame 0xf430aab0 kern_statat_vnhook(cd8cbbc0,200,ffffff9c,28804538,0,...) at kern_statat_vnhook+0xbd/frame 0xf430abb0 sys_lstat(cd8cbbc0,f430acc8,14,c1085875,7b3,...) at sys_lstat+0x4d/frame 0xf430ac40 syscall(f430ad08) at syscall+0x2ed/frame 0xf430acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf430acfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93788 tid 100510 td 0xcd3812f0 sched_switch(cd3812f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf45e2660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf45e2694 sleepq_switch(cd3812f0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf45e26c8 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf45e26ec sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf45e2728 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf45e2808 ffs_lock(f45e2890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf45e2848 VOP_LOCK1_APV(c11e1340,f45e2890,0,f45e2904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf45e2878 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf45e28b8 vget(cc4d5ca8,200100,cd3812f0,29d,c11f3010,...) at vget+0x77/frame 0xf45e28f0 cache_lookup(ca3d3ca8,f45e2b5c,f45e2b70,0,0,...) at cache_lookup+0x5a8/frame 0xf45e2950 vfs_cache_lookup(f45e2a00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf45e2998 VOP_LOOKUP_APV(c11e1340,f45e2a00,f45e2b70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf45e29c8 lookup(f45e2b30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf45e2a28 namei(f45e2b30,ffffffdf,cd616600,0,cd3812f0,...) at namei+0x47d/frame 0xf45e2ab0 kern_statat_vnhook(cd3812f0,200,ffffff9c,28804778,0,...) at kern_statat_vnhook+0xbd/frame 0xf45e2bb0 sys_lstat(cd3812f0,f45e2cc8,7b3,0,f45e2cc4,...) at sys_lstat+0x4d/frame 0xf45e2c40 syscall(f45e2d08) at syscall+0x2ed/frame 0xf45e2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45e2cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93787 tid 100804 td 0xce2b38d0 sched_switch(ce2b38d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a2e660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4a2e694 sleepq_switch(ce2b38d0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf4a2e6c8 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf4a2e6ec sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf4a2e728 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf4a2e808 ffs_lock(f4a2e890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf4a2e848 VOP_LOCK1_APV(c11e1340,f4a2e890,0,f4a2e904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf4a2e878 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf4a2e8b8 vget(cc4d5ca8,200100,ce2b38d0,29d,c11f3010,...) at vget+0x77/frame 0xf4a2e8f0 cache_lookup(ca3d3ca8,f4a2eb5c,f4a2eb70,0,0,...) at cache_lookup+0x5a8/frame 0xf4a2e950 vfs_cache_lookup(f4a2ea00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf4a2e998 VOP_LOOKUP_APV(c11e1340,f4a2ea00,f4a2eb70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf4a2e9c8 lookup(f4a2eb30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf4a2ea28 namei(f4a2eb30,ffffffdf,cd616600,0,ce2b38d0,...) at namei+0x47d/frame 0xf4a2eab0 kern_statat_vnhook(ce2b38d0,200,ffffff9c,28804778,0,...) at kern_statat_vnhook+0xbd/frame 0xf4a2ebb0 sys_lstat(ce2b38d0,f4a2ecc8,f4a2ed08,1,1,...) at sys_lstat+0x4d/frame 0xf4a2ec40 syscall(f4a2ed08) at syscall+0x2ed/frame 0xf4a2ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a2ecfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command find pid 93786 tid 100532 td 0xcb8468d0 sched_switch(cb8468d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4624660 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4624694 sleepq_switch(cb8468d0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf46246c8 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf46246ec sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf4624728 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf4624808 ffs_lock(f4624890,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf4624848 VOP_LOCK1_APV(c11e1340,f4624890,0,f4624904,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf4624878 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf46248b8 vget(cc4d5ca8,200100,cb8468d0,29d,c11f3010,...) at vget+0x77/frame 0xf46248f0 cache_lookup(ca3d3ca8,f4624b5c,f4624b70,0,0,...) at cache_lookup+0x5a8/frame 0xf4624950 vfs_cache_lookup(f4624a00,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf4624998 VOP_LOOKUP_APV(c11e1340,f4624a00,f4624b70,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf46249c8 lookup(f4624b30,c1092d47,106,ce,0,...) at lookup+0x52e/frame 0xf4624a28 namei(f4624b30,ffffffdf,cd616600,0,cb8468d0,...) at namei+0x47d/frame 0xf4624ab0 kern_statat_vnhook(cb8468d0,200,ffffff9c,28804778,0,...) at kern_statat_vnhook+0xbd/frame 0xf4624bb0 sys_lstat(cb8468d0,f4624cc8,14,c1085875,7b3,...) at sys_lstat+0x4d/frame 0xf4624c40 syscall(f4624d08) at syscall+0x2ed/frame 0xf4624cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4624cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x2817bee3, esp = 0xbfbfd6b4, ebp = 0xbfbfd73c --- Tracing command umount pid 93779 tid 100572 td 0xcb842000 sched_switch(cb842000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf477695c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4776990 sleepq_switch(cb842000,0,c1088efd,26d,cb842000,...) at sleepq_switch+0x1b9/frame 0xf47769c4 sleepq_wait(ccfe36ac,5d,c10913c4,0,0,...) at sleepq_wait+0x48/frame 0xf47769e8 _sleep(ccfe36ac,ccfe3660,5d,c10913c4,0,...) at _sleep+0x34e/frame 0xf4776a40 bufobj_wwait(ccfe3660,0,0,12b,0,...) at bufobj_wwait+0x6a/frame 0xf4776a68 ffs_syncvnode(ccfe35a0,1,0,62d,0,...) at ffs_syncvnode+0x3d5/frame 0xf4776ac0 ffs_sync(cbd958c4,1,f4776b70,50e,cf2fe080,...) at ffs_sync+0x23e/frame 0xf4776b48 dounmount(cbd958c4,8080000,cb842000,493,0,...) at dounmount+0x3d2/frame 0xf4776b98 sys_unmount(cb842000,f4776cc8,c10da553,d6,f4776cc4,...) at sys_unmount+0x3dd/frame 0xf4776c40 syscall(f4776d08) at syscall+0x2ed/frame 0xf4776cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4776cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93777 tid 100227 td 0xcb173000 kdb_enter(c10833b1,c10833b1,c10b7736,f41bc8a0,280,...) at kdb_enter+0x3d/frame 0xf41bc848 vpanic(f41bc8a0,f41bc90c,c0cbc31e,c10b7736,ca720778,...) at vpanic+0x142/frame 0xf41bc888 panic(c10b7736,ca720778,280,0,ce1d50d4,...) at panic+0x12/frame 0xf41bc894 ffs_blkfree_cg(cceb0e10,280,0,1000,6,...) at ffs_blkfree_cg+0x72e/frame 0xf41bc90c ffs_blkfree(ca727b00,ce1d5000,cceb0e10,280,0,...) at ffs_blkfree+0xa5/frame 0xf41bc948 freework_freeblock(c13aa7cc,0,c10b860e,1dd4,c109529c,...) at freework_freeblock+0x667/frame 0xf41bc9b0 handle_workitem_freeblocks(0,f41bca40,2,6da,ca727b00,...) at handle_workitem_freeblocks+0x197/frame 0xf41bca00 process_worklist_item(1,0,c10b860e,609,512f389a,...) at process_worklist_item+0x29d/frame 0xf41bca54 softdep_process_worklist(ce19fbb0,1,ce19fbb0,f41bcb18,f41bcac0,...) at softdep_process_worklist+0x7c/frame 0xf41bca80 softdep_flushworklist(ce19fbb0,f41bcb14,cb173000,62d,0,...) at softdep_flushworklist+0x43/frame 0xf41bcac0 ffs_sync(ce19fbb0,1,f41bcb70,50e,cf2fe080,...) at ffs_sync+0x2e5/frame 0xf41bcb48 dounmount(ce19fbb0,8080000,cb173000,493,0,...) at dounmount+0x3d2/frame 0xf41bcb98 sys_unmount(cb173000,f41bccc8,c10da553,d6,1,...) at sys_unmount+0x3dd/frame 0xf41bcc40 syscall(f41bcd08) at syscall+0x2ed/frame 0xf41bccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf41bccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93768 tid 100277 td 0xcbe662f0 sched_switch(cbe662f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf425d88c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf425d8c0 sleepq_switch(cbe662f0,0,c1088efd,26d,cbe662f0,...) at sleepq_switch+0x1b9/frame 0xf425d8f4 sleepq_wait(e1a4f7c0,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf425d918 _sleep(e1a4f7c0,c7d997a4,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf425d970 bwait(e1a4f7c0,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf425d99c bufwrite(e1a4f7c0,0,c10bb239,826,cb348e88) at bufwrite+0x240/frame 0xf425d9cc ffs_bufwrite(e1a4f7c0,cbb42d00,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf425d9f0 ffs_update(cd142438,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf425da68 ffs_syncvnode(cd142438,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf425dac0 ffs_sync(ce1a02ec,1,f425db70,50e,cf2e2480,...) at ffs_sync+0x23e/frame 0xf425db48 dounmount(ce1a02ec,8080000,cbe662f0,493,0,...) at dounmount+0x3d2/frame 0xf425db98 sys_unmount(cbe662f0,f425dcc8,f425dd08,1,1,...) at sys_unmount+0x3dd/frame 0xf425dc40 syscall(f425dd08) at syscall+0x2ed/frame 0xf425dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf425dcfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93764 tid 100817 td 0xce2a8000 sched_switch(ce2a8000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a5588c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4a558c0 sleepq_switch(ce2a8000,0,c1088efd,26d,ce2a8000,...) at sleepq_switch+0x1b9/frame 0xf4a558f4 sleepq_wait(e19d9c60,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf4a55918 _sleep(e19d9c60,c7d993e4,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf4a55970 bwait(e19d9c60,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf4a5599c bufwrite(e19d9c60,0,c10bb239,826,cf770780) at bufwrite+0x240/frame 0xf4a559cc ffs_bufwrite(e19d9c60,cc7dd600,100,8000,0,...) at ffs_bufwrite+0x13b/frame 0xf4a559f0 ffs_update(d035d870,1,c10bb9b0,152,0,...) at ffs_update+0x328/frame 0xf4a55a68 ffs_syncvnode(d035d870,1,0,62d,0,...) at ffs_syncvnode+0x4ec/frame 0xf4a55ac0 ffs_sync(cbd942ec,1,f4a55b70,50e,cf30ba80,...) at ffs_sync+0x23e/frame 0xf4a55b48 dounmount(cbd942ec,8080000,ce2a8000,493,0,...) at dounmount+0x3d2/frame 0xf4a55b98 sys_unmount(ce2a8000,f4a55cc8,14,c1085875,7b3,...) at sys_unmount+0x3dd/frame 0xf4a55c40 syscall(f4a55d08) at syscall+0x2ed/frame 0xf4a55cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a55cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command umount pid 93763 tid 100611 td 0xcab138d0 sched_switch(cab138d0,0,103,1ae,0,...) at sched_switch+0x4b4/frame 0xf47eb8e4 mi_switch(103,0,c1089ad0,2e6,afcb,...) at mi_switch+0x1c9/frame 0xf47eb918 turnstile_wait(cb6b9e00,cb173000,0,c7d864d8,c1378cd8,...) at turnstile_wait+0x3b4/frame 0xf47eb948 __mtx_lock_sleep(c13f7334,cab138d0,c1084095,c1084095,101,...) at __mtx_lock_sleep+0x28e/frame 0xf47eb9b4 __mtx_lock_flags(c13f7334,0,c1084095,101,0,...) at __mtx_lock_flags+0xfd/frame 0xf47eb9e8 _sleep(cd4e5814,cd4e57c8,5d,c10913c4,0,...) at _sleep+0x3d4/frame 0xf47eba40 bufobj_wwait(cd4e57c8,0,0,12b,0,...) at bufobj_wwait+0x6a/frame 0xf47eba68 ffs_syncvnode(cd4e5708,1,0,62d,0,...) at ffs_syncvnode+0x3d5/frame 0xf47ebac0 ffs_sync(ca70c2ec,1,f47ebb70,50e,cf14b900,...) at ffs_sync+0x23e/frame 0xf47ebb48 dounmount(ca70c2ec,8080000,cab138d0,493,0,...) at dounmount+0x3d2/frame 0xf47ebb98 sys_unmount(cab138d0,f47ebcc8,7b3,0,f47ebcc4,...) at sys_unmount+0x3dd/frame 0xf47ebc40 syscall(f47ebd08) at syscall+0x2ed/frame 0xf47ebcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf47ebcfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d67, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command find pid 93754 tid 100655 td 0xcf16d000 sched_switch(cf16d000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf486f620 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf486f654 sleepq_switch(cf16d000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf486f688 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf486f6ac sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf486f6e8 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf486f7c8 ffs_lock(f486f850,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf486f808 VOP_LOCK1_APV(c11e1340,f486f850,0,f486f8c4,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf486f838 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf486f878 vget(cc4d5ca8,200100,cf16d000,29d,c11f3010,...) at vget+0x77/frame 0xf486f8b0 cache_lookup(ca3d3ca8,f486fbb4,f486fbc8,0,0,...) at cache_lookup+0x5a8/frame 0xf486f910 vfs_cache_lookup(f486f9c0,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf486f958 VOP_LOOKUP_APV(c11e1340,f486f9c0,f486fbc8,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf486f988 lookup(f486fb88,c1092d47,106,ce,c1085875,...) at lookup+0x52e/frame 0xf486f9e8 namei(f486fb88,cb252cdc,cb252cdc,c10929af,f486fab0,...) at namei+0x47d/frame 0xf486fa70 vn_open_cred(f486fb88,f486fbfc,4c0,0,cd616600,ca7a25e8) at vn_open_cred+0x24d/frame 0xf486fb40 vn_open(f486fb88,f486fbfc,4c0,ca7a25e8,cb252d58,...) at vn_open+0x3b/frame 0xf486fb60 kern_openat(cf16d000,ffffff9c,2887b100,0,120004,288046c0) at kern_openat+0x1e4/frame 0xf486fc20 sys_open(cf16d000,f486fcc8,f486fd08,1,1,...) at sys_open+0x38/frame 0xf486fc40 syscall(f486fd08) at syscall+0x2ed/frame 0xf486fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf486fcfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28185197, esp = 0xbfbfd6c8, ebp = 0xbfbfd6e0 --- Tracing command find pid 93746 tid 100698 td 0xcddee000 sched_switch(cddee000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf48f0620 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf48f0654 sleepq_switch(cddee000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf48f0688 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf48f06ac sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf48f06e8 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf48f07c8 ffs_lock(f48f0850,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf48f0808 VOP_LOCK1_APV(c11e1340,f48f0850,0,f48f08c4,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf48f0838 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf48f0878 vget(cc4d5ca8,200100,cddee000,29d,c11f3010,...) at vget+0x77/frame 0xf48f08b0 cache_lookup(ca3d3ca8,f48f0bb4,f48f0bc8,0,0,...) at cache_lookup+0x5a8/frame 0xf48f0910 vfs_cache_lookup(f48f09c0,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf48f0958 VOP_LOOKUP_APV(c11e1340,f48f09c0,f48f0bc8,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf48f0988 lookup(f48f0b88,c1092d47,106,ce,281b1000,...) at lookup+0x52e/frame 0xf48f09e8 namei(f48f0b88,cb252cdc,cb252cdc,c10929af,f48f0ab0,...) at namei+0x47d/frame 0xf48f0a70 vn_open_cred(f48f0b88,f48f0bfc,4c0,0,cd616600,cf841118) at vn_open_cred+0x24d/frame 0xf48f0b40 vn_open(f48f0b88,f48f0bfc,4c0,cf841118,cb252d58,...) at vn_open+0x3b/frame 0xf48f0b60 kern_openat(cddee000,ffffff9c,2887b100,0,120004,288046c0) at kern_openat+0x1e4/frame 0xf48f0c20 sys_open(cddee000,f48f0cc8,7b3,0,f48f0cc4,...) at sys_open+0x38/frame 0xf48f0c40 syscall(f48f0d08) at syscall+0x2ed/frame 0xf48f0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf48f0cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28185197, esp = 0xbfbfd6c8, ebp = 0xbfbfd6e0 --- Tracing command mount pid 93742 tid 100808 td 0xce2adbc0 sched_switch(ce2adbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a3a75c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4a3a790 sleepq_switch(ce2adbc0,0,c1088efd,26d,ce2adbc0,...) at sleepq_switch+0x1b9/frame 0xf4a3a7c4 sleepq_wait(e1995860,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf4a3a7e8 _sleep(e1995860,c7d9977c,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf4a3a840 bwait(e1995860,5c,c1091116,f64,c1090c8e,...) at bwait+0x7f/frame 0xf4a3a86c bufwrite(e1995860,0,c10bb239,826,e1995860) at bufwrite+0x240/frame 0xf4a3a89c ffs_bufwrite(e1995860,e2268000,1000,1000,0,...) at ffs_bufwrite+0x13b/frame 0xf4a3a8c0 ffs_sbupdate(cab09400,1,0,cd616600,0,...) at ffs_sbupdate+0x3eb/frame 0xf4a3a908 ffs_mount(cbd948c4,c11e1048,cf14b800,cd616600,f4a3aab0,...) at ffs_mount+0x235e/frame 0xf4a3aa50 vfs_donmount(ce2adbc0,0,0,ca71a180,ca71a180,...) at vfs_donmount+0xd33/frame 0xf4a3ac18 sys_nmount(ce2adbc0,f4a3acc8,f4a3ad08,1,1,...) at sys_nmount+0x78/frame 0xf4a3ac40 syscall(f4a3ad08) at syscall+0x2ed/frame 0xf4a3acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a3acfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280d3367, esp = 0xbfbfc8d8, ebp = 0xbfbfce30 --- Tracing command find pid 93739 tid 100586 td 0xce7febc0 sched_switch(ce7febc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf47a0620 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf47a0654 sleepq_switch(ce7febc0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf47a0688 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf47a06ac sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf47a06e8 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf47a07c8 ffs_lock(f47a0850,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf47a0808 VOP_LOCK1_APV(c11e1340,f47a0850,0,f47a08c4,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf47a0838 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf47a0878 vget(cc4d5ca8,200100,ce7febc0,29d,c11f3010,...) at vget+0x77/frame 0xf47a08b0 cache_lookup(ca3d3ca8,f47a0bb4,f47a0bc8,0,0,...) at cache_lookup+0x5a8/frame 0xf47a0910 vfs_cache_lookup(f47a09c0,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf47a0958 VOP_LOOKUP_APV(c11e1340,f47a09c0,f47a0bc8,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf47a0988 lookup(f47a0b88,c1092d47,106,ce,ccfe3910,...) at lookup+0x52e/frame 0xf47a09e8 namei(f47a0b88,cb252cdc,cb252cdc,c10929af,f47a0ab0,...) at namei+0x47d/frame 0xf47a0a70 vn_open_cred(f47a0b88,f47a0bfc,4c0,0,cd616600,cbc49150) at vn_open_cred+0x24d/frame 0xf47a0b40 vn_open(f47a0b88,f47a0bfc,4c0,cbc49150,cb252d58,...) at vn_open+0x3b/frame 0xf47a0b60 kern_openat(ce7febc0,ffffff9c,2887b100,0,120004,288046c0) at kern_openat+0x1e4/frame 0xf47a0c20 sys_open(ce7febc0,f47a0cc8,14,c1085875,7b3,...) at sys_open+0x38/frame 0xf47a0c40 syscall(f47a0d08) at syscall+0x2ed/frame 0xf47a0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf47a0cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28185197, esp = 0xbfbfd6c8, ebp = 0xbfbfd6e0 --- Tracing command find pid 93738 tid 100288 td 0xcb98a5e0 sched_switch(cb98a5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4281620 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4281654 sleepq_switch(cb98a5e0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf4281688 sleepq_wait(cc4d5cdc,60,c1072cdc,4,1,...) at sleepq_wait+0x48/frame 0xf42816ac sleeplk(cc4d5d48,c1072cdc,60,33,1,...) at sleeplk+0x11e/frame 0xf42816e8 __lockmgr_args(cc4d5cdc,200100,cc4d5d48,0,0,...) at __lockmgr_args+0x612/frame 0xf42817c8 ffs_lock(f4281850,0,c7d7f1e0,c7d80d18,c7d7f1e0,...) at ffs_lock+0xad/frame 0xf4281808 VOP_LOCK1_APV(c11e1340,f4281850,0,f42818c4,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf4281838 _vn_lock(cc4d5ca8,200100,c1093903,880,2a1,...) at _vn_lock+0xca/frame 0xf4281878 vget(cc4d5ca8,200100,cb98a5e0,29d,c11f3010,...) at vget+0x77/frame 0xf42818b0 cache_lookup(ca3d3ca8,f4281bb4,f4281bc8,0,0,...) at cache_lookup+0x5a8/frame 0xf4281910 vfs_cache_lookup(f42819c0,c10e0c61,c10b5ccd,c1092d47,c11f3010,...) at vfs_cache_lookup+0xbc/frame 0xf4281958 VOP_LOOKUP_APV(c11e1340,f42819c0,f4281bc8,204,ca3d3d48,...) at VOP_LOOKUP_APV+0x124/frame 0xf4281988 lookup(f4281b88,c1092d47,106,ce,ccfe3910,...) at lookup+0x52e/frame 0xf42819e8 namei(f4281b88,cb252cdc,cb252cdc,c10929af,f4281ab0,...) at namei+0x47d/frame 0xf4281a70 vn_open_cred(f4281b88,f4281bfc,4c0,0,cd616600,cf974738) at vn_open_cred+0x24d/frame 0xf4281b40 vn_open(f4281b88,f4281bfc,4c0,cf974738,cb252d58,...) at vn_open+0x3b/frame 0xf4281b60 kern_openat(cb98a5e0,ffffff9c,2887b100,0,120004,288046c0) at kern_openat+0x1e4/frame 0xf4281c20 sys_open(cb98a5e0,f4281cc8,7b3,0,f4281cc4,...) at sys_open+0x38/frame 0xf4281c40 syscall(f4281d08) at syscall+0x2ed/frame 0xf4281cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4281cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28185197, esp = 0xbfbfd6c8, ebp = 0xbfbfd6e0 --- Tracing command sleep pid 93165 tid 100290 td 0xcbdea2f0 sched_switch(cbdea2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4287a80 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf4287ab4 sleepq_switch(cbdea2f0,0,c1088efd,1ab,f4287b2c,...) at sleepq_switch+0x1b9/frame 0xf4287ae8 sleepq_catch_signals(2711,c0ad4fb0,cbdea2f0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf4287b30 sleepq_timedwait_sig(c12303a0,6c,c1084a2e,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf4287b58 _sleep(c12303a0,0,16c,c1084a2e,2711,...) at _sleep+0x303/frame 0xf4287bb0 kern_nanosleep(bfbfdce0,f4287c18,f4287c20,2,a,...) at kern_nanosleep+0xd9/frame 0xf4287c00 sys_nanosleep(cbdea2f0,f4287cc8,c10da553,d6,1,...) at sys_nanosleep+0x6b/frame 0xf4287c40 syscall(f4287d08) at syscall+0x2ed/frame 0xf4287cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4287cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816337f, esp = 0xbfbfdcac, ebp = 0xbfbfdcf4 --- Tracing command sh pid 92887 tid 100307 td 0xcb8b85e0 sched_switch(cb8b85e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf42bc998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf42bc9cc sleepq_switch(cb8b85e0,0,c1088efd,1ab,f42bca44,...) at sleepq_switch+0x1b9/frame 0xf42bca00 sleepq_catch_signals(0,c1088efd,164,a80,cb8b85e0,...) at sleepq_catch_signals+0x3b1/frame 0xf42bca48 sleepq_wait_sig(ccb7f000,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf42bca6c _sleep(ccb7f000,ccb7f088,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf42bcac4 kern_wait6(cb8b85e0,7,0,0,f42bcb4c,...) at kern_wait6+0x43c/frame 0xf42bcb20 sys_wait4(cb8b85e0,f42bccc8,14,c1085875,7b3,...) at sys_wait4+0x94/frame 0xf42bcc40 syscall(f42bcd08) at syscall+0x2ed/frame 0xf42bccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf42bccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92885 tid 100291 td 0xcbdea000 sched_switch(cbdea000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf428a998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf428a9cc sleepq_switch(cbdea000,0,c1088efd,1ab,f428aa44,...) at sleepq_switch+0x1b9/frame 0xf428aa00 sleepq_catch_signals(0,c1088efd,164,a08,cbdea000,...) at sleepq_catch_signals+0x3b1/frame 0xf428aa48 sleepq_wait_sig(cbdaeb40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf428aa6c _sleep(cbdaeb40,cbdaebc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf428aac4 kern_wait6(cbdea000,7,0,0,f428ab4c,...) at kern_wait6+0x43c/frame 0xf428ab20 sys_wait4(cbdea000,f428acc8,7b3,0,f428acc4,...) at sys_wait4+0x94/frame 0xf428ac40 syscall(f428ad08) at syscall+0x2ed/frame 0xf428acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf428acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92882 tid 100647 td 0xcb51b2f0 sched_switch(cb51b2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4857998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf48579cc sleepq_switch(cb51b2f0,0,c1088efd,1ab,f4857a44,...) at sleepq_switch+0x1b9/frame 0xf4857a00 sleepq_catch_signals(0,c1088efd,164,678,cb51b2f0,...) at sleepq_catch_signals+0x3b1/frame 0xf4857a48 sleepq_wait_sig(cedc45a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4857a6c _sleep(cedc45a0,cedc4628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4857ac4 kern_wait6(cb51b2f0,7,0,0,f4857b4c,...) at kern_wait6+0x43c/frame 0xf4857b20 sys_wait4(cb51b2f0,f4857cc8,8,c1083a9c,db,...) at sys_wait4+0x94/frame 0xf4857c40 syscall(f4857d08) at syscall+0x2ed/frame 0xf4857cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4857cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92833 tid 100607 td 0xcab2c5e0 sched_switch(cab2c5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf47df998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf47df9cc sleepq_switch(cab2c5e0,0,c1088efd,1ab,f47dfa44,...) at sleepq_switch+0x1b9/frame 0xf47dfa00 sleepq_catch_signals(0,c1088efd,164,4f8,cab2c5e0,...) at sleepq_catch_signals+0x3b1/frame 0xf47dfa48 sleepq_wait_sig(ce7f35a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf47dfa6c _sleep(ce7f35a0,ce7f3628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf47dfac4 kern_wait6(cab2c5e0,7,0,0,f47dfb4c,...) at kern_wait6+0x43c/frame 0xf47dfb20 sys_wait4(cab2c5e0,f47dfcc8,c10da553,e9,f47dfcc4,...) at sys_wait4+0x94/frame 0xf47dfc40 syscall(f47dfd08) at syscall+0x2ed/frame 0xf47dfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf47dfcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92832 tid 100519 td 0xcb6b4bc0 sched_switch(cb6b4bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf45fd998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf45fd9cc sleepq_switch(cb6b4bc0,0,c1088efd,1ab,f45fda44,...) at sleepq_switch+0x1b9/frame 0xf45fda00 sleepq_catch_signals(0,c1088efd,164,ab0,cb6b4bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf45fda48 sleepq_wait_sig(cc6d72d0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf45fda6c _sleep(cc6d72d0,cc6d7358,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf45fdac4 kern_wait6(cb6b4bc0,7,0,0,f45fdb4c,...) at kern_wait6+0x43c/frame 0xf45fdb20 sys_wait4(cb6b4bc0,f45fdcc8,7b3,0,f45fdcc4,...) at sys_wait4+0x94/frame 0xf45fdc40 syscall(f45fdd08) at syscall+0x2ed/frame 0xf45fdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45fdcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92831 tid 100478 td 0xcc28ebc0 sched_switch(cc28ebc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf457a998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf457a9cc sleepq_switch(cc28ebc0,0,c1088efd,1ab,f457aa44,...) at sleepq_switch+0x1b9/frame 0xf457aa00 sleepq_catch_signals(0,c1088efd,164,6c0,cc28ebc0,...) at sleepq_catch_signals+0x3b1/frame 0xf457aa48 sleepq_wait_sig(cc27c870,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf457aa6c _sleep(cc27c870,cc27c8f8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf457aac4 kern_wait6(cc28ebc0,7,0,0,f457ab4c,...) at kern_wait6+0x43c/frame 0xf457ab20 sys_wait4(cc28ebc0,f457acc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf457ac40 syscall(f457ad08) at syscall+0x2ed/frame 0xf457acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf457acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92830 tid 100813 td 0xce2a8bc0 sched_switch(ce2a8bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a49998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf4a499cc sleepq_switch(ce2a8bc0,0,c1088efd,1ab,f4a49a44,...) at sleepq_switch+0x1b9/frame 0xf4a49a00 sleepq_catch_signals(0,c1088efd,164,af8,ce2a8bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf4a49a48 sleepq_wait_sig(cc46f5a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4a49a6c _sleep(cc46f5a0,cc46f628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4a49ac4 kern_wait6(ce2a8bc0,7,0,0,f4a49b4c,...) at kern_wait6+0x43c/frame 0xf4a49b20 sys_wait4(ce2a8bc0,f4a49cc8,7b3,0,f4a49cc4,...) at sys_wait4+0x94/frame 0xf4a49c40 syscall(f4a49d08) at syscall+0x2ed/frame 0xf4a49cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a49cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92829 tid 100488 td 0xcc2a52f0 sched_switch(cc2a52f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4598998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf45989cc sleepq_switch(cc2a52f0,0,c1088efd,1ab,f4598a44,...) at sleepq_switch+0x1b9/frame 0xf4598a00 sleepq_catch_signals(0,c1088efd,164,840,cc2a52f0,...) at sleepq_catch_signals+0x3b1/frame 0xf4598a48 sleepq_wait_sig(cc275870,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4598a6c _sleep(cc275870,cc2758f8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4598ac4 kern_wait6(cc2a52f0,7,0,0,f4598b4c,...) at kern_wait6+0x43c/frame 0xf4598b20 sys_wait4(cc2a52f0,f4598cc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf4598c40 syscall(f4598d08) at syscall+0x2ed/frame 0xf4598cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4598cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92828 tid 100508 td 0xcd3818d0 sched_switch(cd3818d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf45dc998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf45dc9cc sleepq_switch(cd3818d0,0,c1088efd,1ab,f45dca44,...) at sleepq_switch+0x1b9/frame 0xf45dca00 sleepq_catch_signals(0,c1088efd,164,900,cd3818d0,...) at sleepq_catch_signals+0x3b1/frame 0xf45dca48 sleepq_wait_sig(ccbc6000,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf45dca6c _sleep(ccbc6000,ccbc6088,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf45dcac4 kern_wait6(cd3818d0,7,0,0,f45dcb4c,...) at kern_wait6+0x43c/frame 0xf45dcb20 sys_wait4(cd3818d0,f45dccc8,7b3,0,f45dccc4,...) at sys_wait4+0x94/frame 0xf45dcc40 syscall(f45dcd08) at syscall+0x2ed/frame 0xf45dccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45dccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92827 tid 100142 td 0xcb174000 sched_switch(cb174000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4062998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf40629cc sleepq_switch(cb174000,0,c1088efd,1ab,f4062a44,...) at sleepq_switch+0x1b9/frame 0xf4062a00 sleepq_catch_signals(0,c1088efd,164,7f8,cb174000,...) at sleepq_catch_signals+0x3b1/frame 0xf4062a48 sleepq_wait_sig(cb14d5a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4062a6c _sleep(cb14d5a0,cb14d628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4062ac4 kern_wait6(cb174000,7,0,0,f4062b4c,...) at kern_wait6+0x43c/frame 0xf4062b20 sys_wait4(cb174000,f4062cc8,c10da553,e9,f4062cc4,...) at sys_wait4+0x94/frame 0xf4062c40 syscall(f4062d08) at syscall+0x2ed/frame 0xf4062cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4062cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92826 tid 100428 td 0xcd4f82f0 sched_switch(cd4f82f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf44bd998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf44bd9cc sleepq_switch(cd4f82f0,0,c1088efd,1ab,f44bda44,...) at sleepq_switch+0x1b9/frame 0xf44bda00 sleepq_catch_signals(0,c1088efd,164,c0,cd4f82f0,...) at sleepq_catch_signals+0x3b1/frame 0xf44bda48 sleepq_wait_sig(d0608870,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf44bda6c _sleep(d0608870,d06088f8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf44bdac4 kern_wait6(cd4f82f0,7,0,0,f44bdb4c,...) at kern_wait6+0x43c/frame 0xf44bdb20 sys_wait4(cd4f82f0,f44bdcc8,7b3,0,f44bdcc4,...) at sys_wait4+0x94/frame 0xf44bdc40 syscall(f44bdd08) at syscall+0x2ed/frame 0xf44bdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf44bdcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92825 tid 100775 td 0xcde2d8d0 sched_switch(cde2d8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf49d7998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf49d79cc sleepq_switch(cde2d8d0,0,c1088efd,1ab,f49d7a44,...) at sleepq_switch+0x1b9/frame 0xf49d7a00 sleepq_catch_signals(0,c1088efd,164,300,cde2d8d0,...) at sleepq_catch_signals+0x3b1/frame 0xf49d7a48 sleepq_wait_sig(cc4c2000,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf49d7a6c _sleep(cc4c2000,cc4c2088,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf49d7ac4 kern_wait6(cde2d8d0,7,0,0,f49d7b4c,...) at kern_wait6+0x43c/frame 0xf49d7b20 sys_wait4(cde2d8d0,f49d7cc8,7b3,0,f49d7cc4,...) at sys_wait4+0x94/frame 0xf49d7c40 syscall(f49d7d08) at syscall+0x2ed/frame 0xf49d7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf49d7cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92824 tid 100781 td 0xcde2c5e0 sched_switch(cde2c5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf49e9998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf49e99cc sleepq_switch(cde2c5e0,0,c1088efd,1ab,f49e9a44,...) at sleepq_switch+0x1b9/frame 0xf49e9a00 sleepq_catch_signals(0,c1088efd,164,108,cde2c5e0,...) at sleepq_catch_signals+0x3b1/frame 0xf49e9a48 sleepq_wait_sig(cc4b8b40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf49e9a6c _sleep(cc4b8b40,cc4b8bc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf49e9ac4 kern_wait6(cde2c5e0,7,0,0,f49e9b4c,...) at kern_wait6+0x43c/frame 0xf49e9b20 sys_wait4(cde2c5e0,f49e9cc8,f49e9d08,1,1,...) at sys_wait4+0x94/frame 0xf49e9c40 syscall(f49e9d08) at syscall+0x2ed/frame 0xf49e9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf49e9cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92823 tid 100403 td 0xcbe848d0 sched_switch(cbe848d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4444998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf44449cc sleepq_switch(cbe848d0,0,c1088efd,1ab,f4444a44,...) at sleepq_switch+0x1b9/frame 0xf4444a00 sleepq_catch_signals(0,c1088efd,164,78,cbe848d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4444a48 sleepq_wait_sig(cbe805a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4444a6c _sleep(cbe805a0,cbe80628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4444ac4 kern_wait6(cbe848d0,7,0,0,f4444b4c,...) at kern_wait6+0x43c/frame 0xf4444b20 sys_wait4(cbe848d0,f4444cc8,7b3,0,f4444cc4,...) at sys_wait4+0x94/frame 0xf4444c40 syscall(f4444d08) at syscall+0x2ed/frame 0xf4444cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4444cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92822 tid 100862 td 0xd637e8d0 sched_switch(d637e8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4ba8998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf4ba89cc sleepq_switch(d637e8d0,0,c1088efd,1ab,f4ba8a44,...) at sleepq_switch+0x1b9/frame 0xf4ba8a00 sleepq_catch_signals(0,c1088efd,164,0,d637e8d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4ba8a48 sleepq_wait_sig(d6370000,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4ba8a6c _sleep(d6370000,d6370088,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4ba8ac4 kern_wait6(d637e8d0,7,0,0,f4ba8b4c,...) at kern_wait6+0x43c/frame 0xf4ba8b20 sys_wait4(d637e8d0,f4ba8cc8,7b3,0,f4ba8cc4,...) at sys_wait4+0x94/frame 0xf4ba8c40 syscall(f4ba8d08) at syscall+0x2ed/frame 0xf4ba8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4ba8cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92819 tid 100449 td 0xd060bbc0 sched_switch(d060bbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf44fc998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf44fc9cc sleepq_switch(d060bbc0,0,c1088efd,1ab,f44fca44,...) at sleepq_switch+0x1b9/frame 0xf44fca00 sleepq_catch_signals(0,c1088efd,164,540,d060bbc0,...) at sleepq_catch_signals+0x3b1/frame 0xf44fca48 sleepq_wait_sig(caec3870,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf44fca6c _sleep(caec3870,caec38f8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf44fcac4 kern_wait6(d060bbc0,7,0,0,f44fcb4c,...) at kern_wait6+0x43c/frame 0xf44fcb20 sys_wait4(d060bbc0,f44fccc8,c10da553,e9,db,...) at sys_wait4+0x94/frame 0xf44fcc40 syscall(f44fcd08) at syscall+0x2ed/frame 0xf44fccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf44fccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92818 tid 100677 td 0xcac9ebc0 sched_switch(cac9ebc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf48b1998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf48b19cc sleepq_switch(cac9ebc0,0,c1088efd,1ab,f48b1a44,...) at sleepq_switch+0x1b9/frame 0xf48b1a00 sleepq_catch_signals(0,c1088efd,164,3c0,cac9ebc0,...) at sleepq_catch_signals+0x3b1/frame 0xf48b1a48 sleepq_wait_sig(cf0fa870,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf48b1a6c _sleep(cf0fa870,cf0fa8f8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf48b1ac4 kern_wait6(cac9ebc0,7,0,0,f48b1b4c,...) at kern_wait6+0x43c/frame 0xf48b1b20 sys_wait4(cac9ebc0,f48b1cc8,14,c1085875,7b3,...) at sys_wait4+0x94/frame 0xf48b1c40 syscall(f48b1d08) at syscall+0x2ed/frame 0xf48b1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf48b1cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92817 tid 100306 td 0xcb8b88d0 sched_switch(cb8b88d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf42b9998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf42b99cc sleepq_switch(cb8b88d0,0,c1088efd,1ab,f42b9a44,...) at sleepq_switch+0x1b9/frame 0xf42b9a00 sleepq_catch_signals(0,c1088efd,164,ab0,cb8b88d0,...) at sleepq_catch_signals+0x3b1/frame 0xf42b9a48 sleepq_wait_sig(ccb7f2d0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf42b9a6c _sleep(ccb7f2d0,ccb7f358,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf42b9ac4 kern_wait6(cb8b88d0,7,0,0,f42b9b4c,...) at kern_wait6+0x43c/frame 0xf42b9b20 sys_wait4(cb8b88d0,f42b9cc8,14,c1085875,7b3,...) at sys_wait4+0x94/frame 0xf42b9c40 syscall(f42b9d08) at syscall+0x2ed/frame 0xf42b9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf42b9cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92816 tid 100344 td 0xcd4f8bc0 sched_switch(cd4f8bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4364998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf43649cc sleepq_switch(cd4f8bc0,0,c1088efd,1ab,f4364a44,...) at sleepq_switch+0x1b9/frame 0xf4364a00 sleepq_catch_signals(0,c1088efd,164,108,cd4f8bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf4364a48 sleepq_wait_sig(cd838b40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4364a6c _sleep(cd838b40,cd838bc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4364ac4 kern_wait6(cd4f8bc0,7,0,0,f4364b4c,...) at kern_wait6+0x43c/frame 0xf4364b20 sys_wait4(cd4f8bc0,f4364cc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf4364c40 syscall(f4364d08) at syscall+0x2ed/frame 0xf4364cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4364cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92815 tid 100321 td 0xcd8cb8d0 sched_switch(cd8cb8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf431f998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf431f9cc sleepq_switch(cd8cb8d0,0,c1088efd,1ab,f431fa44,...) at sleepq_switch+0x1b9/frame 0xf431fa00 sleepq_catch_signals(0,c1088efd,164,7f8,cd8cb8d0,...) at sleepq_catch_signals+0x3b1/frame 0xf431fa48 sleepq_wait_sig(cd8b55a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf431fa6c _sleep(cd8b55a0,cd8b5628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf431fac4 kern_wait6(cd8cb8d0,7,0,0,f431fb4c,...) at kern_wait6+0x43c/frame 0xf431fb20 sys_wait4(cd8cb8d0,f431fcc8,c10da553,e9,2aea181,...) at sys_wait4+0x94/frame 0xf431fc40 syscall(f431fd08) at syscall+0x2ed/frame 0xf431fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf431fcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92814 tid 100718 td 0xcca755e0 sched_switch(cca755e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf492c998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf492c9cc sleepq_switch(cca755e0,0,c1088efd,1ab,f492ca44,...) at sleepq_switch+0x1b9/frame 0xf492ca00 sleepq_catch_signals(0,c1088efd,164,180,cca755e0,...) at sleepq_catch_signals+0x3b1/frame 0xf492ca48 sleepq_wait_sig(cdde1000,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf492ca6c _sleep(cdde1000,cdde1088,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf492cac4 kern_wait6(cca755e0,7,0,0,f492cb4c,...) at kern_wait6+0x43c/frame 0xf492cb20 sys_wait4(cca755e0,f492ccc8,f492cd08,1,1,...) at sys_wait4+0x94/frame 0xf492cc40 syscall(f492cd08) at syscall+0x2ed/frame 0xf492ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf492ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92813 tid 100755 td 0xcfc302f0 sched_switch(cfc302f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf499b998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf499b9cc sleepq_switch(cfc302f0,0,c1088efd,1ab,f499ba44,...) at sleepq_switch+0x1b9/frame 0xf499ba00 sleepq_catch_signals(0,c1088efd,164,c0,cfc302f0,...) at sleepq_catch_signals+0x3b1/frame 0xf499ba48 sleepq_wait_sig(cddd8870,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf499ba6c _sleep(cddd8870,cddd88f8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf499bac4 kern_wait6(cfc302f0,7,0,0,f499bb4c,...) at kern_wait6+0x43c/frame 0xf499bb20 sys_wait4(cfc302f0,f499bcc8,7b3,0,f499bcc4,...) at sys_wait4+0x94/frame 0xf499bc40 syscall(f499bd08) at syscall+0x2ed/frame 0xf499bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf499bcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92812 tid 100280 td 0xcbe6d5e0 sched_switch(cbe6d5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4268998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf42689cc sleepq_switch(cbe6d5e0,0,c1088efd,1ab,f4268a44,...) at sleepq_switch+0x1b9/frame 0xf4268a00 sleepq_catch_signals(0,c1088efd,164,708,cbe6d5e0,...) at sleepq_catch_signals+0x3b1/frame 0xf4268a48 sleepq_wait_sig(cbe54b40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4268a6c _sleep(cbe54b40,cbe54bc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4268ac4 kern_wait6(cbe6d5e0,7,0,0,f4268b4c,...) at kern_wait6+0x43c/frame 0xf4268b20 sys_wait4(cbe6d5e0,f4268cc8,f4268d08,1,1,...) at sys_wait4+0x94/frame 0xf4268c40 syscall(f4268d08) at syscall+0x2ed/frame 0xf4268cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4268cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92811 tid 100226 td 0xcbc4d000 sched_switch(cbc4d000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf41b9998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf41b99cc sleepq_switch(cbc4d000,0,c1088efd,1ab,f41b9a44,...) at sleepq_switch+0x1b9/frame 0xf41b9a00 sleepq_catch_signals(0,c1088efd,164,930,cbc4d000,...) at sleepq_catch_signals+0x3b1/frame 0xf41b9a48 sleepq_wait_sig(cbdfe2d0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf41b9a6c _sleep(cbdfe2d0,cbdfe358,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf41b9ac4 kern_wait6(cbc4d000,7,0,0,f41b9b4c,...) at kern_wait6+0x43c/frame 0xf41b9b20 sys_wait4(cbc4d000,f41b9cc8,14,c1085875,7b3,...) at sys_wait4+0x94/frame 0xf41b9c40 syscall(f41b9d08) at syscall+0x2ed/frame 0xf41b9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf41b9cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92810 tid 100472 td 0xcc295000 sched_switch(cc295000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4568998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf45689cc sleepq_switch(cc295000,0,c1088efd,1ab,f4568a44,...) at sleepq_switch+0x1b9/frame 0xf4568a00 sleepq_catch_signals(0,c1088efd,164,408,cc295000,...) at sleepq_catch_signals+0x3b1/frame 0xf4568a48 sleepq_wait_sig(cc282b40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4568a6c _sleep(cc282b40,cc282bc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4568ac4 kern_wait6(cc295000,7,0,0,f4568b4c,...) at kern_wait6+0x43c/frame 0xf4568b20 sys_wait4(cc295000,f4568cc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf4568c40 syscall(f4568d08) at syscall+0x2ed/frame 0xf4568cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4568cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92809 tid 100179 td 0xcbc74000 sched_switch(cbc74000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf410d998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf410d9cc sleepq_switch(cbc74000,0,c1088efd,1ab,f410da44,...) at sleepq_switch+0x1b9/frame 0xf410da00 sleepq_catch_signals(0,c1088efd,164,a08,cbc74000,...) at sleepq_catch_signals+0x3b1/frame 0xf410da48 sleepq_wait_sig(cbc6eb40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf410da6c _sleep(cbc6eb40,cbc6ebc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf410dac4 kern_wait6(cbc74000,7,0,0,f410db4c,...) at kern_wait6+0x43c/frame 0xf410db20 sys_wait4(cbc74000,f410dcc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf410dc40 syscall(f410dd08) at syscall+0x2ed/frame 0xf410dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf410dcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92808 tid 100470 td 0xcc2955e0 sched_switch(cc2955e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4562998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf45629cc sleepq_switch(cc2955e0,0,c1088efd,1ab,f4562a44,...) at sleepq_switch+0x1b9/frame 0xf4562a00 sleepq_catch_signals(0,c1088efd,164,1b0,cc2955e0,...) at sleepq_catch_signals+0x3b1/frame 0xf4562a48 sleepq_wait_sig(cc2892d0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4562a6c _sleep(cc2892d0,cc289358,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4562ac4 kern_wait6(cc2955e0,7,0,0,f4562b4c,...) at kern_wait6+0x43c/frame 0xf4562b20 sys_wait4(cc2955e0,f4562cc8,14,c1085875,7b3,...) at sys_wait4+0x94/frame 0xf4562c40 syscall(f4562d08) at syscall+0x2ed/frame 0xf4562cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4562cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92807 tid 100821 td 0xce2c28d0 sched_switch(ce2c28d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a61998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf4a619cc sleepq_switch(ce2c28d0,0,c1088efd,1ab,f4a61a44,...) at sleepq_switch+0x1b9/frame 0xf4a61a00 sleepq_catch_signals(0,c1088efd,164,288,ce2c28d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4a61a48 sleepq_wait_sig(cc439b40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4a61a6c _sleep(cc439b40,cc439bc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4a61ac4 kern_wait6(ce2c28d0,7,0,0,f4a61b4c,...) at kern_wait6+0x43c/frame 0xf4a61b20 sys_wait4(ce2c28d0,f4a61cc8,c10da553,e9,f4a61cc4,...) at sys_wait4+0x94/frame 0xf4a61c40 syscall(f4a61d08) at syscall+0x2ed/frame 0xf4a61cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a61cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command sh pid 92806 tid 100221 td 0xcbc4d8d0 sched_switch(cbc4d8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf41a9998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf41a99cc sleepq_switch(cbc4d8d0,0,c1088efd,1ab,f41a9a44,...) at sleepq_switch+0x1b9/frame 0xf41a9a00 sleepq_catch_signals(0,c1088efd,164,a08,cbc4d8d0,...) at sleepq_catch_signals+0x3b1/frame 0xf41a9a48 sleepq_wait_sig(cbdfeb40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf41a9a6c _sleep(cbdfeb40,cbdfebc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf41a9ac4 kern_wait6(cbc4d8d0,7,0,0,f41a9b4c,...) at kern_wait6+0x43c/frame 0xf41a9b20 sys_wait4(cbc4d8d0,f41a9cc8,f41a9d08,1,1,...) at sys_wait4+0x94/frame 0xf41a9c40 syscall(f41a9d08) at syscall+0x2ed/frame 0xf41a9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf41a9cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd570, ebp = 0xbfbfd588 --- Tracing command sh pid 92805 tid 100831 td 0xce2b58d0 sched_switch(ce2b58d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4a7f998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf4a7f9cc sleepq_switch(ce2b58d0,0,c1088efd,1ab,f4a7fa44,...) at sleepq_switch+0x1b9/frame 0xf4a7fa00 sleepq_catch_signals(0,c1088efd,164,888,ce2b58d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4a7fa48 sleepq_wait_sig(cc41db40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4a7fa6c _sleep(cc41db40,cc41dbc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4a7fac4 kern_wait6(ce2b58d0,7,0,0,f4a7fb4c,...) at kern_wait6+0x43c/frame 0xf4a7fb20 sys_wait4(ce2b58d0,f4a7fcc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf4a7fc40 syscall(f4a7fd08) at syscall+0x2ed/frame 0xf4a7fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4a7fcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd4f8, ebp = 0xbfbfd510 --- Tracing command md19 pid 92801 tid 100136 td 0xca7f5000 sched_switch(ca7f5000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4050bb4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4050be8 sleepq_switch(ca7f5000,0,c1088efd,26d,ca7f5000,...) at sleepq_switch+0x1b9/frame 0xf4050c1c sleepq_wait(ca861800,5c,c101de0d,0,0,...) at sleepq_wait+0x48/frame 0xf4050c40 _sleep(ca861800,ca861820,25c,c101de0d,0,...) at _sleep+0x34e/frame 0xf4050c98 md_kthread(ca861800,f4050d08,c107cf30,3d7,0,...) at md_kthread+0xf8/frame 0xf4050ccc fork_exit(c077b3c0,ca861800,f4050d08) at fork_exit+0x7f/frame 0xf4050cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4050cf4 --- trap 0, eip = 0, esp = 0xf4050d40, ebp = 0 --- Tracing command md18 pid 92789 tid 100415 td 0xcb6ba8d0 sched_switch(cb6ba8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4470848 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf447087c sleepq_switch(cb6ba8d0,0,c1088efd,26d,cb6ba8d0,...) at sleepq_switch+0x1b9/frame 0xf44708b0 sleepq_wait(e1a88280,5c,c1091110,0,0,...) at sleepq_wait+0x48/frame 0xf44708d4 _sleep(e1a88280,c7d99790,5c,c1091110,0,...) at _sleep+0x34e/frame 0xf447092c bwait(e1a88280,5c,c1091110,0,0,...) at bwait+0x7f/frame 0xf4470958 breadn_flags(ce571708,b,0,4000,0,...) at breadn_flags+0x160/frame 0xf4470988 ffs_balloc_ufs2(ce571708,2c000,0,4000,cd616600,...) at ffs_balloc_ufs2+0x1172/frame 0xf4470ac8 ffs_write(f4470c70,c10e1081,f4470ba8,c0ced82d,c11f3010,...) at ffs_write+0x333/frame 0xf4470b58 VOP_WRITE_APV(c11e1340,f4470c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4470c18 mdstart_vnode(ca869800,cac2eed8,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4470c98 md_kthread(ca869800,f4470d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4470ccc fork_exit(c077b3c0,ca869800,f4470d08) at fork_exit+0x7f/frame 0xf4470cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4470cf4 --- trap 0, eip = 0, esp = 0xf4470d40, ebp = 0 --- Tracing command md17 pid 92777 tid 100484 td 0xcc2aa000 sched_switch(cc2aa000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf458c820 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf458c854 sleepq_switch(cc2aa000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf458c888 sleepq_wait(e1a1ab20,60,c107acd6,4,0,...) at sleepq_wait+0x48/frame 0xf458c8ac sleeplk(ca7dd0c0,c107acd6,60,0,0,...) at sleeplk+0x11e/frame 0xf458c8e8 __lockmgr_args(e1a1ab20,81900,ca7dd0c0,c107acd6,60,...) at __lockmgr_args+0xaa4/frame 0xf458c9c4 getblk(ca7dd000,5e653e0,0,4000,0,...) at getblk+0x21c/frame 0xf458ca20 breadn_flags(ca7dd000,5e653e0,0,4000,0,...) at breadn_flags+0x40/frame 0xf458ca50 ffs_update(ce77de10,1,f458cc50,2000,cd616600,...) at ffs_update+0x191/frame 0xf458cac8 ffs_write(f458cc70,c10e1081,f458cba8,c0ced82d,c11f3010,...) at ffs_write+0x625/frame 0xf458cb58 VOP_WRITE_APV(c11e1340,f458cc70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf458cc18 mdstart_vnode(ca8a5000,cd22fa18,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf458cc98 md_kthread(ca8a5000,f458cd08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf458cccc fork_exit(c077b3c0,ca8a5000,f458cd08) at fork_exit+0x7f/frame 0xf458ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf458ccf4 --- trap 0, eip = 0, esp = 0xf458cd40, ebp = 0 --- Tracing command md16 pid 92765 tid 100260 td 0xcbe695e0 sched_switch(cbe695e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4225bb4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4225be8 sleepq_switch(cbe695e0,0,c1088efd,26d,cbe695e0,...) at sleepq_switch+0x1b9/frame 0xf4225c1c sleepq_wait(ca869000,5c,c101de0d,0,0,...) at sleepq_wait+0x48/frame 0xf4225c40 _sleep(ca869000,ca869020,25c,c101de0d,0,...) at _sleep+0x34e/frame 0xf4225c98 md_kthread(ca869000,f4225d08,c107cf30,3d7,0,...) at md_kthread+0xf8/frame 0xf4225ccc fork_exit(c077b3c0,ca869000,f4225d08) at fork_exit+0x7f/frame 0xf4225cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4225cf4 --- trap 0, eip = 0, esp = 0xf4225d40, ebp = 0 --- Tracing command md15 pid 92753 tid 100319 td 0xcb98abc0 sched_switch(cb98abc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4319820 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4319854 sleepq_switch(cb98abc0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf4319888 sleepq_wait(e1a1ab20,60,c107acd6,4,0,...) at sleepq_wait+0x48/frame 0xf43198ac sleeplk(ca7dd0c0,c107acd6,60,0,0,...) at sleeplk+0x11e/frame 0xf43198e8 __lockmgr_args(e1a1ab20,81900,ca7dd0c0,c107acd6,60,...) at __lockmgr_args+0xaa4/frame 0xf43199c4 getblk(ca7dd000,5e653e0,0,4000,0,...) at getblk+0x21c/frame 0xf4319a20 breadn_flags(ca7dd000,5e653e0,0,4000,0,...) at breadn_flags+0x40/frame 0xf4319a50 ffs_update(cc9b1b40,1,f4319c50,1000,cd616600,...) at ffs_update+0x191/frame 0xf4319ac8 ffs_write(f4319c70,c10e1081,f4319ba8,c0ced82d,c11f3010,...) at ffs_write+0x625/frame 0xf4319b58 VOP_WRITE_APV(c11e1340,f4319c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4319c18 mdstart_vnode(ca8a5800,cfa84d10,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4319c98 md_kthread(ca8a5800,f4319d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4319ccc fork_exit(c077b3c0,ca8a5800,f4319d08) at fork_exit+0x7f/frame 0xf4319cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4319cf4 --- trap 0, eip = 0, esp = 0xf4319d40, ebp = 0 --- Tracing command md14 pid 92741 tid 100689 td 0xcf10b5e0 sched_switch(cf10b5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf48d5bb4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf48d5be8 sleepq_switch(cf10b5e0,0,c1088efd,26d,cf10b5e0,...) at sleepq_switch+0x1b9/frame 0xf48d5c1c sleepq_wait(ca8a6000,5c,c101de0d,0,0,...) at sleepq_wait+0x48/frame 0xf48d5c40 _sleep(ca8a6000,ca8a6020,25c,c101de0d,0,...) at _sleep+0x34e/frame 0xf48d5c98 md_kthread(ca8a6000,f48d5d08,c107cf30,3d7,0,...) at md_kthread+0xf8/frame 0xf48d5ccc fork_exit(c077b3c0,ca8a6000,f48d5d08) at fork_exit+0x7f/frame 0xf48d5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf48d5cf4 --- trap 0, eip = 0, esp = 0xf48d5d40, ebp = 0 --- Tracing command md13 pid 92729 tid 100678 td 0xcac9e8d0 sched_switch(cac9e8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf48b48ec mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf48b4920 sleepq_switch(cac9e8d0,0,c1088efd,26d,cac9e8d0,...) at sleepq_switch+0x1b9/frame 0xf48b4954 sleepq_wait(e1a1aac0,5c,c1091116,0,0,...) at sleepq_wait+0x48/frame 0xf48b4978 _sleep(e1a1aac0,c7d9968c,5c,c1091116,0,...) at _sleep+0x34e/frame 0xf48b49d0 bwait(e1a1aac0,5c,c1091116,f64,c0b190cb,...) at bwait+0x7f/frame 0xf48b49fc bufwrite(e1a1aac0,0,c10bb239,826,d2bc82d0) at bufwrite+0x240/frame 0xf48b4a2c ffs_bufwrite(e1a1aac0,cc0e3400,100,4000,0,...) at ffs_bufwrite+0x13b/frame 0xf48b4a50 ffs_update(d0354438,1,f48b4c50,1000,cd616600,...) at ffs_update+0x328/frame 0xf48b4ac8 ffs_write(f48b4c70,c10e1081,f48b4ba8,c0ced82d,c11f3010,...) at ffs_write+0x625/frame 0xf48b4b58 VOP_WRITE_APV(c11e1340,f48b4c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf48b4c18 mdstart_vnode(ca862000,cfd49980,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf48b4c98 md_kthread(ca862000,f48b4d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf48b4ccc fork_exit(c077b3c0,ca862000,f48b4d08) at fork_exit+0x7f/frame 0xf48b4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf48b4cf4 --- trap 0, eip = 0, esp = 0xf48b4d40, ebp = 0 --- Tracing command md12 pid 92717 tid 100742 td 0xcf3715e0 sched_switch(cf3715e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4974848 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf497487c sleepq_switch(cf3715e0,0,c1088efd,26d,cf3715e0,...) at sleepq_switch+0x1b9/frame 0xf49748b0 sleepq_wait(e1937fc0,5c,c1091110,0,0,...) at sleepq_wait+0x48/frame 0xf49748d4 _sleep(e1937fc0,c7d996c8,5c,c1091110,0,...) at _sleep+0x34e/frame 0xf497492c bwait(e1937fc0,5c,c1091110,0,0,...) at bwait+0x7f/frame 0xf4974958 breadn_flags(cd3bfe10,c,0,4000,0,...) at breadn_flags+0x160/frame 0xf4974988 ffs_balloc_ufs2(cd3bfe10,30000,0,2000,cd616600,...) at ffs_balloc_ufs2+0x228f/frame 0xf4974ac8 ffs_write(f4974c70,c10e1081,f4974ba8,c0ced82d,c11f3010,...) at ffs_write+0x333/frame 0xf4974b58 VOP_WRITE_APV(c11e1340,f4974c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4974c18 mdstart_vnode(ca862800,cfd5b7b8,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4974c98 md_kthread(ca862800,f4974d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4974ccc fork_exit(c077b3c0,ca862800,f4974d08) at fork_exit+0x7f/frame 0xf4974cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4974cf4 --- trap 0, eip = 0, esp = 0xf4974d40, ebp = 0 --- Tracing command md11 pid 92705 tid 100482 td 0xcc28e000 sched_switch(cc28e000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4586820 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4586854 sleepq_switch(cc28e000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf4586888 sleepq_wait(e1a1ab20,60,c107acd6,4,0,...) at sleepq_wait+0x48/frame 0xf45868ac sleeplk(ca7dd0c0,c107acd6,60,0,0,...) at sleeplk+0x11e/frame 0xf45868e8 __lockmgr_args(e1a1ab20,81900,ca7dd0c0,c107acd6,60,...) at __lockmgr_args+0xaa4/frame 0xf45869c4 getblk(ca7dd000,5e653e0,0,4000,0,...) at getblk+0x21c/frame 0xf4586a20 breadn_flags(ca7dd000,5e653e0,0,4000,0,...) at breadn_flags+0x40/frame 0xf4586a50 ffs_update(d07bc168,1,f4586c50,2000,cd616600,...) at ffs_update+0x191/frame 0xf4586ac8 ffs_write(f4586c70,c10e1081,f4586ba8,c0ced82d,c11f3010,...) at ffs_write+0x625/frame 0xf4586b58 VOP_WRITE_APV(c11e1340,f4586c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4586c18 mdstart_vnode(cb7b8800,cfc055f0,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4586c98 md_kthread(cb7b8800,f4586d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4586ccc fork_exit(c077b3c0,cb7b8800,f4586d08) at fork_exit+0x7f/frame 0xf4586cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4586cf4 --- trap 0, eip = 0, esp = 0xf4586d40, ebp = 0 --- Tracing command md10 pid 92693 tid 100547 td 0xd060a8d0 sched_switch(d060a8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf46a7bb4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf46a7be8 sleepq_switch(d060a8d0,0,c1088efd,26d,d060a8d0,...) at sleepq_switch+0x1b9/frame 0xf46a7c1c sleepq_wait(ca863000,5c,c101de0d,0,0,...) at sleepq_wait+0x48/frame 0xf46a7c40 _sleep(ca863000,ca863020,25c,c101de0d,0,...) at _sleep+0x34e/frame 0xf46a7c98 md_kthread(ca863000,f46a7d08,c107cf30,3d7,0,...) at md_kthread+0xf8/frame 0xf46a7ccc fork_exit(c077b3c0,ca863000,f46a7d08) at fork_exit+0x7f/frame 0xf46a7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf46a7cf4 --- trap 0, eip = 0, esp = 0xf46a7d40, ebp = 0 --- Tracing command md9 pid 92681 tid 100327 td 0xcd8c68d0 sched_switch(cd8c68d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4331bb4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4331be8 sleepq_switch(cd8c68d0,0,c1088efd,26d,cd8c68d0,...) at sleepq_switch+0x1b9/frame 0xf4331c1c sleepq_wait(ca8a6800,5c,c101de0d,0,0,...) at sleepq_wait+0x48/frame 0xf4331c40 _sleep(ca8a6800,ca8a6820,25c,c101de0d,0,...) at _sleep+0x34e/frame 0xf4331c98 md_kthread(ca8a6800,f4331d08,c107cf30,3d7,0,...) at md_kthread+0xf8/frame 0xf4331ccc fork_exit(c077b3c0,ca8a6800,f4331d08) at fork_exit+0x7f/frame 0xf4331cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4331cf4 --- trap 0, eip = 0, esp = 0xf4331d40, ebp = 0 --- Tracing command md8 pid 92669 tid 100857 td 0xd63752f0 sched_switch(d63752f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4b99820 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4b99854 sleepq_switch(d63752f0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf4b99888 sleepq_wait(e1a1ab20,60,c107acd6,4,0,...) at sleepq_wait+0x48/frame 0xf4b998ac sleeplk(ca7dd0c0,c107acd6,60,0,0,...) at sleeplk+0x11e/frame 0xf4b998e8 __lockmgr_args(e1a1ab20,81900,ca7dd0c0,c107acd6,60,...) at __lockmgr_args+0xaa4/frame 0xf4b999c4 getblk(ca7dd000,5e653e0,0,4000,0,...) at getblk+0x21c/frame 0xf4b99a20 breadn_flags(ca7dd000,5e653e0,0,4000,0,...) at breadn_flags+0x40/frame 0xf4b99a50 ffs_update(ce72d9d8,1,f4b99c50,4000,cd616600,...) at ffs_update+0x191/frame 0xf4b99ac8 ffs_write(f4b99c70,c10e1081,f4b99ba8,c0ced82d,c11f3010,...) at ffs_write+0x625/frame 0xf4b99b58 VOP_WRITE_APV(c11e1340,f4b99c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4b99c18 mdstart_vnode(ca867000,cda7e7b8,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4b99c98 md_kthread(ca867000,f4b99d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4b99ccc fork_exit(c077b3c0,ca867000,f4b99d08) at fork_exit+0x7f/frame 0xf4b99cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4b99cf4 --- trap 0, eip = 0, esp = 0xf4b99d40, ebp = 0 --- Tracing command md7 pid 92657 tid 100631 td 0xca7c7000 sched_switch(ca7c7000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4827848 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf482787c sleepq_switch(ca7c7000,0,c1088efd,26d,ca7c7000,...) at sleepq_switch+0x1b9/frame 0xf48278b0 sleepq_wait(e1ba3360,5c,c1091110,0,0,...) at sleepq_wait+0x48/frame 0xf48278d4 _sleep(e1ba3360,c7d99434,5c,c1091110,0,...) at _sleep+0x34e/frame 0xf482792c bwait(e1ba3360,5c,c1091110,0,0,...) at bwait+0x7f/frame 0xf4827958 breadn_flags(cb407438,c,0,4000,0,...) at breadn_flags+0x160/frame 0xf4827988 ffs_balloc_ufs2(cb407438,30000,0,2000,cd616600,...) at ffs_balloc_ufs2+0x228f/frame 0xf4827ac8 ffs_write(f4827c70,c10e1081,f4827ba8,c0ced82d,c11f3010,...) at ffs_write+0x333/frame 0xf4827b58 VOP_WRITE_APV(c11e1340,f4827c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4827c18 mdstart_vnode(ca8a7000,cfd58260,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4827c98 md_kthread(ca8a7000,f4827d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4827ccc fork_exit(c077b3c0,ca8a7000,f4827d08) at fork_exit+0x7f/frame 0xf4827cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4827cf4 --- trap 0, eip = 0, esp = 0xf4827d40, ebp = 0 --- Tracing command md6 pid 92645 tid 100143 td 0xcb173bc0 sched_switch(cb173bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4065bb4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4065be8 sleepq_switch(cb173bc0,0,c1088efd,26d,cb173bc0,...) at sleepq_switch+0x1b9/frame 0xf4065c1c sleepq_wait(ca866800,5c,c101de0d,0,0,...) at sleepq_wait+0x48/frame 0xf4065c40 _sleep(ca866800,ca866820,25c,c101de0d,0,...) at _sleep+0x34e/frame 0xf4065c98 md_kthread(ca866800,f4065d08,c107cf30,3d7,0,...) at md_kthread+0xf8/frame 0xf4065ccc fork_exit(c077b3c0,ca866800,f4065d08) at fork_exit+0x7f/frame 0xf4065cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4065cf4 --- trap 0, eip = 0, esp = 0xf4065d40, ebp = 0 --- Tracing command md5 pid 92633 tid 100154 td 0xcbc242f0 sched_switch(cbc242f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4086820 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf4086854 sleepq_switch(cbc242f0,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf4086888 sleepq_wait(e1a1ab20,60,c107acd6,4,0,...) at sleepq_wait+0x48/frame 0xf40868ac sleeplk(ca7dd0c0,c107acd6,60,0,0,...) at sleeplk+0x11e/frame 0xf40868e8 __lockmgr_args(e1a1ab20,81900,ca7dd0c0,c107acd6,60,...) at __lockmgr_args+0xaa4/frame 0xf40869c4 getblk(ca7dd000,5e653e0,0,4000,0,...) at getblk+0x21c/frame 0xf4086a20 breadn_flags(ca7dd000,5e653e0,0,4000,0,...) at breadn_flags+0x40/frame 0xf4086a50 ffs_update(cad87168,1,f4086c50,2000,cd616600,...) at ffs_update+0x191/frame 0xf4086ac8 ffs_write(f4086c70,c10e1081,f4086ba8,c0ced82d,c11f3010,...) at ffs_write+0x625/frame 0xf4086b58 VOP_WRITE_APV(c11e1340,f4086c70,c101dd38,26a,26f,...) at VOP_WRITE_APV+0x19f/frame 0xf4086c18 mdstart_vnode(cb7b5000,cac2abe0,c101dd38,2fd,0,...) at mdstart_vnode+0x407/frame 0xf4086c98 md_kthread(cb7b5000,f4086d08,c107cf30,3d7,0,...) at md_kthread+0x1aa/frame 0xf4086ccc fork_exit(c077b3c0,cb7b5000,f4086d08) at fork_exit+0x7f/frame 0xf4086cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4086cf4 --- trap 0, eip = 0, esp = 0xf4086d40, ebp = 0 --- Tracing command sh pid 92616 tid 100542 td 0xcaeba8d0 sched_switch(caeba8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4679ab4 mi_switch(104,0,c1088efd,1f7,c1088efd,...) at mi_switch+0x1c9/frame 0xf4679ae8 sleepq_switch(caeba8d0,0,c1088efd,1ab,f4679b60,...) at sleepq_switch+0x1b9/frame 0xf4679b1c sleepq_catch_signals(0,c1088efd,164,588,caeba8d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4679b64 sleepq_wait_sig(cc6ebb98,74,c0f02504,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4679b88 _sleep(cc6ebb98,cc6ebbc8,174,c0f02504,0,...) at _sleep+0x32d/frame 0xf4679be0 kern_sigsuspend(caeba8d0,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf4679c10 sys_sigsuspend(caeba8d0,f4679cc8,c10da553,e9,7b3,...) at sys_sigsuspend+0x58/frame 0xf4679c40 syscall(f4679d08) at syscall+0x2ed/frame 0xf4679cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4679cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281384b7, esp = 0xbfbfd69c, ebp = 0xbfbfd730 --- Tracing command sh pid 91633 tid 100706 td 0xcca8cbc0 sched_switch(cca8cbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4908998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf49089cc sleepq_switch(cca8cbc0,0,c1088efd,1ab,f4908a44,...) at sleepq_switch+0x1b9/frame 0xf4908a00 sleepq_catch_signals(0,c1088efd,164,4f8,cca8cbc0,...) at sleepq_catch_signals+0x3b1/frame 0xf4908a48 sleepq_wait_sig(cdde35a0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4908a6c _sleep(cdde35a0,cdde3628,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf4908ac4 kern_wait6(cca8cbc0,7,0,0,f4908b4c,...) at kern_wait6+0x43c/frame 0xf4908b20 sys_wait4(cca8cbc0,f4908cc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf4908c40 syscall(f4908d08) at syscall+0x2ed/frame 0xf4908cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4908cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd6f8, ebp = 0xbfbfd710 --- Tracing command bash pid 79462 tid 100507 td 0xcd381bc0 sched_switch(cd381bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf45d9998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf45d99cc sleepq_switch(cd381bc0,0,c1088efd,1ab,f45d9a44,...) at sleepq_switch+0x1b9/frame 0xf45d9a00 sleepq_catch_signals(0,c1088efd,164,930,cd381bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf45d9a48 sleepq_wait_sig(ccbc62d0,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf45d9a6c _sleep(ccbc62d0,ccbc6358,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf45d9ac4 kern_wait6(cd381bc0,7,0,0,f45d9b4c,...) at kern_wait6+0x43c/frame 0xf45d9b20 sys_wait4(cd381bc0,f45d9cc8,8,c1083a9c,db,...) at sys_wait4+0x94/frame 0xf45d9c40 syscall(f45d9d08) at syscall+0x2ed/frame 0xf45d9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45d9cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282af98f, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command csh pid 79459 tid 100460 td 0xcee0e000 Tracing command su pid 79458 tid 100467 td 0xcb2268d0 Tracing command bash pid 3148 tid 100259 td 0xcbe23bc0 Tracing command sshd pid 3147 tid 100283 td 0xcbe65bc0 sched_switch(cbe65bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4272918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf427294c sleepq_switch(cbe65bc0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf4272980 sleepq_catch_signals(f42729ec,c0a7f619,cc6463e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf42729c8 sleepq_wait_sig(cc6463e4,0,f4272a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf42729ec _cv_wait_sig(cc6463e4,cc6463d0,c108bcac,677,c,...) at _cv_wait_sig+0x200/frame 0xf4272a34 seltdwait(caec1738,58,ce036d00,cbe65bc0,c1375370,...) at seltdwait+0x8c/frame 0xf4272a58 kern_select(cbe65bc0,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf4272bf8 sys_select(cbe65bc0,f4272cc8,f4272d08,1,1,...) at sys_select+0x69/frame 0xf4272c40 syscall(f4272d08) at syscall+0x2ed/frame 0xf4272cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4272cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28522f77, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 3145 tid 100224 td 0xcbc4d2f0 sched_switch(cbc4d2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf41b3988 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf41b39bc sleepq_switch(cbc4d2f0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf41b39f0 sleepq_catch_signals(f41b3a5c,c0a7f619,cd8b62e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf41b3a38 sleepq_wait_sig(cd8b62e4,0,f41b3a90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf41b3a5c _cv_wait_sig(cd8b62e4,cd8b62d0,c108bcac,677,cbc4d2f0,...) at _cv_wait_sig+0x200/frame 0xf41b3aa4 seltdwait(cc65082c,c108bcac,5ac,cbc4d2f0,ffffff80,...) at seltdwait+0x8c/frame 0xf41b3ac8 sys_poll(cbc4d2f0,f41b3cc8,14,c1085875,7b3,...) at sys_poll+0x3e5/frame 0xf41b3c40 syscall(f41b3d08) at syscall+0x2ed/frame 0xf41b3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf41b3cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b9aaf, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command getty pid 1447 tid 100137 td 0xca7f4bc0 sched_switch(ca7f4bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf40539b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf40539ec sleepq_switch(ca7f4bc0,0,c1088efd,1ab,f4053a64,...) at sleepq_switch+0x1b9/frame 0xf4053a20 sleepq_catch_signals(0,c1088efd,164,330,1,...) at sleepq_catch_signals+0x3b1/frame 0xf4053a68 sleepq_wait_sig(c80ba270,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf4053a8c _cv_wait_sig(c80ba270,c13f7324,c108dc5d,531,f4053c10,...) at _cv_wait_sig+0x200/frame 0xf4053ad4 tty_wait(c80ba200,c80ba270,f4053c10,1,0,...) at tty_wait+0x4b/frame 0xf4053af8 ttydisc_read(c80ba200,f4053c10,0,a1,f4053c10,...) at ttydisc_read+0x377/frame 0xf4053b3c ttydev_read(c8093500,f4053c10,0,1,0,...) at ttydev_read+0x81/frame 0xf4053b5c devfs_read_f(ca7acd58,f4053c10,c7d7ce00,0,ca7f4bc0,...) at devfs_read_f+0x87/frame 0xf4053b90 dofileread(ca7acd58,f4053c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf4053bc4 kern_readv(ca7f4bc0,0,f4053c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf4053bf0 sys_read(ca7f4bc0,f4053cc8,f4053d08,1,1,...) at sys_read+0x5c/frame 0xf4053c40 syscall(f4053d08) at syscall+0x2ed/frame 0xf4053cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4053cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1446 tid 100166 td 0xcaefe000 sched_switch(caefe000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf40c19b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf40c19ec sleepq_switch(caefe000,0,c1088efd,1ab,f40c1a64,...) at sleepq_switch+0x1b9/frame 0xf40c1a20 sleepq_catch_signals(0,c1088efd,164,360,1,...) at sleepq_catch_signals+0x3b1/frame 0xf40c1a68 sleepq_wait_sig(c80ba470,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40c1a8c _cv_wait_sig(c80ba470,c13f7324,c108dc5d,531,f40c1c10,...) at _cv_wait_sig+0x200/frame 0xf40c1ad4 tty_wait(c80ba400,c80ba470,f40c1c10,1,0,...) at tty_wait+0x4b/frame 0xf40c1af8 ttydisc_read(c80ba400,f40c1c10,0,a1,f40c1c10,...) at ttydisc_read+0x377/frame 0xf40c1b3c ttydev_read(c8093600,f40c1c10,0,1,0,...) at ttydev_read+0x81/frame 0xf40c1b5c devfs_read_f(cbc49968,f40c1c10,c7d7ce00,0,caefe000,...) at devfs_read_f+0x87/frame 0xf40c1b90 dofileread(cbc49968,f40c1c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf40c1bc4 kern_readv(caefe000,0,f40c1c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf40c1bf0 sys_read(caefe000,f40c1cc8,c10da553,d6,1,...) at sys_read+0x5c/frame 0xf40c1c40 syscall(f40c1d08) at syscall+0x2ed/frame 0xf40c1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf40c1cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1445 tid 100135 td 0xcb1742f0 sched_switch(cb1742f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf404d9b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf404d9ec sleepq_switch(cb1742f0,0,c1088efd,1ab,f404da64,...) at sleepq_switch+0x1b9/frame 0xf404da20 sleepq_catch_signals(0,c1088efd,164,a80,1,...) at sleepq_catch_signals+0x3b1/frame 0xf404da68 sleepq_wait_sig(c7f07070,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf404da8c _cv_wait_sig(c7f07070,c13f7324,c108dc5d,531,f404dc10,...) at _cv_wait_sig+0x200/frame 0xf404dad4 tty_wait(c7f07000,c7f07070,f404dc10,1,0,...) at tty_wait+0x4b/frame 0xf404daf8 ttydisc_read(c7f07000,f404dc10,0,a1,f404dc10,...) at ttydisc_read+0x377/frame 0xf404db3c ttydev_read(c8093700,f404dc10,0,1,0,...) at ttydev_read+0x81/frame 0xf404db5c devfs_read_f(cbc659d8,f404dc10,c7d7ce00,0,cb1742f0,...) at devfs_read_f+0x87/frame 0xf404db90 dofileread(cbc659d8,f404dc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf404dbc4 kern_readv(cb1742f0,0,f404dc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf404dbf0 sys_read(cb1742f0,f404dcc8,f404dd08,1,1,...) at sys_read+0x5c/frame 0xf404dc40 syscall(f404dd08) at syscall+0x2ed/frame 0xf404dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf404dcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1444 tid 100163 td 0xcbc218d0 sched_switch(cbc218d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf40a89b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf40a89ec sleepq_switch(cbc218d0,0,c1088efd,1ab,f40a8a64,...) at sleepq_switch+0x1b9/frame 0xf40a8a20 sleepq_catch_signals(0,c1088efd,164,ab0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf40a8a68 sleepq_wait_sig(c7f07270,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40a8a8c _cv_wait_sig(c7f07270,c13f7324,c108dc5d,531,f40a8c10,...) at _cv_wait_sig+0x200/frame 0xf40a8ad4 tty_wait(c7f07200,c7f07270,f40a8c10,1,0,...) at tty_wait+0x4b/frame 0xf40a8af8 ttydisc_read(c7f07200,f40a8c10,0,a1,f40a8c10,...) at ttydisc_read+0x377/frame 0xf40a8b3c ttydev_read(c8093800,f40a8c10,0,1,0,...) at ttydev_read+0x81/frame 0xf40a8b5c devfs_read_f(ca76c5e8,f40a8c10,c7d7ce00,0,cbc218d0,...) at devfs_read_f+0x87/frame 0xf40a8b90 dofileread(ca76c5e8,f40a8c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf40a8bc4 kern_readv(cbc218d0,0,f40a8c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf40a8bf0 sys_read(cbc218d0,f40a8cc8,f40a8d08,1,1,...) at sys_read+0x5c/frame 0xf40a8c40 syscall(f40a8d08) at syscall+0x2ed/frame 0xf40a8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf40a8cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1443 tid 100092 td 0xca7915e0 sched_switch(ca7915e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f689b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf3f689ec sleepq_switch(ca7915e0,0,c1088efd,1ab,f3f68a64,...) at sleepq_switch+0x1b9/frame 0xf3f68a20 sleepq_catch_signals(0,c1088efd,164,ae0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3f68a68 sleepq_wait_sig(c7f07470,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3f68a8c _cv_wait_sig(c7f07470,c13f7324,c108dc5d,531,f3f68c10,...) at _cv_wait_sig+0x200/frame 0xf3f68ad4 tty_wait(c7f07400,c7f07470,f3f68c10,1,0,...) at tty_wait+0x4b/frame 0xf3f68af8 ttydisc_read(c7f07400,f3f68c10,0,a1,f3f68c10,...) at ttydisc_read+0x377/frame 0xf3f68b3c ttydev_read(c8093900,f3f68c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3f68b5c devfs_read_f(cafab508,f3f68c10,c7d7ce00,0,ca7915e0,...) at devfs_read_f+0x87/frame 0xf3f68b90 dofileread(cafab508,f3f68c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3f68bc4 kern_readv(ca7915e0,0,f3f68c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3f68bf0 sys_read(ca7915e0,f3f68cc8,c10da553,d6,1,...) at sys_read+0x5c/frame 0xf3f68c40 syscall(f3f68d08) at syscall+0x2ed/frame 0xf3f68cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f68cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1442 tid 100175 td 0xcbc51000 sched_switch(cbc51000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf40f09b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf40f09ec sleepq_switch(cbc51000,0,c1088efd,1ab,f40f0a64,...) at sleepq_switch+0x1b9/frame 0xf40f0a20 sleepq_catch_signals(0,c1088efd,164,b10,1,...) at sleepq_catch_signals+0x3b1/frame 0xf40f0a68 sleepq_wait_sig(c7f07670,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40f0a8c _cv_wait_sig(c7f07670,c13f7324,c108dc5d,531,f40f0c10,...) at _cv_wait_sig+0x200/frame 0xf40f0ad4 tty_wait(c7f07600,c7f07670,f40f0c10,1,0,...) at tty_wait+0x4b/frame 0xf40f0af8 ttydisc_read(c7f07600,f40f0c10,0,a1,f40f0c10,...) at ttydisc_read+0x377/frame 0xf40f0b3c ttydev_read(c8093a00,f40f0c10,0,1,0,...) at ttydev_read+0x81/frame 0xf40f0b5c devfs_read_f(cbc65888,f40f0c10,c7d7ce00,0,cbc51000,...) at devfs_read_f+0x87/frame 0xf40f0b90 dofileread(cbc65888,f40f0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf40f0bc4 kern_readv(cbc51000,0,f40f0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf40f0bf0 sys_read(cbc51000,f40f0cc8,14,c1085875,7b3,...) at sys_read+0x5c/frame 0xf40f0c40 syscall(f40f0d08) at syscall+0x2ed/frame 0xf40f0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf40f0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1441 tid 100182 td 0xcbc735e0 sched_switch(cbc735e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf411a9b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf411a9ec sleepq_switch(cbc735e0,0,c1088efd,1ab,f411aa64,...) at sleepq_switch+0x1b9/frame 0xf411aa20 sleepq_catch_signals(0,c1088efd,164,b40,1,...) at sleepq_catch_signals+0x3b1/frame 0xf411aa68 sleepq_wait_sig(c7f07870,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf411aa8c _cv_wait_sig(c7f07870,c13f7324,c108dc5d,531,f411ac10,...) at _cv_wait_sig+0x200/frame 0xf411aad4 tty_wait(c7f07800,c7f07870,f411ac10,1,0,...) at tty_wait+0x4b/frame 0xf411aaf8 ttydisc_read(c7f07800,f411ac10,0,a1,f411ac10,...) at ttydisc_read+0x377/frame 0xf411ab3c ttydev_read(c8093b00,f411ac10,0,1,0,...) at ttydev_read+0x81/frame 0xf411ab5c devfs_read_f(cbc65738,f411ac10,c7d7ce00,0,cbc735e0,...) at devfs_read_f+0x87/frame 0xf411ab90 dofileread(cbc65738,f411ac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf411abc4 kern_readv(cbc735e0,0,f411ac10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf411abf0 sys_read(cbc735e0,f411acc8,c10da553,d6,1,...) at sys_read+0x5c/frame 0xf411ac40 syscall(f411ad08) at syscall+0x2ed/frame 0xf411acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf411acfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1440 tid 100141 td 0xca7f4000 sched_switch(ca7f4000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf405f9b8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf405f9ec sleepq_switch(ca7f4000,0,c1088efd,1ab,f405fa64,...) at sleepq_switch+0x1b9/frame 0xf405fa20 sleepq_catch_signals(0,c1088efd,164,b70,1,...) at sleepq_catch_signals+0x3b1/frame 0xf405fa68 sleepq_wait_sig(c7f07a70,0,c108dc71,101,0,...) at sleepq_wait_sig+0x14/frame 0xf405fa8c _cv_wait_sig(c7f07a70,c13f7324,c108dc5d,531,f405fc10,...) at _cv_wait_sig+0x200/frame 0xf405fad4 tty_wait(c7f07a00,c7f07a70,f405fc10,1,0,...) at tty_wait+0x4b/frame 0xf405faf8 ttydisc_read(c7f07a00,f405fc10,0,a1,f405fc10,...) at ttydisc_read+0x377/frame 0xf405fb3c ttydev_read(c8093c00,f405fc10,0,1,0,...) at ttydev_read+0x81/frame 0xf405fb5c devfs_read_f(ca76c7a8,f405fc10,c7d7ce00,0,ca7f4000,...) at devfs_read_f+0x87/frame 0xf405fb90 dofileread(ca76c7a8,f405fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf405fbc4 kern_readv(ca7f4000,0,f405fc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf405fbf0 sys_read(ca7f4000,f405fcc8,f405fd08,1,1,...) at sys_read+0x5c/frame 0xf405fc40 syscall(f405fd08) at syscall+0x2ed/frame 0xf405fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf405fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1439 tid 100140 td 0xca7f42f0 sched_switch(ca7f42f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf405c9b8 mi_switch(104,0,c1088efd,1f7,46,...) at mi_switch+0x1c9/frame 0xf405c9ec sleepq_switch(ca7f42f0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf405ca20 sleepq_catch_signals(f405ca8c,c0a7f619,c7f07c14,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf405ca68 sleepq_wait_sig(c7f07c70,0,f405cac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf405ca8c _cv_wait_sig(c7f07c70,c7f07c04,c108dc5d,531,f405cc10,...) at _cv_wait_sig+0x200/frame 0xf405cad4 tty_wait(c7f07c00,c7f07c70,f405cc10,1,0,...) at tty_wait+0x4b/frame 0xf405caf8 ttydisc_read(c7f07c00,f405cc10,0,a1,f405cc10,...) at ttydisc_read+0x377/frame 0xf405cb3c ttydev_read(c7eeed00,f405cc10,0,1,0,...) at ttydev_read+0x81/frame 0xf405cb5c devfs_read_f(ca76cc78,f405cc10,c7d7ce00,0,ca7f42f0,...) at devfs_read_f+0x87/frame 0xf405cb90 dofileread(ca76cc78,f405cc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf405cbc4 kern_readv(ca7f42f0,0,f405cc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf405cbf0 sys_read(ca7f42f0,f405ccc8,c10da553,d6,7b3,...) at sys_read+0x5c/frame 0xf405cc40 syscall(f405cd08) at syscall+0x2ed/frame 0xf405ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf405ccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfb7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 1422 tid 100161 td 0xcbc22000 sched_switch(cbc22000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf40a0918 mi_switch(104,0,c1088efd,1f7,46,...) at mi_switch+0x1c9/frame 0xf40a094c sleepq_switch(cbc22000,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf40a0980 sleepq_catch_signals(f40a09ec,c0a7f619,caeea060,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40a09c8 sleepq_wait_sig(caeea064,0,f40a0a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40a09ec _cv_wait_sig(caeea064,caeea050,c108bcac,677,8,...) at _cv_wait_sig+0x200/frame 0xf40a0a34 seltdwait(cbd58268,58,c7d7ce00,cbc22000,cbc1cbc8,...) at seltdwait+0x8c/frame 0xf40a0a58 kern_select(cbc22000,8,bfbfd008,0,0,...) at kern_select+0x85f/frame 0xf40a0bf8 sys_select(cbc22000,f40a0cc8,f40a0d08,1,1,...) at sys_select+0x69/frame 0xf40a0c40 syscall(f40a0d08) at syscall+0x2ed/frame 0xf40a0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf40a0cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aef77, esp = 0xbfbfcf84, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 1397 tid 100155 td 0xca7ea2f0 sched_switch(ca7ea2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4089a80 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf4089ab4 sleepq_switch(ca7ea2f0,0,c1088efd,1ab,f4089b2c,...) at sleepq_switch+0x1b9/frame 0xf4089ae8 sleepq_catch_signals(ea61,c0ad4fb0,ca7ea2f0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf4089b30 sleepq_timedwait_sig(c12303a0,6c,c1084a2e,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf4089b58 _sleep(c12303a0,0,16c,c1084a2e,ea61,...) at _sleep+0x303/frame 0xf4089bb0 kern_nanosleep(bfbfdd08,f4089c18,f4089c20,d490e670,3c,...) at kern_nanosleep+0xd9/frame 0xf4089c00 sys_nanosleep(ca7ea2f0,f4089cc8,14,c1085875,7b3,...) at sys_nanosleep+0x6b/frame 0xf4089c40 syscall(f4089d08) at syscall+0x2ed/frame 0xf4089cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4089cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817637f, esp = 0xbfbfdcfc, ebp = 0xbfbfdd40 --- Tracing command awk pid 835 tid 100139 td 0xca7f45e0 sched_switch(ca7f45e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4059a30 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf4059a64 sleepq_switch(ca7f45e0,0,c1088efd,1ab,f4059adc,...) at sleepq_switch+0x1b9/frame 0xf4059a98 sleepq_catch_signals(0,c1088efd,164,1e0,ca7f45e0,...) at sleepq_catch_signals+0x3b1/frame 0xf4059ae0 sleepq_wait_sig(cbc114c8,5c,c108bef1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4059b04 _sleep(cbc114c8,cbc11648,15c,c108bef1,0,...) at _sleep+0x32d/frame 0xf4059b5c pipe_read(ca7a2690,f4059c10,ca7a9480,0,ca7f45e0,...) at pipe_read+0x29c/frame 0xf4059b90 dofileread(ca7a2690,f4059c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf4059bc4 kern_readv(ca7f45e0,0,f4059c10,0,28855000,...) at kern_readv+0x66/frame 0xf4059bf0 sys_read(ca7f45e0,f4059cc8,8,c1083a9c,db,...) at sys_read+0x5c/frame 0xf4059c40 syscall(f4059d08) at syscall+0x2ed/frame 0xf4059cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4059cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c1fb7, esp = 0xbfbfd9e4, ebp = 0xbfbfd9f8 --- Tracing command sh pid 834 tid 100082 td 0xca741bc0 sched_switch(ca741bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f40998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xf3f409cc sleepq_switch(ca741bc0,0,c1088efd,1ab,f3f40a44,...) at sleepq_switch+0x1b9/frame 0xf3f40a00 sleepq_catch_signals(0,c1088efd,164,288,ca741bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f40a48 sleepq_wait_sig(ca629b40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3f40a6c _sleep(ca629b40,ca629bc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xf3f40ac4 kern_wait6(ca741bc0,7,0,0,f3f40b4c,...) at kern_wait6+0x43c/frame 0xf3f40b20 sys_wait4(ca741bc0,f3f40cc8,c10da553,e9,1,...) at sys_wait4+0x94/frame 0xf3f40c40 syscall(f3f40d08) at syscall+0x2ed/frame 0xf3f40cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f40cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815098f, esp = 0xbfbfd938, ebp = 0xbfbfd950 --- Tracing command tail pid 833 tid 100129 td 0xca7f55e0 sched_switch(ca7f55e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf403b948 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf403b97c sleepq_switch(ca7f55e0,0,c1088efd,1ab,f403b9f4,...) at sleepq_switch+0x1b9/frame 0xf403b9b0 sleepq_catch_signals(3e9,c0ad4fb0,ca7f55e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf403b9f8 sleepq_timedwait_sig(ca73d580,68,c107ca40,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf403ba20 _sleep(ca73d580,ca73d580,168,c107ca40,3e9,...) at _sleep+0x303/frame 0xf403ba78 kern_kevent(ca7f55e0,4,0,1,f403bc10,...) at kern_kevent+0x444/frame 0xf403bbb8 sys_kevent(ca7f55e0,f403bcc8,14,c1085875,7b3,...) at sys_kevent+0x12b/frame 0xf403bc40 syscall(f403bd08) at syscall+0x2ed/frame 0xf403bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf403bcfc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x281674bf, esp = 0xbfbfdb9c, ebp = 0xbfbfdc48 --- Tracing command sshd pid 832 tid 100128 td 0xca7f58d0 sched_switch(ca7f58d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4038918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf403894c sleepq_switch(ca7f58d0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf4038980 sleepq_catch_signals(f40389ec,c0a7f619,ca61fe60,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40389c8 sleepq_wait_sig(ca61fe64,0,f4038a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40389ec _cv_wait_sig(ca61fe64,ca61fe50,c108bcac,677,c,...) at _cv_wait_sig+0x200/frame 0xf4038a34 seltdwait(ca76c268,58,ca7a9280,ca7f58d0,c1379ca8,...) at seltdwait+0x8c/frame 0xf4038a58 kern_select(ca7f58d0,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf4038bf8 sys_select(ca7f58d0,f4038cc8,c7b15c80,c7b15ccc,0,...) at sys_select+0x69/frame 0xf4038c40 syscall(f4038d08) at syscall+0x2ed/frame 0xf4038cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4038cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28522f77, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sh pid 831 tid 100127 td 0xca7f5bc0 Tracing command sshd pid 830 tid 100086 td 0xca7f0000 sched_switch(ca7f0000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f50918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf3f5094c sleepq_switch(ca7f0000,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3f50980 sleepq_catch_signals(f3f509ec,c0a7f619,ca7406e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f509c8 sleepq_wait_sig(ca7406e4,0,f3f50a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3f509ec _cv_wait_sig(ca7406e4,ca7406d0,c108bcac,677,c,...) at _cv_wait_sig+0x200/frame 0xf3f50a34 seltdwait(cafab268,58,ca7a8a80,ca7f0000,c1379d00,...) at seltdwait+0x8c/frame 0xf3f50a58 kern_select(ca7f0000,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf3f50bf8 sys_select(ca7f0000,f3f50cc8,f3f50d08,1,1,...) at sys_select+0x69/frame 0xf3f50c40 syscall(f3f50d08) at syscall+0x2ed/frame 0xf3f50cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f50cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28522f77, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command top pid 829 tid 100148 td 0xca7f05e0 sched_switch(ca7f05e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4074914 mi_switch(104,0,c1088efd,1f7,c13f8000,...) at mi_switch+0x1c9/frame 0xf4074948 sleepq_switch(ca7f05e0,0,c1088efd,1ab,ca7e9dd0,...) at sleepq_switch+0x1b9/frame 0xf407497c sleepq_catch_signals(c11b6c64,f40749ec,c0a7f619,ca7e9de0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40749c4 sleepq_timedwait_sig(ca7e9de4,0,f4074a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf40749ec _cv_timedwait_sig(ca7e9de4,ca7e9dd0,3e9,677,f4074ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf4074a34 seltdwait(f4074ac0,f4074ac8,ca70e080,ca7f05e0,a302e30,...) at seltdwait+0x7e/frame 0xf4074a58 kern_select(ca7f05e0,2,bfbfdbe8,0,0,...) at kern_select+0x85f/frame 0xf4074bf8 sys_select(ca7f05e0,f4074cc8,f4074d08,1,1,...) at sys_select+0x69/frame 0xf4074c40 syscall(f4074d08) at syscall+0x2ed/frame 0xf4074cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4074cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281f3f77, esp = 0xbfbfdb7c, ebp = 0xbfbfdcf4 --- Tracing command sshd pid 828 tid 100077 td 0xca791bc0 sched_switch(ca791bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f2c918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf3f2c94c sleepq_switch(ca791bc0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3f2c980 sleepq_catch_signals(f3f2c9ec,c0a7f619,ca7403e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f2c9c8 sleepq_wait_sig(ca7403e4,0,f3f2ca20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3f2c9ec _cv_wait_sig(ca7403e4,ca7403d0,c108bcac,677,a,...) at _cv_wait_sig+0x200/frame 0xf3f2ca34 seltdwait(ca7ace38,58,ca77e400,ca791bc0,c1379e60,...) at seltdwait+0x8c/frame 0xf3f2ca58 kern_select(ca791bc0,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf3f2cbf8 sys_select(ca791bc0,f3f2ccc8,f3f2cd08,1,1,...) at sys_select+0x69/frame 0xf3f2cc40 syscall(f3f2cd08) at syscall+0x2ed/frame 0xf3f2ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f2ccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28522f77, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 825 tid 100125 td 0xca78b8d0 sched_switch(ca78b8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf402f988 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf402f9bc sleepq_switch(ca78b8d0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf402f9f0 sleepq_catch_signals(f402fa5c,c0a7f619,ca7e92e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf402fa38 sleepq_wait_sig(ca7e92e4,0,f402fa90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf402fa5c _cv_wait_sig(ca7e92e4,ca7e92d0,c108bcac,677,ca78b8d0,...) at _cv_wait_sig+0x200/frame 0xf402faa4 seltdwait(cb17622c,c108bcac,5ac,ca78b8d0,ca78b8d0,...) at seltdwait+0x8c/frame 0xf402fac8 sys_poll(ca78b8d0,f402fcc8,f402fd08,1,1,...) at sys_poll+0x3e5/frame 0xf402fc40 syscall(f402fd08) at syscall+0x2ed/frame 0xf402fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf402fcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b9aaf, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sshd pid 824 tid 100132 td 0xca78b000 sched_switch(ca78b000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4044988 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf40449bc sleepq_switch(ca78b000,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf40449f0 sleepq_catch_signals(f4044a5c,c0a7f619,ca7e97a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf4044a38 sleepq_wait_sig(ca7e97a4,0,f4044a90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf4044a5c _cv_wait_sig(ca7e97a4,ca7e9790,c108bcac,677,ca78b000,...) at _cv_wait_sig+0x200/frame 0xf4044aa4 seltdwait(ca7f152c,c108bcac,5ac,ca78b000,ca78b000,...) at seltdwait+0x8c/frame 0xf4044ac8 sys_poll(ca78b000,f4044cc8,f4044d08,1,1,...) at sys_poll+0x3e5/frame 0xf4044c40 syscall(f4044d08) at syscall+0x2ed/frame 0xf4044cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4044cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b9aaf, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sshd pid 822 tid 100133 td 0xcb1748d0 sched_switch(cb1748d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4047988 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf40479bc sleepq_switch(cb1748d0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf40479f0 sleepq_catch_signals(f4047a5c,c0a7f619,ca7e98e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf4047a38 sleepq_wait_sig(ca7e98e4,0,f4047a90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf4047a5c _cv_wait_sig(ca7e98e4,ca7e98d0,c108bcac,677,cb1748d0,...) at _cv_wait_sig+0x200/frame 0xf4047aa4 seltdwait(cab6d32c,c108bcac,5ac,cb1748d0,ca7399f8,...) at seltdwait+0x8c/frame 0xf4047ac8 sys_poll(cb1748d0,f4047cc8,f4047d08,1,1,...) at sys_poll+0x3e5/frame 0xf4047c40 syscall(f4047d08) at syscall+0x2ed/frame 0xf4047cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4047cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b9aaf, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command bash pid 807 tid 100097 td 0xca7412f0 sched_switch(ca7412f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f7c9b8 mi_switch(104,0,c1088efd,1f7,46,...) at mi_switch+0x1c9/frame 0xf3f7c9ec sleepq_switch(ca7412f0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3f7ca20 sleepq_catch_signals(f3f7ca8c,c0a7f619,ca566214,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f7ca68 sleepq_wait_sig(ca566270,0,f3f7cac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3f7ca8c _cv_wait_sig(ca566270,ca566204,c108dc5d,531,f3f7cc10,...) at _cv_wait_sig+0x200/frame 0xf3f7cad4 tty_wait(ca566200,ca566270,f3f7cc10,1,0,...) at tty_wait+0x4b/frame 0xf3f7caf8 ttydisc_read(ca566200,f3f7cc10,0,a1,f3f7cc10,...) at ttydisc_read+0x377/frame 0xf3f7cb3c ttydev_read(ca708a00,f3f7cc10,0,1,0,...) at ttydev_read+0x81/frame 0xf3f7cb5c devfs_read_f(ca7a21c0,f3f7cc10,ca7a9b00,0,ca7412f0,...) at devfs_read_f+0x87/frame 0xf3f7cb90 dofileread(ca7a21c0,f3f7cc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3f7cbc4 kern_readv(ca7412f0,0,f3f7cc10,0,bfbfcdff,...) at kern_readv+0x66/frame 0xf3f7cbf0 sys_read(ca7412f0,f3f7ccc8,f3f7cc8c,c0a64f80,c123c590,...) at sys_read+0x5c/frame 0xf3f7cc40 syscall(f3f7cd08) at syscall+0x2ed/frame 0xf3f7ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f7ccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2835efb7, esp = 0xbfbfcddc, ebp = 0xbfbfce08 --- Tracing command csh pid 804 tid 100114 td 0xcaeff5e0 Tracing command su pid 803 tid 100105 td 0xca7ee8d0 Tracing command bash pid 798 tid 100094 td 0xca7ef2f0 Tracing command sshd pid 797 tid 100145 td 0xca7f08d0 sched_switch(ca7f08d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf406b918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf406b94c sleepq_switch(ca7f08d0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf406b980 sleepq_catch_signals(f406b9ec,c0a7f619,ca7404a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf406b9c8 sleepq_wait_sig(ca7404a4,0,f406ba20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf406b9ec _cv_wait_sig(ca7404a4,ca740490,c108bcac,677,c,...) at _cv_wait_sig+0x200/frame 0xf406ba34 seltdwait(ca76ce70,58,ca70eb00,ca7f08d0,c137a280,...) at seltdwait+0x8c/frame 0xf406ba58 kern_select(ca7f08d0,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf406bbf8 sys_select(ca7f08d0,f406bcc8,f406bd08,1,1,...) at sys_select+0x69/frame 0xf406bc40 syscall(f406bd08) at syscall+0x2ed/frame 0xf406bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf406bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28522f77, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 795 tid 100150 td 0xcb1732f0 sched_switch(cb1732f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf407a988 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf407a9bc sleepq_switch(cb1732f0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf407a9f0 sleepq_catch_signals(f407aa5c,c0a7f619,ca7e9ea0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf407aa38 sleepq_wait_sig(ca7e9ea4,0,f407aa90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf407aa5c _cv_wait_sig(ca7e9ea4,ca7e9e90,c108bcac,677,cb1732f0,...) at _cv_wait_sig+0x200/frame 0xf407aaa4 seltdwait(cb37322c,c108bcac,5ac,cb1732f0,ffffff80,...) at seltdwait+0x8c/frame 0xf407aac8 sys_poll(cb1732f0,f407acc8,f407ad08,1,1,...) at sys_poll+0x3e5/frame 0xf407ac40 syscall(f407ad08) at syscall+0x2ed/frame 0xf407acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf407acfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b9aaf, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command cron pid 746 tid 100090 td 0xca7ef8d0 sched_switch(ca7ef8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f60a80 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf3f60ab4 sleepq_switch(ca7ef8d0,0,c1088efd,1ab,f3f60b2c,...) at sleepq_switch+0x1b9/frame 0xf3f60ae8 sleepq_catch_signals(74ad,c0ad4fb0,ca7ef8d0,3,3,...) at sleepq_catch_signals+0x3b1/frame 0xf3f60b30 sleepq_timedwait_sig(c12303a0,6c,c1084a2e,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f60b58 _sleep(c12303a0,0,16c,c1084a2e,74ad,...) at _sleep+0x303/frame 0xf3f60bb0 kern_nanosleep(bfbfde28,f3f60c18,f3f60c20,0,1d,...) at kern_nanosleep+0xd9/frame 0xf3f60c00 sys_nanosleep(ca7ef8d0,f3f60cc8,0,0,ca7ef8d0,...) at sys_nanosleep+0x6b/frame 0xf3f60c40 syscall(f3f60d08) at syscall+0x2ed/frame 0xf3f60cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f60cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2818537f, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 741 tid 100113 td 0xc950f2f0 Tracing command sendmail pid 738 tid 100124 td 0xca78bbc0 sched_switch(ca78bbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf402c914 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf402c948 sleepq_switch(ca78bbc0,0,c1088efd,1ab,ca7e9810,...) at sleepq_switch+0x1b9/frame 0xf402c97c sleepq_catch_signals(c11b6c64,f402c9ec,c0a7f619,ca7e9820,0,...) at sleepq_catch_signals+0x3b1/frame 0xf402c9c4 sleepq_timedwait_sig(ca7e9824,0,f402ca20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf402c9ec _cv_timedwait_sig(ca7e9824,ca7e9810,1389,677,f402cac0,...) at _cv_timedwait_sig+0x20c/frame 0xf402ca34 seltdwait(f402cac0,f402cac8,ca77e800,ca78bbc0,f402caa0,...) at seltdwait+0x7e/frame 0xf402ca58 kern_select(ca78bbc0,5,bfbfb478,0,0,...) at kern_select+0x85f/frame 0xf402cbf8 sys_select(ca78bbc0,f402ccc8,f402cc8c,c0a64f80,c123d390,...) at sys_select+0x69/frame 0xf402cc40 syscall(f402cd08) at syscall+0x2ed/frame 0xf402ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf402ccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2841cf77, esp = 0xbfbfb36c, ebp = 0xbfbfbf98 --- Tracing command sshd pid 735 tid 100121 td 0xcaefe8d0 sched_switch(caefe8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4023918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf402394c sleepq_switch(caefe8d0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf4023980 sleepq_catch_signals(f40239ec,c0a7f619,ca789c20,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40239c8 sleepq_wait_sig(ca789c24,0,f4023a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40239ec _cv_wait_sig(ca789c24,ca789c10,c108bcac,677,5,...) at _cv_wait_sig+0x200/frame 0xf4023a34 seltdwait(ca7ac3b8,58,ca60d580,caefe8d0,c7d7f998,...) at seltdwait+0x8c/frame 0xf4023a58 kern_select(caefe8d0,9,28c0c140,0,0,...) at kern_select+0x85f/frame 0xf4023bf8 sys_select(caefe8d0,f4023cc8,0,0,caefe8d0,...) at sys_select+0x69/frame 0xf4023c40 syscall(f4023d08) at syscall+0x2ed/frame 0xf4023cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4023cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28522f77, esp = 0xbfbfd47c, ebp = 0xbfbfde44 --- Tracing command winbindd pid 720 tid 100084 td 0xca7415e0 sched_switch(ca7415e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f48984 mi_switch(104,0,c1088efd,1f7,c13f8000,...) at mi_switch+0x1c9/frame 0xf3f489b8 sleepq_switch(ca7415e0,0,c1088efd,1ab,ca7e9690,...) at sleepq_switch+0x1b9/frame 0xf3f489ec sleepq_catch_signals(c11b6c64,f3f48a5c,c0a7f619,ca7e96a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f48a34 sleepq_timedwait_sig(ca7e96a4,0,f3f48a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f48a5c _cv_timedwait_sig(ca7e96a4,ca7e9690,5265c00,677,ca7415e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f48aa4 seltdwait(f3f48b10,f3f48b18,5ac,ca7415e0,caf87120,...) at seltdwait+0x7e/frame 0xf3f48ac8 sys_poll(ca7415e0,f3f48cc8,f3f48d08,1,1,...) at sys_poll+0x3e5/frame 0xf3f48c40 syscall(f3f48d08) at syscall+0x2ed/frame 0xf3f48cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f48cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21937aaf, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command moused pid 702 tid 100123 td 0xcaefe2f0 sched_switch(caefe2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4029918 mi_switch(104,0,c1088efd,1f7,46,...) at mi_switch+0x1c9/frame 0xf402994c sleepq_switch(caefe2f0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf4029980 sleepq_catch_signals(f40299ec,c0a7f619,ca7e9720,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40299c8 sleepq_wait_sig(ca7e9724,0,f4029a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40299ec _cv_wait_sig(ca7e9724,ca7e9710,c108bcac,677,6,...) at _cv_wait_sig+0x200/frame 0xf4029a34 seltdwait(ca754c08,58,c7d7ce00,caefe2f0,0,...) at seltdwait+0x8c/frame 0xf4029a58 kern_select(caefe2f0,400,bfbfdcb0,0,0,...) at kern_select+0x85f/frame 0xf4029bf8 sys_select(caefe2f0,f4029cc8,f4029d08,1,1,...) at sys_select+0x69/frame 0xf4029c40 syscall(f4029d08) at syscall+0x2ed/frame 0xf4029cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4029cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bcf77, esp = 0xbfbfd88c, ebp = 0xbfbfde24 --- Tracing command smbd pid 701 tid 100079 td 0xca7455e0 sched_switch(ca7455e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f34984 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf3f349b8 sleepq_switch(ca7455e0,0,c1088efd,1ab,ca78a110,...) at sleepq_switch+0x1b9/frame 0xf3f349ec sleepq_catch_signals(c11b6c64,f3f34a5c,c0a7f619,ca78a120,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f34a34 sleepq_timedwait_sig(ca78a124,0,f3f34a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f34a5c _cv_timedwait_sig(ca78a124,ca78a110,5265c00,677,ca7455e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f34aa4 seltdwait(f3f34b10,f3f34b18,5ac,ca7455e0,cac48bc8,...) at seltdwait+0x7e/frame 0xf3f34ac8 sys_poll(ca7455e0,f3f34cc8,f3f34d08,1,1,...) at sys_poll+0x3e5/frame 0xf3f34c40 syscall(f3f34d08) at syscall+0x2ed/frame 0xf3f34cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f34cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b60aaf, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 685 tid 100120 td 0xcaefebc0 sched_switch(caefebc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4020984 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf40209b8 sleepq_switch(caefebc0,0,c1088efd,1ab,ca78a090,...) at sleepq_switch+0x1b9/frame 0xf40209ec sleepq_catch_signals(c11b6c64,f4020a5c,c0a7f619,ca78a0a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf4020a34 sleepq_timedwait_sig(ca78a0a4,0,f4020a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf4020a5c _cv_timedwait_sig(ca78a0a4,ca78a090,493d1,677,caefebc0,...) at _cv_timedwait_sig+0x20c/frame 0xf4020aa4 seltdwait(f4020b10,f4020b18,5ac,caefebc0,c7de50e8,...) at seltdwait+0x7e/frame 0xf4020ac8 sys_poll(caefebc0,f4020cc8,f4020d08,1,1,...) at sys_poll+0x3e5/frame 0xf4020c40 syscall(f4020d08) at syscall+0x2ed/frame 0xf4020cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4020cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21937aaf, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 683 tid 100088 td 0xc807b8d0 sched_switch(c807b8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f58984 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf3f589b8 sleepq_switch(c807b8d0,0,c1088efd,1ab,ca7e9450,...) at sleepq_switch+0x1b9/frame 0xf3f589ec sleepq_catch_signals(c11b6c64,f3f58a5c,c0a7f619,ca7e9460,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f58a34 sleepq_timedwait_sig(ca7e9464,0,f3f58a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f58a5c _cv_timedwait_sig(ca7e9464,ca7e9450,ea61,677,c807b8d0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f58aa4 seltdwait(f3f58b10,f3f58b18,5ac,c807b8d0,0,...) at seltdwait+0x7e/frame 0xf3f58ac8 sys_poll(c807b8d0,f3f58cc8,0,0,c807b8d0,...) at sys_poll+0x3e5/frame 0xf3f58c40 syscall(f3f58d08) at syscall+0x2ed/frame 0xf3f58cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f58cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b60aaf, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 681 tid 100087 td 0xca7efbc0 sched_switch(ca7efbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f54984 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf3f549b8 sleepq_switch(ca7efbc0,0,c1088efd,1ab,ca78a0d0,...) at sleepq_switch+0x1b9/frame 0xf3f549ec sleepq_catch_signals(c11b6c64,f3f54a5c,c0a7f619,ca78a0e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f54a34 sleepq_timedwait_sig(ca78a0e4,0,f3f54a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f54a5c _cv_timedwait_sig(ca78a0e4,ca78a0d0,2711,677,ca7efbc0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f54aa4 seltdwait(f3f54b10,f3f54b18,5ac,ca7efbc0,cab7d0e8,...) at seltdwait+0x7e/frame 0xf3f54ac8 sys_poll(ca7efbc0,f3f54cc8,f3f54d08,1,1,...) at sys_poll+0x3e5/frame 0xf3f54c40 syscall(f3f54d08) at syscall+0x2ed/frame 0xf3f54cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f54cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21562aaf, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 657 tid 100103 td 0xca790000 sched_switch(ca790000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f9b918 mi_switch(104,0,c1088efd,1f7,200046,...) at mi_switch+0x1c9/frame 0xf3f9b94c sleepq_switch(ca790000,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3f9b980 sleepq_catch_signals(f3f9b9ec,c0a7f619,ca789760,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f9b9c8 sleepq_wait_sig(ca789764,0,f3f9ba20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3f9b9ec _cv_wait_sig(ca789764,ca789750,c108bcac,677,1c,...) at _cv_wait_sig+0x200/frame 0xf3f9ba34 seltdwait(ca7a2818,58,c7d7ce00,ca790000,0,...) at seltdwait+0x8c/frame 0xf3f9ba58 kern_select(ca790000,1c,bfbfdd48,0,0,...) at kern_select+0x85f/frame 0xf3f9bbf8 sys_select(ca790000,f3f9bcc8,0,0,ca790000,...) at sys_select+0x69/frame 0xf3f9bc40 syscall(f3f9bd08) at syscall+0x2ed/frame 0xf3f9bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f9bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28396f77, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 602 tid 100119 td 0xca7ea5e0 sched_switch(ca7ea5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf401da90 mi_switch(104,0,c1088efd,1f7,c13f7f00,...) at mi_switch+0x1c9/frame 0xf401dac4 sleepq_switch(ca7ea5e0,0,c1088efd,1ab,c803c980,...) at sleepq_switch+0x1b9/frame 0xf401daf8 sleepq_catch_signals(c11b6c64,f401db68,c0a7f619,c803c990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf401db40 sleepq_timedwait_sig(ca6ee9d0,0,f401db9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf401db68 _cv_timedwait_sig(ca6ee9d0,c803c980,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf401dbb0 svc_run_internal(f401dcf4,c0a62abf,c803c980,f401dd08,c107cf30,...) at svc_run_internal+0xa50/frame 0xf401dcc4 svc_thread_start(c803c980,f401dd08,c107cf30,3d7,0,...) at svc_thread_start+0xd/frame 0xf401dccc fork_exit(c0c8df90,c803c980,f401dd08) at fork_exit+0x7f/frame 0xf401dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf401dcf4 --- trap 0x8f94c22e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd92f --- Tracing command nfsd pid 602 tid 100118 td 0xca7ea8d0 sched_switch(ca7ea8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf401aa90 mi_switch(104,0,c1088efd,1f7,c13f8000,...) at mi_switch+0x1c9/frame 0xf401aac4 sleepq_switch(ca7ea8d0,0,c1088efd,1ab,c803c980,...) at sleepq_switch+0x1b9/frame 0xf401aaf8 sleepq_catch_signals(c11b6c64,f401ab68,c0a7f619,c803c990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf401ab40 sleepq_timedwait_sig(ca6ef5d0,0,f401ab9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf401ab68 _cv_timedwait_sig(ca6ef5d0,c803c980,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf401abb0 svc_run_internal(f401acf4,c0a62abf,c803c980,f401ad08,c107cf30,...) at svc_run_internal+0xa50/frame 0xf401acc4 svc_thread_start(c803c980,f401ad08,c107cf30,3d7,0,...) at svc_thread_start+0xd/frame 0xf401accc fork_exit(c0c8df90,c803c980,f401ad08) at fork_exit+0x7f/frame 0xf401acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf401acf4 --- trap 0x8f94c22e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd92f --- Tracing command nfsd pid 602 tid 100117 td 0xca7eabc0 sched_switch(ca7eabc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4017a90 mi_switch(104,0,c1088efd,1f7,c13f7f00,...) at mi_switch+0x1c9/frame 0xf4017ac4 sleepq_switch(ca7eabc0,0,c1088efd,1ab,c803c980,...) at sleepq_switch+0x1b9/frame 0xf4017af8 sleepq_catch_signals(c11b6c64,f4017b68,c0a7f619,c803c990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf4017b40 sleepq_timedwait_sig(ca6eea10,0,f4017b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf4017b68 _cv_timedwait_sig(ca6eea10,c803c980,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf4017bb0 svc_run_internal(f4017cf4,c0a62abf,c803c980,f4017d08,c107cf30,...) at svc_run_internal+0xa50/frame 0xf4017cc4 svc_thread_start(c803c980,f4017d08,c107cf30,3d7,0,...) at svc_thread_start+0xd/frame 0xf4017ccc fork_exit(c0c8df90,c803c980,f4017d08) at fork_exit+0x7f/frame 0xf4017cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf4017cf4 --- trap 0x8f94c22e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd92f --- Tracing command nfsd pid 602 tid 100100 td 0xca7908d0 sched_switch(ca7908d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f8e318 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf3f8e34c sleepq_switch(ca7908d0,0,c1088efd,1ab,c803c980,...) at sleepq_switch+0x1b9/frame 0xf3f8e380 sleepq_catch_signals(c11b6c64,f3f8e3f0,c0a7f619,c803c990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f8e3c8 sleepq_timedwait_sig(ca60ed10,0,f3f8e424,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f8e3f0 _cv_timedwait_sig(ca60ed10,c803c980,1388,3b1,c7d7e340,...) at _cv_timedwait_sig+0x20c/frame 0xf3f8e438 svc_run_internal(c0c8df90,c803c980,ca786870,f3f8e578,0,...) at svc_run_internal+0xa50/frame 0xf3f8e550 svc_run(c803c980,0,c106ed1b,1b2,c7d82440,...) at svc_run+0xc3/frame 0xf3f8e588 nfsrvd_nfsd(ca7908d0,f3f8e6e0,c,20b,ca3d3cdc,...) at nfsrvd_nfsd+0x1a2/frame 0xf3f8e6c0 nfssvc_nfsd(ca7908d0,f3f8ecc8,0,ca7908d0,f3f8ecfc,...) at nfssvc_nfsd+0xf4/frame 0xf3f8ec28 sys_nfssvc(ca7908d0,f3f8ecc8,f3f8ed08,1,1,...) at sys_nfssvc+0xbf/frame 0xf3f8ec40 syscall(f3f8ed08) at syscall+0x2ed/frame 0xf3f8ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f8ecfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c1ae7, esp = 0xbfbfd7dc, ebp = 0xbfbfda50 --- Tracing command nfsd pid 596 tid 100111 td 0xc950f8d0 sched_switch(c950f8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4005918 mi_switch(104,0,c1088efd,1f7,46,...) at mi_switch+0x1c9/frame 0xf400594c sleepq_switch(c950f8d0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf4005980 sleepq_catch_signals(f40059ec,c0a7f619,ca7898a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40059c8 sleepq_wait_sig(ca7898a4,0,f4005a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf40059ec _cv_wait_sig(ca7898a4,ca789890,c108bcac,677,7,...) at _cv_wait_sig+0x200/frame 0xf4005a34 seltdwait(ca754b60,58,c7d7ce00,c950f8d0,f4005a90,...) at seltdwait+0x8c/frame 0xf4005a58 kern_select(c950f8d0,7,bfbfdc30,0,0,...) at kern_select+0x85f/frame 0xf4005bf8 sys_select(c950f8d0,f4005cc8,f4005d08,1,1,...) at sys_select+0x69/frame 0xf4005c40 syscall(f4005d08) at syscall+0x2ed/frame 0xf4005cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4005cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f77, esp = 0xbfbfda54, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 594 tid 100110 td 0xc950fbc0 sched_switch(c950fbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf4002914 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf4002948 sleepq_switch(c950fbc0,0,c1088efd,1ab,ca7402d0,...) at sleepq_switch+0x1b9/frame 0xf400297c sleepq_catch_signals(c11b6c64,f40029ec,c0a7f619,ca7402e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf40029c4 sleepq_timedwait_sig(ca7402e4,0,f4002a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf40029ec _cv_timedwait_sig(ca7402e4,ca7402d0,7531,677,f4002ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf4002a34 seltdwait(f4002ac0,f4002ac8,c7d7ce00,c950fbc0,f4002ab0,...) at seltdwait+0x7e/frame 0xf4002a58 kern_select(c950fbc0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf4002bf8 sys_select(c950fbc0,f4002cc8,f4002c8c,c0a64f80,c123c590,...) at sys_select+0x69/frame 0xf4002c40 syscall(f4002d08) at syscall+0x2ed/frame 0xf4002cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4002cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28187f77, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 593 tid 100109 td 0xca741000 sched_switch(ca741000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3fff914 mi_switch(104,0,c1088efd,1f7,c13f8000,...) at mi_switch+0x1c9/frame 0xf3fff948 sleepq_switch(ca741000,0,c1088efd,1ab,ca7897d0,...) at sleepq_switch+0x1b9/frame 0xf3fff97c sleepq_catch_signals(c11b6c64,f3fff9ec,c0a7f619,ca7897e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3fff9c4 sleepq_timedwait_sig(ca7897e4,0,f3fffa20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3fff9ec _cv_timedwait_sig(ca7897e4,ca7897d0,7531,677,f3fffac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3fffa34 seltdwait(f3fffac0,f3fffac8,c7d7ce00,ca741000,f3fffb60,...) at seltdwait+0x7e/frame 0xf3fffa58 kern_select(ca741000,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3fffbf8 sys_select(ca741000,f3fffcc8,f3fffc8c,c0a64f80,c123d390,...) at sys_select+0x69/frame 0xf3fffc40 syscall(f3fffd08) at syscall+0x2ed/frame 0xf3fffcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3fffcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28187f77, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 592 tid 100078 td 0xca7458d0 sched_switch(ca7458d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f30914 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf3f30948 sleepq_switch(ca7458d0,0,c1088efd,1ab,ca7e9010,...) at sleepq_switch+0x1b9/frame 0xf3f3097c sleepq_catch_signals(c11b6c64,f3f309ec,c0a7f619,ca7e9020,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f309c4 sleepq_timedwait_sig(ca7e9024,0,f3f30a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f309ec _cv_timedwait_sig(ca7e9024,ca7e9010,7531,677,f3f30ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f30a34 seltdwait(f3f30ac0,f3f30ac8,c7d7ce00,ca7458d0,ca745b9c,...) at seltdwait+0x7e/frame 0xf3f30a58 kern_select(ca7458d0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3f30bf8 sys_select(ca7458d0,f3f30cc8,f3f30d08,1,1,...) at sys_select+0x69/frame 0xf3f30c40 syscall(f3f30d08) at syscall+0x2ed/frame 0xf3f30cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f30cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28187f77, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 591 tid 100099 td 0xca7f6000 sched_switch(ca7f6000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f85914 mi_switch(104,0,c1088efd,1f7,c13f8100,...) at mi_switch+0x1c9/frame 0xf3f85948 sleepq_switch(ca7f6000,0,c1088efd,1ab,ca789790,...) at sleepq_switch+0x1b9/frame 0xf3f8597c sleepq_catch_signals(c11b6c64,f3f859ec,c0a7f619,ca7897a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f859c4 sleepq_timedwait_sig(ca7897a4,0,f3f85a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f859ec _cv_timedwait_sig(ca7897a4,ca789790,7531,677,f3f85ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f85a34 seltdwait(f3f85ac0,f3f85ac8,c7d7ce00,ca7f6000,f3f85a90,...) at seltdwait+0x7e/frame 0xf3f85a58 kern_select(ca7f6000,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3f85bf8 sys_select(ca7f6000,f3f85cc8,f3f85c8c,c0a64f80,c123cc90,...) at sys_select+0x69/frame 0xf3f85c40 syscall(f3f85d08) at syscall+0x2ed/frame 0xf3f85cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f85cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28187f77, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 590 tid 100101 td 0xca7905e0 Tracing command mountd pid 574 tid 100081 td 0xca745000 sched_switch(ca745000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f3c710 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xf3f3c744 sleepq_switch(ca745000,0,c1088efd,26d,0,...) at sleepq_switch+0x1b9/frame 0xf3f3c778 sleepq_wait(ca3d3cdc,60,c1072cdc,4,0,...) at sleepq_wait+0x48/frame 0xf3f3c79c sleeplk(ca3d3d48,c1072cdc,60,33,0,...) at sleeplk+0x11e/frame 0xf3f3c7d8 __lockmgr_args(ca3d3cdc,400400,ca3d3d48,0,0,...) at __lockmgr_args+0xaa4/frame 0xf3f3c8b8 ffs_lock(f3f3c940,0,0,0,ca7450b4,...) at ffs_lock+0xad/frame 0xf3f3c8f8 VOP_LOCK1_APV(c11e1340,f3f3c940,f3f3c968,c0ec9c20,c11f5b48,...) at VOP_LOCK1_APV+0x112/frame 0xf3f3c928 _vn_lock(ca3d3ca8,400400,c1092d47,383,ca3d3d48,...) at _vn_lock+0xca/frame 0xf3f3c968 lookup(f3f3ca98,c1092d47,106,ce,c10bdb1c,...) at lookup+0xc28/frame 0xf3f3c9c8 namei(f3f3ca98,152,0,1,4,...) at namei+0x47d/frame 0xf3f3ca50 vfs_donmount(ca745000,1300,0,ca71ac00,ca71ac00,...) at vfs_donmount+0x820/frame 0xf3f3cc18 sys_nmount(ca745000,f3f3ccc8,f3f3cd08,1,1,...) at sys_nmount+0x78/frame 0xf3f3cc40 syscall(f3f3cd08) at syscall+0x2ed/frame 0xf3f3ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f3ccfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280d8367, esp = 0xbfbfd7ac, ebp = 0xbfbfdd08 --- Tracing command rpcbind pid 541 tid 100085 td 0xca7918d0 sched_switch(ca7918d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f4c984 mi_switch(104,0,c1088efd,1f7,c13f7f00,...) at mi_switch+0x1c9/frame 0xf3f4c9b8 sleepq_switch(ca7918d0,0,c1088efd,1ab,ca7893d0,...) at sleepq_switch+0x1b9/frame 0xf3f4c9ec sleepq_catch_signals(c11b6c64,f3f4ca5c,c0a7f619,ca7893e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f4ca34 sleepq_timedwait_sig(ca7893e4,0,f3f4ca90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f4ca5c _cv_timedwait_sig(ca7893e4,ca7893d0,7531,677,ca7918d0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f4caa4 seltdwait(f3f4cb10,f3f4cb18,5ac,ca7918d0,ca7392b8,...) at seltdwait+0x7e/frame 0xf3f4cac8 sys_poll(ca7918d0,f3f4ccc8,f3f4cc8c,c0a64f80,c123c590,...) at sys_poll+0x3e5/frame 0xf3f4cc40 syscall(f3f4cd08) at syscall+0x2ed/frame 0xf3f4ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f4ccfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813eaaf, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 526 tid 100102 td 0xca7902f0 sched_switch(ca7902f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f97918 mi_switch(104,0,c1088efd,1f7,46,...) at mi_switch+0x1c9/frame 0xf3f9794c sleepq_switch(ca7902f0,0,c1088efd,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3f97980 sleepq_catch_signals(f3f979ec,c0a7f619,ca7891a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f979c8 sleepq_wait_sig(ca7891a4,0,f3f97a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3f979ec _cv_wait_sig(ca7891a4,ca789190,c108bcac,677,9,...) at _cv_wait_sig+0x200/frame 0xf3f97a34 seltdwait(ca76c3f0,58,c7d7ce00,ca7902f0,c11b6c64,...) at seltdwait+0x8c/frame 0xf3f97a58 kern_select(ca7902f0,9,28849100,0,0,...) at kern_select+0x85f/frame 0xf3f97bf8 sys_select(ca7902f0,f3f97cc8,0,0,ca7902f0,...) at sys_select+0x69/frame 0xf3f97c40 syscall(f3f97d08) at syscall+0x2ed/frame 0xf3f97cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f97cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2819ef77, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 423 tid 100095 td 0xca7ef000 sched_switch(ca7ef000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xf3f74914 mi_switch(104,0,c1088efd,1f7,c13f7e00,...) at mi_switch+0x1c9/frame 0xf3f74948 sleepq_switch(ca7ef000,0,c1088efd,1ab,ca789bd0,...) at sleepq_switch+0x1b9/frame 0xf3f7497c sleepq_catch_signals(c11b6c64,f3f749ec,c0a7f619,ca789be0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3f749c4 sleepq_timedwait_sig(ca789be4,0,f3f74a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3f749ec _cv_timedwait_sig(ca789be4,ca789bd0,ea61,677,f3f74ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3f74a34 seltdwait(f3f74ac0,f3f74ac8,c7d7ce00,ca7ef000,ca6cacb8,...) at seltdwait+0x7e/frame 0xf3f74a58 kern_select(ca7ef000,5,bfbfd998,0,0,...) at kern_select+0x85f/frame 0xf3f74bf8 sys_select(ca7ef000,f3f74cc8,f3f74d08,1,1,...) at sys_select+0x69/frame 0xf3f74c40 syscall(f3f74d08) at syscall+0x2ed/frame 0xf3f74cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3f74cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095903, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 18 tid 100075 td 0xc807bbc0 sched_switch(c807bbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea56bb8 mi_switch(104,0,c1088efd,1f7,0,...) at mi_switch+0x1c9/frame 0xeea56bec sleepq_switch(c807bbc0,0,c1088efd,290,c807bbc0,...) at sleepq_switch+0x1b9/frame 0xeea56c20 sleepq_timedwait(c13aa830,54,c10baeb0,0,0,...) at sleepq_timedwait+0x48/frame 0xeea56c44 _sleep(c13aa830,c13aa7bc,54,c10baeb0,3e8,...) at _sleep+0x317/frame 0xeea56c9c softdep_flush(0,eea56d08,c107cf30,3d7,0,...) at softdep_flush+0x23e/frame 0xeea56ccc fork_exit(c0ce6b00,0,eea56d08) at fork_exit+0x7f/frame 0xeea56cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea56cf4 --- trap 0, eip = 0, esp = 0xeea56d40, ebp = 0 --- Tracing command syncer pid 17 tid 100074 td 0xc950d000 sched_switch(c950d000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea53b84 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xeea53bb8 sleepq_switch(c950d000,0,c1088efd,290,0,...) at sleepq_switch+0x1b9/frame 0xeea53bec sleepq_timedwait(c13a6654,0,eea53c44,1,0,...) at sleepq_timedwait+0x48/frame 0xeea53c10 _cv_timedwait(c13a6654,c13a6634,3e8,795,4e20,...) at _cv_timedwait+0x20c/frame 0xeea53c58 sched_sync(0,eea53d08,c107cf30,3d7,0,...) at sched_sync+0x641/frame 0xeea53ccc fork_exit(c0b39c80,0,eea53d08) at fork_exit+0x7f/frame 0xeea53cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea53cf4 --- trap 0, eip = 0, esp = 0xeea53d40, ebp = 0 --- Tracing command vnlru pid 16 tid 100073 td 0xc950d2f0 sched_switch(c950d2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea50b8c mi_switch(104,0,c1088efd,1f7,0,...) at mi_switch+0x1c9/frame 0xeea50bc0 sleepq_switch(c950d2f0,0,c1088efd,290,c950d2f0,...) at sleepq_switch+0x1b9/frame 0xeea50bf4 sleepq_timedwait(ca628870,60,c1094c9a,0,0,...) at sleepq_timedwait+0x48/frame 0xeea50c18 _sleep(ca628870,c13a660c,260,c1094c9a,3e8,...) at _sleep+0x317/frame 0xeea50c70 vnlru_proc(0,eea50d08,c107cf30,3d7,0,...) at vnlru_proc+0x95/frame 0xeea50ccc fork_exit(c0b3a450,0,eea50d08) at fork_exit+0x7f/frame 0xeea50cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea50cf4 --- trap 0, eip = 0, esp = 0xeea50d40, ebp = 0 --- Tracing command bufdaemon pid 9 tid 100072 td 0xc950d5e0 sched_switch(c950d5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea4dbc8 mi_switch(104,0,c1088efd,1f7,0,...) at mi_switch+0x1c9/frame 0xeea4dbfc sleepq_switch(c950d5e0,0,c1088efd,290,c950d5e0,...) at sleepq_switch+0x1b9/frame 0xeea4dc30 sleepq_timedwait(c13a63e8,54,c1091898,0,0,...) at sleepq_timedwait+0x48/frame 0xeea4dc54 _sleep(c13a63e8,c13a63d0,54,c1091898,3e8,...) at _sleep+0x317/frame 0xeea4dcac buf_daemon(0,eea4dd08,c107cf30,3d7,0,...) at buf_daemon+0x8c/frame 0xeea4dccc fork_exit(c0b1da40,0,eea4dd08) at fork_exit+0x7f/frame 0xeea4dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea4dcf4 --- trap 0, eip = 0, esp = 0xeea4dd40, ebp = 0 --- Tracing command pagezero pid 8 tid 100071 td 0xc950d8d0 sched_switch(c950d8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea4abc0 mi_switch(104,0,c1088efd,1f7,0,...) at mi_switch+0x1c9/frame 0xeea4abf4 sleepq_switch(c950d8d0,0,c1088efd,290,c950d8d0,...) at sleepq_switch+0x1b9/frame 0xeea4ac28 sleepq_timedwait(c13ab134,0,c10c1eaa,0,0,...) at sleepq_timedwait+0x48/frame 0xeea4ac4c _sleep(c13ab134,c13feb00,0,c10c1eaa,493e0,...) at _sleep+0x317/frame 0xeea4aca4 vm_pagezero(0,eea4ad08,c107cf30,3d7,0,...) at vm_pagezero+0x89/frame 0xeea4accc fork_exit(c0d2cdf0,0,eea4ad08) at fork_exit+0x7f/frame 0xeea4acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea4acf4 --- trap 0, eip = 0, esp = 0xeea4ad40, ebp = 0 --- Tracing command vmdaemon pid 7 tid 100070 td 0xc950dbc0 sched_switch(c950dbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea47b8c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xeea47bc0 sleepq_switch(c950dbc0,0,c1088efd,26d,c950dbc0,...) at sleepq_switch+0x1b9/frame 0xeea47bf4 sleepq_wait(c13aad00,74,c1091898,0,0,...) at sleepq_wait+0x48/frame 0xeea47c18 _sleep(c13aad00,c13aace8,74,c1091898,0,...) at _sleep+0x34e/frame 0xeea47c70 vm_daemon(0,eea47d08,c107cf30,3d7,0,...) at vm_daemon+0x8c/frame 0xeea47ccc fork_exit(c0d25f30,0,eea47d08) at fork_exit+0x7f/frame 0xeea47cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea47cf4 --- trap 0, eip = 0, esp = 0xeea47d40, ebp = 0 --- Tracing command pagedaemon pid 6 tid 100069 td 0xc950e000 sched_switch(c950e000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xeea44b3c mi_switch(104,0,c1088efd,1f7,0,...) at mi_switch+0x1c9/frame 0xeea44b70 sleepq_switch(c950e000,0,c1088efd,290,c950e000,...) at sleepq_switch+0x1b9/frame 0xeea44ba4 sleepq_timedwait(c13feb84,54,c1091898,0,0,...) at sleepq_timedwait+0x48/frame 0xeea44bc8 _sleep(c13feb84,c13feb00,54,c1091898,1388,...) at _sleep+0x317/frame 0xeea44c20 vm_pageout(0,eea44d08,c107cf30,3d7,0,...) at vm_pageout+0x256/frame 0xeea44ccc fork_exit(c0d26790,0,eea44d08) at fork_exit+0x7f/frame 0xeea44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea44cf4 --- trap 0, eip = 0, esp = 0xeea44d40, ebp = 0 --- Tracing command xpt_thrd pid 5 tid 100068 td 0xc950e2f0 sched_switch(c950e2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee8c1bc4 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xee8c1bf8 sleepq_switch(c950e2f0,0,c1088efd,26d,c950e2f0,...) at sleepq_switch+0x1b9/frame 0xee8c1c2c sleepq_wait(c11fbe24,5c,c0ed5980,0,0,...) at sleepq_wait+0x48/frame 0xee8c1c50 _sleep(c11fbe24,c11fbe68,5c,c0ed5980,0,...) at _sleep+0x34e/frame 0xee8c1ca8 xpt_scanner_thread(0,ee8c1d08,c107cf30,3d7,0,...) at xpt_scanner_thread+0xfc/frame 0xee8c1ccc fork_exit(c04b2f00,0,ee8c1d08) at fork_exit+0x7f/frame 0xee8c1cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8c1cf4 --- trap 0, eip = 0, esp = 0xee8c1d40, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100067 td 0xc950e5e0 sched_switch(c950e5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee8bebcc mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xee8bec00 sleepq_switch(c950e5e0,0,c1088efd,26d,c950e5e0,...) at sleepq_switch+0x1b9/frame 0xee8bec34 sleepq_wait(c13fa870,0,c10a81b5,0,0,...) at sleepq_wait+0x48/frame 0xee8bec58 _sleep(c13fa870,c13fa838,0,c10a81b5,0,...) at _sleep+0x34e/frame 0xee8becb0 sctp_iterator_thread(0,ee8bed08,c107cf30,3d7,0,...) at sctp_iterator_thread+0x5c/frame 0xee8beccc fork_exit(c0bd5760,0,ee8bed08) at fork_exit+0x7f/frame 0xee8becf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8becf4 --- trap 0, eip = 0, esp = 0xee8bed40, ebp = 0 --- Tracing command ctl_thrd pid 3 tid 100064 td 0xc950f000 sched_switch(c950f000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee8b464c mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xee8b4680 sleepq_switch(c950f000,0,c1088efd,26d,c950f000,...) at sleepq_switch+0x1b9/frame 0xee8b46b4 sleepq_wait(c80bc000,5c,c0ee0567,0,0,...) at sleepq_wait+0x48/frame 0xee8b46d8 _sleep(c80bc000,c80bc000,5c,c0ee0567,0,...) at _sleep+0x34e/frame 0xee8b4730 ctl_work_thread(c80bc000,ee8b4d08,c107cf30,3d7,0,...) at ctl_work_thread+0x110/frame 0xee8b4ccc fork_exit(c04d5bf0,c80bc000,ee8b4d08) at fork_exit+0x7f/frame 0xee8b4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8b4cf4 --- trap 0, eip = 0, esp = 0xee8b4d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc806d8d0 sched_switch(c806d8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee8abb50 mi_switch(104,0,c1088efd,1f7,1,...) at mi_switch+0x1c9/frame 0xee8abb84 sleepq_switch(c806d8d0,0,c1088efd,290,c806d8d0,...) at sleepq_switch+0x1b9/frame 0xee8abbb8 sleepq_timedwait(c801423c,5c,c106f74a,0,0,...) at sleepq_timedwait+0x48/frame 0xee8abbdc _sleep(c801423c,c80142f0,5c,c106f74a,3e8,...) at _sleep+0x317/frame 0xee8abc34 fdc_thread(c8014200,ee8abd08,c107cf30,3d7,0,...) at fdc_thread+0x74a/frame 0xee8abccc fork_exit(c0e36940,c8014200,ee8abd08) at fork_exit+0x7f/frame 0xee8abcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8abcf4 --- trap 0, eip = 0, esp = 0xee8abd40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc80782f0 sched_switch(c80782f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee887bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee887c08 sleepq_switch(c80782f0,0,c1088efd,26d,c80782f0,...) at sleepq_switch+0x1b9/frame 0xee887c3c sleepq_wait(c8081d34,0,ee887c90,1,0,...) at sleepq_wait+0x48/frame 0xee887c60 _cv_wait(c8081d34,c8081e4c,c1060fa3,77,c8081d3c,...) at _cv_wait+0x1f9/frame 0xee887ca4 usb_process(c8081d2c,ee887d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee887ccc fork_exit(c0948520,c8081d2c,ee887d08) at fork_exit+0x7f/frame 0xee887cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee887cf4 --- trap 0, eip = 0, esp = 0xee887d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc80785e0 sched_switch(c80785e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee884bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee884c08 sleepq_switch(c80785e0,0,c1088efd,26d,c80785e0,...) at sleepq_switch+0x1b9/frame 0xee884c3c sleepq_wait(c8081d04,0,ee884c90,1,0,...) at sleepq_wait+0x48/frame 0xee884c60 _cv_wait(c8081d04,c8081e4c,c1060fa3,77,c8081d0c,...) at _cv_wait+0x1f9/frame 0xee884ca4 usb_process(c8081cfc,ee884d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee884ccc fork_exit(c0948520,c8081cfc,ee884d08) at fork_exit+0x7f/frame 0xee884cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee884cf4 --- trap 0, eip = 0, esp = 0xee884d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc80788d0 sched_switch(c80788d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee881bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee881c08 sleepq_switch(c80788d0,0,c1088efd,26d,c80788d0,...) at sleepq_switch+0x1b9/frame 0xee881c3c sleepq_wait(c8081cd4,0,ee881c90,1,0,...) at sleepq_wait+0x48/frame 0xee881c60 _cv_wait(c8081cd4,c8081e4c,c1060fa3,77,c8081cdc,...) at _cv_wait+0x1f9/frame 0xee881ca4 usb_process(c8081ccc,ee881d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee881ccc fork_exit(c0948520,c8081ccc,ee881d08) at fork_exit+0x7f/frame 0xee881cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee881cf4 --- trap 0, eip = 0, esp = 0xee881d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8078bc0 sched_switch(c8078bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee87ebd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee87ec08 sleepq_switch(c8078bc0,0,c1088efd,26d,c8078bc0,...) at sleepq_switch+0x1b9/frame 0xee87ec3c sleepq_wait(c8081ca4,0,ee87ec90,1,0,...) at sleepq_wait+0x48/frame 0xee87ec60 _cv_wait(c8081ca4,c8081e4c,c1060fa3,77,c8081cac,...) at _cv_wait+0x1f9/frame 0xee87eca4 usb_process(c8081c9c,ee87ed08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee87eccc fork_exit(c0948520,c8081c9c,ee87ed08) at fork_exit+0x7f/frame 0xee87ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee87ecf4 --- trap 0, eip = 0, esp = 0xee87ed40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc807b2f0 sched_switch(c807b2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee875bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee875c08 sleepq_switch(c807b2f0,0,c1088efd,26d,c807b2f0,...) at sleepq_switch+0x1b9/frame 0xee875c3c sleepq_wait(c8074b5c,0,ee875c90,1,0,...) at sleepq_wait+0x48/frame 0xee875c60 _cv_wait(c8074b5c,c8074c74,c1060fa3,77,c8074b64,...) at _cv_wait+0x1f9/frame 0xee875ca4 usb_process(c8074b54,ee875d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee875ccc fork_exit(c0948520,c8074b54,ee875d08) at fork_exit+0x7f/frame 0xee875cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee875cf4 --- trap 0, eip = 0, esp = 0xee875d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc807b5e0 sched_switch(c807b5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee872bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee872c08 sleepq_switch(c807b5e0,0,c1088efd,26d,c807b5e0,...) at sleepq_switch+0x1b9/frame 0xee872c3c sleepq_wait(c8074b2c,0,ee872c90,1,0,...) at sleepq_wait+0x48/frame 0xee872c60 _cv_wait(c8074b2c,c8074c74,c1060fa3,77,c8074b34,...) at _cv_wait+0x1f9/frame 0xee872ca4 usb_process(c8074b24,ee872d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee872ccc fork_exit(c0948520,c8074b24,ee872d08) at fork_exit+0x7f/frame 0xee872cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee872cf4 --- trap 0, eip = 0, esp = 0xee872d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc806b000 sched_switch(c806b000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee86fbd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee86fc08 sleepq_switch(c806b000,0,c1088efd,26d,c806b000,...) at sleepq_switch+0x1b9/frame 0xee86fc3c sleepq_wait(c8074afc,0,ee86fc90,1,0,...) at sleepq_wait+0x48/frame 0xee86fc60 _cv_wait(c8074afc,c8074c74,c1060fa3,77,c8074b04,...) at _cv_wait+0x1f9/frame 0xee86fca4 usb_process(c8074af4,ee86fd08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee86fccc fork_exit(c0948520,c8074af4,ee86fd08) at fork_exit+0x7f/frame 0xee86fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee86fcf4 --- trap 0, eip = 0, esp = 0xee86fd40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc806b2f0 sched_switch(c806b2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee86cbd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee86cc08 sleepq_switch(c806b2f0,0,c1088efd,26d,c806b2f0,...) at sleepq_switch+0x1b9/frame 0xee86cc3c sleepq_wait(c8074acc,0,ee86cc90,1,0,...) at sleepq_wait+0x48/frame 0xee86cc60 _cv_wait(c8074acc,c8074c74,c1060fa3,77,c8074ad4,...) at _cv_wait+0x1f9/frame 0xee86cca4 usb_process(c8074ac4,ee86cd08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee86cccc fork_exit(c0948520,c8074ac4,ee86cd08) at fork_exit+0x7f/frame 0xee86ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee86ccf4 --- trap 0, eip = 0, esp = 0xee86cd40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc806b5e0 sched_switch(c806b5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee868bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee868c08 sleepq_switch(c806b5e0,0,c1088efd,26d,c806b5e0,...) at sleepq_switch+0x1b9/frame 0xee868c3c sleepq_wait(c806eb5c,0,ee868c90,1,0,...) at sleepq_wait+0x48/frame 0xee868c60 _cv_wait(c806eb5c,c806ec74,c1060fa3,77,c806eb64,...) at _cv_wait+0x1f9/frame 0xee868ca4 usb_process(c806eb54,ee868d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee868ccc fork_exit(c0948520,c806eb54,ee868d08) at fork_exit+0x7f/frame 0xee868cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee868cf4 --- trap 0, eip = 0, esp = 0xee868d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc806b8d0 sched_switch(c806b8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee865bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee865c08 sleepq_switch(c806b8d0,0,c1088efd,26d,c806b8d0,...) at sleepq_switch+0x1b9/frame 0xee865c3c sleepq_wait(c806eb2c,0,ee865c90,1,0,...) at sleepq_wait+0x48/frame 0xee865c60 _cv_wait(c806eb2c,c806ec74,c1060fa3,77,c806eb34,...) at _cv_wait+0x1f9/frame 0xee865ca4 usb_process(c806eb24,ee865d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee865ccc fork_exit(c0948520,c806eb24,ee865d08) at fork_exit+0x7f/frame 0xee865cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee865cf4 --- trap 0, eip = 0, esp = 0xee865d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc806bbc0 sched_switch(c806bbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee862bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee862c08 sleepq_switch(c806bbc0,0,c1088efd,26d,c806bbc0,...) at sleepq_switch+0x1b9/frame 0xee862c3c sleepq_wait(c806eafc,0,ee862c90,1,0,...) at sleepq_wait+0x48/frame 0xee862c60 _cv_wait(c806eafc,c806ec74,c1060fa3,77,c806eb04,...) at _cv_wait+0x1f9/frame 0xee862ca4 usb_process(c806eaf4,ee862d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee862ccc fork_exit(c0948520,c806eaf4,ee862d08) at fork_exit+0x7f/frame 0xee862cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee862cf4 --- trap 0, eip = 0, esp = 0xee862d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc806c000 sched_switch(c806c000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee85fbd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee85fc08 sleepq_switch(c806c000,0,c1088efd,26d,c806c000,...) at sleepq_switch+0x1b9/frame 0xee85fc3c sleepq_wait(c806eacc,0,ee85fc90,1,0,...) at sleepq_wait+0x48/frame 0xee85fc60 _cv_wait(c806eacc,c806ec74,c1060fa3,77,c806ead4,...) at _cv_wait+0x1f9/frame 0xee85fca4 usb_process(c806eac4,ee85fd08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee85fccc fork_exit(c0948520,c806eac4,ee85fd08) at fork_exit+0x7f/frame 0xee85fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee85fcf4 --- trap 0, eip = 0, esp = 0xee85fd40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc806c2f0 sched_switch(c806c2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee85bbd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee85bc08 sleepq_switch(c806c2f0,0,c1088efd,26d,c806c2f0,...) at sleepq_switch+0x1b9/frame 0xee85bc3c sleepq_wait(c8067b5c,0,ee85bc90,1,0,...) at sleepq_wait+0x48/frame 0xee85bc60 _cv_wait(c8067b5c,c8067c74,c1060fa3,77,c8067b64,...) at _cv_wait+0x1f9/frame 0xee85bca4 usb_process(c8067b54,ee85bd08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee85bccc fork_exit(c0948520,c8067b54,ee85bd08) at fork_exit+0x7f/frame 0xee85bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee85bcf4 --- trap 0, eip = 0, esp = 0xee85bd40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc806c5e0 sched_switch(c806c5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee858bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee858c08 sleepq_switch(c806c5e0,0,c1088efd,26d,c806c5e0,...) at sleepq_switch+0x1b9/frame 0xee858c3c sleepq_wait(c8067b2c,0,ee858c90,1,0,...) at sleepq_wait+0x48/frame 0xee858c60 _cv_wait(c8067b2c,c8067c74,c1060fa3,77,c8067b34,...) at _cv_wait+0x1f9/frame 0xee858ca4 usb_process(c8067b24,ee858d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee858ccc fork_exit(c0948520,c8067b24,ee858d08) at fork_exit+0x7f/frame 0xee858cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee858cf4 --- trap 0, eip = 0, esp = 0xee858d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc806c8d0 sched_switch(c806c8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee855bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee855c08 sleepq_switch(c806c8d0,0,c1088efd,26d,c806c8d0,...) at sleepq_switch+0x1b9/frame 0xee855c3c sleepq_wait(c8067afc,0,ee855c90,1,0,...) at sleepq_wait+0x48/frame 0xee855c60 _cv_wait(c8067afc,c8067c74,c1060fa3,77,c8067b04,...) at _cv_wait+0x1f9/frame 0xee855ca4 usb_process(c8067af4,ee855d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee855ccc fork_exit(c0948520,c8067af4,ee855d08) at fork_exit+0x7f/frame 0xee855cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee855cf4 --- trap 0, eip = 0, esp = 0xee855d40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc806cbc0 sched_switch(c806cbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee852bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee852c08 sleepq_switch(c806cbc0,0,c1088efd,26d,c806cbc0,...) at sleepq_switch+0x1b9/frame 0xee852c3c sleepq_wait(c8067acc,0,ee852c90,1,0,...) at sleepq_wait+0x48/frame 0xee852c60 _cv_wait(c8067acc,c8067c74,c1060fa3,77,c8067ad4,...) at _cv_wait+0x1f9/frame 0xee852ca4 usb_process(c8067ac4,ee852d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee852ccc fork_exit(c0948520,c8067ac4,ee852d08) at fork_exit+0x7f/frame 0xee852cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee852cf4 --- trap 0, eip = 0, esp = 0xee852d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc805b000 sched_switch(c805b000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee84bbd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee84bc08 sleepq_switch(c805b000,0,c1088efd,26d,c805b000,...) at sleepq_switch+0x1b9/frame 0xee84bc3c sleepq_wait(c8062b5c,0,ee84bc90,1,0,...) at sleepq_wait+0x48/frame 0xee84bc60 _cv_wait(c8062b5c,c8062c74,c1060fa3,77,c8062b64,...) at _cv_wait+0x1f9/frame 0xee84bca4 usb_process(c8062b54,ee84bd08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee84bccc fork_exit(c0948520,c8062b54,ee84bd08) at fork_exit+0x7f/frame 0xee84bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee84bcf4 --- trap 0, eip = 0, esp = 0xee84bd40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc805b2f0 sched_switch(c805b2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee848bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee848c08 sleepq_switch(c805b2f0,0,c1088efd,26d,c805b2f0,...) at sleepq_switch+0x1b9/frame 0xee848c3c sleepq_wait(c8062b2c,0,ee848c90,1,0,...) at sleepq_wait+0x48/frame 0xee848c60 _cv_wait(c8062b2c,c8062c74,c1060fa3,77,c8062b34,...) at _cv_wait+0x1f9/frame 0xee848ca4 usb_process(c8062b24,ee848d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee848ccc fork_exit(c0948520,c8062b24,ee848d08) at fork_exit+0x7f/frame 0xee848cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee848cf4 --- trap 0, eip = 0, esp = 0xee848d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc805b5e0 sched_switch(c805b5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee845bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee845c08 sleepq_switch(c805b5e0,0,c1088efd,26d,c805b5e0,...) at sleepq_switch+0x1b9/frame 0xee845c3c sleepq_wait(c8062afc,0,ee845c90,1,0,...) at sleepq_wait+0x48/frame 0xee845c60 _cv_wait(c8062afc,c8062c74,c1060fa3,77,c8062b04,...) at _cv_wait+0x1f9/frame 0xee845ca4 usb_process(c8062af4,ee845d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee845ccc fork_exit(c0948520,c8062af4,ee845d08) at fork_exit+0x7f/frame 0xee845cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee845cf4 --- trap 0, eip = 0, esp = 0xee845d40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc805b8d0 sched_switch(c805b8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee842bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee842c08 sleepq_switch(c805b8d0,0,c1088efd,26d,c805b8d0,...) at sleepq_switch+0x1b9/frame 0xee842c3c sleepq_wait(c8062acc,0,ee842c90,1,0,...) at sleepq_wait+0x48/frame 0xee842c60 _cv_wait(c8062acc,c8062c74,c1060fa3,77,c8062ad4,...) at _cv_wait+0x1f9/frame 0xee842ca4 usb_process(c8062ac4,ee842d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee842ccc fork_exit(c0948520,c8062ac4,ee842d08) at fork_exit+0x7f/frame 0xee842cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee842cf4 --- trap 0, eip = 0, esp = 0xee842d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc805e000 sched_switch(c805e000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee83bbd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee83bc08 sleepq_switch(c805e000,0,c1088efd,26d,c805e000,...) at sleepq_switch+0x1b9/frame 0xee83bc3c sleepq_wait(c8056b5c,0,ee83bc90,1,0,...) at sleepq_wait+0x48/frame 0xee83bc60 _cv_wait(c8056b5c,c8056c74,c1060fa3,77,c8056b64,...) at _cv_wait+0x1f9/frame 0xee83bca4 usb_process(c8056b54,ee83bd08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee83bccc fork_exit(c0948520,c8056b54,ee83bd08) at fork_exit+0x7f/frame 0xee83bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee83bcf4 --- trap 0, eip = 0, esp = 0xee83bd40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc805e2f0 sched_switch(c805e2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee838bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee838c08 sleepq_switch(c805e2f0,0,c1088efd,26d,c805e2f0,...) at sleepq_switch+0x1b9/frame 0xee838c3c sleepq_wait(c8056b2c,0,ee838c90,1,0,...) at sleepq_wait+0x48/frame 0xee838c60 _cv_wait(c8056b2c,c8056c74,c1060fa3,77,c8056b34,...) at _cv_wait+0x1f9/frame 0xee838ca4 usb_process(c8056b24,ee838d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee838ccc fork_exit(c0948520,c8056b24,ee838d08) at fork_exit+0x7f/frame 0xee838cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee838cf4 --- trap 0, eip = 0, esp = 0xee838d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc805e5e0 sched_switch(c805e5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee835bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee835c08 sleepq_switch(c805e5e0,0,c1088efd,26d,c805e5e0,...) at sleepq_switch+0x1b9/frame 0xee835c3c sleepq_wait(c8056afc,0,ee835c90,1,0,...) at sleepq_wait+0x48/frame 0xee835c60 _cv_wait(c8056afc,c8056c74,c1060fa3,77,c8056b04,...) at _cv_wait+0x1f9/frame 0xee835ca4 usb_process(c8056af4,ee835d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee835ccc fork_exit(c0948520,c8056af4,ee835d08) at fork_exit+0x7f/frame 0xee835cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee835cf4 --- trap 0, eip = 0, esp = 0xee835d40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc805e8d0 sched_switch(c805e8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee832bd4 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xee832c08 sleepq_switch(c805e8d0,0,c1088efd,26d,c805e8d0,...) at sleepq_switch+0x1b9/frame 0xee832c3c sleepq_wait(c8056acc,0,ee832c90,1,0,...) at sleepq_wait+0x48/frame 0xee832c60 _cv_wait(c8056acc,c8056c74,c1060fa3,77,c8056ad4,...) at _cv_wait+0x1f9/frame 0xee832ca4 usb_process(c8056ac4,ee832d08,c107cf30,3d7,0,...) at usb_process+0xe6/frame 0xee832ccc fork_exit(c0948520,c8056ac4,ee832d08) at fork_exit+0x7f/frame 0xee832cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee832cf4 --- trap 0, eip = 0, esp = 0xee832d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7ef05e0 sched_switch(c7ef05e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b51b90 mi_switch(104,0,c1088efd,1f7,2,...) at mi_switch+0x1c9/frame 0xc7b51bc4 sleepq_switch(c7ef05e0,0,c1088efd,290,c7ef05e0,...) at sleepq_switch+0x1b9/frame 0xc7b51bf8 sleepq_timedwait(c122f2c0,0,c106f74a,2,0,...) at sleepq_timedwait+0x48/frame 0xc7b51c1c _sleep(c122f2c0,0,0,c106f74a,64) at _sleep+0x317/frame 0xc7b51c74 pause(c106f74a,64,c103c95e,111,0,...) at pause+0x85/frame 0xc7b51c98 random_kthread(0,c7b51d08,c107cf30,3d7,0,...) at random_kthread+0x30f/frame 0xc7b51ccc fork_exit(c0838670,0,c7b51d08) at fork_exit+0x7f/frame 0xc7b51cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b51cf4 --- trap 0, eip = 0, esp = 0xc7b51d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7ef08d0 sched_switch(c7ef08d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b4db88 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b4dbbc sleepq_switch(c7ef08d0,0,c1088efd,26d,c7ef08d0,...) at sleepq_switch+0x1b9/frame 0xc7b4dbf0 sleepq_wait(c13f6994,5c,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b4dc14 _sleep(c13f6994,c122d610,25c,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b4dc6c g_io_schedule_down(c7ef08d0,0,c10711d4,6c,c7b4dcf4,...) at g_io_schedule_down+0x3c/frame 0xc7b4dcb4 g_down_procbody(0,c7b4dd08,c107cf30,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7b4dccc fork_exit(c09f4bf0,0,c7b4dd08) at fork_exit+0x7f/frame 0xc7b4dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b4dcf4 --- trap 0, eip = 0, esp = 0xc7b4dd40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7ef0bc0 sched_switch(c7ef0bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b4abac mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b4abe0 sleepq_switch(c7ef0bc0,0,c1088efd,26d,c7ef0bc0,...) at sleepq_switch+0x1b9/frame 0xc7b4ac14 sleepq_wait(c13f6990,5c,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b4ac38 _sleep(c13f6990,c122d630,25c,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b4ac90 g_io_schedule_up(c7ef0bc0,0,c10711d4,5f,c7b4acf4,...) at g_io_schedule_up+0x8f/frame 0xc7b4acb4 g_up_procbody(0,c7b4ad08,c107cf30,3d7,0,...) at g_up_procbody+0x9d/frame 0xc7b4accc fork_exit(c09f4b50,0,c7b4ad08) at fork_exit+0x7f/frame 0xc7b4acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b4acf4 --- trap 0, eip = 0, esp = 0xc7b4ad40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7ef1000 sched_switch(c7ef1000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b47bbc mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b47bf0 sleepq_switch(c7ef1000,0,c1088efd,26d,c7ef1000,...) at sleepq_switch+0x1b9/frame 0xc7b47c24 sleepq_wait(c13f698c,5c,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b47c48 _sleep(c13f698c,c122d5e8,25c,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b47ca0 g_run_events(0,c7b47d08,c107cf30,3d7,0,...) at g_run_events+0x4f3/frame 0xc7b47ccc fork_exit(c09f4ab0,0,c7b47d08) at fork_exit+0x7f/frame 0xc7b47cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b47cf4 --- trap 0, eip = 0, esp = 0xc7b47d40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc806d2f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc806d5e0 sched_switch(c806d5e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee8aec64 mi_switch(109,0,c107d1cd,563,c806d5e0,...) at mi_switch+0x1c9/frame 0xee8aec98 ithread_loop(c7e2a670,ee8aed08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee8aeccc fork_exit(c0a65800,c7e2a670,ee8aed08) at fork_exit+0x7f/frame 0xee8aecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8aecf4 --- trap 0, eip = 0, esp = 0xee8aed40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc806dbc0 sched_switch(c806dbc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee89ec64 mi_switch(109,0,c107d1cd,563,c806dbc0,...) at mi_switch+0x1c9/frame 0xee89ec98 ithread_loop(c7e2a680,ee89ed08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee89eccc fork_exit(c0a65800,c7e2a680,ee89ed08) at fork_exit+0x7f/frame 0xee89ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee89ecf4 --- trap 0, eip = 0, esp = 0xee89ed40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc8078000 sched_switch(c8078000,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee88dc64 mi_switch(109,0,c107d1cd,563,c8078000,...) at mi_switch+0x1c9/frame 0xee88dc98 ithread_loop(c7e2a690,ee88dd08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee88dccc fork_exit(c0a65800,c7e2a690,ee88dd08) at fork_exit+0x7f/frame 0xee88dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee88dcf4 --- trap 0, eip = 0, esp = 0xee88dd40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc807b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc806d000 sched_switch(c806d000,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee84fc64 mi_switch(109,0,c107d1cd,563,c806d000,...) at mi_switch+0x1c9/frame 0xee84fc98 ithread_loop(c7e2a6b0,ee84fd08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee84fccc fork_exit(c0a65800,c7e2a6b0,ee84fd08) at fork_exit+0x7f/frame 0xee84fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee84fcf4 --- trap 0, eip = 0, esp = 0xee84fd40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc805bbc0 sched_switch(c805bbc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee83fc64 mi_switch(109,0,c107d1cd,563,c805bbc0,...) at mi_switch+0x1c9/frame 0xee83fc98 ithread_loop(c7e2a6c0,ee83fd08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee83fccc fork_exit(c0a65800,c7e2a6c0,ee83fd08) at fork_exit+0x7f/frame 0xee83fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee83fcf4 --- trap 0, eip = 0, esp = 0xee83fd40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc805ebc0 sched_switch(c805ebc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee82fc64 mi_switch(109,0,c107d1cd,563,c805ebc0,...) at mi_switch+0x1c9/frame 0xee82fc98 ithread_loop(c7e2a6d0,ee82fd08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee82fccc fork_exit(c0a65800,c7e2a6d0,ee82fd08) at fork_exit+0x7f/frame 0xee82fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee82fcf4 --- trap 0, eip = 0, esp = 0xee82fd40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7ef12f0 sched_switch(c7ef12f0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee6d9c64 mi_switch(109,0,c107d1cd,563,c7ef12f0,...) at mi_switch+0x1c9/frame 0xee6d9c98 ithread_loop(c7e2a6e0,ee6d9d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee6d9ccc fork_exit(c0a65800,c7e2a6e0,ee6d9d08) at fork_exit+0x7f/frame 0xee6d9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee6d9cf4 --- trap 0, eip = 0, esp = 0xee6d9d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7ef15e0 sched_switch(c7ef15e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xee6d5c64 mi_switch(109,0,c107d1cd,563,c7ef15e0,...) at mi_switch+0x1c9/frame 0xee6d5c98 ithread_loop(c7e2a6f0,ee6d5d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xee6d5ccc fork_exit(c0a65800,c7e2a6f0,ee6d5d08) at fork_exit+0x7f/frame 0xee6d5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee6d5cf4 --- trap 0, eip = 0, esp = 0xee6d5d40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7ef18d0 sched_switch(c7ef18d0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7ba1c64 mi_switch(109,0,c107d1cd,563,c7ef18d0,...) at mi_switch+0x1c9/frame 0xc7ba1c98 ithread_loop(c7e2a740,c7ba1d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7ba1ccc fork_exit(c0a65800,c7e2a740,c7ba1d08) at fork_exit+0x7f/frame 0xc7ba1cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7ba1cf4 --- trap 0, eip = 0, esp = 0xc7ba1d40, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc7fdd8d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100021 td 0xc7e2b8d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xc7e2bbc0 sched_switch(c7e2bbc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7b5ac64 mi_switch(109,0,c107d1cd,563,c7e2bbc0,...) at mi_switch+0x1c9/frame 0xc7b5ac98 ithread_loop(c7e2a780,c7b5ad08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b5accc fork_exit(c0a65800,c7e2a780,c7b5ad08) at fork_exit+0x7f/frame 0xc7b5acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b5acf4 --- trap 0, eip = 0, esp = 0xc7b5ad40, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc7ef0000 sched_switch(c7ef0000,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7b57c64 mi_switch(109,0,c107d1cd,563,c7ef0000,...) at mi_switch+0x1c9/frame 0xc7b57c98 ithread_loop(c7e2a790,c7b57d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b57ccc fork_exit(c0a65800,c7e2a790,c7b57d08) at fork_exit+0x7f/frame 0xc7b57cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b57cf4 --- trap 0, eip = 0, esp = 0xc7b57d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7de35e0 sched_switch(c7de35e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7b41c64 mi_switch(109,0,c107d1cd,563,c7de35e0,...) at mi_switch+0x1c9/frame 0xc7b41c98 ithread_loop(c7e2a7a0,c7b41d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b41ccc fork_exit(c0a65800,c7e2a7a0,c7b41d08) at fork_exit+0x7f/frame 0xc7b41cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b41cf4 --- trap 0, eip = 0, esp = 0xc7b41d40, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc7de38d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc7de3bc0 sched_switch(c7de3bc0,0,109,1b3,c107d1cd,...) at sched_switch+0x4b4/frame 0xc7b3bc64 mi_switch(109,0,c107d1cd,563,c7de3bc0,...) at mi_switch+0x1c9/frame 0xc7b3bc98 ithread_loop(c7e2a7c0,c7b3bd08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b3bccc fork_exit(c0a65800,c7e2a7c0,c7b3bd08) at fork_exit+0x7f/frame 0xc7b3bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b3bcf4 --- trap 0, eip = 0, esp = 0xc7b3bd40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e2b000 sched_switch(c7e2b000,0,109,1b3,c107d1cd,...) at sched_switch+0x4b4/frame 0xc7b38c64 mi_switch(109,0,c107d1cd,563,c7e2b000,...) at mi_switch+0x1c9/frame 0xc7b38c98 ithread_loop(c7e2a7d0,c7b38d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b38ccc fork_exit(c0a65800,c7e2a7d0,c7b38d08) at fork_exit+0x7f/frame 0xc7b38cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b38cf4 --- trap 0, eip = 0, esp = 0xc7b38d40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e2b2f0 sched_switch(c7e2b2f0,0,109,1b3,c107d1cd,...) at sched_switch+0x4b4/frame 0xc7b35c64 mi_switch(109,0,c107d1cd,563,c7e2b2f0,...) at mi_switch+0x1c9/frame 0xc7b35c98 ithread_loop(c7e2a7e0,c7b35d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b35ccc fork_exit(c0a65800,c7e2a7e0,c7b35d08) at fork_exit+0x7f/frame 0xc7b35cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b35cf4 --- trap 0, eip = 0, esp = 0xc7b35d40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e2b5e0 sched_switch(c7e2b5e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7b32c64 mi_switch(109,0,c107d1cd,563,c7e2b5e0,...) at mi_switch+0x1c9/frame 0xc7b32c98 ithread_loop(c7e2a7f0,c7b32d08,c107cf30,3d7,0,...) at ithread_loop+0x100/frame 0xc7b32ccc fork_exit(c0a65800,c7e2a7f0,c7b32d08) at fork_exit+0x7f/frame 0xc7b32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b32cf4 --- trap 0, eip = 0, esp = 0xc7b32d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dde000 sched_switch(c7dde000,0,108,1ae,c1085875,...) at sched_switch+0x4b4/frame 0xc7b2ec1c mi_switch(108,0,c1085875,407,c123db08,...) at mi_switch+0x1c9/frame 0xc7b2ec50 sched_idletd(0,c7b2ed08,c107cf30,3d7,0,...) at sched_idletd+0x45b/frame 0xc7b2eccc fork_exit(c0aba680,0,c7b2ed08) at fork_exit+0x7f/frame 0xc7b2ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2ecf4 --- trap 0, eip = 0, esp = 0xc7b2ed40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dde2f0 sched_switch(c7dde2f0,0,108,1ae,c1085875,...) at sched_switch+0x4b4/frame 0xc7b2bc1c mi_switch(108,0,c1085875,a44,c123d408,...) at mi_switch+0x1c9/frame 0xc7b2bc50 sched_idletd(0,c7b2bd08,c107cf30,3d7,0,...) at sched_idletd+0x10d/frame 0xc7b2bccc fork_exit(c0aba680,0,c7b2bd08) at fork_exit+0x7f/frame 0xc7b2bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2bcf4 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dde5e0 sched_switch(c7dde5e0,0,108,1ae,c1085875,...) at sched_switch+0x4b4/frame 0xc7b28c1c mi_switch(108,0,c1085875,407,c123cd08,...) at mi_switch+0x1c9/frame 0xc7b28c50 sched_idletd(0,c7b28d08,c107cf30,3d7,0,...) at sched_idletd+0x45b/frame 0xc7b28ccc fork_exit(c0aba680,0,c7b28d08) at fork_exit+0x7f/frame 0xc7b28cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b28cf4 --- trap 0, eip = 0, esp = 0xc7b28d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dde8d0 cpustop_handler(0,13,c7b25b14,c0ea5e7b,c11ee378,...) at cpustop_handler+0x2f/frame 0xc7b259c8 ipi_nmi_handler(c11ee378,c0ec9487,c7b25a54,1c,c7b25a00,...) at ipi_nmi_handler+0x37/frame 0xc7b259d8 trap(c7b25b20) at trap+0x3b/frame 0xc7b25b14 calltrap() at calltrap+0x6/frame 0xc7b25b14 --- trap 0x13, eip = 0xc0a9c0dd, esp = 0xc7b25b60, ebp = 0xc7b25b74 --- runq_choose_from(c123c824,25,c1085875,528,0,...) at runq_choose_from+0x2d/frame 0xc7b25b74 tdq_choose(c123c590,4,c1085875,90f,c0a809b2,...) at tdq_choose+0x5a/frame 0xc7b25b94 sched_choose(c7b25c1c,c0ab80a1,c123c590,14,c1085875,...) at sched_choose+0x4c/frame 0xc7b25bc0 choosethread(c123c590,14,c1085875,783,cd6c9bc0,...) at choosethread+0x1f/frame 0xc7b25bc8 sched_switch(c7dde8d0,0,108,1ae,c1085875,...) at sched_switch+0x361/frame 0xc7b25c1c mi_switch(108,0,c1085875,407,c123c608,...) at mi_switch+0x1c9/frame 0xc7b25c50 sched_idletd(0,c7b25d08,c107cf30,3d7,0,...) at sched_idletd+0x45b/frame 0xc7b25ccc fork_exit(c0aba680,0,c7b25d08) at fork_exit+0x7f/frame 0xc7b25cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b25cf4 --- trap 0, eip = 0, esp = 0xc7b25d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7ddebc0 sched_switch(c7ddebc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b21998 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xc7b219cc sleepq_switch(c7ddebc0,0,c1088efd,1ab,c7b21a44,...) at sleepq_switch+0x1b9/frame 0xc7b21a00 sleepq_catch_signals(0,c1088efd,164,708,c7ddebc0,...) at sleepq_catch_signals+0x3b1/frame 0xc7b21a48 sleepq_wait_sig(c7ddcb40,6c,c108c3e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7b21a6c _sleep(c7ddcb40,c7ddcbc8,16c,c108c3e1,0,...) at _sleep+0x32d/frame 0xc7b21ac4 kern_wait6(c7ddebc0,7,0,0,c7b21b4c,...) at kern_wait6+0x43c/frame 0xc7b21b20 sys_wait4(c7ddebc0,c7b21cc8,c123da80,8,c7b21c84,...) at sys_wait4+0x94/frame 0xc7b21c40 syscall(c7b21d08) at syscall+0x2ed/frame 0xc7b21cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7b21cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805dcf7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc7de3000 sched_switch(c7de3000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b1eba8 mi_switch(104,0,c1088efd,1f7,8,...) at mi_switch+0x1c9/frame 0xc7b1ebdc sleepq_switch(c7de3000,0,c1088efd,26d,c7de3000,...) at sleepq_switch+0x1b9/frame 0xc7b1ec10 sleepq_wait(c13fd638,0,c7b1ec64,1,0,...) at sleepq_wait+0x48/frame 0xc7b1ec34 _cv_wait(c13fd638,c13fd5c4,c10b43d2,18d,0,...) at _cv_wait+0x1f9/frame 0xc7b1ec78 audit_worker(0,c7b1ed08,c107cf30,3d7,0,...) at audit_worker+0x94/frame 0xc7b1eccc fork_exit(c0c9bd20,0,c7b1ed08) at fork_exit+0x7f/frame 0xc7b1ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b1ecf4 --- trap 0, eip = 0, esp = 0xc7b1ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xc950e8d0 sched_switch(c950e8d0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee8bab8c mi_switch(104,0,c1088efd,1f7,2,...) at mi_switch+0x1c9/frame 0xee8babc0 sleepq_switch(c950e8d0,0,c1088efd,290,c950e8d0,...) at sleepq_switch+0x1b9/frame 0xee8babf4 sleepq_timedwait(c122f2c0,0,c106f74a,2,0,...) at sleepq_timedwait+0x48/frame 0xee8bac18 _sleep(c122f2c0,0,0,c106f74a,bb8) at _sleep+0x317/frame 0xee8bac70 pause(c106f74a,bb8,12c,12a,c13f6a14,...) at pause+0x85/frame 0xee8bac94 deadlkres(0,ee8bad08,c107cf30,3d7,0,...) at deadlkres+0x48/frame 0xee8baccc fork_exit(c0a44c90,0,ee8bad08) at fork_exit+0x7f/frame 0xee8bacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8bacf4 --- trap 0, eip = 0, esp = 0xee8bad40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc950ebc0 sched_switch(c950ebc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xee8b7bd8 mi_switch(104,0,c1088efd,1f7,c124b6e4,...) at mi_switch+0x1c9/frame 0xee8b7c0c sleepq_switch(c950ebc0,0,c1088efd,26d,ca33b580,...) at sleepq_switch+0x1b9/frame 0xee8b7c40 sleepq_wait(ca33b580,0,c108403d,c106f74a,0,...) at sleepq_wait+0x48/frame 0xee8b7c64 msleep_spin(ca33b580,ca33b598,c106f74a,0,c950ebc0,...) at msleep_spin+0x216/frame 0xee8b7ca4 taskqueue_thread_loop(c13f30d0,ee8b7d08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xee8b7ccc fork_exit(c0ad9130,c13f30d0,ee8b7d08) at fork_exit+0x7f/frame 0xee8b7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee8b7cf4 --- trap 0, eip = 0, esp = 0xee8b7d40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc7ef1bc0 sched_switch(c7ef1bc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b6fbd8 mi_switch(104,0,c1088efd,1f7,c124bccc,...) at mi_switch+0x1c9/frame 0xc7b6fc0c sleepq_switch(c7ef1bc0,0,c1088efd,26d,c7fdf4c0,...) at sleepq_switch+0x1b9/frame 0xc7b6fc40 sleepq_wait(c7fdf4c0,0,c108403d,c106f74a,0,...) at sleepq_wait+0x48/frame 0xc7b6fc64 msleep_spin(c7fdf4c0,c7fdf4d8,c106f74a,0,c7ef1bc0,...) at msleep_spin+0x216/frame 0xc7b6fca4 taskqueue_thread_loop(c13f3ce8,c7b6fd08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b6fccc fork_exit(c0ad9130,c13f3ce8,c7b6fd08) at fork_exit+0x7f/frame 0xc7b6fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b6fcf4 --- trap 0, eip = 0, esp = 0xc7b6fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc7fdd000 sched_switch(c7fdd000,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b6cbd8 mi_switch(104,0,c1088efd,1f7,c124bccc,...) at mi_switch+0x1c9/frame 0xc7b6cc0c sleepq_switch(c7fdd000,0,c1088efd,26d,c7fdf4c0,...) at sleepq_switch+0x1b9/frame 0xc7b6cc40 sleepq_wait(c7fdf4c0,0,c108403d,c106f74a,0,...) at sleepq_wait+0x48/frame 0xc7b6cc64 msleep_spin(c7fdf4c0,c7fdf4d8,c106f74a,0,c7fdd000,...) at msleep_spin+0x216/frame 0xc7b6cca4 taskqueue_thread_loop(c13f3ce8,c7b6cd08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b6cccc fork_exit(c0ad9130,c13f3ce8,c7b6cd08) at fork_exit+0x7f/frame 0xc7b6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b6ccf4 --- trap 0, eip = 0, esp = 0xc7b6cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fdd2f0 sched_switch(c7fdd2f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b69bd8 mi_switch(104,0,c1088efd,1f7,c124bccc,...) at mi_switch+0x1c9/frame 0xc7b69c0c sleepq_switch(c7fdd2f0,0,c1088efd,26d,c7fdf4c0,...) at sleepq_switch+0x1b9/frame 0xc7b69c40 sleepq_wait(c7fdf4c0,0,c108403d,c106f74a,0,...) at sleepq_wait+0x48/frame 0xc7b69c64 msleep_spin(c7fdf4c0,c7fdf4d8,c106f74a,0,c7fdd2f0,...) at msleep_spin+0x216/frame 0xc7b69ca4 taskqueue_thread_loop(c13f3ce8,c7b69d08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b69ccc fork_exit(c0ad9130,c13f3ce8,c7b69d08) at fork_exit+0x7f/frame 0xc7b69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b69cf4 --- trap 0, eip = 0, esp = 0xc7b69d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc7fdd5e0 sched_switch(c7fdd5e0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b66bc0 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b66bf4 sleepq_switch(c7fdd5e0,0,c1088efd,26d,c7fdd5e0,...) at sleepq_switch+0x1b9/frame 0xc7b66c28 sleepq_wait(c7f62280,0,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b66c4c _sleep(c7f62280,c7f62298,0,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b66ca4 taskqueue_thread_loop(c13f7168,c7b66d08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b66ccc fork_exit(c0ad9130,c13f7168,c7b66d08) at fork_exit+0x7f/frame 0xc7b66cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b66cf4 --- trap 0, eip = 0, esp = 0xc7b66d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fddbc0 sched_switch(c7fddbc0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b60bc0 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b60bf4 sleepq_switch(c7fddbc0,0,c1088efd,26d,c7fddbc0,...) at sleepq_switch+0x1b9/frame 0xc7b60c28 sleepq_wait(c7f62300,0,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b60c4c _sleep(c7f62300,c7f62318,0,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b60ca4 taskqueue_thread_loop(c13fa028,c7b60d08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b60ccc fork_exit(c0ad9130,c13fa028,c7b60d08) at fork_exit+0x7f/frame 0xc7b60cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b60cf4 --- trap 0, eip = 0, esp = 0xc7b60d40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7ef02f0 sched_switch(c7ef02f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b54bc0 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b54bf4 sleepq_switch(c7ef02f0,0,c1088efd,26d,c7ef02f0,...) at sleepq_switch+0x1b9/frame 0xc7b54c28 sleepq_wait(c7f623c0,0,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b54c4c _sleep(c7f623c0,c7f623d8,0,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b54ca4 taskqueue_thread_loop(c13fd670,c7b54d08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b54ccc fork_exit(c0ad9130,c13fd670,c7b54d08) at fork_exit+0x7f/frame 0xc7b54cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b54cf4 --- trap 0, eip = 0, esp = 0xc7b54d40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc7de32f0 sched_switch(c7de32f0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc7b44bc0 mi_switch(104,0,c1088efd,1f7,164,...) at mi_switch+0x1c9/frame 0xc7b44bf4 sleepq_switch(c7de32f0,0,c1088efd,26d,c7de32f0,...) at sleepq_switch+0x1b9/frame 0xc7b44c28 sleepq_wait(c7d7a7c0,0,c106f74a,0,0,...) at sleepq_wait+0x48/frame 0xc7b44c4c _sleep(c7d7a7c0,c7d7a7d8,0,c106f74a,0,...) at _sleep+0x34e/frame 0xc7b44ca4 taskqueue_thread_loop(c124a6c0,c7b44d08,c107cf30,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b44ccc fork_exit(c0ad9130,c124a6c0,c7b44d08) at fork_exit+0x7f/frame 0xc7b44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b44cf4 --- trap 0, eip = 0, esp = 0xc7b44d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc13f6cf0 sched_switch(c13f6cf0,0,104,1b3,c0a80bfe,...) at sched_switch+0x4b4/frame 0xc1820c20 mi_switch(104,0,c1088efd,1f7,0,...) at mi_switch+0x1c9/frame 0xc1820c54 sleepq_switch(c13f6cf0,0,c1088efd,290,c13f6cf0,...) at sleepq_switch+0x1b9/frame 0xc1820c88 sleepq_timedwait(c13f6a14,54,c10b5595,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820cac _sleep(c13f6a14,0,54,c10b5595,2710,...) at _sleep+0x317/frame 0xc1820d04 scheduler(0,0,c10e7d00,181e000,1825000,...) at scheduler+0x274/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 374 MB: 359 343 327 311 295 279 263 247 231 215 199 183 167 151 135 119 103 87 71 55 39 23 7 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:249 #1 0xc052615d in db_fncall (dummy1=0xf41bc3bc, dummy2=0xf41bc3bc, dummy3=0xf41bc3bc, dummy4=0xf41bc3bc "\n") at ../../../ddb/db_command.c:578 #2 0xc0525e57 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc0529d04 in db_script_exec (scriptname=0xc13f3a50 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc0525e57 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc0525b70 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc05283b0 in db_trap (type=, code=0xf41bc7a8) at ../../../ddb/db_main.c:231 #7 0xc0aca416 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0ea65be in trap (frame=) at ../../../i386/i386/trap.c:720 #9 0xc0e8f9bc in calltrap () at exception.s:169 #10 0xc0ac9cbd in kdb_enter (why=0xc10833b1 "panic", msg=) at cpufunc.h:71 #11 0xc0a94f42 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:746 #12 0xc0a94f72 in panic (fmt=0xf41bc890 " È\033ô\fÉ\033ô\036ÃËÀ6w\vÁx\arÊ\200\002") at ../../../kern/kern_shutdown.c:682 #13 0xc0cbc31e in ffs_blkfree_cg (ump=0xca727b00, fs=0x0, devvp=, bno=0xf41bc90cf41bc89c, size=, inum=) at ../../../ufs/ffs/ffs_alloc.c:2152 #14 0xc0cb8b05 in ffs_blkfree (ump=, devvp=0xcceb0e10, bno=0xf41bc948f41bc914, size=, vtype=, dephd=) at ../../../ufs/ffs/ffs_alloc.c:2258 #15 0xc0ce5607 in freework_freeblock (freework=0xd11f2080) at ../../../ufs/ffs/ffs_softdep.c:7519 #16 0xc0cd9f47 in handle_workitem_freeblocks (freeblks=0xcd402b00, flags=0x200) at ../../../ufs/ffs/ffs_softdep.c:7573 #17 0xc0ccdeed in process_worklist_item (mp=0xce19fbb0) at ../../../ufs/ffs/ffs_softdep.c:1765 #18 0xc0ccd07c in softdep_process_worklist (mp=0xce19fbb0) at ../../../ufs/ffs/ffs_softdep.c:1549 #19 0xc0cceb13 in softdep_flushworklist (oldmnt=, countp=) at ../../../ufs/ffs/ffs_softdep.c:1864 #20 0xc0cebfa5 in ffs_sync (mp=0xce19fbb0, waitfor=) at ../../../ufs/ffs/ffs_vfsops.c:1599 #21 0xc0b2be02 in dounmount (mp=0xce19fbb0, td=) at ../../../kern/vfs_mount.c:1313 #22 0xc0b2b9ed in sys_unmount (uap=0x0) at ../../../kern/vfs_mount.c:1211 #23 0xc0ea728d in syscall (frame=) at subr_syscall.c:134 #24 0xc0e8fa51 in Xint0x80_syscall () at exception.s:267 #25 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xc0cbc31e in ffs_blkfree_cg (ump=0xca727b00, fs=0x0, devvp=, bno=0xf41bc90cf41bc89c, size=, inum=) at ../../../ufs/ffs/ffs_alloc.c:2152 2152 panic("ffs_blkfree_cg: freeing free frag"); (kgdb) l 2147 for (i = 0; i < frags; i++) { 2148 if (isset(blksfree, cgbno + i)) { 2149 printf("dev = %s, block = %jd, fs = %s\n", 2150 devtoname(dev), (intmax_t)(bno + i), 2151 fs->fs_fsmnt); 2152 panic("ffs_blkfree_cg: freeing free frag"); 2153 } 2154 setbit(blksfree, cgbno + i); 2155 } 2156 cgp->cg_cs.cs_nffree += i; (kgdb) info loc dev = (struct cdev *) 0xca720700 blk = frags = 0x1 i = bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 bp = (struct buf *) 0xe198c7c0 blksfree = (u_int8_t *) 0xe2df40d8 "ÿÿÿ" bbase = fragno = mp = dephd = (struct workhead *) Cannot access memory at address 0x0 (kgdb) p *blksfree $3 = 0xff (kgdb) p *ump $1 = {um_mountp = 0xce19fbb0, um_dev = 0xca720700, um_cp = 0xca4dd140, um_bo = 0xcceb0ed0, um_devvp = 0xcceb0e10, um_fstype = 0x2, um_fs = 0xce1d5000, um_extattr = {uepm_lock = {lock_object = { lo_name = 0xc10bc468 "ufs_extattr_sx", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xc7d86470}, sx_lock = 0x1}, uepm_list = {lh_first = 0x0}, uepm_ucred = 0x0, uepm_flags = 0x1}, um_nindir = 0x1000, um_bptrtodb = 0x3, um_seqinc = 0x8, um_lock = {lock_object = {lo_name = 0xc10bb74b "FFS", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d86408}, mtx_lock = 0xcb173000}, um_fsckpid = 0x0, um_numindirdeps = 0x0, softdep_workitem_pending = {lh_first = 0xf41bca30}, softdep_worklist_tail = 0xcbbcaa00, softdep_journal_pending = {lh_first = 0x0}, softdep_journal_tail = 0x0, softdep_jblocks = 0x0, softdep_unlinked = {tqh_first = 0x0, tqh_last = 0xca727b78}, softdep_dirtycg = {lh_first = 0xd474eb80}, softdep_on_journal = 0x0, softdep_on_worklist = 0x2, softdep_deps = 0x7, softdep_accdeps = 0x2a, softdep_req = 0x0, um_quotas = {0x0, 0x0}, um_cred = {0x0, 0x0}, um_btime = {0x0, 0x0}, um_itime = {0x0, 0x0}, um_qflags = "\000", um_savedmaxfilesize = 0x0, um_candelete = 0x0, um_writesuspended = 0x0, um_balloc = 0xc0cc07f0 , um_blkatoff = 0xc0ce6d50 , um_truncate = 0xc0cc3240 , um_update = 0xc0cc2e60 , um_valloc = 0xc0cba180 , um_vfree = 0xc0cbb340 , um_ifree = 0xc0cec370 , um_rdonly = 0xc0cc5200 , um_snapgone = 0xc0cc9cd0 } (kgdb) f 14 #14 0xc0cb8b05 in ffs_blkfree (ump=, devvp=0xcceb0e10, bno=0xf41bc948f41bc914, size=, vtype=, dephd=) at ../../../ufs/ffs/ffs_alloc.c:2258 2258 ffs_blkfree_cg(ump, fs, devvp, bno, size, inum, dephd); (kgdb) l 2253 /* 2254 * Nothing to delay if TRIM is disabled, or the operation is 2255 * performed on the snapshot. 2256 */ 2257 if (!ump->um_candelete || devvp->v_type == VREG) { 2258 ffs_blkfree_cg(ump, fs, devvp, bno, size, inum, dephd); 2259 return; 2260 } 2261 2262 /* (kgdb) info loc mp = (struct mount *) 0xcb173000 bip = fs = (struct fs *) Cannot access memory at address 0x0 (kgdb) p *mp $2 = {mnt_mtx = {lock_object = {lo_name = 0xc123d380 "4Ú#Á", lo_flags = 0xcbe22000, lo_data = 0x0, lo_witness = 0xcbe22008}, mtx_lock = 0x0}, mnt_gen = 0xc123d7d4, mnt_list = {tqe_next = 0x0, tqe_prev = 0xcb86b980}, mnt_op = 0x0, mnt_vfc = 0xf414e978, mnt_vnodecovered = 0x0, mnt_syncer = 0xc7dbce0c, mnt_ref = 0xc7dbfe38, mnt_nvnodelist = {tqh_first = 0x0, tqh_last = 0xcb86b980}, mnt_nvnodelistsize = 0xcb6b9200, mnt_activevnodelist = { tqh_first = 0xca7788a4, tqh_last = 0xca767880}, mnt_activevnodelistsize = 0x18783, mnt_writeopcount = 0x0, mnt_kern_flag = 0x0, mnt_flag = 0x0, mnt_opt = 0x0, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x0, mnt_stat = { f_version = 0x0, f_type = 0x0, f_flags = 0xcbe22000cb17306c, f_bsize = 0xff00000001, f_iosize = 0x10004, f_blocks = 0x0, f_bfree = 0x0, f_bavail = 0xff00020200000000, f_files = 0x1000000000004, f_ffree = 0x0, f_syncwrites = 0xc1378bd0cb6b9e00, f_asyncwrites = 0x100000000, f_syncreads = 0xcd616600, f_asyncreads = 0x0, f_spare = {0xc02aeaecf, 0x0, 0x0, 0xc000005f4, 0x8000000004, 0x35, 0x100000000, 0x11, 0x0, 0x300000016}, f_namemax = 0x0, f_owner = 0x0, f_fsid = {val = {0x0, 0x0}}, f_charspare = '\0' , "ºÄ\021\001\000\000\000\000ºÄ\021\001\000\000\000\000\001\000\000\000\001", '\0' , f_fstypename = '\0' , "\031\000\000", f_mntfromname = "\000\000\000\000\000\000\000\000\004", '\0' , "umount", '\0' , f_mntonname = '\0' }, mnt_cred = 0x0, mnt_data = 0x3989835, mnt_time = 0xacac, mnt_iosize_max = 0xf41bcd60, mnt_export = 0x4, mnt_label = 0x0, mnt_hashseed = 0x804ac04, mnt_lockref = 0x0, mnt_secondary_writes = 0xc7ebb4d8, mnt_secondary_accwrites = 0x2a81c9b, mnt_susp_owner = 0xcb173000, mnt_gjprovider = 0xc0ad4fb0 "U\211åSWV\203ì\020\213u\b\2114$ÇD$\f\202\003", mnt_explock = {lock_object = {lo_name = 0x0, lo_flags = 0x10, lo_data = 0x3, lo_witness = 0xf41bcd08}, lk_lock = 0xcbe152e4, lk_exslpfail = 0xf41bb000, lk_timo = 0x2, lk_pri = 0x1, lk_stack = {depth = 0x1, pcs = {0x246, 0x0, 0xcb1732cc, 0x0, 0x0, 0x0, 0xcab24000, 0x0, 0x0, 0x0, 0x0, 0xd63712d0, 0x0, 0x0, 0xc123d624, 0x20000, 0x2aeaed6, 0x0}}}, mnt_upper_link = {tqe_next = 0x5c5db, tqe_prev = 0x67e1b}, mnt_uppers = {tqh_first = 0x2aeaed6, tqh_last = 0x2ae8658}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ufs/ufs_lookup.c =================================================================== --- /usr/src/sys/ufs/ufs/ufs_lookup.c (revision 247393) +++ /usr/src/sys/ufs/ufs/ufs_lookup.c (working copy) @@ -1473,3 +1473,71 @@ ufs_checkpath(ino_t source_ino, ino_t parent_ino, vput(vp); return (error); } + +/* + * Returns best effort at calculating the depth of directory from root. + * If successfully calculated, saved in i_depth for future use. + */ +int +ufs_dirdepth(struct inode *dip) +{ + struct mount *mp; + struct vnode *tvp, *vp, *vp1; + struct inode *ip1; + int depth, error; + ino_t dd_ino; + + /* + * If we already know the depth, do not attempt to recalculate it. + */ + if (dip->i_depth > 0) + return (dip->i_depth); + if (dip->i_number == ROOTINO) + return (0); + vp = tvp = ITOV(dip); + mp = vp->v_mount; + depth = 0; + for (;;) { + error = ufs_dir_dd_ino(vp, curthread->td_ucred, &dd_ino); + if (error != 0) + break; + if (dd_ino == ROOTINO) { + depth += 1; + /* Save depth for this node since we know it */ + VTOI(vp)->i_depth = 1; + break; + } + error = VFS_VGET(mp, dd_ino, LK_SHARED | LK_NOWAIT, &vp1); + if (error != 0) + break; + ip1 = VTOI(vp1); + /* Redo the check of ".." if directory was reparented */ + if (dd_ino != ip1->i_number) { + vput(vp1); + continue; + } + if (ip1->i_depth == 0) { + depth += 1; + } else { + depth += ip1->i_depth + 1; + /* Save depth for this node since we know it */ + VTOI(vp)->i_depth = ip1->i_depth + 1; + vput(vp1); + break; + } + if (vp != tvp) + vput(vp); + vp = vp1; + } + KASSERT(error != ENOTDIR, ("ufs_calcdepth: .. not a directory")); + if (vp != tvp) + vput(vp); + /* + * Only save the depth if we got it accurately. + * + * Always return what we were able to determine. + */ + if (error == 0) + dip->i_depth = depth; + return (depth); +} Index: /usr/src/sys/ufs/ufs/inode.h =================================================================== --- /usr/src/sys/ufs/ufs/inode.h (revision 247393) +++ /usr/src/sys/ufs/ufs/inode.h (working copy) @@ -86,6 +86,7 @@ struct inode { struct dirhash *dirhash; /* Hashing for large directories. */ daddr_t *snapblklist; /* Collect expunged snapshot blocks. */ } i_un; + int i_depth; /* For directories, depth from root */ /* * Data for extended attribute modification. Index: /usr/src/sys/ufs/ufs/ufs_extern.h =================================================================== --- /usr/src/sys/ufs/ufs/ufs_extern.h (revision 247393) +++ /usr/src/sys/ufs/ufs/ufs_extern.h (working copy) @@ -58,6 +58,7 @@ int ufs_bmaparray(struct vnode *, ufs2_daddr_t, u struct buf *, int *, int *); int ufs_fhtovp(struct mount *, struct ufid *, int, struct vnode **); int ufs_checkpath(ino_t, ino_t, struct inode *, struct ucred *, ino_t *); +int ufs_dirdepth(struct inode *); void ufs_dirbad(struct inode *, doff_t, char *); int ufs_dirbadentry(struct vnode *, struct direct *, int); int ufs_dirempty(struct inode *, ino_t, struct ucred *); Index: /usr/src/sys/ufs/ffs/ffs_balloc.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_balloc.c (revision 247393) +++ /usr/src/sys/ufs/ffs/ffs_balloc.c (working copy) @@ -245,7 +245,8 @@ ffs_balloc_ufs1(struct vnode *vp, off_t startoffse lbns_remfree = lbns; if (nb == 0) { UFS_LOCK(ump); - pref = ffs_blkpref_ufs1(ip, lbn, 0, (ufs1_daddr_t *)0); + pref = ffs_blkpref_ufs1(ip, lbn, -indirs[0].in_off - 1, + (ufs1_daddr_t *)0); if ((error = ffs_alloc(ip, lbn, pref, (int)fs->fs_bsize, flags, cred, &newb)) != 0) { curthread_pflags_restore(saved_inbdflush); @@ -298,7 +299,8 @@ retry: } UFS_LOCK(ump); if (pref == 0) - pref = ffs_blkpref_ufs1(ip, lbn, 0, (ufs1_daddr_t *)0); + pref = ffs_blkpref_ufs1(ip, lbn, i - num - 1, + (ufs1_daddr_t *)0); if ((error = ffs_alloc(ip, lbn, pref, (int)fs->fs_bsize, flags | IO_BUFLOCKED, cred, &newb)) != 0) { brelse(bp); @@ -787,7 +789,8 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffse lbns_remfree = lbns; if (nb == 0) { UFS_LOCK(ump); - pref = ffs_blkpref_ufs2(ip, lbn, 0, (ufs2_daddr_t *)0); + pref = ffs_blkpref_ufs2(ip, lbn, -indirs[0].in_off - 1, + (ufs2_daddr_t *)0); if ((error = ffs_alloc(ip, lbn, pref, (int)fs->fs_bsize, flags, cred, &newb)) != 0) { curthread_pflags_restore(saved_inbdflush); @@ -840,7 +843,8 @@ retry: } UFS_LOCK(ump); if (pref == 0) - pref = ffs_blkpref_ufs2(ip, lbn, 0, (ufs2_daddr_t *)0); + pref = ffs_blkpref_ufs2(ip, lbn, i - num - 1, + (ufs2_daddr_t *)0); if ((error = ffs_alloc(ip, lbn, pref, (int)fs->fs_bsize, flags | IO_BUFLOCKED, cred, &newb)) != 0) { brelse(bp); Index: /usr/src/sys/ufs/ffs/fs.h =================================================================== --- /usr/src/sys/ufs/ffs/fs.h (revision 247393) +++ /usr/src/sys/ufs/ffs/fs.h (working copy) @@ -333,7 +333,8 @@ struct fs { int32_t fs_maxbsize; /* maximum blocking factor permitted */ int64_t fs_unrefs; /* number of unreferenced inodes */ int64_t fs_providersize; /* size of underlying GEOM provider */ - int64_t fs_sparecon64[15]; /* old rotation block list head */ + int64_t fs_metaspace; /* size of area reserved for metadata */ + int64_t fs_sparecon64[14]; /* old rotation block list head */ int64_t fs_sblockloc; /* byte offset of standard superblock */ struct csum_total fs_cstotal; /* (u) cylinder summary information */ ufs_time_t fs_time; /* last time written */ @@ -525,6 +526,8 @@ struct cg { * They calc filesystem addresses of cylinder group data structures. */ #define cgbase(fs, c) (((ufs2_daddr_t)(fs)->fs_fpg) * (c)) +#define cgdata(fs, c) (cgdmin(fs, c) + (fs)->fs_metaspace) /* data zone */ +#define cgmeta(fs, c) (cgdmin(fs, c)) /* meta data */ #define cgdmin(fs, c) (cgstart(fs, c) + (fs)->fs_dblkno) /* 1st data */ #define cgimin(fs, c) (cgstart(fs, c) + (fs)->fs_iblkno) /* inode blk */ #define cgsblock(fs, c) (cgstart(fs, c) + (fs)->fs_sblkno) /* super blk */ Index: /usr/src/sys/ufs/ffs/ffs_alloc.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_alloc.c (revision 247393) +++ /usr/src/sys/ufs/ffs/ffs_alloc.c (working copy) @@ -815,15 +815,6 @@ ffs_reallocblks_ufs2(ap) UFS_LOCK(ump); pref = ffs_blkpref_ufs2(ip, start_lbn, soff, sbap); /* - * Skip a block for the first indirect block. Indirect blocks are - * usually initially laid out in a good position between the data - * blocks, but block reallocation would usually destroy locality by - * moving them out of the way to make room for data blocks if we - * didn't compensate here. - */ - if (start_lbn == NDADDR) - pref += fs->fs_frag; - /* * Search the block map looking for an allocation of the desired size. */ if ((newblk = ffs_hashalloc(ip, dtog(fs, pref), pref, @@ -1088,7 +1079,7 @@ ffs_dirpref(pip) struct inode *pip; { struct fs *fs; - u_int cg, prefcg, dirsize, cgsize; + int cg, prefcg, dirsize, cgsize; u_int avgifree, avgbfree, avgndir, curdirsize; u_int minifree, minbfree, maxndir; u_int mincg, minndir; @@ -1149,6 +1140,9 @@ ffs_dirpref(pip) if (fs->fs_avgfpdir > 0) maxcontigdirs = min(maxcontigdirs, fs->fs_ipg / fs->fs_avgfpdir); + UFS_UNLOCK(pip->i_ump); + maxcontigdirs = min(maxcontigdirs, ufs_dirdepth(pip)); + UFS_LOCK(pip->i_ump); if (maxcontigdirs == 0) maxcontigdirs = 1; @@ -1165,7 +1159,7 @@ ffs_dirpref(pip) if (fs->fs_contigdirs[cg] < maxcontigdirs) return ((ino_t)(fs->fs_ipg * cg)); } - for (cg = 0; cg < prefcg; cg++) + for (cg = prefcg - 1; cg >= 0; cg--) if (fs->fs_cs(fs, cg).cs_ndir < maxndir && fs->fs_cs(fs, cg).cs_nifree >= minifree && fs->fs_cs(fs, cg).cs_nbfree >= minbfree) { @@ -1178,7 +1172,7 @@ ffs_dirpref(pip) for (cg = prefcg; cg < fs->fs_ncg; cg++) if (fs->fs_cs(fs, cg).cs_nifree >= avgifree) return ((ino_t)(fs->fs_ipg * cg)); - for (cg = 0; cg < prefcg; cg++) + for (cg = prefcg - 1; cg >= 0; cg--) if (fs->fs_cs(fs, cg).cs_nifree >= avgifree) break; return ((ino_t)(fs->fs_ipg * cg)); @@ -1191,9 +1185,15 @@ ffs_dirpref(pip) * * If no blocks have been allocated in the first section, the policy is to * request a block in the same cylinder group as the inode that describes - * the file. If no blocks have been allocated in any other section, the - * policy is to place the section in a cylinder group with a greater than - * average number of free blocks. An appropriate cylinder group is found + * the file. The first indirect is allocated immediately following the last + * direct block and the data blocks for the first indirect immediately + * follow it. + * + * If no blocks have been allocated in any other section, the indirect + * block(s) are allocated in the same cylinder group as its inode in an + * area reserved immediately following the inode blocks. The policy for + * the data blocks is to place them in a cylinder group with a greater than + * average number of free blocks. An appropriate cylinder group is found * by using a rotor that sweeps the cylinder groups. When a new group of * blocks is needed, the sweep begins in the cylinder group following the * cylinder group from which the previous allocation was made. The sweep @@ -1216,39 +1216,77 @@ ffs_blkpref_ufs1(ip, lbn, indx, bap) ufs1_daddr_t *bap; { struct fs *fs; - u_int cg; + u_int cg, inocg; u_int avgbfree, startcg; ufs2_daddr_t pref; mtx_assert(UFS_MTX(ip->i_ump), MA_OWNED); fs = ip->i_fs; /* - * If we are allocating the first indirect block, try to place it - * immediately following the last direct block. - * + * Allocation of indirect blocks is indicated by passing negative + * values in indx: -1 for single indirect, -2 for double indirect, + * -3 for triple indirect. As noted below, we attempt to allocate + * the first indirect inline with the file data. For all later + * indirect blocks, the data is often allocated in other cylinder + * groups. However to speed random file access and to speed up + * fsck, the filesystem reserves the first fs_metaspace blocks + * (typically half of fs_minfree) of the data area of each cylinder + * group to hold these later indirect blocks. + */ + inocg = ino_to_cg(fs, ip->i_number); + if (indx < 0) { + /* + * Our preference for indirect blocks is the zone at the + * beginning of the inode's cylinder group data area that + * we try to reserve for indirect blocks. + */ + pref = cgmeta(fs, inocg); + /* + * If we are allocating the first indirect block, try to + * place it immediately following the last direct block. + */ + if (indx == -1 && lbn < NDADDR + NINDIR(fs) && + ip->i_din1->di_db[NDADDR - 1] != 0) + pref = ip->i_din1->di_db[NDADDR - 1] + fs->fs_frag; + return (pref); + } + /* * If we are allocating the first data block in the first indirect - * block, try to place it immediately following the indirect block. + * block and the indirect has been allocated in the data block area, + * try to place it immediately following the indirect block. */ if (lbn == NDADDR) { - pref = ip->i_din1->di_db[NDADDR - 1]; - if (bap == NULL && pref != 0) - return (pref + fs->fs_frag); pref = ip->i_din1->di_ib[0]; - if (pref != 0) + if (pref != 0 && pref >= cgdata(fs, inocg) && + pref < cgbase(fs, inocg + 1)) return (pref + fs->fs_frag); } + /* + * If we are at the beginning of a file, or we have already allocated + * the maximum number of blocks per cylinder group, or we do not + * have a block allocated immediately preceeding us, then we need + * to decide where to start allocating new blocks. + */ if (indx % fs->fs_maxbpg == 0 || bap[indx - 1] == 0) { - if (lbn < NDADDR + NINDIR(fs)) { - cg = ino_to_cg(fs, ip->i_number); - return (cgbase(fs, cg) + fs->fs_frag); - } /* + * If we are allocating a directory data block, we want + * to place it in the metadata area. + */ + if ((ip->i_mode & IFMT) == IFDIR) + return (cgmeta(fs, inocg)); + /* + * Until we fill all the direct and all the first indirect's + * blocks, we try to allocate in the data area of the inode's + * cylinder group. + */ + if (lbn < NDADDR + NINDIR(fs)) + return (cgdata(fs, inocg)); + /* * Find a cylinder with greater than average number of * unused data blocks. */ if (indx == 0 || bap[indx - 1] == 0) - startcg = - ino_to_cg(fs, ip->i_number) + lbn / fs->fs_maxbpg; + startcg = inocg + lbn / fs->fs_maxbpg; else startcg = dtog(fs, bap[indx - 1]) + 1; startcg %= fs->fs_ncg; @@ -1256,17 +1294,17 @@ ffs_blkpref_ufs1(ip, lbn, indx, bap) for (cg = startcg; cg < fs->fs_ncg; cg++) if (fs->fs_cs(fs, cg).cs_nbfree >= avgbfree) { fs->fs_cgrotor = cg; - return (cgbase(fs, cg) + fs->fs_frag); + return (cgdata(fs, cg)); } for (cg = 0; cg <= startcg; cg++) if (fs->fs_cs(fs, cg).cs_nbfree >= avgbfree) { fs->fs_cgrotor = cg; - return (cgbase(fs, cg) + fs->fs_frag); + return (cgdata(fs, cg)); } return (0); } /* - * We just always try to lay things out contiguously. + * Otherwise, we just always try to lay things out contiguously. */ return (bap[indx - 1] + fs->fs_frag); } @@ -1282,39 +1320,77 @@ ffs_blkpref_ufs2(ip, lbn, indx, bap) ufs2_daddr_t *bap; { struct fs *fs; - u_int cg; + u_int cg, inocg; u_int avgbfree, startcg; ufs2_daddr_t pref; mtx_assert(UFS_MTX(ip->i_ump), MA_OWNED); fs = ip->i_fs; /* - * If we are allocating the first indirect block, try to place it - * immediately following the last direct block. - * + * Allocation of indirect blocks is indicated by passing negative + * values in indx: -1 for single indirect, -2 for double indirect, + * -3 for triple indirect. As noted below, we attempt to allocate + * the first indirect inline with the file data. For all later + * indirect blocks, the data is often allocated in other cylinder + * groups. However to speed random file access and to speed up + * fsck, the filesystem reserves the first fs_metaspace blocks + * (typically half of fs_minfree) of the data area of each cylinder + * group to hold these later indirect blocks. + */ + inocg = ino_to_cg(fs, ip->i_number); + if (indx < 0) { + /* + * Our preference for indirect blocks is the zone at the + * beginning of the inode's cylinder group data area that + * we try to reserve for indirect blocks. + */ + pref = cgmeta(fs, inocg); + /* + * If we are allocating the first indirect block, try to + * place it immediately following the last direct block. + */ + if (indx == -1 && lbn < NDADDR + NINDIR(fs) && + ip->i_din2->di_db[NDADDR - 1] != 0) + pref = ip->i_din2->di_db[NDADDR - 1] + fs->fs_frag; + return (pref); + } + /* * If we are allocating the first data block in the first indirect - * block, try to place it immediately following the indirect block. + * block and the indirect has been allocated in the data block area, + * try to place it immediately following the indirect block. */ if (lbn == NDADDR) { - pref = ip->i_din1->di_db[NDADDR - 1]; - if (bap == NULL && pref != 0) + pref = ip->i_din2->di_ib[0]; + if (pref != 0 && pref >= cgdata(fs, inocg) && + pref < cgbase(fs, inocg + 1)) return (pref + fs->fs_frag); - pref = ip->i_din1->di_ib[0]; - if (pref != 0) - return (pref + fs->fs_frag); } + /* + * If we are at the beginning of a file, or we have already allocated + * the maximum number of blocks per cylinder group, or we do not + * have a block allocated immediately preceeding us, then we need + * to decide where to start allocating new blocks. + */ if (indx % fs->fs_maxbpg == 0 || bap[indx - 1] == 0) { - if (lbn < NDADDR + NINDIR(fs)) { - cg = ino_to_cg(fs, ip->i_number); - return (cgbase(fs, cg) + fs->fs_frag); - } /* + * If we are allocating a directory data block, we want + * to place it in the metadata area. + */ + if ((ip->i_mode & IFMT) == IFDIR) + return (cgmeta(fs, inocg)); + /* + * Until we fill all the direct and all the first indirect's + * blocks, we try to allocate in the data area of the inode's + * cylinder group. + */ + if (lbn < NDADDR + NINDIR(fs)) + return (cgdata(fs, inocg)); + /* * Find a cylinder with greater than average number of * unused data blocks. */ if (indx == 0 || bap[indx - 1] == 0) - startcg = - ino_to_cg(fs, ip->i_number) + lbn / fs->fs_maxbpg; + startcg = inocg + lbn / fs->fs_maxbpg; else startcg = dtog(fs, bap[indx - 1]) + 1; startcg %= fs->fs_ncg; @@ -1322,17 +1398,17 @@ ffs_blkpref_ufs2(ip, lbn, indx, bap) for (cg = startcg; cg < fs->fs_ncg; cg++) if (fs->fs_cs(fs, cg).cs_nbfree >= avgbfree) { fs->fs_cgrotor = cg; - return (cgbase(fs, cg) + fs->fs_frag); + return (cgdata(fs, cg)); } for (cg = 0; cg <= startcg; cg++) if (fs->fs_cs(fs, cg).cs_nbfree >= avgbfree) { fs->fs_cgrotor = cg; - return (cgbase(fs, cg) + fs->fs_frag); + return (cgdata(fs, cg)); } return (0); } /* - * We just always try to lay things out contiguously. + * Otherwise, we just always try to lay things out contiguously. */ return (bap[indx - 1] + fs->fs_frag); } @@ -1609,31 +1685,37 @@ ffs_alloccgblk(ip, bp, bpref, size) ufs1_daddr_t bno; ufs2_daddr_t blkno; u_int8_t *blksfree; - int i; + int i, cgbpref; fs = ip->i_fs; ump = ip->i_ump; mtx_assert(UFS_MTX(ump), MA_OWNED); cgp = (struct cg *)bp->b_data; blksfree = cg_blksfree(cgp); - if (bpref == 0 || dtog(fs, bpref) != cgp->cg_cgx) { + if (bpref == 0) { bpref = cgp->cg_rotor; - } else { - bpref = blknum(fs, bpref); - bno = dtogd(fs, bpref); - /* - * if the requested block is available, use it - */ - if (ffs_isblock(fs, blksfree, fragstoblks(fs, bno))) - goto gotit; + } else if ((cgbpref = dtog(fs, bpref)) != cgp->cg_cgx) { + /* map bpref to correct zone in this cg */ + if (bpref < cgdata(fs, cgbpref)) + bpref = cgmeta(fs, cgp->cg_cgx); + else + bpref = cgdata(fs, cgp->cg_cgx); } /* + * if the requested block is available, use it + */ + bno = dtogd(fs, blknum(fs, bpref)); + if (ffs_isblock(fs, blksfree, fragstoblks(fs, bno))) + goto gotit; + /* * Take the next available block in this cylinder group. */ bno = ffs_mapsearch(fs, cgp, bpref, (int)fs->fs_frag); if (bno < 0) return (0); - cgp->cg_rotor = bno; + /* Update cg_rotor only if allocated from the data zone */ + if (bno >= dtogd(fs, cgdata(fs, cgp->cg_cgx))) + cgp->cg_rotor = bno; gotit: blkno = fragstoblks(fs, bno); ffs_clrblock(fs, blksfree, (long)blkno); @@ -1740,9 +1822,10 @@ ffs_clusteralloc(ip, cg, bpref, len, unused) * be recalled to try an allocation in the next cylinder group. */ if (dtog(fs, bpref) != cg) - bpref = 0; + bpref = cgdata(fs, cg); else - bpref = fragstoblks(fs, dtogd(fs, blknum(fs, bpref))); + bpref = blknum(fs, bpref); + bpref = fragstoblks(fs, dtogd(fs, bpref)); mapp = &cg_clustersfree(cgp)[bpref / NBBY]; map = *mapp++; bit = 1 << (bpref % NBBY); @@ -2398,6 +2481,11 @@ ffs_checkfreefile(fs, devvp, ino) /* * Find a block of the specified size in the specified cylinder group. * + * First try to allocate from the data zone. Only if that fails, + * allocate from the indirect block zone. If the bpref requests + * an allocation from the indirect zone, that area will be searched + * first falling back to the data zone if the indirect zone is full. + * * It is a panic if a request is made to find a block if none are * available. */ @@ -2409,29 +2497,62 @@ ffs_mapsearch(fs, cgp, bpref, allocsiz) int allocsiz; { ufs1_daddr_t bno; - int start, len, loc, i; + int wantmetablk, startdatazone, start, len, loc, i; int blk, field, subfield, pos; - u_int8_t *blksfree; + u_int8_t *blksfree, mask; /* - * find the fragment by searching through the free block - * map for an appropriate bit pattern + * Find the block or fragment by searching through the free block + * map for an appropriate bit pattern. */ if (bpref) start = dtogd(fs, bpref) / NBBY; else start = cgp->cg_frotor / NBBY; blksfree = cg_blksfree(cgp); - len = howmany(fs->fs_fpg, NBBY) - start; + mask = 1 << (allocsiz - 1 + (fs->fs_frag % NBBY)); + startdatazone = dtogd(fs, cgdata(fs, cgp->cg_cgx)); + /* + * If the preference is in the area for data we seek: + * 1) from preference to the end of the block map + * 2) from the beginning of the data area to where we started + * 3) in the area held for metadata + * + * If the preference is in the area held for metadata we seek: + * 1) from preference to the end of the area held for metadata + * 2) from the beginning of the metadata area to where we started + * 3) in the area for data + */ + if (start >= startdatazone) { + wantmetablk = 0; + len = howmany(fs->fs_fpg, NBBY) - start; + } else { + wantmetablk = 1; + len = startdatazone - start; + } loc = scanc((u_int)len, (u_char *)&blksfree[start], - fragtbl[fs->fs_frag], - (u_char)(1 << (allocsiz - 1 + (fs->fs_frag % NBBY)))); + fragtbl[fs->fs_frag], mask); if (loc == 0) { - len = start + 1; - start = 0; - loc = scanc((u_int)len, (u_char *)&blksfree[0], - fragtbl[fs->fs_frag], - (u_char)(1 << (allocsiz - 1 + (fs->fs_frag % NBBY)))); + if (wantmetablk == 0) { + len = start - startdatazone; + start = startdatazone; + } else { + len = start; + start = 0; + } + loc = scanc((u_int)len, (u_char *)&blksfree[start], + fragtbl[fs->fs_frag], mask); + } + if (loc == 0) { + if (wantmetablk == 0) { + len = startdatazone; + start = 0; + } else { + len = howmany(fs->fs_fpg, NBBY) - startdatazone; + start = startdatazone; + } + loc = scanc((u_int)len, (u_char *)&blksfree[start], + fragtbl[fs->fs_frag], mask); if (loc == 0) { printf("start = %d, len = %d, fs = %s\n", start, len, fs->fs_fsmnt); @@ -2440,7 +2561,9 @@ ffs_mapsearch(fs, cgp, bpref, allocsiz) } } bno = (start + len - loc) * NBBY; - cgp->cg_frotor = bno; + /* Update cg_frotor only if allocated from the data zone */ + if (bno >= startdatazone) + cgp->cg_frotor = bno; /* * found the byte in the map * sift through the bits to find the selected frag -- Test scenario: umountf6.sh