GENERIC HEAD from 2015-04-25 00:58:24 UTC, r281981M, vmcore.800 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #0 r281981M: Sat Apr 25 13:01:17 CEST 2015 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.6.0 (tags/RELEASE_360/final 230434) 20150225 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT: running with driver "vga". CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3528839168 (3365 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 58624 free (1232 frags, 7174 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 732201 free (8929 frags, 90409 blocks, 0.9% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 53499249 free (19569 frags, 6684960 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3717252 free (297420 frags, 427479 blocks, 2.9% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 3596619 free (233915 frags, 420338 blocks, 0.9% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. Feeding entropy:. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP Starting pflogd: add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/gcc48 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. Starting watchdogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Starting casperd. lock order reversal: 1st 0xe44f5230 bufwait (bufwait) @ kern/vfs_bio.c:3099 2nd 0xc93dae00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c96d3c00,e44f51e0,edbc1748,c0bfcd5a,...) at db_trace_self_wrapper+0x2a/frame 0xedbc1718 kdb_backtrace(c11e7c45,c93dae00,c121b655,c858b8c0,c121b29a,...) at kdb_backtrace+0x2d/frame 0xedbc1780 witness_checkorder(c93dae00,9,c121b291,11d,0,...) at witness_checkorder+0xd2e/frame 0xedbc17d4 _sx_xlock(c93dae00,0,c121b291,11d,0,...) at _sx_xlock+0x74/frame 0xedbc1804 ufsdirhash_add(c944b438,edbc1950,9354,edbc1890,edbc1894,...) at ufsdirhash_add+0x4a/frame 0xedbc1838 ufs_direnter(c96d3b40,c9aab5a0,edbc1950,edbc1b3c,e4500f88,...) at ufs_direnter+0x654/frame 0xedbc18c0 ufs_mkdir(edbc1bd8,c13abbed,c12143a6,c96d3b40,edbc1bd4,...) at ufs_mkdir+0x7ec/frame 0xedbc1a70 VOP_MKDIR_APV(c147bdb0,edbc1bd8,edbc1b3c,edbc1b68,28803020,...) at VOP_MKDIR_APV+0x12f/frame 0xedbc1aa0 kern_mkdirat(c9b05310,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x22d/frame 0xedbc1bfc sys_mkdir(c9b05310,edbc1ca8,c11d843d,4,c10657e7,...) at sys_mkdir+0x31/frame 0xedbc1c18 syscall(edbc1ce8) at syscall+0x34a/frame 0xedbc1cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc1cdc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2818f087, esp = 0xbfbfe924, ebp = 0xbfbfedd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting smartd. Apr 25 13:24:02 x4 smartd[623]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Apr 25 13:24:02 x4 smartd[623]: see the following Seagate web pages: Apr 25 13:24:02 x4 smartd[623]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Apr 25 13:24:02 x4 smartd[623]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Starting default moused. Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc96d3b74 ufs (ufs) @ kern/vfs_subr.c:2176 2nd 0xe44f4bd0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:263 3rd 0xc9e0846c ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,f88bd630,c0ab278f,4000,0,...) at db_trace_self_wrapper+0x2a/frame 0xf88bd5d8 kdb_backtrace(c11e7c5e,c9e0846c,c11cdfa9,c858b858,c11f12bd,...) at kdb_backtrace+0x2d/frame 0xf88bd63c witness_checkorder(c9e0846c,9,c11f12b4,880,c9e084d8,...) at witness_checkorder+0xd2e/frame 0xf88bd690 __lockmgr_args(c9e0846c,80100,c9e084d8,0,0,...) at __lockmgr_args+0x935/frame 0xf88bd76c ffs_lock(f88bd7e8,c8589a48,c15a9988,c8589a48,c8583178,...) at ffs_lock+0x98/frame 0xf88bd7a4 VOP_LOCK1_APV(c147bdb0,f88bd7e8,0,ca100930,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xf88bd7d0 _vn_lock(c9e08438,80100,c11f12b4,880,c11f04d4,...) at _vn_lock+0xba/frame 0xf88bd810 vget(c9e08438,80100,ca100930,57,80100,...) at vget+0x74/frame 0xf88bd848 vfs_hash_get(c96e6bb0,a6c00,80000,ca100930,f88bd940,...) at vfs_hash_get+0xe7/frame 0xf88bd874 ffs_vgetf(c96e6bb0,a6c00,80000,f88bd940,1,...) at ffs_vgetf+0x44/frame 0xf88bd8d0 softdep_sync_buf(c96d3b40,e44f4b80,1,0,0,...) at softdep_sync_buf+0x36b/frame 0xf88bd958 ffs_syncvnode(c96d3b40,1,0,5fa,c8583588,...) at ffs_syncvnode+0x2aa/frame 0xf88bd9b0 ffs_sync(c96e6bb0,4,c11f2d78,733,ca100930,...) at ffs_sync+0x1e9/frame 0xf88bda38 vfs_write_suspend(c96e6bb0,0,c121b842,79,72,...) at vfs_write_suspend+0x1bf/frame 0xf88bda74 vfs_write_suspend_umnt(c96e6bb0,ca100930,f88bdac0,c11f12b4,8ce,...) at vfs_write_suspend_umnt+0x42/frame 0xf88bda9c ffs_unmount(c96e6bb0,8080000,f88bdb20,510,c15a9988,...) at ffs_unmount+0xa7/frame 0xf88bdae8 dounmount(c96e6bb0,8080000,ca100930,492,14f,...) at dounmount+0x4c9/frame 0xf88bdb48 sys_unmount(ca100930,f88bdca8,c11d843d,4,c156b410,...) at sys_unmount+0x2d4/frame 0xf88bdc18 syscall(f88bdce8) at syscall+0x34a/frame 0xf88bdcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88bdcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe69c, ebp = 0xbfbfe768 --- lock order reversal: 1st 0xc93cc304 ufs (ufs) @ kern/vfs_mount.c:1229 2nd 0xc93285d4 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1904 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c15a9988,8,10,c1454ae8,...) at db_trace_self_wrapper+0x2a/frame 0xf88bd740 kdb_backtrace(c11e7c45,c93285d4,c11da2dc,c858b6b8,c1216e64,...) at kdb_backtrace+0x2d/frame 0xf88bd7a4 witness_checkorder(c93285d4,9,c1216e5b,770,0,...) at witness_checkorder+0xd2e/frame 0xf88bd7f8 __lockmgr_args(c93285d4,80400,c9328640,0,0,0,c1216e5b,770) at __lockmgr_args+0x935/frame 0xf88bd8d4 vop_stdlock(f88bd948,c96ec000,f88bd940,c0b5d569,c96ec000,...) at vop_stdlock+0x53/frame 0xf88bd904 VOP_LOCK1_APV(c14442b0,f88bd948,f88bd970,c0dd7265,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xf88bd930 _vn_lock(c93285a0,80400,c1216e5b,770,f88bda0c,...) at _vn_lock+0xba/frame 0xf88bd970 softdep_flushworklist(c96e6bb0,f88bda08,ca100930,60e,c8583588,...) at softdep_flushworklist+0x68/frame 0xf88bd9b0 ffs_sync(c96e6bb0,4,c11f2d78,733,ca100930,...) at ffs_sync+0x2ae/frame 0xf88bda38 vfs_write_suspend(c96e6bb0,0,c121b842,79,72,...) at vfs_write_suspend+0x1bf/frame 0xf88bda74 vfs_write_suspend_umnt(c96e6bb0,ca100930,f88bdac0,c11f12b4,8ce,...) at vfs_write_suspend_umnt+0x42/frame 0xf88bda9c ffs_unmount(c96e6bb0,8080000,f88bdb20,510,c15a9988,...) at ffs_unmount+0xa7/frame 0xf88bdae8 dounmount(c96e6bb0,8080000,ca100930,492,14f,...) at dounmount+0x4c9/frame 0xf88bdb48 sys_unmount(ca100930,f88bdca8,c11d843d,4,c156b410,...) at sys_unmount+0x2d4/frame 0xf88bdc18 syscall(f88bdce8) at syscall+0x34a/frame 0xf88bdcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88bdcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe69c, ebp = 0xbfbfe768 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 406953 files, 64814732 used, 53499249 free (19569 frags, 6684960 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting inetd. Sat Apr 25 13:26:08 CEST 2015 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Apr 25 13:27:30 x4 su: pho to root on /dev/pts/0 20150425 13:27:44 all (1/1): msync.sh 20150425 13:29:54 all (1/1): msync.sh 20150425 13:32:02 all (1/1): msync.sh 20150425 13:34:10 all (1/1): msync.sh 20150425 13:36:20 all (1/314): tmpfs8.sh 20150425 13:37:07 all (2/314): zfs.sh 20150425 13:37:07 all (3/314): mountu.sh lock order reversal: 1st 0xcb8eb8a4 msdosfs (msdosfs) @ kern/vfs_subr.c:2176 2nd 0xcb8dc19c devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:843 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,1,c8af4e00,c156c200,c156c210,...) at db_trace_self_wrapper+0x2a/frame 0xedb3c578 kdb_backtrace(c11e7c45,cb8dc19c,c11da2dc,c858b6b8,c11c65be,...) at kdb_backtrace+0x2d/frame 0xedb3c5dc witness_checkorder(cb8dc19c,9,c11c65b5,34b,0,...) at witness_checkorder+0xd2e/frame 0xedb3c630 __lockmgr_args(cb8dc19c,80400,cb8dc208,0,0,0,c11c65b5,34b) at __lockmgr_args+0x935/frame 0xedb3c70c vop_stdlock(edb3c780,c11f032b,2d0,100,5d,...) at vop_stdlock+0x53/frame 0xedb3c73c VOP_LOCK1_APV(c14442b0,edb3c780,0,0,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xedb3c768 _vn_lock(cb8dc168,80400,c11c65b5,34b,c1444760,...) at _vn_lock+0xba/frame 0xedb3c7a8 msdosfs_fsync(edb3c860,c13abac8,c0c1c239,cbd7a8d4,0,...) at msdosfs_fsync+0x51/frame 0xedb3c7e8 VOP_FSYNC_APV(c1444760,edb3c860,cbcf8000,3c6,edb3c884,...) at VOP_FSYNC_APV+0x12f/frame 0xedb3c818 msdosfs_sync(cbd7a8c4,1,0,0,0,...) at msdosfs_sync+0xb2/frame 0xedb3c888 msdosfs_mount(cbd7a8c4,c92a4310,4,3ae,c88d0c80,...) at msdosfs_mount+0x3dc/frame 0xedb3c9e8 vfs_donmount(cbcf8000,0,0,ca110d00,ca110d00,...) at vfs_donmount+0xfdb/frame 0xedb3cbf0 sys_nmount(cbcf8000,edb3cca8,c11d843d,4,c10657e7,...) at sys_nmount+0x7a/frame 0xedb3cc18 syscall(edb3cce8) at syscall+0x34a/frame 0xedb3ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb3ccdc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280dbabb, esp = 0xbfbfe284, ebp = 0xbfbfe854 --- 20150425 13:37:27 all (4/314): holdcnt0.sh 20150425 13:37:27 all (5/314): lockf4.sh *** Excessive run time: lockf4.sh, 53 min 20150425 14:31:19 all (6/314): fcntl.sh 20150425 14:31:23 all (7/314): namecache.sh 20150425 14:44:30 all (8/314): mkfifo2c.sh 20150425 15:14:45 all (9/314): ptrace3.sh 20150425 15:14:45 all (10/314): syscall4.sh 20150425 15:16:58 all (11/314): marcus2.sh 20150425 15:40:14 all (12/314): nullfs11.sh 20150425 15:44:35 all (13/314): umountf2.sh 20150425 15:50:31 all (14/314): linger.sh 20150425 16:12:29 all (15/314): suj6.sh 20150425 16:13:30 all (16/314): suj29.sh 20150425 16:19:59 all (17/314): quota4.sh lock order reversal: 1st 0xdb97046c syncer (syncer) @ kern/vfs_subr.c:1769 2nd 0xd78d6304 ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c0ab278f,3800,246,200,...) at db_trace_self_wrapper+0x2a/frame 0xedb098c8 kdb_backtrace(c11e7c45,d78d6304,c11cdfa9,c858b858,c11f12bd,...) at kdb_backtrace+0x2d/frame 0xedb0992c witness_checkorder(d78d6304,9,c11f12b4,880,d78d6370,...) at witness_checkorder+0xd2e/frame 0xedb09980 __lockmgr_args(d78d6304,80100,d78d6370,0,0,...) at __lockmgr_args+0x935/frame 0xedb09a5c ffs_lock(edb09ad8,c1fa5450,cbef0600,200,cbdd92c0,...) at ffs_lock+0x98/frame 0xedb09a94 VOP_LOCK1_APV(c147bdb0,edb09ad8,c15d731c,c15d730c,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xedb09ac0 _vn_lock(d78d62d0,80100,c11f12b4,880,12eb,...) at _vn_lock+0xba/frame 0xedb09b00 vget(d78d62d0,80100,c8efcc40,c15d731c,c8efcc40,...) at vget+0x74/frame 0xedb09b34 qsync(cbd7a8c4,cbd7a8c4,c121a5d5,59a,c11f12b4,...) at qsync+0x96/frame 0xedb09b60 ffs_sync(cbd7a8c4,3,2,cbd7a8c4,c145f080,...) at ffs_sync+0x593/frame 0xedb09be4 sync_fsync(edb09c88,c13abac8,80400,c11f12b4,6e9,...) at sync_fsync+0x116/frame 0xedb09c08 VOP_FSYNC_APV(c145f080,edb09c88,c11f12b4,6e9,0,...) at VOP_FSYNC_APV+0x12f/frame 0xedb09c38 sched_sync(0,edb09ce8,c11d881c,3dc,0,...) at sched_sync+0x441/frame 0xedb09cac fork_exit(c0c20f10,0,edb09ce8) at fork_exit+0x7e/frame 0xedb09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb09cd4 --- trap 0, eip = 0, esp = 0xedb09d20, ebp = 0 --- lock order reversal: 1st 0xd5ab7948 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:725 2nd 0xcbd7a8c4 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:731 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,33373a63,a31,c11f2d78,6f1,...) at db_trace_self_wrapper+0x2a/frame 0xf91eb890 kdb_backtrace(c11e7c45,cbd7a8c4,c11e894a,c8583588,c121be12,...) at kdb_backtrace+0x2d/frame 0xf91eb8f8 witness_checkorder(cbd7a8c4,9,c121be09,2db,0,...) at witness_checkorder+0xd2e/frame 0xf91eb94c __mtx_lock_flags(cbd7a8d4,0,c121be09,2db,d5ab7958,...) at __mtx_lock_flags+0x99/frame 0xf91eb980 quotaoff_inchange(0,0,c121be09,2f7) at quotaoff_inchange+0x7c/frame 0xf91eb9ac quotaoff(d15e9930,cbd7a8c4,0,d15e9930,c8583588,...) at quotaoff+0xbd/frame 0xf91eb9d0 ffs_flushfiles(cbd7a8c4,a,d15e9930,10,c1454ae8,...) at ffs_flushfiles+0x6b/frame 0xf91eba20 softdep_flushfiles(cbd7a8c4,2,d15e9930,c11f12b4,8ce,...) at softdep_flushfiles+0x19d/frame 0xf91eba9c ffs_unmount(cbd7a8c4,8080000,f91ebb20,510,c15a7fc0,...) at ffs_unmount+0xd9/frame 0xf91ebae8 dounmount(cbd7a8c4,8080000,d15e9930,492,14f,...) at dounmount+0x4c9/frame 0xf91ebb48 sys_unmount(d15e9930,f91ebca8,c11d843d,4,0,...) at sys_unmount+0x2d4/frame 0xf91ebc18 syscall(f91ebce8) at syscall+0x34a/frame 0xf91ebcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf91ebcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe0ec, ebp = 0xbfbfe1b8 --- 20150425 16:21:15 all (18/314): extattr_set_fd.sh 20150425 16:21:18 all (19/314): mmap3.sh Apr 25 16:26:22 x4 kernel: Failed to write core file for process mmap3 (error 14) Apr 25 16:27:27 x4 kernel: Failed to write core file for process mmap3 (error 14) Apr 25 16:28:16 x4 last message repeated 4 times 20150425 16:31:50 all (20/314): rename5.sh 20150425 16:32:32 all (21/314): syscall3.sh 20150425 16:42:33 all (22/314): sendfile5.sh lock order reversal: 1st 0xc9c6a2f4 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:262 2nd 0xdc2ca034 ufs (ufs) @ kern/uipc_syscalls.c:2351 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,0,246,dbfc746c,c11f032b,...) at db_trace_self_wrapper+0x2a/frame 0xf9a24758 kdb_backtrace(c11e7c45,dc2ca034,c11cdfa9,c858b858,c11ed982,...) at kdb_backtrace+0x2d/frame 0xf9a247bc witness_checkorder(dc2ca034,1,c11ed979,92f,0,...) at witness_checkorder+0xd2e/frame 0xf9a24810 __lockmgr_args(dc2ca034,200000,dc2ca0a0,0,0,...) at __lockmgr_args+0x50b/frame 0xf9a248ec ffs_lock(f9a24968,f9a24968,f9a24ae0,c15913bc,c15913b8,...) at ffs_lock+0x98/frame 0xf9a24924 VOP_LOCK1_APV(c147bdb0,f9a24968,c9c6a2e0,f9a24990,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xf9a24950 _vn_lock(dc2ca000,200000,c11ed979,92f,0,...) at _vn_lock+0xba/frame 0xf9a24990 vn_sendfile(c93fc9d8,4,0,0,0,...) at vn_sendfile+0x83c/frame 0xf9a24b70 do_sendfile(0) at do_sendfile+0x1b3/frame 0xf9a24c0c sys_sendfile(d4e6a930,f9a24ca8,c11d843d,4,c10657e7,...) at sys_sendfile+0x16/frame 0xf9a24c18 syscall(f9a24ce8) at syscall+0x34a/frame 0xf9a24cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf9a24cdc --- syscall (393, FreeBSD ELF32, sys_sendfile), eip = 0x280d7a1b, esp = 0xbfbfe7c4, ebp = 0xbfbfe884 --- 20150425 16:43:46 all (23/314): tmpfs5.sh 20150425 16:44:01 all (24/314): graid0.sh GEOM_STRIPE: Device data created (id=3556370333). GEOM_STRIPE: Disk md5 attached to data. GEOM_STRIPE: Disk md6 attached to data. GEOM_STRIPE: Disk md7 attached to data. GEOM_STRIPE: Device stripe/data activated. GEOM_STRIPE: Disk md7 removed from data. GEOM_STRIPE: Device stripe/data deactivated. GEOM_STRIPE: Disk md6 removed from data. GEOM_STRIPE: Disk md5 removed from data. GEOM_STRIPE: Device data destroyed. 20150425 16:56:39 all (25/314): swap.sh 20150425 17:02:23 all (26/314): truncate2.sh 20150425 17:06:36 all (27/314): nullfs3.sh 20150425 17:06:38 all (28/314): nullfs7.sh 20150425 17:06:39 all (29/314): kevent7.sh lock order reversal: 1st 0xd067c398 filedesc structure (filedesc structure) @ kern/kern_descrip.c:1218 2nd 0xdba68034 pseudofs (pseudofs) @ kern/vfs_subr.c:4459 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,2e706972,32313a63,a3831,0,...) at db_trace_self_wrapper+0x2a/frame 0xc82178c8 kdb_backtrace(c11e7c45,dba68034,c11ca32a,c858b9f8,c11f12bd,...) at kdb_backtrace+0x2d/frame 0xc821792c witness_checkorder(dba68034,9,c11f12b4,116b,0,...) at witness_checkorder+0xd2e/frame 0xc8217980 __lockmgr_args(dba68034,80400,dba680a0,0,0,0,c11f12b4,116b) at __lockmgr_args+0x935/frame 0xc8217a5c vop_stdlock(c8217ad0,c8217aa4,c0c09048,dba68034,c8217ad0,...) at vop_stdlock+0x53/frame 0xc8217a8c VOP_LOCK1_APV(c1447604,c8217ad0,dd627cc4,0,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xc8217ab8 _vn_lock(dba68000,80400,c11f12b4,116b) at _vn_lock+0xba/frame 0xc8217af4 vfs_knllock(dba68000,0,c11d8014,7a2,10,...) at vfs_knllock+0x29/frame 0xc8217b0c knlist_remove_kq(0,0) at knlist_remove_kq+0x86/frame 0xc8217b34 knlist_remove(dd627cc4,cacd0dc8,0,db371490,db371490,...) at knlist_remove+0x1f/frame 0xc8217b44 filt_vfsdetach(cacd0dc8,0,c11d8014,8ac,0,...) at filt_vfsdetach+0x2f/frame 0xc8217b64 knote_fdclose(db5e8310,200,c11d75a1,479,d067c374,...) at knote_fdclose+0x138/frame 0xc8217ba0 closefp(cbeac268,db5e8310,1,b3,dd6c1008,...) at closefp+0x68/frame 0xc8217bd4 kern_close(db5e8310,200) at kern_close+0x12a/frame 0xc8217c08 sys_close(db5e8310,c8217ca8,c11d843d,4,c10657e7,...) at sys_close+0x1a/frame 0xc8217c18 syscall(c8217ce8) at syscall+0x34a/frame 0xc8217cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc8217cdc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x281c3f1f, esp = 0xbbbfdf48, ebp = 0xbbbfdf60 --- 20150425 17:11:41 all (30/314): umount.sh 20150425 17:15:54 all (31/314): msdos2.sh 20150425 17:15:55 all (32/314): kevent3.sh 20150425 17:15:57 all (33/314): pts.sh 20150425 17:20:08 all (34/314): nullfs10.sh 20150425 17:20:09 all (35/314): vfork.sh 20150425 17:20:12 all (36/314): wire_no_page.sh 20150425 17:20:21 all (37/314): suj8.sh lock order reversal: 1st 0xd81858a4 ufs (ufs) @ kern/vfs_subr.c:2176 2nd 0xc1632920 proctree (proctree) @ kern/subr_prf.c:146 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c0b3ee5a,e4537f98,8,3ee403bf,...) at db_trace_self_wrapper+0x2a/frame 0xc64ec5a0 kdb_backtrace(c11e7c45,c1632920,c11dd8ec,c8582068,c11e4cb4,...) at kdb_backtrace+0x2d/frame 0xc64ec608 witness_checkorder(c1632920,1,c11e4cab,92,0,...) at witness_checkorder+0xd2e/frame 0xc64ec65c _sx_slock(c1632920,0,c11e4cab,92,c64ec6b8,...) at _sx_slock+0x6e/frame 0xc64ec688 uprintf(c121560e,cbf810d4,c12155fe,4130,0,...) at uprintf+0x46/frame 0xc64ec6e0 ffs_balloc_ufs2(d8185870,7b80000,0,1000,ca04dd00,...) at ffs_balloc_ufs2+0x2613/frame 0xc64ec82c ffs_write(c64ec9b0,c13ab945,d81858a4,d8185870,c148f0e4,...) at ffs_write+0x592/frame 0xc64ec8b8 VOP_WRITE_APV(c147bdb0,c64ec9b0,d8185870,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xc64ec978 vn_write(c942b7e0,c64ecbe8,ca04dd00,1,d0287930,...) at vn_write+0x328/frame 0xc64ec9e0 vn_io_fault_doio(d0287930,c64eca4c,c0baf43c,c157a24c,0,...) at vn_io_fault_doio+0x34/frame 0xc64eca28 vn_io_fault1(d0287930,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xc64ecaf8 vn_io_fault(c942b7e0,c64ecbe8,ca04dd00,0,d0287930,...) at vn_io_fault+0x1fa/frame 0xc64ecb4c dofilewrite(c942b7e0,c64ecbe8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xc64ecb80 kern_writev(d0287930,4,c64ecbe8,c15a4b80,28828000,...) at kern_writev+0x93/frame 0xc64ecbc8 sys_write(d0287930,c64ecca8,c11d843d,4,df,...) at sys_write+0x59/frame 0xc64ecc18 syscall(c64ecce8) at syscall+0x34a/frame 0xc64eccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc64eccdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a5eef, esp = 0xbfbfe828, ebp = 0xbfbfe84c --- Apr 25 17:20:22 x4 kernel: pid 87619 (dd), uid 0 inumber 4 on /mnt: filesystem full Apr 25 17:20:24 x4 kernel: pid 87640 (dd), uid 0 inumber 5 on /mnt: filesystem full 20150425 17:20:26 all (38/314): crossmp4.sh 20150425 17:28:29 all (39/314): nfs8.sh 20150425 17:28:33 all (40/314): suj17.sh 20150425 17:41:54 all (41/314): md3.sh 20150425 17:52:48 all (42/314): pthread6.sh 20150425 18:02:17 all (43/314): tmpfs10.sh 20150425 18:05:19 all (44/314): mmap6.sh 20150425 18:06:16 all (45/314): trim3.sh 20150425 18:32:00 all (46/314): quota1.sh Apr 25 18:34:24 x4 kernel: pid 23395 (mkdir), uid 0 inumber 4096 on /mnt: out of inodes Apr 25 18:38:40 x4 kernel: pid 23516 (mkdir), uid 0 inumber 16370 on /mnt: out of inodes Apr 25 18:38:50 x4 kernel: pid 23497 (mkdir), uid 0 inumber 4095 on /mnt: out of inodes 20150425 18:42:10 all (47/314): mountro3.sh 20150425 18:42:12 all (48/314): mountro2.sh 20150425 18:42:14 all (49/314): md5.sh 20150425 18:42:19 all (50/314): kevent4.sh 20150425 18:45:35 all (51/314): snap4.sh lock order reversal: 1st 0xe46eef40 bufwait (bufwait) @ kern/vfs_bio.c:2361 2nd 0xd41e7a1c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2298 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,da,c8b2d400,c8efcc40,c8cec3c0,...) at db_trace_self_wrapper+0x2a/frame 0xedb09878 kdb_backtrace(c11e7c45,d41e7a1c,c12169a6,c858c898,c12165c8,...) at kdb_backtrace+0x2d/frame 0xedb098dc witness_checkorder(d41e7a1c,9,c12165bf,8fa,c9328640,...) at witness_checkorder+0xd2e/frame 0xedb09930 __lockmgr_args(d41e7a1c,80900,c9328640,0,0,...) at __lockmgr_args+0x935/frame 0xedb09a10 ffs_copyonwrite(c93285a0,e4566df0,4,e4566df0,c8efcc40,...) at ffs_copyonwrite+0x1cf/frame 0xedb09a84 ffs_geom_strategy(c9328660,e4566df0,4e7,c9328660,edb09ae4,...) at ffs_geom_strategy+0xd2/frame 0xedb09aa0 bufwrite(e4566df0,c121a5d5,809,5dc000,e4566df0,c9328670,c9337270,c96e6bc0,0) at bufwrite+0x160/frame 0xedb09ae4 ffs_bufwrite(e4566df0,e8644000,4000,4000,0,...) at ffs_bufwrite+0x147/frame 0xedb09b18 ffs_sbupdate(c933ce00,3,0,59a,c11f12b4,...) at ffs_sbupdate+0x1e8/frame 0xedb09b60 ffs_sync(c96e6bb0,3,2,c96e6bb0,c145f080,...) at ffs_sync+0x64f/frame 0xedb09be4 sync_fsync(edb09c88,c13abac8,80400,c11f12b4,6e9,...) at sync_fsync+0x116/frame 0xedb09c08 VOP_FSYNC_APV(c145f080,edb09c88,c11f12b4,6e9,0,...) at VOP_FSYNC_APV+0x12f/frame 0xedb09c38 sched_sync(0,edb09ce8,c11d881c,3dc,0,...) at sched_sync+0x441/frame 0xedb09cac fork_exit(c0c20f10,0,edb09ce8) at fork_exit+0x7e/frame 0xedb09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb09cd4 --- trap 0, eip = 0, esp = 0xedb09d20, ebp = 0 --- lock order reversal: 1st 0xd41e7a1c snaplk (snaplk) @ kern/vfs_vnops.c:434 2nd 0xd1201cdc ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1629 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c15a8fc4,c15a8f90,c15a8fe0,c15a8f90,...) at db_trace_self_wrapper+0x2a/frame 0xc67b0440 kdb_backtrace(c11e7c45,d1201cdc,c11cdfa9,c858b858,c12165c8,...) at kdb_backtrace+0x2d/frame 0xc67b04a4 witness_checkorder(d1201cdc,9,c12165bf,65d,0,...) at witness_checkorder+0xd2e/frame 0xc67b04f8 __lockmgr_args(d1201cdc,80000,0,0,0,...) at __lockmgr_args+0x935/frame 0xc67b05d8 ffs_snapremove(d1201ca8,c1216490,c67b0724,c0b3f26a,0,...) at ffs_snapremove+0x119/frame 0xc67b0638 ffs_truncate(d1201ca8,0,0,c00,0,...) at ffs_truncate+0x2a1/frame 0xc67b07e8 ufs_inactive(c67b0870,c13abd89,8,c11f12b4,9db,...) at ufs_inactive+0x1ed/frame 0xc67b0818 VOP_INACTIVE_APV(c147bdb0,c67b0870,c11f12b4,9db,d41e7a1c,...) at VOP_INACTIVE_APV+0x12f/frame 0xc67b0848 vinactive(d1201ca8,d0776930,c11f12b4,8ce,c67b08d8,...) at vinactive+0x182/frame 0xc67b0890 vputx(d1201ca8,c67b08f8,c11f2d78,1b2,0,...) at vputx+0x3c3/frame 0xc67b08d8 vn_close(d1201ca8,1,ca04dd00,d0776930,1999997c,...) at vn_close+0xdd/frame 0xc67b0920 mddestroy(c14ae114,0,c1167730,5f7,180,...) at mddestroy+0x282/frame 0xc67b0980 mdctlioctl(c8ce3100,c1b46d01,c96eb400,3,d0776930,...) at mdctlioctl+0x772/frame 0xc67b0ae4 devfs_ioctl_f(c938bcb0,c1b46d01,c96eb400,ca04dd00,d0776930,...) at devfs_ioctl_f+0x121/frame 0xc67b0b1c kern_ioctl(d0776930,3,c1b46d01,c96eb400,0,...) at kern_ioctl+0x2dc/frame 0xc67b0b58 sys_ioctl(d0776930,c67b0ca8,c11d843d,4,c156ad10,...) at sys_ioctl+0x11b/frame 0xc67b0c18 syscall(c67b0ce8) at syscall+0x34a/frame 0xc67b0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc67b0cdc --- syscall (54, FreeBSD ELF32, sys_ioctl), eip = 0x281baf3f, esp = 0xbfbfe848, ebp = 0xbfbfe884 --- 20150425 19:15:43 all (52/314): pfl2.sh 20150425 19:27:39 all (53/314): f_offset.sh 20150425 19:31:24 all (54/314): socketpair.sh 20150425 19:31:25 all (55/314): core3.sh Apr 25 19:31:27 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:28 x4 last message repeated 245 times Apr 25 19:31:28 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:28 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:29 x4 last message repeated 573 times Apr 25 19:31:30 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:30 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:33 x4 last message repeated 894 times Apr 25 19:31:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:35 x4 last message repeated 635 times Apr 25 19:31:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:44 x4 last message repeated 2985 times Apr 25 19:31:44 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:44 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:46 x4 last message repeated 637 times Apr 25 19:31:46 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:46 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:50 x4 last message repeated 1663 times Apr 25 19:31:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:52 x4 last message repeated 703 times Apr 25 19:31:52 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:52 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:55 x4 last message repeated 1342 times Apr 25 19:31:55 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:55 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:57 x4 last message repeated 817 times Apr 25 19:31:57 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:57 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:57 x4 last message repeated 63 times Apr 25 19:31:57 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:57 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:31:57 x4 last message repeated 63 times Apr 25 19:31:57 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:31:57 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:02 x4 last message repeated 1907 times Apr 25 19:32:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:03 x4 last message repeated 255 times Apr 25 19:32:03 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:03 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:03 x4 last message repeated 63 times Apr 25 19:32:03 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:03 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:06 x4 last message repeated 1150 times Apr 25 19:32:06 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:06 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:08 x4 last message repeated 509 times Apr 25 19:32:08 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:08 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:11 x4 last message repeated 1215 times Apr 25 19:32:11 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:11 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:14 x4 last message repeated 959 times Apr 25 19:32:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:17 x4 last message repeated 1277 times Apr 25 19:32:17 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:17 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:25 x4 last message repeated 2907 times Apr 25 19:32:25 x4 mountd[536]: bad exports list line /mnt Apr 25 19:32:25 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:31 x4 last message repeated 2185 times Apr 25 19:32:32 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:32 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:33 x4 last message repeated 441 times Apr 25 19:32:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:34 x4 last message repeated 510 times Apr 25 19:32:34 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:34 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:36 x4 last message repeated 714 times Apr 25 19:32:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:37 x4 last message repeated 371 times Apr 25 19:32:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:37 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:38 x4 last message repeated 383 times Apr 25 19:32:38 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:38 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:39 x4 last message repeated 254 times Apr 25 19:32:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:41 x4 last message repeated 768 times Apr 25 19:32:41 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:41 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:41 x4 last message repeated 191 times Apr 25 19:32:41 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:41 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:44 x4 last message repeated 958 times Apr 25 19:32:44 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:44 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:47 x4 last message repeated 1278 times Apr 25 19:32:47 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:47 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:48 x4 last message repeated 319 times Apr 25 19:32:48 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:48 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:48 x4 last message repeated 190 times Apr 25 19:32:49 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:49 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:50 x4 last message repeated 578 times Apr 25 19:32:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:51 x4 last message repeated 636 times Apr 25 19:32:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:32:54 x4 last message repeated 1215 times Apr 25 19:32:54 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:32:54 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:00 x4 last message repeated 2366 times Apr 25 19:33:00 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:00 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:01 x4 last message repeated 319 times Apr 25 19:33:01 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:01 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:01 x4 last message repeated 190 times Apr 25 19:33:01 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:01 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:05 x4 last message repeated 1084 times Apr 25 19:33:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:05 x4 last message repeated 127 times Apr 25 19:33:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:07 x4 last message repeated 703 times Apr 25 19:33:07 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:07 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:09 x4 last message repeated 1023 times Apr 25 19:33:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:09 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:11 x4 last message repeated 639 times Apr 25 19:33:11 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:11 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:13 x4 last message repeated 706 times Apr 25 19:33:13 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:13 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:14 x4 last message repeated 380 times Apr 25 19:33:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:16 x4 last message repeated 895 times Apr 25 19:33:16 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:16 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:17 x4 last message repeated 191 times Apr 25 19:33:17 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:17 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:18 x4 last message repeated 830 times Apr 25 19:33:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:19 x4 last message repeated 252 times Apr 25 19:33:19 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:19 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:21 x4 last message repeated 895 times Apr 25 19:33:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:22 x4 last message repeated 63 times Apr 25 19:33:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:35 x4 last message repeated 1083 times Apr 25 19:33:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:36 x4 last message repeated 127 times Apr 25 19:33:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:42 x4 last message repeated 1402 times Apr 25 19:33:42 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:42 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:42 x4 last message repeated 127 times Apr 25 19:33:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:43 x4 last message repeated 190 times Apr 25 19:33:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:44 x4 last message repeated 318 times Apr 25 19:33:44 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:44 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:48 x4 last message repeated 1342 times Apr 25 19:33:48 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:48 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:54 x4 last message repeated 2180 times Apr 25 19:33:54 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:54 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:56 x4 last message repeated 952 times Apr 25 19:33:56 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:56 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:33:57 x4 last message repeated 255 times Apr 25 19:33:57 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:33:57 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:02 x4 last message repeated 2232 times Apr 25 19:34:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:05 x4 last message repeated 955 times Apr 25 19:34:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:05 x4 last message repeated 191 times Apr 25 19:34:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:07 x4 last message repeated 383 times Apr 25 19:34:07 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:07 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:09 x4 last message repeated 639 times Apr 25 19:34:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:09 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:11 x4 last message repeated 1022 times Apr 25 19:34:11 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:11 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:11 x4 last message repeated 127 times Apr 25 19:34:11 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:11 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:13 x4 last message repeated 575 times Apr 25 19:34:13 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:13 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:14 x4 last message repeated 386 times Apr 25 19:34:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:14 x4 last message repeated 59 times Apr 25 19:34:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:15 x4 last message repeated 123 times Apr 25 19:34:15 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:15 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:20 x4 last message repeated 2174 times Apr 25 19:34:20 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:20 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:22 x4 last message repeated 837 times Apr 25 19:34:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:22 x4 last message repeated 121 times Apr 25 19:34:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:23 x4 last message repeated 127 times Apr 25 19:34:23 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:23 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:24 x4 last message repeated 575 times Apr 25 19:34:24 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:24 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:28 x4 last message repeated 1274 times Apr 25 19:34:28 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:28 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:28 x4 last message repeated 255 times Apr 25 19:34:28 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:28 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:29 x4 last message repeated 127 times Apr 25 19:34:29 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:29 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:30 x4 last message repeated 383 times Apr 25 19:34:30 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:30 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:31 x4 last message repeated 578 times Apr 25 19:34:31 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:31 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:32 x4 last message repeated 508 times Apr 25 19:34:32 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:32 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:32 x4 last message repeated 63 times Apr 25 19:34:32 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:32 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:34 x4 last message repeated 513 times Apr 25 19:34:34 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:34 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:35 x4 last message repeated 381 times Apr 25 19:34:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:35 x4 last message repeated 127 times Apr 25 19:34:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:38 x4 last message repeated 1151 times Apr 25 19:34:38 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:38 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:43 x4 last message repeated 2044 times Apr 25 19:34:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:45 x4 last message repeated 762 times Apr 25 19:34:45 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:45 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:45 x4 last message repeated 63 times Apr 25 19:34:45 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:45 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:51 x4 last message repeated 2366 times Apr 25 19:34:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:51 x4 last message repeated 127 times Apr 25 19:34:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:51 x4 last message repeated 63 times Apr 25 19:34:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:52 x4 last message repeated 258 times Apr 25 19:34:52 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:52 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:54 x4 last message repeated 957 times Apr 25 19:34:54 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:54 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:55 x4 last message repeated 191 times Apr 25 19:34:55 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:55 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:55 x4 last message repeated 123 times Apr 25 19:34:55 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:55 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:57 x4 last message repeated 767 times Apr 25 19:34:57 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:57 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:57 x4 last message repeated 127 times Apr 25 19:34:58 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:58 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:34:59 x4 last message repeated 511 times Apr 25 19:34:59 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:34:59 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:01 x4 last message repeated 641 times Apr 25 19:35:01 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:01 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:01 x4 last message repeated 253 times Apr 25 19:35:01 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:01 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:04 x4 last message repeated 827 times Apr 25 19:35:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:06 x4 last message repeated 831 times Apr 25 19:35:06 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:06 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:14 x4 last message repeated 3257 times Apr 25 19:35:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:15 x4 last message repeated 639 times Apr 25 19:35:15 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:15 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:16 x4 last message repeated 127 times Apr 25 19:35:16 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:16 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:18 x4 last message repeated 958 times Apr 25 19:35:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:22 x4 last message repeated 1599 times Apr 25 19:35:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:23 x4 last message repeated 511 times Apr 25 19:35:23 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:23 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:24 x4 last message repeated 63 times Apr 25 19:35:24 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:24 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:25 x4 last message repeated 454 times Apr 25 19:35:25 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:25 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:25 x4 last message repeated 248 times Apr 25 19:35:25 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:25 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:32 x4 last message repeated 2751 times Apr 25 19:35:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:33 x4 last message repeated 447 times Apr 25 19:35:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:35 x4 last message repeated 637 times Apr 25 19:35:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:36 x4 last message repeated 191 times Apr 25 19:35:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:36 x4 last message repeated 127 times Apr 25 19:35:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:37 x4 last message repeated 255 times Apr 25 19:35:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:37 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:37 x4 last message repeated 127 times Apr 25 19:35:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:37 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:38 x4 last message repeated 319 times Apr 25 19:35:38 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:38 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:39 x4 last message repeated 255 times Apr 25 19:35:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:39 x4 last message repeated 191 times Apr 25 19:35:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:42 x4 last message repeated 958 times Apr 25 19:35:42 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:42 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:44 x4 last message repeated 703 times Apr 25 19:35:44 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:44 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:44 x4 last message repeated 130 times Apr 25 19:35:44 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:44 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:47 x4 last message repeated 955 times Apr 25 19:35:47 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:47 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:50 x4 last message repeated 1406 times Apr 25 19:35:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:50 x4 last message repeated 127 times Apr 25 19:35:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:51 x4 last message repeated 191 times Apr 25 19:35:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:51 x4 last message repeated 63 times Apr 25 19:35:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:51 x4 last message repeated 63 times Apr 25 19:35:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:52 x4 last message repeated 254 times Apr 25 19:35:52 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:52 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:53 x4 last message repeated 509 times Apr 25 19:35:53 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:53 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:54 x4 last message repeated 447 times Apr 25 19:35:54 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:54 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:56 x4 last message repeated 639 times Apr 25 19:35:56 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:56 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:57 x4 last message repeated 382 times Apr 25 19:35:57 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:57 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:35:59 x4 last message repeated 574 times Apr 25 19:35:59 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:35:59 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:04 x4 last message repeated 1922 times Apr 25 19:36:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:07 x4 last message repeated 1147 times Apr 25 19:36:07 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:07 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:08 x4 last message repeated 319 times Apr 25 19:36:08 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:08 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:10 x4 last message repeated 827 times Apr 25 19:36:10 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:10 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:13 x4 last message repeated 1150 times Apr 25 19:36:13 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:13 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:15 x4 last message repeated 381 times Apr 25 19:36:15 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:15 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:16 x4 last message repeated 894 times Apr 25 19:36:17 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:17 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:20 x4 last message repeated 1587 times Apr 25 19:36:20 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:20 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:21 x4 last message repeated 191 times Apr 25 19:36:21 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:21 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:22 x4 last message repeated 255 times Apr 25 19:36:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:23 x4 last message repeated 446 times Apr 25 19:36:23 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:23 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:26 x4 last message repeated 1086 times Apr 25 19:36:26 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:26 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:28 x4 last message repeated 959 times Apr 25 19:36:28 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:28 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:33 x4 last message repeated 1855 times Apr 25 19:36:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:34 x4 last message repeated 317 times Apr 25 19:36:34 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:34 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:34 x4 last message repeated 255 times Apr 25 19:36:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:36 x4 last message repeated 511 times Apr 25 19:36:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:38 x4 last message repeated 767 times Apr 25 19:36:38 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:38 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:40 x4 last message repeated 848 times Apr 25 19:36:40 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:40 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:40 x4 last message repeated 63 times Apr 25 19:36:40 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:40 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:47 x4 last message repeated 2618 times Apr 25 19:36:47 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:47 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:48 x4 last message repeated 511 times Apr 25 19:36:48 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:48 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:49 x4 last message repeated 388 times Apr 25 19:36:49 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:49 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:49 x4 last message repeated 122 times Apr 25 19:36:49 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:49 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:51 x4 last message repeated 703 times Apr 25 19:36:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:36:53 x4 last message repeated 446 times Apr 25 19:36:53 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:36:53 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:02 x4 last message repeated 3263 times Apr 25 19:37:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:05 x4 last message repeated 1155 times Apr 25 19:37:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:05 x4 last message repeated 186 times Apr 25 19:37:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:05 x4 last message repeated 63 times Apr 25 19:37:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:06 x4 last message repeated 127 times Apr 25 19:37:06 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:06 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:06 x4 last message repeated 127 times Apr 25 19:37:06 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:06 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:07 x4 last message repeated 191 times Apr 25 19:37:07 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:07 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:09 x4 last message repeated 830 times Apr 25 19:37:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:09 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:12 x4 last message repeated 1214 times Apr 25 19:37:12 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:12 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:14 x4 last message repeated 1021 times Apr 25 19:37:15 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:15 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:18 x4 last message repeated 1276 times Apr 25 19:37:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:20 x4 last message repeated 830 times Apr 25 19:37:20 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:20 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:21 x4 last message repeated 703 times Apr 25 19:37:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:23 x4 last message repeated 447 times Apr 25 19:37:23 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:23 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:23 x4 last message repeated 190 times Apr 25 19:37:23 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:23 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:28 x4 last message repeated 1707 times Apr 25 19:37:28 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:28 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:31 x4 last message repeated 1344 times Apr 25 19:37:31 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:31 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:35 x4 last message repeated 1790 times Apr 25 19:37:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:36 x4 last message repeated 253 times Apr 25 19:37:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:37 x4 last message repeated 257 times Apr 25 19:37:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:37 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:39 x4 last message repeated 820 times Apr 25 19:37:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:39 x4 last message repeated 127 times Apr 25 19:37:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:40 x4 last message repeated 127 times Apr 25 19:37:40 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:40 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:45 x4 last message repeated 2105 times Apr 25 19:37:45 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:45 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:45 x4 last message repeated 63 times Apr 25 19:37:45 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:45 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:49 x4 last message repeated 1279 times Apr 25 19:37:49 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:49 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:50 x4 last message repeated 703 times Apr 25 19:37:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:50 x4 last message repeated 71 times Apr 25 19:37:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:51 x4 last message repeated 232 times Apr 25 19:37:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:58 x4 last message repeated 2550 times Apr 25 19:37:58 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:58 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:37:59 x4 last message repeated 383 times Apr 25 19:37:59 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:37:59 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:00 x4 last message repeated 454 times Apr 25 19:38:00 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:00 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:04 x4 last message repeated 1719 times Apr 25 19:38:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:09 x4 last message repeated 1852 times Apr 25 19:38:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:09 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:10 x4 last message repeated 511 times Apr 25 19:38:10 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:10 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:10 x4 last message repeated 72 times Apr 25 19:38:10 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:10 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:13 x4 last message repeated 950 times Apr 25 19:38:13 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:13 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:13 x4 last message repeated 63 times Apr 25 19:38:13 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:13 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:13 x4 last message repeated 191 times Apr 25 19:38:13 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:13 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:14 x4 last message repeated 127 times Apr 25 19:38:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:15 x4 last message repeated 451 times Apr 25 19:38:15 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:15 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:16 x4 last message repeated 368 times Apr 25 19:38:16 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:16 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:17 x4 last message repeated 383 times Apr 25 19:38:17 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:17 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:17 x4 last message repeated 255 times Apr 25 19:38:17 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:17 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:18 x4 last message repeated 191 times Apr 25 19:38:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:18 x4 last message repeated 255 times Apr 25 19:38:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:19 x4 last message repeated 447 times Apr 25 19:38:19 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:19 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:22 x4 last message repeated 960 times Apr 25 19:38:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:22 x4 last message repeated 251 times Apr 25 19:38:22 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:22 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:24 x4 last message repeated 895 times Apr 25 19:38:25 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:25 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:27 x4 last message repeated 829 times Apr 25 19:38:27 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:27 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:28 x4 last message repeated 636 times Apr 25 19:38:29 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:29 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:29 x4 last message repeated 255 times Apr 25 19:38:29 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:29 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:30 x4 last message repeated 255 times Apr 25 19:38:30 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:30 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:31 x4 last message repeated 575 times Apr 25 19:38:31 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:31 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:31 x4 last message repeated 127 times Apr 25 19:38:31 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:31 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:34 x4 last message repeated 1023 times Apr 25 19:38:34 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:34 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:34 x4 last message repeated 127 times Apr 25 19:38:34 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:34 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:36 x4 last message repeated 756 times Apr 25 19:38:36 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:36 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:36 x4 last message repeated 65 times Apr 25 19:38:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:37 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:39 x4 last message repeated 895 times Apr 25 19:38:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:43 x4 last message repeated 1592 times Apr 25 19:38:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:43 x4 last message repeated 127 times Apr 25 19:38:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:43 x4 last message repeated 63 times Apr 25 19:38:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:47 x4 last message repeated 1534 times Apr 25 19:38:48 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:48 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:50 x4 last message repeated 897 times Apr 25 19:38:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:51 x4 last message repeated 443 times Apr 25 19:38:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:52 x4 last message repeated 319 times Apr 25 19:38:52 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:52 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:52 x4 last message repeated 191 times Apr 25 19:38:52 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:52 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:53 x4 last message repeated 382 times Apr 25 19:38:53 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:53 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:54 x4 last message repeated 126 times Apr 25 19:38:54 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:54 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:56 x4 last message repeated 830 times Apr 25 19:38:56 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:56 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:38:56 x4 last message repeated 191 times Apr 25 19:38:56 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:38:56 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:00 x4 last message repeated 1535 times Apr 25 19:39:00 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:00 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:01 x4 last message repeated 79 times Apr 25 19:39:01 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:01 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:02 x4 last message repeated 367 times Apr 25 19:39:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:04 x4 last message repeated 759 times Apr 25 19:39:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:04 x4 last message repeated 63 times Apr 25 19:39:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:05 x4 last message repeated 449 times Apr 25 19:39:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:06 x4 last message repeated 506 times Apr 25 19:39:06 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:06 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:09 x4 last message repeated 1087 times Apr 25 19:39:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:09 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:11 x4 last message repeated 1022 times Apr 25 19:39:11 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:11 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:15 x4 last message repeated 1535 times Apr 25 19:39:15 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:15 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:19 x4 last message repeated 1726 times Apr 25 19:39:20 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:20 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:24 x4 last message repeated 1791 times Apr 25 19:39:24 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:24 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:26 x4 last message repeated 831 times Apr 25 19:39:26 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:26 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:27 x4 last message repeated 382 times Apr 25 19:39:27 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:27 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:30 x4 last message repeated 684 times Apr 25 19:39:30 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:30 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:33 x4 last message repeated 1471 times Apr 25 19:39:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:35 x4 last message repeated 511 times Apr 25 19:39:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:35 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:37 x4 last message repeated 819 times Apr 25 19:39:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:37 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:39 x4 last message repeated 903 times Apr 25 19:39:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:39 x4 last message repeated 119 times Apr 25 19:39:39 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:39 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:40 x4 last message repeated 194 times Apr 25 19:39:40 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:40 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:43 x4 last message repeated 1341 times Apr 25 19:39:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:43 x4 last message repeated 188 times Apr 25 19:39:43 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:43 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:45 x4 last message repeated 382 times Apr 25 19:39:45 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:45 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:45 x4 last message repeated 127 times Apr 25 19:39:45 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:45 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:46 x4 last message repeated 575 times Apr 25 19:39:46 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:46 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:47 x4 last message repeated 255 times Apr 25 19:39:47 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:47 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:48 x4 last message repeated 383 times Apr 25 19:39:48 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:48 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:49 x4 last message repeated 451 times Apr 25 19:39:49 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:49 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:50 x4 last message repeated 248 times Apr 25 19:39:50 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:50 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:51 x4 last message repeated 319 times Apr 25 19:39:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:53 x4 last message repeated 639 times Apr 25 19:39:53 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:53 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:39:59 x4 last message repeated 2495 times Apr 25 19:39:59 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:39:59 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:02 x4 last message repeated 1156 times Apr 25 19:40:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:02 x4 last message repeated 185 times Apr 25 19:40:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:02 x4 last message repeated 127 times Apr 25 19:40:02 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:02 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:04 x4 last message repeated 446 times Apr 25 19:40:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:07 x4 last message repeated 1214 times Apr 25 19:40:07 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:07 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:09 x4 last message repeated 766 times Apr 25 19:40:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:09 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:12 x4 last message repeated 1019 times Apr 25 19:40:12 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:12 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:18 x4 last message repeated 2371 times Apr 25 19:40:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:19 x4 last message repeated 249 times Apr 25 19:40:19 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:19 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:19 x4 last message repeated 77 times Apr 25 19:40:19 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:19 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:19 x4 last message repeated 242 times Apr 25 19:40:19 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:19 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:33 x4 last message repeated 1021 times Apr 25 19:40:33 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:33 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:38 x4 last message repeated 1215 times Apr 25 19:40:38 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:38 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:41 x4 last message repeated 958 times Apr 25 19:40:42 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:42 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:44 x4 last message repeated 703 times Apr 25 19:40:44 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:44 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:46 x4 last message repeated 705 times Apr 25 19:40:46 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:46 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:47 x4 last message repeated 256 times Apr 25 19:40:47 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:47 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:47 x4 last message repeated 124 times Apr 25 19:40:47 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:47 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:48 x4 last message repeated 383 times Apr 25 19:40:48 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:48 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:51 x4 last message repeated 643 times Apr 25 19:40:51 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:51 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:52 x4 last message repeated 299 times Apr 25 19:40:52 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:52 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:40:53 x4 last message repeated 638 times Apr 25 19:40:53 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:40:53 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:03 x4 last message repeated 2992 times Apr 25 19:41:03 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:03 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:04 x4 last message repeated 510 times Apr 25 19:41:04 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:04 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:05 x4 last message repeated 321 times Apr 25 19:41:05 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:05 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:06 x4 last message repeated 189 times Apr 25 19:41:06 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:06 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:07 x4 last message repeated 447 times Apr 25 19:41:07 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:07 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:10 x4 last message repeated 1378 times Apr 25 19:41:10 x4 mountd[536]: bad exports list line /mnt Apr 25 19:41:10 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:11 x4 last message repeated 190 times Apr 25 19:41:11 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:11 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:13 x4 last message repeated 1151 times Apr 25 19:41:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:14 x4 last message repeated 63 times Apr 25 19:41:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:14 x4 last message repeated 255 times Apr 25 19:41:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:14 x4 last message repeated 63 times Apr 25 19:41:14 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:14 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:16 x4 last message repeated 895 times Apr 25 19:41:16 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:16 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:18 x4 last message repeated 511 times Apr 25 19:41:18 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:18 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:19 x4 last message repeated 511 times Apr 25 19:41:19 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:19 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:23 x4 last message repeated 1726 times Apr 25 19:41:23 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:23 x4 kernel: Failed to write core file for process core3 (error 5) Apr 25 19:41:24 x4 last message repeated 318 times Apr 25 19:41:24 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 19:41:24 x4 kernel: Failed to write core file for process core3 (error 5) lock order reversal: 1st 0xd896f034 tmpfs (tmpfs) @ kern/vfs_mount.c:1229 2nd 0xdb1ae46c syncer (syncer) @ kern/vfs_subr.c:2287 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c9df12d0,c1592c30,c1592c20,c1592c20,...) at db_trace_self_wrapper+0x2a/frame 0xf9513870 kdb_backtrace(c11e7c45,db1ae46c,c11f19d1,c858b928,c11f12bd,...) at kdb_backtrace+0x2d/frame 0xf95138d4 witness_checkorder(db1ae46c,9,c11f12b4,8ef,db1ae4d8,...) at witness_checkorder+0xd2e/frame 0xf9513928 __lockmgr_args(db1ae46c,80100,db1ae4d8,0,0,0,c11f12b4,8ef) at __lockmgr_args+0x935/frame 0xf9513a04 vop_stdlock(f9513a78,f9513a94,c0bbfd0f,c1592c24,c1592c20,...) at vop_stdlock+0x53/frame 0xf9513a34 VOP_LOCK1_APV(c145f080,f9513a78,c0b47b92,db1ae4d8,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xf9513a60 _vn_lock(db1ae438,80100,c11f12b4,8ef,d1581000,...) at _vn_lock+0xba/frame 0xf9513aa0 vputx(dd5685d8,0,c11f087f,510,c1592c20,...) at vputx+0x36d/frame 0xf9513ae8 dounmount(dd5685d8,8080000,d1581000,492,200000,...) at dounmount+0x39d/frame 0xf9513b48 sys_unmount(d1581000,f9513ca8,c11d843d,4,c10657e7,...) at sys_unmount+0x2d4/frame 0xf9513c18 syscall(f9513ce8) at syscall+0x34a/frame 0xf9513cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf9513cdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe0dc, ebp = 0xbfbfe1a8 --- Apr 25 19:41:26 x4 last message repeated 511 times 20150425 19:51:26 all (56/314): jail3.sh 20150425 19:51:27 all (57/314): rename9.sh 20150425 19:52:15 all (58/314): nfs12.sh 20150425 19:52:59 all (59/314): tmpfs6.sh 20150425 19:53:02 all (60/314): procfs.sh Apr 25 19:53:05 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:53:06 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:53:08 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:53:10 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:53:11 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:53:16 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:53:19 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 19:53:26 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:53:26 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:53:30 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:53:31 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:53:47 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:54:00 x4 last message repeated 3 times Apr 25 19:54:01 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 19:54:02 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:54:03 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:54:06 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:54:12 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 19:54:16 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:54:16 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:54:16 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:54:20 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 19:54:23 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:54:24 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:54:28 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:54:29 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:54:29 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:54:34 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 19:54:35 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:54:36 x4 mountd[536]: can't delete exports for /mnt8: Device busy Apr 25 19:54:48 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 19:54:49 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:54:50 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 19:54:57 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:54:58 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 25 19:55:08 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:55:24 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:55:30 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:55:30 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:55:31 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:55:40 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 19:55:47 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:55:48 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:55:50 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:55:54 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 25 19:55:57 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:56:10 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:56:10 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:56:16 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 19:56:18 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 19:56:22 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:56:23 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:56:26 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:56:34 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 19:56:38 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:56:43 x4 mountd[536]: can't delete exports for /mnt8: Device busy Apr 25 19:56:49 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:56:49 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:56:51 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:56:52 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:56:54 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:56:56 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 19:56:56 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:56:58 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 19:56:59 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:57:00 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:57:00 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 19:57:04 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:57:06 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:57:06 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:57:09 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:57:13 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:57:18 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:57:22 x4 last message repeated 2 times Apr 25 19:57:26 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:57:38 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 19:57:44 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:57:53 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:57:55 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:58:00 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:58:02 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:58:04 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:58:07 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 19:58:16 x4 mountd[536]: can't delete exports for /mnt9: Device busy Apr 25 19:58:24 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:58:34 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:58:34 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 19:58:36 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 19:58:37 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:58:45 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:58:46 x4 mountd[536]: can't delete exports for /mnt7: Device busy Apr 25 19:58:53 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:58:56 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 19:59:02 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:59:03 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:59:05 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:59:08 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 19:59:16 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:59:16 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 19:59:18 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 19:59:26 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:59:26 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:59:28 x4 mountd[536]: can't delete exports for /mnt8: Device busy Apr 25 19:59:32 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:59:36 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:59:36 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 19:59:38 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 19:59:40 x4 mountd[536]: can't delete exports for /mnt7: Device busy Apr 25 19:59:43 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 19:59:44 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:59:46 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 19:59:48 x4 mountd[536]: can't delete exports for /mnt9: Device busy Apr 25 19:59:52 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 19:59:59 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:00:04 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:00:09 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 20:00:15 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:00:16 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:00:17 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:00:18 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 20:00:24 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:00:25 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 20:00:42 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:00:50 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:00:52 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:00:54 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:00:56 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 20:00:58 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 20:01:00 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 25 20:01:00 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:01:02 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:01:02 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 20:01:05 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 20:01:12 x4 mountd[536]: can't delete exports for /mnt9: Device busy Apr 25 20:01:21 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:01:24 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 20:01:34 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:01:36 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:01:37 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:01:37 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:01:38 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:01:50 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 20:01:52 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:01:59 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:02:01 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:02:11 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 20:02:20 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:02:22 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:02:23 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:02:25 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 25 20:02:26 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:02:26 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:02:36 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:02:38 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:02:42 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:02:46 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:02:46 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:02:47 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:02:47 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:02:59 x4 last message repeated 2 times Apr 25 20:03:14 x4 mountd[536]: can't delete exports for /mnt9: Device busy Apr 25 20:03:23 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:03:27 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:03:33 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:03:40 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:03:40 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:03:42 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:03:50 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:03:57 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:03:58 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:04:01 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:04:06 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 25 20:04:07 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:07 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:08 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:04:09 x4 mountd[536]: can't delete exports for /mnt7: Device busy Apr 25 20:04:13 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:04:18 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 20:04:19 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:26 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:29 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:04:31 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:04:33 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:04:34 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:37 x4 mountd[536]: can't delete exports for /mnt9: Device busy Apr 25 20:04:38 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:04:40 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:04:46 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:04:51 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:52 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:04:54 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:05:04 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:05:08 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:05:10 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 25 20:05:11 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:05:12 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 20:05:13 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:05:15 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:05:23 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 20:05:25 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 20:05:26 x4 mountd[536]: can't delete exports for /mnt5: Device busy Apr 25 20:05:28 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:05:28 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:05:33 x4 mountd[536]: can't delete exports for /mnt7: Device busy Apr 25 20:05:35 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:05:36 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:05:39 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 20:05:40 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:05:46 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:05:46 x4 mountd[536]: can't delete exports for /mnt7: Device busy Apr 25 20:05:48 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:05:48 x4 mountd[536]: can't delete exports for /mnt19: Device busy Apr 25 20:05:50 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:05:50 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:05:50 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 25 20:05:51 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:05:52 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:05:52 x4 mountd[536]: can't delete exports for /mnt17: Device busy Apr 25 20:05:54 x4 mountd[536]: can't delete exports for /mnt14: Device busy Apr 25 20:05:55 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:05:57 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:06:02 x4 mountd[536]: can't delete exports for /mnt9: Device busy Apr 25 20:06:02 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:06:08 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:06:10 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:06:12 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:06:12 x4 mountd[536]: can't delete exports for /mnt18: Device busy Apr 25 20:06:14 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:06:16 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:06:21 x4 mountd[536]: can't delete exports for /mnt11: Device busy Apr 25 20:06:23 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 25 20:06:24 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:06:36 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:06:40 x4 mountd[536]: can't delete exports for /mnt16: Device busy Apr 25 20:06:41 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 25 20:06:42 x4 mountd[536]: can't delete exports for /mnt12: Device busy Apr 25 20:06:46 x4 mountd[536]: can't delete exports for /mnt10: Device busy 20150425 20:07:05 all (61/314): sendfile3.sh 20150425 20:08:38 all (62/314): stealer.sh 20150425 20:13:08 all (63/314): linger4.sh *** Excessive run time: linger4.sh, 54 min 20150425 21:07:53 all (64/314): crossmp3.sh 20150425 21:14:49 all (65/314): fifo.sh 20150425 21:14:53 all (66/314): procfs5.sh 20150425 21:14:53 all (67/314): link.sh 20150425 21:18:36 all (68/314): mlockall2.sh 20150425 21:29:04 all (69/314): umountf8.sh 20150425 21:31:54 all (70/314): udp.sh Expensive timeout(9) function: 0xc0b599f0(0xcacc89c0) 0.036511002 s 20150425 21:42:23 all (71/314): cmp.sh 20150425 21:45:09 all (72/314): dangling.sh 20150425 21:56:21 all (73/314): sendfile2.sh 20150425 21:56:49 all (74/314): snap7.sh Apr 25 21:58:37 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 22:00:35 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 22:03:09 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 22:11:16 x4 mountd[536]: can't delete exports for /mnt: Device busy Apr 25 22:19:18 x4 last message repeated 3 times 20150425 22:27:07 all (75/314): syscall5.sh 22:27:07 syscall 547 (utimensat) 22:29:24 syscall 546 (futimens) 22:31:28 syscall 545 (ppoll) lock order reversal: 1st 0xd1a2d70c filedesc structure (filedesc structure) @ kern/sys_generic.c:1542 2nd 0xd85c4b74 devfs (devfs) @ kern/vfs_vnops.c:1511 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,632e6369,3435313a,c1000a32,c1597500,...) at db_trace_self_wrapper+0x2a/frame 0xf8b037d8 kdb_backtrace(c11e7c45,d85c4b74,c11da2dc,c858b6b8,c11f2d81,...) at kdb_backtrace+0x2d/frame 0xf8b0383c witness_checkorder(d85c4b74,9,c11f2d78,5e7,0,...) at witness_checkorder+0xd2e/frame 0xf8b03890 __lockmgr_args(d85c4b74,80400,d85c4be0,0,0,0,c11f2d78,5e7) at __lockmgr_args+0x935/frame 0xf8b0396c vop_stdlock(f8b039e0,db5fb930,c8efbd20,c9c94fa8,c9c94fa8,...) at vop_stdlock+0x53/frame 0xf8b0399c VOP_LOCK1_APV(c144418c,f8b039e0,0,f8b03a08,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xf8b039c8 _vn_lock(d85c4b40,80400,c11f2d78,5e7,1,...) at _vn_lock+0xba/frame 0xf8b03a08 vn_poll(c9389380,6445,d24a8600,db5fb930,0,...) at vn_poll+0x35/frame 0xf8b03a48 kern_poll(db5fb930,804efe4,28ca,f8b03bf8,f8b03be8,...) at kern_poll+0x463/frame 0xf8b03bc8 sys_ppoll(db5fb930,f8b03ca8,c11d843d,4,c10657e7,...) at sys_ppoll+0x7c/frame 0xf8b03c18 syscall(f8b03ce8) at syscall+0x34a/frame 0xf8b03cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8b03cdc --- syscall (545, FreeBSD ELF32, sys_ppoll), eip = 0x28119775, esp = 0xbb5f7f50, ebp = 0xbb5f7f98 --- lock order reversal: 1st 0xd1a2d70c filedesc structure (filedesc structure) @ kern/sys_generic.c:1542 2nd 0xd80185d4 ufs (ufs) @ kern/vfs_vnops.c:1511 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,632e6369,3435313a,a32,c82ec868,...) at db_trace_self_wrapper+0x2a/frame 0xc82ec7d0 kdb_backtrace(c11e7c45,d80185d4,c11cdfa9,c858b858,c11f2d81,...) at kdb_backtrace+0x2d/frame 0xc82ec834 witness_checkorder(d80185d4,9,c11f2d78,5e7,0,...) at witness_checkorder+0xd2e/frame 0xc82ec888 __lockmgr_args(d80185d4,80400,d8018640,0,0,...) at __lockmgr_args+0x935/frame 0xc82ec964 ffs_lock(c82ec9e0,c82ec9d8,c0c1d529,c1447604,c82ec9c0,...) at ffs_lock+0x98/frame 0xc82ec99c VOP_LOCK1_APV(c147bdb0,c82ec9e0,c82eca08,c108cec0,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xc82ec9c8 _vn_lock(d80185a0,80400,c11f2d78,5e7,c82ecba0,...) at _vn_lock+0xba/frame 0xc82eca08 vn_poll(d2862850,ffffab19,d24a8600,dd628620,0,...) at vn_poll+0x35/frame 0xc82eca48 kern_poll(dd628620,b969749c,b89e,c82ecbf8,c82ecbe8,...) at kern_poll+0x463/frame 0xc82ecbc8 sys_ppoll(dd628620,c82ecca8,c11d843d,4,c10657e7,...) at sys_ppoll+0x7c/frame 0xc82ecc18 syscall(c82ecce8) at syscall+0x34a/frame 0xc82eccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc82eccdc --- syscall (545, FreeBSD ELF32, sys_ppoll), eip = 0x28119775, esp = 0xbaef0f50, ebp = 0xbaef0f98 --- 22:33:45 syscall 544 (procctl) 22:36:19 syscall 543 (aio_mlock) 22:39:00 syscall 542 (pipe2) 22:41:16 syscall 541 (accept4) 22:43:46 syscall 540 (chflagsat) 22:46:10 syscall 539 (connectat) 22:48:16 syscall 538 (bindat) 22:50:26 syscall 537 (cap_fcntls_get) 22:53:21 syscall 536 (cap_fcntls_limit) 22:55:38 syscall 535 (cap_ioctls_get) 20150425 22:58:06 all (76/314): suj4.sh 20150425 23:28:11 all (77/314): swap2.sh 20150425 23:33:50 all (78/314): core2.sh Apr 25 23:35:19 x4 kernel: Failed to write core file for process core2 (error 5) 20150425 23:35:19 all (79/314): zfs3.sh 20150425 23:35:20 all (80/314): posix_fadvise.sh 20150425 23:35:21 all (81/314): nullfs14.sh 20150425 23:35:22 all (82/314): lockf3.sh Apr 25 23:35:19 x4 last message repeated 27 times 20150425 23:47:04 all (83/314): socketpair2.sh 20150425 23:47:06 all (84/314): vm_reserv_populate.sh 20150425 23:52:39 all (85/314): mount2.sh Apr 26 00:04:40 x4 mountd[536]: can't delete exports for /mnt16: Device busy 20150426 00:11:56 all (86/314): lookup_shared.sh 20150426 00:33:17 all (87/314): kinfo2.sh 20150426 01:03:21 all (88/314): isofs.sh 20150426 01:03:30 all (89/314): ldt.sh 20150426 01:03:31 all (90/314): mountro.sh 20150426 01:05:22 all (91/314): umountf5.sh 20150426 01:05:56 all (92/314): kinfo.sh 20150426 01:35:58 all (93/314): fpu.sh 20150426 01:38:38 all (94/314): crossmp.sh Apr 26 01:38:46 x4 mountd[536]: can't delete exports for /mnt6: Device busy Apr 26 01:39:07 x4 mountd[536]: can't delete exports for /mnt13: Device busy Apr 26 01:39:11 x4 mountd[536]: can't delete exports for /mnt15: Device busy Apr 26 01:42:17 x4 mountd[536]: can't delete exports for /mnt10: Device busy Apr 26 01:53:38 x4 mountd[536]: can't delete exports for /mnt14: Device busy 20150426 01:55:59 all (95/314): ffs_sync.sh 20150426 01:59:06 all (96/314): tcp.sh witness_lock_list_get: witness exhausted Expensive timeout(9) function: 0xc0d39ae0(0xe170e918) 0.037418900 s Expensive timeout(9) function: 0xc0d39ae0(0xe0058610) 0.562074645 s [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached Expensive timeout(9) function: 0xc0d3a850(0xd5fcb308) 0.907234930 s Expensive timeout(9) function: 0xc0d3a850(0xdb817c20) 1.906531356 s [zone: mbuf] kern.ipc.nmbufs limit reached [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached Expensive timeout(9) function: 0xc0d3a4d0(0xdc9ac000) 2.592799871 s [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached [zone: mbuf] kern.ipc.nmbufs limit reached 20150426 02:14:17 all (97/314): tmpfs9.sh 20150426 02:20:34 all (98/314): nbufkv.sh panic: __lockmgr_args: recursing on non recursive lockmgr bufwait @ ../../../ufs/ffs/ffs_vnops.c:268 cpuid = 2 KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,2e2e2f2e,7366752f,7366662f,7366662f,...) at db_trace_self_wrapper+0x2a/frame 0xfee75380 kdb_backtrace(c13aa02b,2,c11dae07,fee7543c,2,...) at kdb_backtrace+0x2d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x117/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- KDB: enter: panic [ thread pid 85249 tid 106131 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 85249 tid 106131 td 0xdd4dd620 kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x791480 curthread = 0xcc935000: pid 85240 "md5" curpcb = 0xfa8c6d40 fpcurthread = none idlethread = 0xc8a3c000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x23297480 curthread = 0xc8a3bc40: pid 11 "idle: cpu1" curpcb = 0xe473ed40 fpcurthread = none idlethread = 0xc8a3bc40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x2329a480 curthread = 0xdd4dd620: pid 85249 "nbufkv" curpcb = 0xfee75d40 fpcurthread = none idlethread = 0xc8a3b930: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x2329d480 curthread = 0xcd02e930: pid 85250 "nbufkv" curpcb = 0xfb348d40 fpcurthread = none idlethread = 0xc8a3b620: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes 0xd7e34b40: tag ufs, type VREG usecount 1, writecount 1, refcount 219 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xd87ce9c0 ref 0 pages 78236 cleanbuf 13 dirtybuf 204 lock type ufs: EXCL by thread 0xcc935000 (pid 85240, md5, tid 103902) #0 0xc0b3f26a at __lockmgr_args+0xbca #1 0xc0df8108 at ffs_lock+0x98 #2 0xc108e8ba at VOP_LOCK1_APV+0x10a #3 0xc0c2c96a at _vn_lock+0xba #4 0xc07a9da3 at mdstart_vnode+0x413 #5 0xc07ab2cd at md_kthread+0x1dd #6 0xc0b299ae at fork_exit+0x7e #7 0xc1049864 at fork_trampoline+0x8 ino 307, on dev label/tmp 0xd0d06168: tag ufs, type VREG usecount 1, writecount 1, refcount 70 mountedhere 0 flags (VV_MD|VI_ACTIVE) v_object 0xd89af750 ref 0 pages 71552 cleanbuf 12 dirtybuf 56 lock type ufs: EXCL by thread 0xccf0e930 (pid 85244, md6, tid 106586) #0 0xc0b3f26a at __lockmgr_args+0xbca #1 0xc0df8108 at ffs_lock+0x98 #2 0xc108e8ba at VOP_LOCK1_APV+0x10a #3 0xc0c2c96a at _vn_lock+0xba #4 0xc07a9da3 at mdstart_vnode+0x413 #5 0xc07ab2cd at md_kthread+0x1dd #6 0xc0b299ae at fork_exit+0x7e #7 0xc1049864 at fork_trampoline+0x8 ino 308, on dev label/tmp 0xd7482168: tag ufs, type VDIR usecount 3, writecount 0, refcount 5 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xd7401e04 ref 0 pages 16 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xc0b3ee31 at __lockmgr_args+0x791 #1 0xc0df8108 at ffs_lock+0x98 #2 0xc108e8ba at VOP_LOCK1_APV+0x10a #3 0xc0c2c96a at _vn_lock+0xba #4 0xc0c0e73f at lookup+0xef #5 0xc0c0e27e at namei+0x50e #6 0xc0c2652e at kern_statat+0xae #7 0xc0c266f9 at sys_fstatat+0x49 #8 0xc105e5aa at syscall+0x34a #9 0xc1049851 at Xint0x80_syscall+0x21 ino 2, on dev md5a 0xda74ae10: tag ufs, type VREG usecount 1, writecount 1, refcount 55 mountedhere 0 flags (VI_ACTIVE) v_object 0xd8debea0 ref 0 pages 77792 cleanbuf 1 dirtybuf 51 lock type ufs: EXCL by thread 0xdd4dd620 (pid 85249, nbufkv, tid 106131) with shared waiters pending #0 0xc0b3f26a at __lockmgr_args+0xbca #1 0xc0df8108 at ffs_lock+0x98 #2 0xc108e8ba at VOP_LOCK1_APV+0x10a #3 0xc0c2c96a at _vn_lock+0xba #4 0xc0c2f6c9 at vn_write+0x1c9 #5 0xc0c2fa54 at vn_io_fault_doio+0x34 #6 0xc0c2cead at vn_io_fault1+0x6d #7 0xc0c2b2ba at vn_io_fault+0x1fa #8 0xc0bc4ea0 at dofilewrite+0xa0 #9 0xc0bc4b63 at kern_writev+0x93 #10 0xc0bc4ac9 at sys_write+0x59 #11 0xc105e5aa at syscall+0x34a #12 0xc1049851 at Xint0x80_syscall+0x21 ino 4, on dev md5a db:0:lockedvnods> show mount 0xc931a2ec /dev/ad4s1a on / (ufs) 0xc931a5d8 devfs on /dev (devfs) 0xc96e7000 /dev/ad4s1f on /home (ufs) 0xc96e68c4 /dev/ad4s1d on /usr (ufs) 0xc96e65d8 /dev/ad4s1e on /var (ufs) 0xc96e62ec procfs on /proc (procfs) 0xc96e6bb0 /dev/label/tmp on /tmp (ufs) 0xdd63bbb0 /dev/md5a on /mnt (ufs) 0xdd6322ec /dev/md6a on /mnt2 (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 85252 85251 476 0 D ufs 0xda74ae44 ls 85251 476 476 0 S wait 0xd4fab340 sh 85250 85215 37218 0 R+ CPU 3 nbufkv 85249 85215 37218 0 R+ CPU 2 nbufkv 85244 0 0 0 DL biowr 0xe46850c8 [md6] 85240 0 0 0 RL CPU 0 [md5] 85216 37218 37218 0 S+ piperd 0xda4f4330 tee 85215 37218 37218 0 S+ pause 0xd806a064 sh 98725 98724 98725 1001 Ss+ ttyin 0xd58e2470 bash 98724 98722 98722 1001 S select 0xdd7abb64 sshd 98722 679 98722 0 Ss select 0xce17cf24 sshd 47037 0 47037 0 DLs aiordy 0xcbd0f620 [aiod4] 47036 0 47036 0 DLs aiordy 0xcbc9bc40 [aiod3] 47035 0 47035 0 DLs aiordy 0xcbca8620 [aiod2] 47034 0 47034 0 DLs aiordy 0xcbd1cc40 [aiod1] 37218 888 37218 0 S+ wait 0xc9f63680 sh 888 886 888 0 SW+ wait 0xc9374680 bash 886 885 886 0 SW+ pause 0xcbc6ca24 csh 885 880 885 1001 SW+ wait 0xc917b680 su 880 879 880 1001 SWs+ wait 0xc9470340 bash 879 877 877 1001 S select 0xc9e02724 sshd 877 679 877 0 Ss select 0xc9a64b24 sshd 874 1 874 0 Ss+ ttyin 0xc8c63c70 getty 873 1 873 0 Ss+ ttyin 0xc8c63670 getty 872 1 872 0 Ss+ ttyin 0xc8c63870 getty 871 1 871 0 Ss+ ttyin 0xc8c63a70 getty 870 1 870 0 Ss+ ttyin 0xc8c65270 getty 869 1 869 0 Ss+ ttyin 0xc8c65070 getty 868 1 868 0 Ss+ ttyin 0xc8c64e70 getty 867 1 867 0 Ss+ ttyin 0xc8c64c70 getty 866 1 866 0 Ss+ ttyin 0xc8c64070 getty 847 1 847 0 Ss select 0xc9a64b64 inetd 690 1 690 0 Ss nanslp 0xc155eae1 cron 685 1 685 25 SWs pause 0xc917ca24 sendmail 682 1 682 0 Ss select 0xc91f66e4 sendmail 679 1 679 0 Ss select 0xc9a64f64 sshd 632 1 632 0 Ss select 0xc9a65064 moused 625 1 624 0 SW nanslp 0xc155eae3 smartd 606 1 606 0 Ss select 0xc9a65664 powerd 603 1 603 0 Ss (threaded) ntpd 100102 S select 0xc9a65124 ntpd 547 542 542 0 S (threaded) nfsd 100098 S rpcsvc 0xc9fbd290 nfsd: master 100108 S rpcsvc 0xc9f60b90 nfsd: service 100109 S rpcsvc 0xc9f60a90 nfsd: service 100110 S rpcsvc 0xc9f60990 nfsd: service 100111 S rpcsvc 0xc9f60890 nfsd: service 100112 S rpcsvc 0xc9f60790 nfsd: service 100113 S rpcsvc 0xc9f60690 nfsd: service 100114 S rpcsvc 0xc9f60590 nfsd: service 100115 S rpcsvc 0xc9f60490 nfsd: service 100116 S rpcsvc 0xc9f60390 nfsd: service 100117 S rpcsvc 0xc9f60290 nfsd: service 100118 S rpcsvc 0xc9f60190 nfsd: service 100119 S rpcsvc 0xc9f60090 nfsd: service 100120 S rpcsvc 0xc9f5fe90 nfsd: service 100121 S rpcsvc 0xc9f5fd90 nfsd: service 100122 S rpcsvc 0xc9f5fc90 nfsd: service 100123 S rpcsvc 0xc9f5fb90 nfsd: service 100124 S rpcsvc 0xc9f5fa90 nfsd: service 100125 S rpcsvc 0xc9f5f990 nfsd: service 100126 S rpcsvc 0xc9f5f890 nfsd: service 100127 S rpcsvc 0xc9f5f790 nfsd: service 100128 S rpcsvc 0xc9f5f690 nfsd: service 100129 S rpcsvc 0xc9f5f590 nfsd: service 100130 S rpcsvc 0xc9f5f490 nfsd: service 100131 S rpcsvc 0xc9f5f390 nfsd: service 100132 S rpcsvc 0xc9f5f290 nfsd: service 100133 S rpcsvc 0xc9f5f190 nfsd: service 100134 S rpcsvc 0xc9f5f090 nfsd: service 100135 S rpcsvc 0xc9f5ee90 nfsd: service 100136 S rpcsvc 0xc9f5ed90 nfsd: service 100137 S rpcsvc 0xc9f5ec90 nfsd: service 100138 S rpcsvc 0xc9f5eb90 nfsd: service 542 1 542 0 Ss select 0xc8faf124 nfsd 536 1 536 0 Ss select 0xc8faf1e4 mountd 529 525 525 0 S select 0xc9e029e4 nfsuserd 528 525 525 0 S select 0xc9a656a4 nfsuserd 527 525 525 0 S select 0xc9a656e4 nfsuserd 526 525 525 0 S select 0xc9e029a4 nfsuserd 525 1 525 0 SWs pause 0xc8a34a24 nfsuserd 508 1 508 0 Ss select 0xc9a657a4 casperd 507 1 507 0 Ss select 0xc9a65864 casperd 493 1 493 0 Ss select 0xc9a658a4 rpcbind 476 1 476 0 Ss wait 0xc917a340 watchdogd 472 1 472 0 Ss select 0xc9a657e4 syslogd 352 1 352 0 Ss select 0xc8faf1a4 rtsold 316 1 316 0 Ss select 0xc91f66a4 devd 16 0 0 0 DL syncer 0xc15d7354 [syncer] 9 0 0 0 DL vlruwt 0xc917c000 [vnlru] 8 0 0 0 DL (threaded) [bufdaemon] 100072 D wdrain 0xc15d6984 [bufdaemon] 100087 D sdflush 0xc96ec284 [/home worker] 100089 D sdflush 0xc96ebe84 [/usr worker] 100090 D sdflush 0xc96ebc84 [/var worker] 100173 D sdflush 0xc8e90084 [/tmp worker] 7 0 0 0 DL pgzero 0xc15dc5c0 [pagezero] 6 0 0 0 DL psleep 0xc15dc33c [vmdaemon] 5 0 0 0 DL psleep 0xc1639b08 [pagedaemon] 4 0 0 0 DL waiting_ 0xc163649c [sctp_iterator] 3 0 0 0 DL - 0xc8c18a3c [fdc0] 15 0 0 0 DL (threaded) [usb] 100032 D - 0xc8c2eacc [usbus0] 100033 D - 0xc8c2eafc [usbus0] 100034 D - 0xc8c2eb2c [usbus0] 100035 D - 0xc8c2eb5c [usbus0] 100037 D - 0xc8c77acc [usbus1] 100038 D - 0xc8c77afc [usbus1] 100039 D - 0xc8c77b2c [usbus1] 100040 D - 0xc8c77b5c [usbus1] 100042 D - 0xc8c80acc [usbus2] 100043 D - 0xc8c80afc [usbus2] 100044 D - 0xc8c80b2c [usbus2] 100045 D - 0xc8c80b5c [usbus2] 100046 D - 0xc8c82acc [usbus3] 100047 D - 0xc8c82afc [usbus3] 100048 D - 0xc8c82b2c [usbus3] 100049 D - 0xc8c82b5c [usbus3] 100050 D - 0xc8c88acc [usbus4] 100051 D - 0xc8c88afc [usbus4] 100052 D - 0xc8c88b2c [usbus4] 100053 D - 0xc8c88b5c [usbus4] 100055 D - 0xc8c33ca4 [usbus5] 100056 D - 0xc8c33cd4 [usbus5] 100057 D - 0xc8c33d04 [usbus5] 100058 D - 0xc8c33d34 [usbus5] 2 0 0 0 DL (threaded) [cam] 100026 D - 0xc1494b80 [doneq0] 100068 D - 0xc1494a2c [scanner] 14 0 0 0 DL - 0xc14af770 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100013 D - 0xc1631620 [g_event] 100014 D - 0xc1631624 [g_up] 100015 D - 0xc1631628 [g_down] 12 0 0 0 WL (threaded) [intr] 100007 I [swi3: vm] 100008 I [swi4: clock (0)] 100009 I [swi4: clock (1)] 100010 I [swi4: clock (2)] 100011 I [swi4: clock (3)] 100012 I [swi1: netisr 0] 100018 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100027 I [swi6: task queue] 100028 I [irq256: hdac0] 100029 I [irq257: re0] 100030 I [irq22: ahci0] 100031 I [irq16: hdac1 ohci0] 100036 I [irq17: ohci1 ohci3] 100041 I [irq18: ohci2 ohci4] 100054 I [irq19: ehci0] 100059 I [irq14: ata0] 100060 I [swi0: uart] 100062 I [irq1: atkbd0] 100063 I [irq12: psm0] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 1 0 1 0 SLs wait 0xc8a339c0 [init] 10 0 0 0 DL audit_wo 0xc16383d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1631644 [swapper] 100016 D - 0xc8a38180 [firmware taskq] 100019 D - 0xc8a38000 [ffs_trim taskq] 100020 D - 0xc8a37f00 [thread taskq] 100022 D - 0xc8a37d80 [kqueue taskq] 100023 D - 0xc8a37d00 [acpi_task_0] 100024 D - 0xc8a37d00 [acpi_task_1] 100025 D - 0xc8a37d00 [acpi_task_2] 100064 D - 0xc8cb8900 [mca taskq] 100065 D - 0xc155d9ec [deadlkres] 100067 D - 0xc8a37c80 [CAM taskq] 101101 D - 0xcbccfe00 [aiod_bio taskq] db:0:ps> allt Tracing command ls pid 85252 tid 104081 td 0xcdb35310 sched_switch(cdb35310,0,104,1af,fab0c4b8,...) at sched_switch+0x4e2/frame 0xfab0c480 mi_switch(104,0,c11e5b65,200,da74aeb0,...) at mi_switch+0x1bf/frame 0xfab0c4b8 sleepq_switch(cdb35310,0,c11e5b65,276,da74ae44,...) at sleepq_switch+0x1c5/frame 0xfab0c4ec sleepq_wait(da74ae44,60,c11cdfa9,4,1,...) at sleepq_wait+0x48/frame 0xfab0c510 sleeplk(da74aeb0,c11cdfa9,60,33,1,...) at sleeplk+0x1a6/frame 0xfab0c558 __lockmgr_args(da74ae44,202100,da74aeb0,0,0,...) at __lockmgr_args+0x72f/frame 0xfab0c634 ffs_lock(fab0c6b0,c11ee2b0,719,fab0c760,c15d6e28,...) at ffs_lock+0x98/frame 0xfab0c66c VOP_LOCK1_APV(c147bdb0,fab0c6b0,0,c15d6c00,c1490fec,...) at VOP_LOCK1_APV+0x10a/frame 0xfab0c698 _vn_lock(da74ae10,202100,c11f12b4,880,c11f04d4,...) at _vn_lock+0xba/frame 0xfab0c6d8 vget(da74ae10,202100,cdb35310,57,202100,...) at vget+0x74/frame 0xfab0c710 vfs_hash_get(dd63bbb0,4,202000,cdb35310,fab0c83c,...) at vfs_hash_get+0xe7/frame 0xfab0c73c ffs_vgetf(dd63bbb0,4,202000,fab0c83c,0) at ffs_vgetf+0x44/frame 0xfab0c798 ffs_vget(dd63bbb0,4,202000,fab0c83c,fab0c84c,...) at ffs_vget+0x2f/frame 0xfab0c7b8 ufs_lookup_ino(d7482168,fab0cb28,fab0cb3c,0) at ufs_lookup_ino+0xdd2/frame 0xfab0c878 ufs_lookup(fab0c8e0,c13ab586,fab0c8ac,c0c09048,d748219c,...) at ufs_lookup+0x2a/frame 0xfab0c890 VOP_CACHEDLOOKUP_APV(c147bdb0,fab0c8e0,fab0cb3c,0,0,...) at VOP_CACHEDLOOKUP_APV+0x12f/frame 0xfab0c8c0 vfs_cache_lookup(fab0c978,c13ab525,c121446d,c11f06b7,c148f0e4,...) at vfs_cache_lookup+0xe9/frame 0xfab0c908 VOP_LOOKUP_APV(c147bdb0,fab0c978,fab0cb3c,1fd,d7482208,...) at VOP_LOOKUP_APV+0x12f/frame 0xfab0c938 lookup(fab0cae0,c11f06b7,10e,d3,c15d730c,...) at lookup+0x551/frame 0xfab0c9a0 namei(fab0cae0,0,4000104,0,28824178,...) at namei+0x50e/frame 0xfab0ca40 kern_statat(cdb35310,200,ffffff9c,28824178,0,...) at kern_statat+0xae/frame 0xfab0cb78 sys_fstatat(cdb35310,fab0cca8,c11d843d,4,c10657e7,...) at sys_fstatat+0x49/frame 0xfab0cc18 syscall(fab0cce8) at syscall+0x34a/frame 0xfab0ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfab0ccdc --- syscall (493, FreeBSD ELF32, sys_fstatat), eip = 0x281540b3, esp = 0xbfbfe64c, ebp = 0xbfbfe6f0 --- Tracing command sh pid 85251 tid 104518 td 0xd7e25310 sched_switch(d7e25310,0,104,1af,fb5419a0,...) at sched_switch+0x4e2/frame 0xfb541968 mi_switch(104,0,c11e5b65,200,c121d844,...) at mi_switch+0x1bf/frame 0xfb5419a0 sleepq_switch(d7e25310,0,c11e5b65,1b6,c11e5b65,...) at sleepq_switch+0x1c5/frame 0xfb5419d4 sleepq_catch_signals(c11e5b65,16d,d4fab3f8,16c8,d7e25310,...) at sleepq_catch_signals+0x382/frame 0xfb541a10 sleepq_wait_sig(d4fab340,6c,c11e98fd,100,0,...) at sleepq_wait_sig+0x14/frame 0xfb541a34 _sleep(d4fab340,d4fab3e8,16c,c11e98fd,0,...) at _sleep+0x356/frame 0xfb541a90 kern_wait6(d7e25310,7,0,0,fb541b24,...) at kern_wait6+0x45b/frame 0xfb541af8 sys_wait4(d7e25310,fb541ca8,c11d843d,4,c10657e7,...) at sys_wait4+0x8b/frame 0xfb541c18 syscall(fb541ce8) at syscall+0x34a/frame 0xfb541cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb541cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfeb08, ebp = 0xbfbfeb20 --- Tracing command nbufkv pid 85250 tid 104391 td 0xcd02e930 cpustop_handler(3,13,fb3489f8,c105d047,ca54e9d8,...) at cpustop_handler+0x25/frame 0xfb3488a8 ipi_nmi_handler(ca54e9d8,c13ab945,fb3488d4,c0c09048,ca54ea0c,...) at ipi_nmi_handler+0x36/frame 0xfb3488b8 trap(fb348a04) at trap+0x37/frame 0xfb3489f8 calltrap() at calltrap+0x6/frame 0xfb3489f8 --- trap 0x13, eip = 0xc0bc0392, esp = 0xfb348a44, ebp = 0xfb348a60 --- witness_lock(ca54ea78,8,c11de1a8,db,0,...) at witness_lock+0x1d2/frame 0xfb348a60 __mtx_lock_flags(ca54ea88,0,c11de1a8,db,c88b7218,...) at __mtx_lock_flags+0x122/frame 0xfb348a94 rangelock_enqueue(0,ffffffff,7fffffff,2,ca54ea78) at rangelock_enqueue+0xa9/frame 0xfb348ad0 rangelock_wlock(ca54eafc,0,0,ffffffff,7fffffff,...) at rangelock_wlock+0x37/frame 0xfb348af8 vn_io_fault(dc5568f8,fb348be8,ca04dd00,0,cd02e930,...) at vn_io_fault+0x1e7/frame 0xfb348b4c dofilewrite(dc5568f8,fb348be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfb348b80 kern_writev(cd02e930,3,fb348be8,e9746000,8048a44,...) at kern_writev+0x93/frame 0xfb348bc8 sys_write(cd02e930,fb348ca8,c11d843d,4,c156b410,...) at sys_write+0x59/frame 0xfb348c18 syscall(fb348ce8) at syscall+0x34a/frame 0xfb348cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb348cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command nbufkv pid 85249 tid 106131 td 0xdd4dd620 kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command md6 pid 85244 tid 106586 td 0xccf0e930 sched_switch(ccf0e930,0,104,1af,fe5ad970,...) at sched_switch+0x4e2/frame 0xfe5ad938 mi_switch(104,0,c11e5b65,200,c88b71a0,...) at mi_switch+0x1bf/frame 0xfe5ad970 sleepq_switch(ccf0e930,0,c11e5b65,276,ccf0e930,...) at sleepq_switch+0x1c5/frame 0xfe5ad9a4 sleepq_wait(e46850c8,5c,c11ee725,0,0,...) at sleepq_wait+0x48/frame 0xfe5ad9c8 _sleep(e46850c8,c88b71a0,5c,c11ee725,0,...) at _sleep+0x3a1/frame 0xfe5ada24 bwait(e46850c8,5c,c11ee725,c8a7c920,f0b49000,...) at bwait+0x8f/frame 0xfe5ada60 bufwrite(e46850c8,0,4000,fe5adc20,ca04dd00,...) at bufwrite+0x277/frame 0xfe5adaa4 ffs_write(fe5adc40,c13ab945,d0d0619c,d0d06168,c148f0e4,...) at ffs_write+0x354/frame 0xfe5adb30 VOP_WRITE_APV(c147bdb0,fe5adc40,c1167730,30f,d0d06168,...) at VOP_WRITE_APV+0x1ac/frame 0xfe5adbf0 mdstart_vnode(d1ed1800,d30c4a40,c1167730,3bb,0,...) at mdstart_vnode+0x459/frame 0xfe5adc68 md_kthread(d1ed1800,fe5adce8,c11d881c,3dc,0,...) at md_kthread+0x1dd/frame 0xfe5adcac fork_exit(c07ab0f0,d1ed1800,fe5adce8) at fork_exit+0x7e/frame 0xfe5adcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xfe5adcd4 --- trap 0, eip = 0, esp = 0xfe5add20, ebp = 0 --- Tracing command md5 pid 85240 tid 103902 td 0xcc935000 cpustop_handler(0,13,fa8c6a58,c105d047,d7e34b40,...) at cpustop_handler+0x25/frame 0xfa8c6908 ipi_nmi_handler(d7e34b40,0,fa8c6958,c0bfe86e,d7e34b40,...) at ipi_nmi_handler+0x36/frame 0xfa8c6918 trap(fa8c6a64) at trap+0x37/frame 0xfa8c6a58 calltrap() at calltrap+0x6/frame 0xfa8c6a58 --- trap 0x13, eip = 0xc0c2d621, esp = 0xfa8c6aa4, ebp = 0xfa8c6b30 --- vn_io_fault_pgmove(fa8c6c40,c13ab945,d7e34b74,d7e34b40,c148f0e4,...) at vn_io_fault_pgmove+0x1/frame 0xfa8c6b30 VOP_WRITE_APV(c147bdb0,fa8c6c40,c1167730,30f,d7e34b40,...) at VOP_WRITE_APV+0x1ac/frame 0xfa8c6bf0 mdstart_vnode(d3b9d800,ca406cd0,c1167730,3bb,0,...) at mdstart_vnode+0x459/frame 0xfa8c6c68 md_kthread(d3b9d800,fa8c6ce8,c11d881c,3dc,0,...) at md_kthread+0x1dd/frame 0xfa8c6cac fork_exit(c07ab0f0,d3b9d800,fa8c6ce8) at fork_exit+0x7e/frame 0xfa8c6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xfa8c6cd4 --- trap 0, eip = 0, esp = 0xfa8c6d20, ebp = 0 --- Tracing command tee pid 85216 tid 105564 td 0xdccce000 sched_switch(dccce000,0,104,1af,fc599a18,...) at sched_switch+0x4e2/frame 0xfc5999e0 mi_switch(104,0,c11e5b65,200,cf01c7e8,...) at mi_switch+0x1bf/frame 0xfc599a18 sleepq_switch(dccce000,0,c11e5b65,1b6,c11e5b65,...) at sleepq_switch+0x1c5/frame 0xfc599a4c sleepq_catch_signals(c11e5b65,16d,da4f44c0,ac8,dccce000,...) at sleepq_catch_signals+0x382/frame 0xfc599a88 sleepq_wait_sig(da4f4330,5c,c11e92c4,100,0,...) at sleepq_wait_sig+0x14/frame 0xfc599aac _sleep(da4f4330,da4f44b0,15c,c11e92c4,0,...) at _sleep+0x356/frame 0xfc599b08 pipe_read(dc556700,fc599be8,ca04dd00,0,dccce000,...) at pipe_read+0x2da/frame 0xfc599b4c dofileread(dc556700,fc599be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xfc599b80 kern_readv(dccce000,0,fc599be8,c0e286e9,28803000,...) at kern_readv+0x93/frame 0xfc599bc8 sys_read(dccce000,fc599ca8,c11d843d,4,8,...) at sys_read+0x59/frame 0xfc599c18 syscall(fc599ce8) at syscall+0x34a/frame 0xfc599cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfc599cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a1f0f, esp = 0xbfbfe858, ebp = 0xbfbfe884 --- Tracing command sh pid 85215 tid 104910 td 0xd8a66000 sched_switch(d8a66000,0,104,1af,fc361ab8,...) at sched_switch+0x4e2/frame 0xfc361a80 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xfc361ab8 sleepq_switch(d8a66000,0,c11e5b65,1b6,c11e5b65,...) at sleepq_switch+0x1c5/frame 0xfc361aec sleepq_catch_signals(c11e5b65,16d,d806a0b8,1260,d8a66000,...) at sleepq_catch_signals+0x382/frame 0xfc361b28 sleepq_wait_sig(d806a064,74,c10c0e54,100,0,...) at sleepq_wait_sig+0x14/frame 0xfc361b4c _sleep(d806a064,d806a0a8,174,c10c0e54,0,...) at _sleep+0x356/frame 0xfc361ba8 kern_sigsuspend(d8a66000,0,0,0,0,...) at kern_sigsuspend+0xd4/frame 0xfc361be8 sys_sigsuspend(d8a66000,fc361ca8,c11d843d,4,0,...) at sys_sigsuspend+0x55/frame 0xfc361c18 syscall(fc361ce8) at syscall+0x34a/frame 0xfc361cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfc361cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2817f7ef, esp = 0xbfbfe5b4, ebp = 0xbfbfe63c --- Tracing command bash pid 98725 tid 102080 td 0xd09c5310 sched_switch(d09c5310,0,104,1af,f8f2e9a4,...) at sched_switch+0x4e2/frame 0xf8f2e96c mi_switch(104,0,c11e5b65,200,c1591ba0,...) at mi_switch+0x1bf/frame 0xf8f2e9a4 sleepq_switch(d09c5310,0,c11e5b65,1b6,f8f2ea1c,...) at sleepq_switch+0x1c5/frame 0xf8f2e9d8 sleepq_catch_signals(f8f2ea38,c0b479f9,d58e2414,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8f2ea14 sleepq_wait_sig(d58e2470,0,f8f2ea70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8f2ea38 _cv_wait_sig(d58e2470,d58e2404,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8f2ea84 tty_wait(d58e2400,d58e2470,f8f2ebe8,1,0,...) at tty_wait+0x4b/frame 0xf8f2eaa8 ttydisc_read(d58e2400,f8f2ebe8,0,b2,f8f2ebe8,...) at ttydisc_read+0x3d4/frame 0xf8f2eaf0 ttydev_read(dd5a2500,f8f2ebe8,0,0,f8f2eb40,...) at ttydev_read+0x55/frame 0xf8f2eb10 devfs_read_f(d2e88e38,f8f2ebe8,d3378700,0,d09c5310,...) at devfs_read_f+0xa8/frame 0xf8f2eb4c dofileread(d2e88e38,f8f2ebe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8f2eb80 kern_readv(d09c5310,0,f8f2ebe8,c1591ba0,bfbfe0a3,...) at kern_readv+0x93/frame 0xf8f2ebc8 sys_read(d09c5310,f8f2eca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf8f2ec18 syscall(f8f2ece8) at syscall+0x34a/frame 0xf8f2ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8f2ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2829ff0f, esp = 0xbfbfe090, ebp = 0xbfbfe0b0 --- Tracing command sshd pid 98724 tid 100524 td 0xd0215930 sched_switch(d0215930,0,104,1af,f9bab918,...) at sched_switch+0x4e2/frame 0xf9bab8e0 mi_switch(104,0,c11e5b65,200,f9bab984,...) at mi_switch+0x1bf/frame 0xf9bab918 sleepq_switch(d0215930,0,c11e5b65,1b6,f9bab990,...) at sleepq_switch+0x1c5/frame 0xf9bab94c sleepq_catch_signals(f9bab9ac,c0b479f9,dd7abb60,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf9bab988 sleepq_wait_sig(dd7abb64,0,f9bab9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf9bab9ac _cv_wait_sig(dd7abb64,dd7abb50,c11e904f,732,1ae,...) at _cv_wait_sig+0x214/frame 0xf9bab9f8 seltdwait(ffffffff,0,0,d0215930,0,...) at seltdwait+0xbb/frame 0xf9baba28 kern_select(d0215930,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf9babbd0 sys_select(d0215930,f9babca8,c11d843d,4,c10657e7,...) at sys_select+0x66/frame 0xf9babc18 syscall(f9babce8) at syscall+0x34a/frame 0xf9babcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf9babcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 98722 tid 102735 td 0xd199f310 sched_switch(d199f310,0,104,1af,f9963950,...) at sched_switch+0x4e2/frame 0xf9963918 mi_switch(104,0,c11e5b65,200,f99639bc,...) at mi_switch+0x1bf/frame 0xf9963950 sleepq_switch(d199f310,0,c11e5b65,1b6,f99639c8,...) at sleepq_switch+0x1c5/frame 0xf9963984 sleepq_catch_signals(f99639e4,c0b479f9,ce17cf20,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf99639c0 sleepq_wait_sig(ce17cf24,0,f9963a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf99639e4 _cv_wait_sig(ce17cf24,ce17cf10,c11e904f,732,62d,...) at _cv_wait_sig+0x214/frame 0xf9963a30 seltdwait(ffffffff,0,0,d199f310,0,...) at seltdwait+0xbb/frame 0xf9963a60 kern_poll(d199f310,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf9963be0 sys_poll(d199f310,f9963ca8,c11d843d,4,8,...) at sys_poll+0x71/frame 0xf9963c18 syscall(f9963ce8) at syscall+0x34a/frame 0xf9963cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf9963cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command aiod4 pid 47037 tid 100329 td 0xcbd0f620 sched_switch(cbd0f620,0,104,1af,f8ad7b54,...) at sched_switch+0x4e2/frame 0xf8ad7b1c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xf8ad7b54 sleepq_switch(cbd0f620,0,c11e5b65,299,cbd0f620,...) at sleepq_switch+0x1c5/frame 0xf8ad7b88 sleepq_timedwait(cbd0f620,5c,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xf8ad7bac _sleep(cbd0f620,cbb99b94,5c,cbb97e4e,ffffdd50,...) at _sleep+0x33d/frame 0xf8ad7c08 aio_daemon(4,f8ad7ce8,c11d881c,3dc,0,...) at aio_daemon+0x978/frame 0xf8ad7cac fork_exit(cbb96480,4,f8ad7ce8) at fork_exit+0x7e/frame 0xf8ad7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8ad7cd4 --- trap 0, eip = 0, esp = 0xf8ad7d20, ebp = 0 --- Tracing command aiod3 pid 47036 tid 101254 td 0xcbc9bc40 sched_switch(cbc9bc40,0,104,1af,f8b9fb54,...) at sched_switch+0x4e2/frame 0xf8b9fb1c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xf8b9fb54 sleepq_switch(cbc9bc40,0,c11e5b65,299,cbc9bc40,...) at sleepq_switch+0x1c5/frame 0xf8b9fb88 sleepq_timedwait(cbc9bc40,5c,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xf8b9fbac _sleep(cbc9bc40,cbb99b94,5c,cbb97e4e,ffffdd50,...) at _sleep+0x33d/frame 0xf8b9fc08 aio_daemon(3,f8b9fce8,c11d881c,3dc,0,...) at aio_daemon+0x978/frame 0xf8b9fcac fork_exit(cbb96480,3,f8b9fce8) at fork_exit+0x7e/frame 0xf8b9fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8b9fcd4 --- trap 0, eip = 0, esp = 0xf8b9fd20, ebp = 0 --- Tracing command aiod2 pid 47035 tid 100200 td 0xcbca8620 sched_switch(cbca8620,0,104,1af,f8a7cb54,...) at sched_switch+0x4e2/frame 0xf8a7cb1c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xf8a7cb54 sleepq_switch(cbca8620,0,c11e5b65,299,cbca8620,...) at sleepq_switch+0x1c5/frame 0xf8a7cb88 sleepq_timedwait(cbca8620,5c,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xf8a7cbac _sleep(cbca8620,cbb99b94,5c,cbb97e4e,ffffdd50,...) at _sleep+0x33d/frame 0xf8a7cc08 aio_daemon(2,f8a7cce8,c11d881c,3dc,0,...) at aio_daemon+0x978/frame 0xf8a7ccac fork_exit(cbb96480,2,f8a7cce8) at fork_exit+0x7e/frame 0xf8a7ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8a7ccd4 --- trap 0, eip = 0, esp = 0xf8a7cd20, ebp = 0 --- Tracing command aiod1 pid 47034 tid 101317 td 0xcbd1cc40 sched_switch(cbd1cc40,0,104,1af,f8bc3b54,...) at sched_switch+0x4e2/frame 0xf8bc3b1c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xf8bc3b54 sleepq_switch(cbd1cc40,0,c11e5b65,299,cbd1cc40,...) at sleepq_switch+0x1c5/frame 0xf8bc3b88 sleepq_timedwait(cbd1cc40,5c,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xf8bc3bac _sleep(cbd1cc40,cbb99b94,5c,cbb97e4e,ffffdd50,...) at _sleep+0x33d/frame 0xf8bc3c08 aio_daemon(1,f8bc3ce8,c11d881c,3dc,0,...) at aio_daemon+0x978/frame 0xf8bc3cac fork_exit(cbb96480,1,f8bc3ce8) at fork_exit+0x7e/frame 0xf8bc3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8bc3cd4 --- trap 0, eip = 0, esp = 0xf8bc3d20, ebp = 0 --- Tracing command sh pid 37218 tid 101074 td 0xcbcb7310 sched_switch(cbcb7310,0,104,1af,f8b069a0,...) at sched_switch+0x4e2/frame 0xf8b06968 mi_switch(104,0,c11e5b65,200,c121d844,...) at mi_switch+0x1bf/frame 0xf8b069a0 sleepq_switch(cbcb7310,0,c11e5b65,1b6,c11e5b65,...) at sleepq_switch+0x1c5/frame 0xf8b069d4 sleepq_catch_signals(c11e5b65,16d,c9f63738,1110,cbcb7310,...) at sleepq_catch_signals+0x382/frame 0xf8b06a10 sleepq_wait_sig(c9f63680,6c,c11e98fd,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8b06a34 _sleep(c9f63680,c9f63728,16c,c11e98fd,0,...) at _sleep+0x356/frame 0xf8b06a90 kern_wait6(cbcb7310,7,0,0,f8b06b24,...) at kern_wait6+0x45b/frame 0xf8b06af8 sys_wait4(cbcb7310,f8b06ca8,c11d843d,4,0,...) at sys_wait4+0x8b/frame 0xf8b06c18 syscall(f8b06ce8) at syscall+0x34a/frame 0xf8b06cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8b06cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe780, ebp = 0xbfbfe798 --- Tracing command bash pid 888 tid 100075 td 0xc9383000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(c9383000,ffffffff,378,186eb,c9383000,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command csh pid 886 tid 100178 td 0xc93ea930 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(c93ea930,ffffffff,376,18752,c93ea930,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command su pid 885 tid 100077 td 0xc8efc930 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(c8efc930,ffffffff,375,186ed,c8efc930,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command bash pid 880 tid 100165 td 0xca16d310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(ca16d310,ffffffff,370,18745,ca16d310,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command sshd pid 879 tid 100095 td 0xc947ac40 sched_switch(c947ac40,0,104,1af,edb82918,...) at sched_switch+0x4e2/frame 0xedb828e0 mi_switch(104,0,c11e5b65,200,26,...) at mi_switch+0x1bf/frame 0xedb82918 sleepq_switch(c947ac40,0,c11e5b65,1b6,edb82990,...) at sleepq_switch+0x1c5/frame 0xedb8294c sleepq_catch_signals(edb829ac,c0b479f9,c9e02720,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedb82988 sleepq_wait_sig(c9e02724,0,edb829e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb829ac _cv_wait_sig(c9e02724,c9e02710,c11e904f,732,1ae,...) at _cv_wait_sig+0x214/frame 0xedb829f8 seltdwait(ffffffff,0,0,c947ac40,0,...) at seltdwait+0xbb/frame 0xedb82a28 kern_select(c947ac40,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xedb82bd0 sys_select(c947ac40,edb82ca8,c11d843d,4,c11e1bc2,...) at sys_select+0x66/frame 0xedb82c18 syscall(edb82ce8) at syscall+0x34a/frame 0xedb82cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb82cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 877 tid 100101 td 0xc8efec40 sched_switch(c8efec40,0,104,1af,edbc7950,...) at sched_switch+0x4e2/frame 0xedbc7918 mi_switch(104,0,c11e5b65,200,edbc79bc,...) at mi_switch+0x1bf/frame 0xedbc7950 sleepq_switch(c8efec40,0,c11e5b65,1b6,edbc79c8,...) at sleepq_switch+0x1c5/frame 0xedbc7984 sleepq_catch_signals(edbc79e4,c0b479f9,c9a64b20,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbc79c0 sleepq_wait_sig(c9a64b24,0,edbc7a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbc79e4 _cv_wait_sig(c9a64b24,c9a64b10,c11e904f,732,62d,...) at _cv_wait_sig+0x214/frame 0xedbc7a30 seltdwait(ffffffff,0,0,c8efec40,0,...) at seltdwait+0xbb/frame 0xedbc7a60 kern_poll(c8efec40,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xedbc7be0 sys_poll(c8efec40,edbc7ca8,c11d843d,4,c10657e7,...) at sys_poll+0x71/frame 0xedbc7c18 syscall(edbc7ce8) at syscall+0x34a/frame 0xedbc7cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc7cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command getty pid 874 tid 100176 td 0xcbbc1620 sched_switch(cbbc1620,0,104,1af,f894d9a4,...) at sched_switch+0x4e2/frame 0xf894d96c mi_switch(104,0,c11e5b65,200,c15a9720,...) at mi_switch+0x1bf/frame 0xf894d9a4 sleepq_switch(cbbc1620,0,c11e5b65,1b6,f894da1c,...) at sleepq_switch+0x1c5/frame 0xf894d9d8 sleepq_catch_signals(f894da38,c0b479f9,c8c63c14,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf894da14 sleepq_wait_sig(c8c63c70,0,f894da70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf894da38 _cv_wait_sig(c8c63c70,c8c63c04,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf894da84 tty_wait(c8c63c00,c8c63c70,f894dbe8,1,0,...) at tty_wait+0x4b/frame 0xf894daa8 ttydisc_read(c8c63c00,f894dbe8,0,b2,f894dbe8,...) at ttydisc_read+0x3d4/frame 0xf894daf0 ttydev_read(c8ca0a00,f894dbe8,0,0,f894db40,...) at ttydev_read+0x55/frame 0xf894db10 devfs_read_f(c942a888,f894dbe8,ca04e200,0,cbbc1620,...) at devfs_read_f+0xa8/frame 0xf894db4c dofileread(c942a888,f894dbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf894db80 kern_readv(cbbc1620,0,f894dbe8,c15a9720,bfbfedf7,...) at kern_readv+0x93/frame 0xf894dbc8 sys_read(cbbc1620,f894dca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf894dc18 syscall(f894dce8) at syscall+0x34a/frame 0xf894dcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf894dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 873 tid 100175 td 0xcbbc1930 sched_switch(cbbc1930,0,104,1af,f89499a4,...) at sched_switch+0x4e2/frame 0xf894996c mi_switch(104,0,c11e5b65,200,c15a96c8,...) at mi_switch+0x1bf/frame 0xf89499a4 sleepq_switch(cbbc1930,0,c11e5b65,1b6,f8949a1c,...) at sleepq_switch+0x1c5/frame 0xf89499d8 sleepq_catch_signals(f8949a38,c0b479f9,c8c63614,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8949a14 sleepq_wait_sig(c8c63670,0,f8949a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8949a38 _cv_wait_sig(c8c63670,c8c63604,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8949a84 tty_wait(c8c63600,c8c63670,f8949be8,1,0,...) at tty_wait+0x4b/frame 0xf8949aa8 ttydisc_read(c8c63600,f8949be8,0,b2,f8949be8,...) at ttydisc_read+0x3d4/frame 0xf8949af0 ttydev_read(c90a9400,f8949be8,0,0,f8949b40,...) at ttydev_read+0x55/frame 0xf8949b10 devfs_read_f(c93fea10,f8949be8,c9f67800,0,cbbc1930,...) at devfs_read_f+0xa8/frame 0xf8949b4c dofileread(c93fea10,f8949be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8949b80 kern_readv(cbbc1930,0,f8949be8,c15a96c8,bfbfedf7,...) at kern_readv+0x93/frame 0xf8949bc8 sys_read(cbbc1930,f8949ca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf8949c18 syscall(f8949ce8) at syscall+0x34a/frame 0xf8949cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8949cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 872 tid 100174 td 0xcbbc1c40 sched_switch(cbbc1c40,0,104,1af,f89469a4,...) at sched_switch+0x4e2/frame 0xf894696c mi_switch(104,0,c11e5b65,200,c15a9ae8,...) at mi_switch+0x1bf/frame 0xf89469a4 sleepq_switch(cbbc1c40,0,c11e5b65,1b6,f8946a1c,...) at sleepq_switch+0x1c5/frame 0xf89469d8 sleepq_catch_signals(f8946a38,c0b479f9,c8c63814,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8946a14 sleepq_wait_sig(c8c63870,0,f8946a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8946a38 _cv_wait_sig(c8c63870,c8c63804,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8946a84 tty_wait(c8c63800,c8c63870,f8946be8,1,0,...) at tty_wait+0x4b/frame 0xf8946aa8 ttydisc_read(c8c63800,f8946be8,0,b2,f8946be8,...) at ttydisc_read+0x3d4/frame 0xf8946af0 ttydev_read(c90a9500,f8946be8,0,0,f8946b40,...) at ttydev_read+0x55/frame 0xf8946b10 devfs_read_f(c938a540,f8946be8,ca04de00,0,cbbc1c40,...) at devfs_read_f+0xa8/frame 0xf8946b4c dofileread(c938a540,f8946be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8946b80 kern_readv(cbbc1c40,0,f8946be8,c15a9ae8,bfbfedf7,...) at kern_readv+0x93/frame 0xf8946bc8 sys_read(cbbc1c40,f8946ca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf8946c18 syscall(f8946ce8) at syscall+0x34a/frame 0xf8946cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8946cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 871 tid 100153 td 0xc9fb7620 sched_switch(c9fb7620,0,104,1af,f88ff9a4,...) at sched_switch+0x4e2/frame 0xf88ff96c mi_switch(104,0,c11e5b65,200,c15a9670,...) at mi_switch+0x1bf/frame 0xf88ff9a4 sleepq_switch(c9fb7620,0,c11e5b65,1b6,f88ffa1c,...) at sleepq_switch+0x1c5/frame 0xf88ff9d8 sleepq_catch_signals(f88ffa38,c0b479f9,c8c63a14,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88ffa14 sleepq_wait_sig(c8c63a70,0,f88ffa70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88ffa38 _cv_wait_sig(c8c63a70,c8c63a04,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf88ffa84 tty_wait(c8c63a00,c8c63a70,f88ffbe8,1,0,...) at tty_wait+0x4b/frame 0xf88ffaa8 ttydisc_read(c8c63a00,f88ffbe8,0,b2,f88ffbe8,...) at ttydisc_read+0x3d4/frame 0xf88ffaf0 ttydev_read(c90a9600,f88ffbe8,0,0,f88ffb40,...) at ttydev_read+0x55/frame 0xf88ffb10 devfs_read_f(c938b888,f88ffbe8,ca04e600,0,c9fb7620,...) at devfs_read_f+0xa8/frame 0xf88ffb4c dofileread(c938b888,f88ffbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf88ffb80 kern_readv(c9fb7620,0,f88ffbe8,c15a9670,bfbfedf7,...) at kern_readv+0x93/frame 0xf88ffbc8 sys_read(c9fb7620,f88ffca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf88ffc18 syscall(f88ffce8) at syscall+0x34a/frame 0xf88ffcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88ffcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 870 tid 100170 td 0xca16c620 sched_switch(ca16c620,0,104,1af,f89349a4,...) at sched_switch+0x4e2/frame 0xf893496c mi_switch(104,0,c11e5b65,200,c15a98d8,...) at mi_switch+0x1bf/frame 0xf89349a4 sleepq_switch(ca16c620,0,c11e5b65,1b6,f8934a1c,...) at sleepq_switch+0x1c5/frame 0xf89349d8 sleepq_catch_signals(f8934a38,c0b479f9,c8c65214,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8934a14 sleepq_wait_sig(c8c65270,0,f8934a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8934a38 _cv_wait_sig(c8c65270,c8c65204,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8934a84 tty_wait(c8c65200,c8c65270,f8934be8,1,0,...) at tty_wait+0x4b/frame 0xf8934aa8 ttydisc_read(c8c65200,f8934be8,0,b2,f8934be8,...) at ttydisc_read+0x3d4/frame 0xf8934af0 ttydev_read(c8ca4500,f8934be8,0,0,f8934b40,...) at ttydev_read+0x55/frame 0xf8934b10 devfs_read_f(c93fec40,f8934be8,c9f67900,0,ca16c620,...) at devfs_read_f+0xa8/frame 0xf8934b4c dofileread(c93fec40,f8934be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8934b80 kern_readv(ca16c620,0,f8934be8,c15a98d8,bfbfedf7,...) at kern_readv+0x93/frame 0xf8934bc8 sys_read(ca16c620,f8934ca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf8934c18 syscall(f8934ce8) at syscall+0x34a/frame 0xf8934cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8934cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 869 tid 100156 td 0xca16dc40 sched_switch(ca16dc40,0,104,1af,f89089a4,...) at sched_switch+0x4e2/frame 0xf890896c mi_switch(104,0,c11e5b65,200,c15a9988,...) at mi_switch+0x1bf/frame 0xf89089a4 sleepq_switch(ca16dc40,0,c11e5b65,1b6,f8908a1c,...) at sleepq_switch+0x1c5/frame 0xf89089d8 sleepq_catch_signals(f8908a38,c0b479f9,c8c65014,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8908a14 sleepq_wait_sig(c8c65070,0,f8908a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8908a38 _cv_wait_sig(c8c65070,c8c65004,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8908a84 tty_wait(c8c65000,c8c65070,f8908be8,1,0,...) at tty_wait+0x4b/frame 0xf8908aa8 ttydisc_read(c8c65000,f8908be8,0,b2,f8908be8,...) at ttydisc_read+0x3d4/frame 0xf8908af0 ttydev_read(c8ca4600,f8908be8,0,0,f8908b40,...) at ttydev_read+0x55/frame 0xf8908b10 devfs_read_f(c938a7e0,f8908be8,c933c900,0,ca16dc40,...) at devfs_read_f+0xa8/frame 0xf8908b4c dofileread(c938a7e0,f8908be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8908b80 kern_readv(ca16dc40,0,f8908be8,c15a9988,bfbfedf7,...) at kern_readv+0x93/frame 0xf8908bc8 sys_read(ca16dc40,f8908ca8,c11d843d,4,c10657e7,...) at sys_read+0x59/frame 0xf8908c18 syscall(f8908ce8) at syscall+0x34a/frame 0xf8908cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8908cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 868 tid 100168 td 0xca16cc40 sched_switch(ca16cc40,0,104,1af,f892c9a4,...) at sched_switch+0x4e2/frame 0xf892c96c mi_switch(104,0,c11e5b65,200,c15a99e0,...) at mi_switch+0x1bf/frame 0xf892c9a4 sleepq_switch(ca16cc40,0,c11e5b65,1b6,f892ca1c,...) at sleepq_switch+0x1c5/frame 0xf892c9d8 sleepq_catch_signals(f892ca38,c0b479f9,c8c64e14,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf892ca14 sleepq_wait_sig(c8c64e70,0,f892ca70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf892ca38 _cv_wait_sig(c8c64e70,c8c64e04,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf892ca84 tty_wait(c8c64e00,c8c64e70,f892cbe8,1,0,...) at tty_wait+0x4b/frame 0xf892caa8 ttydisc_read(c8c64e00,f892cbe8,0,b2,f892cbe8,...) at ttydisc_read+0x3d4/frame 0xf892caf0 ttydev_read(c8ca4700,f892cbe8,0,0,f892cb40,...) at ttydev_read+0x55/frame 0xf892cb10 devfs_read_f(c940c188,f892cbe8,c931eb00,0,ca16cc40,...) at devfs_read_f+0xa8/frame 0xf892cb4c dofileread(c940c188,f892cbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf892cb80 kern_readv(ca16cc40,0,f892cbe8,c15a99e0,bfbfedf7,...) at kern_readv+0x93/frame 0xf892cbc8 sys_read(ca16cc40,f892cca8,c11d843d,4,c156bb10,...) at sys_read+0x59/frame 0xf892cc18 syscall(f892cce8) at syscall+0x34a/frame 0xf892ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf892ccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 867 tid 100144 td 0xc93ea620 sched_switch(c93ea620,0,104,1af,f88d79a4,...) at sched_switch+0x4e2/frame 0xf88d796c mi_switch(104,0,c11e5b65,200,c15ab198,...) at mi_switch+0x1bf/frame 0xf88d79a4 sleepq_switch(c93ea620,0,c11e5b65,1b6,f88d7a1c,...) at sleepq_switch+0x1c5/frame 0xf88d79d8 sleepq_catch_signals(f88d7a38,c0b479f9,c8c64c14,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88d7a14 sleepq_wait_sig(c8c64c70,0,f88d7a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88d7a38 _cv_wait_sig(c8c64c70,c8c64c04,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf88d7a84 tty_wait(c8c64c00,c8c64c70,f88d7be8,1,0,...) at tty_wait+0x4b/frame 0xf88d7aa8 ttydisc_read(c8c64c00,f88d7be8,0,b2,f88d7be8,...) at ttydisc_read+0x3d4/frame 0xf88d7af0 ttydev_read(c8ca4800,f88d7be8,0,0,f88d7b40,...) at ttydev_read+0x55/frame 0xf88d7b10 devfs_read_f(c940bab8,f88d7be8,c933a600,0,c93ea620,...) at devfs_read_f+0xa8/frame 0xf88d7b4c dofileread(c940bab8,f88d7be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf88d7b80 kern_readv(c93ea620,0,f88d7be8,c15ab198,bfbfedf7,...) at kern_readv+0x93/frame 0xf88d7bc8 sys_read(c93ea620,f88d7ca8,c11d843d,4,c156c210,...) at sys_read+0x59/frame 0xf88d7c18 syscall(f88d7ce8) at syscall+0x34a/frame 0xf88d7cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88d7cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 866 tid 100166 td 0xc9fb6930 sched_switch(c9fb6930,0,104,1af,f89269a4,...) at sched_switch+0x4e2/frame 0xf892696c mi_switch(104,0,c11e5b65,200,c15ab1f0,...) at mi_switch+0x1bf/frame 0xf89269a4 sleepq_switch(c9fb6930,0,c11e5b65,1b6,f8926a1c,...) at sleepq_switch+0x1c5/frame 0xf89269d8 sleepq_catch_signals(f8926a38,c0b479f9,c8c64014,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8926a14 sleepq_wait_sig(c8c64070,0,f8926a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8926a38 _cv_wait_sig(c8c64070,c8c64004,c11eb16d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8926a84 tty_wait(c8c64000,c8c64070,f8926be8,1,0,...) at tty_wait+0x4b/frame 0xf8926aa8 ttydisc_read(c8c64000,f8926be8,0,b2,f8926be8,...) at ttydisc_read+0x3d4/frame 0xf8926af0 ttydev_read(c8ca4900,f8926be8,0,0,f8926b40,...) at ttydev_read+0x55/frame 0xf8926b10 devfs_read_f(c938b850,f8926be8,c9f67a00,0,c9fb6930,...) at devfs_read_f+0xa8/frame 0xf8926b4c dofileread(c938b850,f8926be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8926b80 kern_readv(c9fb6930,0,f8926be8,c15ab1f0,bfbfedf7,...) at kern_readv+0x93/frame 0xf8926bc8 sys_read(c9fb6930,f8926ca8,c11d843d,4,df,...) at sys_read+0x59/frame 0xf8926c18 syscall(f8926ce8) at syscall+0x34a/frame 0xf8926cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8926cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command inetd pid 847 tid 100152 td 0xc9383c40 sched_switch(c9383c40,0,104,1af,f88fc918,...) at sched_switch+0x4e2/frame 0xf88fc8e0 mi_switch(104,0,c11e5b65,200,f88fc984,...) at mi_switch+0x1bf/frame 0xf88fc918 sleepq_switch(c9383c40,0,c11e5b65,1b6,f88fc990,...) at sleepq_switch+0x1c5/frame 0xf88fc94c sleepq_catch_signals(f88fc9ac,c0b479f9,c9a64b60,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88fc988 sleepq_wait_sig(c9a64b64,0,f88fc9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88fc9ac _cv_wait_sig(c9a64b64,c9a64b50,c11e904f,732,c9a918e8,...) at _cv_wait_sig+0x214/frame 0xf88fc9f8 seltdwait(ffffffff,0,0,c9383c40,0,...) at seltdwait+0xbb/frame 0xf88fca28 kern_select(c9383c40,a,bfbfe078,0,0,...) at kern_select+0x914/frame 0xf88fcbd0 sys_select(c9383c40,f88fcca8,c11d843d,4,c10657e7,...) at sys_select+0x66/frame 0xf88fcc18 syscall(f88fcce8) at syscall+0x34a/frame 0xf88fccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88fccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281cbeff, esp = 0xbfbfe014, ebp = 0xbfbfee34 --- Tracing command cron pid 690 tid 100146 td 0xc93ea310 sched_switch(c93ea310,0,104,1af,f88eaa84,...) at sched_switch+0x4e2/frame 0xf88eaa4c mi_switch(104,0,c11e5b65,200,b66b,...) at mi_switch+0x1bf/frame 0xf88eaa84 sleepq_switch(c93ea310,0,c11e5b65,1b6,8,...) at sleepq_switch+0x1c5/frame 0xf88eaab8 sleepq_catch_signals(c0baf9b0,c93ea310,1,201,1,...) at sleepq_catch_signals+0x382/frame 0xf88eaaf4 sleepq_timedwait_sig(c155eae1,6c,b66b,bf4b6472,3,...) at sleepq_timedwait_sig+0x14/frame 0xf88eab1c _sleep(c155eae1,0,16c,c11e0af6,3a6fa986,...) at _sleep+0x326/frame 0xf88eab78 kern_nanosleep(bfbfee28,f88eabf0,f88eabf8,f88eace8,3b,...) at kern_nanosleep+0x14b/frame 0xf88eabd8 sys_nanosleep(c93ea310,f88eaca8,c11d843d,4,ca152000,...) at sys_nanosleep+0x68/frame 0xf88eac18 syscall(f88eace8) at syscall+0x34a/frame 0xf88eacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88eacdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2815984f, esp = 0xbfbfecb4, ebp = 0xbfbfee44 --- Tracing command sendmail pid 685 tid 100148 td 0xca100310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(ca100310,ffffffff,2ad,18734,ca100310,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command sendmail pid 682 tid 100147 td 0xc947b930 sched_switch(c947b930,0,104,1af,f88ed910,...) at sched_switch+0x4e2/frame 0xf88ed8d8 mi_switch(104,0,c11e5b65,200,c1632c90,...) at mi_switch+0x1bf/frame 0xf88ed910 sleepq_switch(c947b930,0,c11e5b65,1b6,c91f66d0,...) at sleepq_switch+0x1c5/frame 0xf88ed944 sleepq_catch_signals(c1454ae8,f88ed9a8,c0b479f9,c91f66e0,0,...) at sleepq_catch_signals+0x382/frame 0xf88ed980 sleepq_timedwait_sig(c91f66e4,0,f88ed9e4,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf88ed9a8 _cv_timedwait_sig_sbt(c91f66e4,c91f66d0,c86516e9,b649,50000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf88ed9f8 seltdwait(b649,50000000,0,c947b930,0,...) at seltdwait+0xad/frame 0xf88eda28 kern_select(c947b930,5,bfbfd118,0,0,...) at kern_select+0x914/frame 0xf88edbd0 sys_select(c947b930,f88edca8,c11d843d,4,c156b410,...) at sys_select+0x66/frame 0xf88edc18 syscall(f88edce8) at syscall+0x34a/frame 0xf88edcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88edcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28441eff, esp = 0xbfbfcfec, ebp = 0xbfbfdaa0 --- Tracing command sshd pid 679 tid 100145 td 0xc947bc40 sched_switch(c947bc40,0,104,1af,f88e7918,...) at sched_switch+0x4e2/frame 0xf88e78e0 mi_switch(104,0,c11e5b65,200,f88e7984,...) at mi_switch+0x1bf/frame 0xf88e7918 sleepq_switch(c947bc40,0,c11e5b65,1b6,f88e7990,...) at sleepq_switch+0x1c5/frame 0xf88e794c sleepq_catch_signals(f88e79ac,c0b479f9,c9a64f60,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88e7988 sleepq_wait_sig(c9a64f64,0,f88e79e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88e79ac _cv_wait_sig(c9a64f64,c9a64f50,c11e904f,732,c9c6b8e8,...) at _cv_wait_sig+0x214/frame 0xf88e79f8 seltdwait(ffffffff,0,0,c947bc40,0,...) at seltdwait+0xbb/frame 0xf88e7a28 kern_select(c947bc40,7,28c0c158,0,0,...) at kern_select+0x914/frame 0xf88e7bd0 sys_select(c947bc40,f88e7ca8,c11d843d,4,ca136000,...) at sys_select+0x66/frame 0xf88e7c18 syscall(f88e7ce8) at syscall+0x34a/frame 0xf88e7cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88e7cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe88c, ebp = 0xbfbfe8b0 --- Tracing command moused pid 632 tid 100141 td 0xc9b04000 sched_switch(c9b04000,0,104,1af,f88c0918,...) at sched_switch+0x4e2/frame 0xf88c08e0 mi_switch(104,0,c11e5b65,200,246,...) at mi_switch+0x1bf/frame 0xf88c0918 sleepq_switch(c9b04000,0,c11e5b65,1b6,f88c0990,...) at sleepq_switch+0x1c5/frame 0xf88c094c sleepq_catch_signals(f88c09ac,c0b479f9,c9a65060,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88c0988 sleepq_wait_sig(c9a65064,0,f88c09e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c09ac _cv_wait_sig(c9a65064,c9a65050,c11e904f,732,1,...) at _cv_wait_sig+0x214/frame 0xf88c09f8 seltdwait(ffffffff,0,0,c9b04000,0,...) at seltdwait+0xbb/frame 0xf88c0a28 kern_select(c9b04000,400,bfbfeba0,0,0,...) at kern_select+0x914/frame 0xf88c0bd0 sys_select(c9b04000,f88c0ca8,c11d843d,4,c10657e7,...) at sys_select+0x66/frame 0xf88c0c18 syscall(f88c0ce8) at syscall+0x34a/frame 0xf88c0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88c0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281e2eff, esp = 0xbfbfea54, ebp = 0xbfbfee24 --- Tracing command smartd pid 625 tid 100086 td 0xc9382620 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(c9382620,ffffffff,271,186f6,c9382620,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command powerd pid 606 tid 100139 td 0xc8efe930 sched_switch(c8efe930,0,104,1af,f88b9910,...) at sched_switch+0x4e2/frame 0xf88b98d8 mi_switch(104,0,c11e5b65,200,c1632c90,...) at mi_switch+0x1bf/frame 0xf88b9910 sleepq_switch(c8efe930,0,c11e5b65,1b6,c9a65650,...) at sleepq_switch+0x1c5/frame 0xf88b9944 sleepq_catch_signals(c1454ae8,f88b99a8,c0b479f9,c9a65660,0,...) at sleepq_catch_signals+0x382/frame 0xf88b9980 sleepq_timedwait_sig(c9a65664,0,f88b99e4,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xf88b99a8 _cv_timedwait_sig_sbt(c9a65664,c9a65650,2264d7d7,b647,3ffffff,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf88b99f8 seltdwait(b647,3ffffff,0,f88b9a40,ffffffff,...) at seltdwait+0xad/frame 0xf88b9a28 kern_select(c8efe930,0,bfbfeda0,0,bfbfeda0,...) at kern_select+0x914/frame 0xf88b9bd0 sys_select(c8efe930,f88b9ca8,c11d843d,4,c11e1bc2,...) at sys_select+0x66/frame 0xf88b9c18 syscall(f88b9ce8) at syscall+0x34a/frame 0xf88b9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88b9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b5eff, esp = 0xbfbfed1c, ebp = 0xbfbfee44 --- Tracing command ntpd pid 603 tid 100102 td 0xc9b05000 sched_switch(c9b05000,0,104,1af,edbca918,...) at sched_switch+0x4e2/frame 0xedbca8e0 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xedbca918 sleepq_switch(c9b05000,0,c11e5b65,1b6,edbca990,...) at sleepq_switch+0x1c5/frame 0xedbca94c sleepq_catch_signals(edbca9ac,c0b479f9,c9a65120,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbca988 sleepq_wait_sig(c9a65124,0,edbca9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbca9ac _cv_wait_sig(c9a65124,c9a65110,c11e904f,732,c9c6c1c8,...) at _cv_wait_sig+0x214/frame 0xedbca9f8 seltdwait(ffffffff,0,0,c9b05000,0,...) at seltdwait+0xbb/frame 0xedbcaa28 kern_select(c9b05000,1c,bfbfde08,0,0,...) at kern_select+0x914/frame 0xedbcabd0 sys_select(c9b05000,edbcaca8,c11d843d,4,c9f5a000,...) at sys_select+0x66/frame 0xedbcac18 syscall(edbcace8) at syscall+0x34a/frame 0xedbcacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbcacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2843eeff, esp = 0xbfbfdd6c, ebp = 0xbfbfdd90 --- Tracing command nfsd pid 547 tid 100098 td 0xc93f3000 sched_switch(c93f3000,0,104,1af,edbba310,...) at sched_switch+0x4e2/frame 0xedbba2d8 mi_switch(104,0,c11e5b65,200,c1632c90,...) at mi_switch+0x1bf/frame 0xedbba310 sleepq_switch(c93f3000,0,c11e5b65,1b6,c8e38100,...) at sleepq_switch+0x1c5/frame 0xedbba344 sleepq_catch_signals(c1454ae8,edbba3a8,c0b479f9,c8e38110,0,...) at sleepq_catch_signals+0x382/frame 0xedbba380 sleepq_timedwait_sig(c9fbd290,0,edbba3e4,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xedbba3a8 _cv_timedwait_sig_sbt(c9fbd290,c8e38100,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbba3f8 svc_run_internal(c0d96be0,c8e38100,c93e5000,edbba514,0,...) at svc_run_internal+0xc42/frame 0xedbba4dc svc_run(c8e38000,0,c11c9ab0,1e6,edbba578,...) at svc_run+0x1bf/frame 0xedbba524 nfsrvd_nfsd(c93f3000,edbba690,c,c8b2d600,edbba6a4,...) at nfsrvd_nfsd+0x1ba/frame 0xedbba660 nfssvc_nfsd(c93f3000,edbbaca8,edbbaca0,c93f3000,edbbacdc,...) at nfssvc_nfsd+0x11b/frame 0xedbbac00 sys_nfssvc(c93f3000,edbbaca8,c11d843d,4,c156b410,...) at sys_nfssvc+0xc4/frame 0xedbbac18 syscall(edbbace8) at syscall+0x34a/frame 0xedbbacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbbacdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280db1fb, esp = 0xbfbfe7e4, ebp = 0xbfbfea58 --- Tracing command nfsd pid 547 tid 100108 td 0xc947a930 sched_switch(c947a930,0,104,1af,edbe1ae0,...) at sched_switch+0x4e2/frame 0xedbe1aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbe1ae0 sleepq_switch(c947a930,0,c11e5b65,1b6,edbe1b58,...) at sleepq_switch+0x1c5/frame 0xedbe1b14 sleepq_catch_signals(edbe1b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbe1b50 sleepq_wait_sig(c9f60b90,0,edbe1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbe1b74 _cv_wait_sig(c9f60b90,c8e38100,c1211335,414,0,...) at _cv_wait_sig+0x214/frame 0xedbe1bc0 svc_run_internal(edbe1cd4,c0b299ae,c8e38100,edbe1ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbe1ca4 svc_thread_start(c8e38100,edbe1ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbe1cac fork_exit(c0d96be0,c8e38100,edbe1ce8) at fork_exit+0x7e/frame 0xedbe1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbe1cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100109 td 0xc947a620 sched_switch(c947a620,0,104,1af,edbe4ae0,...) at sched_switch+0x4e2/frame 0xedbe4aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbe4ae0 sleepq_switch(c947a620,0,c11e5b65,1b6,edbe4b58,...) at sleepq_switch+0x1c5/frame 0xedbe4b14 sleepq_catch_signals(edbe4b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbe4b50 sleepq_wait_sig(c9f60a90,0,edbe4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbe4b74 _cv_wait_sig(c9f60a90,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbe4bc0 svc_run_internal(edbe4cd4,c0b299ae,c8e38100,edbe4ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbe4ca4 svc_thread_start(c8e38100,edbe4ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbe4cac fork_exit(c0d96be0,c8e38100,edbe4ce8) at fork_exit+0x7e/frame 0xedbe4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbe4cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100110 td 0xc947a310 sched_switch(c947a310,0,104,1af,edbe7ae0,...) at sched_switch+0x4e2/frame 0xedbe7aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbe7ae0 sleepq_switch(c947a310,0,c11e5b65,1b6,edbe7b58,...) at sleepq_switch+0x1c5/frame 0xedbe7b14 sleepq_catch_signals(edbe7b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbe7b50 sleepq_wait_sig(c9f60990,0,edbe7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbe7b74 _cv_wait_sig(c9f60990,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbe7bc0 svc_run_internal(edbe7cd4,c0b299ae,c8e38100,edbe7ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbe7ca4 svc_thread_start(c8e38100,edbe7ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbe7cac fork_exit(c0d96be0,c8e38100,edbe7ce8) at fork_exit+0x7e/frame 0xedbe7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbe7cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100111 td 0xc947a000 sched_switch(c947a000,0,104,1af,edbeaae0,...) at sched_switch+0x4e2/frame 0xedbeaaa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbeaae0 sleepq_switch(c947a000,0,c11e5b65,1b6,edbeab58,...) at sleepq_switch+0x1c5/frame 0xedbeab14 sleepq_catch_signals(edbeab74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbeab50 sleepq_wait_sig(c9f60890,0,edbeabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbeab74 _cv_wait_sig(c9f60890,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbeabc0 svc_run_internal(edbeacd4,c0b299ae,c8e38100,edbeace8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbeaca4 svc_thread_start(c8e38100,edbeace8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbeacac fork_exit(c0d96be0,c8e38100,edbeace8) at fork_exit+0x7e/frame 0xedbeacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbeacd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100112 td 0xc9471c40 sched_switch(c9471c40,0,104,1af,edbedae0,...) at sched_switch+0x4e2/frame 0xedbedaa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbedae0 sleepq_switch(c9471c40,0,c11e5b65,1b6,edbedb58,...) at sleepq_switch+0x1c5/frame 0xedbedb14 sleepq_catch_signals(edbedb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbedb50 sleepq_wait_sig(c9f60790,0,edbedbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbedb74 _cv_wait_sig(c9f60790,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbedbc0 svc_run_internal(edbedcd4,c0b299ae,c8e38100,edbedce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbedca4 svc_thread_start(c8e38100,edbedce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbedcac fork_exit(c0d96be0,c8e38100,edbedce8) at fork_exit+0x7e/frame 0xedbedcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbedcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100113 td 0xc9471930 sched_switch(c9471930,0,104,1af,edbf0ae0,...) at sched_switch+0x4e2/frame 0xedbf0aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbf0ae0 sleepq_switch(c9471930,0,c11e5b65,1b6,edbf0b58,...) at sleepq_switch+0x1c5/frame 0xedbf0b14 sleepq_catch_signals(edbf0b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbf0b50 sleepq_wait_sig(c9f60690,0,edbf0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbf0b74 _cv_wait_sig(c9f60690,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbf0bc0 svc_run_internal(edbf0cd4,c0b299ae,c8e38100,edbf0ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbf0ca4 svc_thread_start(c8e38100,edbf0ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbf0cac fork_exit(c0d96be0,c8e38100,edbf0ce8) at fork_exit+0x7e/frame 0xedbf0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbf0cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100114 td 0xc9471620 sched_switch(c9471620,0,104,1af,edbf3ae0,...) at sched_switch+0x4e2/frame 0xedbf3aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbf3ae0 sleepq_switch(c9471620,0,c11e5b65,1b6,edbf3b58,...) at sleepq_switch+0x1c5/frame 0xedbf3b14 sleepq_catch_signals(edbf3b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbf3b50 sleepq_wait_sig(c9f60590,0,edbf3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbf3b74 _cv_wait_sig(c9f60590,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbf3bc0 svc_run_internal(edbf3cd4,c0b299ae,c8e38100,edbf3ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbf3ca4 svc_thread_start(c8e38100,edbf3ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbf3cac fork_exit(c0d96be0,c8e38100,edbf3ce8) at fork_exit+0x7e/frame 0xedbf3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbf3cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100115 td 0xc9471310 sched_switch(c9471310,0,104,1af,edbf6ae0,...) at sched_switch+0x4e2/frame 0xedbf6aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbf6ae0 sleepq_switch(c9471310,0,c11e5b65,1b6,edbf6b58,...) at sleepq_switch+0x1c5/frame 0xedbf6b14 sleepq_catch_signals(edbf6b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbf6b50 sleepq_wait_sig(c9f60490,0,edbf6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbf6b74 _cv_wait_sig(c9f60490,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbf6bc0 svc_run_internal(edbf6cd4,c0b299ae,c8e38100,edbf6ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbf6ca4 svc_thread_start(c8e38100,edbf6ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbf6cac fork_exit(c0d96be0,c8e38100,edbf6ce8) at fork_exit+0x7e/frame 0xedbf6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbf6cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100116 td 0xc9471000 sched_switch(c9471000,0,104,1af,edbf9ae0,...) at sched_switch+0x4e2/frame 0xedbf9aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbf9ae0 sleepq_switch(c9471000,0,c11e5b65,1b6,edbf9b58,...) at sleepq_switch+0x1c5/frame 0xedbf9b14 sleepq_catch_signals(edbf9b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbf9b50 sleepq_wait_sig(c9f60390,0,edbf9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbf9b74 _cv_wait_sig(c9f60390,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbf9bc0 svc_run_internal(edbf9cd4,c0b299ae,c8e38100,edbf9ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbf9ca4 svc_thread_start(c8e38100,edbf9ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbf9cac fork_exit(c0d96be0,c8e38100,edbf9ce8) at fork_exit+0x7e/frame 0xedbf9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbf9cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100117 td 0xc93f3c40 sched_switch(c93f3c40,0,104,1af,edbfcae0,...) at sched_switch+0x4e2/frame 0xedbfcaa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbfcae0 sleepq_switch(c93f3c40,0,c11e5b65,1b6,edbfcb58,...) at sleepq_switch+0x1c5/frame 0xedbfcb14 sleepq_catch_signals(edbfcb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbfcb50 sleepq_wait_sig(c9f60290,0,edbfcbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbfcb74 _cv_wait_sig(c9f60290,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbfcbc0 svc_run_internal(edbfccd4,c0b299ae,c8e38100,edbfcce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbfcca4 svc_thread_start(c8e38100,edbfcce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbfccac fork_exit(c0d96be0,c8e38100,edbfcce8) at fork_exit+0x7e/frame 0xedbfccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbfccd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100118 td 0xc9fb6620 sched_switch(c9fb6620,0,104,1af,edbffae0,...) at sched_switch+0x4e2/frame 0xedbffaa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xedbffae0 sleepq_switch(c9fb6620,0,c11e5b65,1b6,edbffb58,...) at sleepq_switch+0x1c5/frame 0xedbffb14 sleepq_catch_signals(edbffb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbffb50 sleepq_wait_sig(c9f60190,0,edbffbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbffb74 _cv_wait_sig(c9f60190,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbffbc0 svc_run_internal(edbffcd4,c0b299ae,c8e38100,edbffce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xedbffca4 svc_thread_start(c8e38100,edbffce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xedbffcac fork_exit(c0d96be0,c8e38100,edbffce8) at fork_exit+0x7e/frame 0xedbffcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbffcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100119 td 0xc9fb6310 sched_switch(c9fb6310,0,104,1af,f887cae0,...) at sched_switch+0x4e2/frame 0xf887caa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf887cae0 sleepq_switch(c9fb6310,0,c11e5b65,1b6,f887cb58,...) at sleepq_switch+0x1c5/frame 0xf887cb14 sleepq_catch_signals(f887cb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf887cb50 sleepq_wait_sig(c9f60090,0,f887cbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf887cb74 _cv_wait_sig(c9f60090,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf887cbc0 svc_run_internal(f887ccd4,c0b299ae,c8e38100,f887cce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf887cca4 svc_thread_start(c8e38100,f887cce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf887ccac fork_exit(c0d96be0,c8e38100,f887cce8) at fork_exit+0x7e/frame 0xf887ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf887ccd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100120 td 0xc9fb6000 sched_switch(c9fb6000,0,104,1af,f887fae0,...) at sched_switch+0x4e2/frame 0xf887faa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf887fae0 sleepq_switch(c9fb6000,0,c11e5b65,1b6,f887fb58,...) at sleepq_switch+0x1c5/frame 0xf887fb14 sleepq_catch_signals(f887fb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf887fb50 sleepq_wait_sig(c9f5fe90,0,f887fbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf887fb74 _cv_wait_sig(c9f5fe90,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf887fbc0 svc_run_internal(f887fcd4,c0b299ae,c8e38100,f887fce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf887fca4 svc_thread_start(c8e38100,f887fce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf887fcac fork_exit(c0d96be0,c8e38100,f887fce8) at fork_exit+0x7e/frame 0xf887fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf887fcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100121 td 0xc9fb5c40 sched_switch(c9fb5c40,0,104,1af,f8882ae0,...) at sched_switch+0x4e2/frame 0xf8882aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf8882ae0 sleepq_switch(c9fb5c40,0,c11e5b65,1b6,f8882b58,...) at sleepq_switch+0x1c5/frame 0xf8882b14 sleepq_catch_signals(f8882b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8882b50 sleepq_wait_sig(c9f5fd90,0,f8882bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8882b74 _cv_wait_sig(c9f5fd90,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8882bc0 svc_run_internal(f8882cd4,c0b299ae,c8e38100,f8882ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf8882ca4 svc_thread_start(c8e38100,f8882ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8882cac fork_exit(c0d96be0,c8e38100,f8882ce8) at fork_exit+0x7e/frame 0xf8882cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8882cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100122 td 0xc9fb5930 sched_switch(c9fb5930,0,104,1af,f8885ae0,...) at sched_switch+0x4e2/frame 0xf8885aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf8885ae0 sleepq_switch(c9fb5930,0,c11e5b65,1b6,f8885b58,...) at sleepq_switch+0x1c5/frame 0xf8885b14 sleepq_catch_signals(f8885b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8885b50 sleepq_wait_sig(c9f5fc90,0,f8885bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8885b74 _cv_wait_sig(c9f5fc90,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8885bc0 svc_run_internal(f8885cd4,c0b299ae,c8e38100,f8885ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf8885ca4 svc_thread_start(c8e38100,f8885ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8885cac fork_exit(c0d96be0,c8e38100,f8885ce8) at fork_exit+0x7e/frame 0xf8885cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8885cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100123 td 0xc9fb5620 sched_switch(c9fb5620,0,104,1af,f8888ae0,...) at sched_switch+0x4e2/frame 0xf8888aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf8888ae0 sleepq_switch(c9fb5620,0,c11e5b65,1b6,f8888b58,...) at sleepq_switch+0x1c5/frame 0xf8888b14 sleepq_catch_signals(f8888b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8888b50 sleepq_wait_sig(c9f5fb90,0,f8888bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8888b74 _cv_wait_sig(c9f5fb90,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8888bc0 svc_run_internal(f8888cd4,c0b299ae,c8e38100,f8888ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf8888ca4 svc_thread_start(c8e38100,f8888ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8888cac fork_exit(c0d96be0,c8e38100,f8888ce8) at fork_exit+0x7e/frame 0xf8888cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8888cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100124 td 0xc9fb5310 sched_switch(c9fb5310,0,104,1af,f888bae0,...) at sched_switch+0x4e2/frame 0xf888baa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf888bae0 sleepq_switch(c9fb5310,0,c11e5b65,1b6,f888bb58,...) at sleepq_switch+0x1c5/frame 0xf888bb14 sleepq_catch_signals(f888bb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf888bb50 sleepq_wait_sig(c9f5fa90,0,f888bbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf888bb74 _cv_wait_sig(c9f5fa90,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf888bbc0 svc_run_internal(f888bcd4,c0b299ae,c8e38100,f888bce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf888bca4 svc_thread_start(c8e38100,f888bce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf888bcac fork_exit(c0d96be0,c8e38100,f888bce8) at fork_exit+0x7e/frame 0xf888bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf888bcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100125 td 0xc9fb5000 sched_switch(c9fb5000,0,104,1af,f888eae0,...) at sched_switch+0x4e2/frame 0xf888eaa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf888eae0 sleepq_switch(c9fb5000,0,c11e5b65,1b6,f888eb58,...) at sleepq_switch+0x1c5/frame 0xf888eb14 sleepq_catch_signals(f888eb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf888eb50 sleepq_wait_sig(c9f5f990,0,f888ebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf888eb74 _cv_wait_sig(c9f5f990,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf888ebc0 svc_run_internal(f888ecd4,c0b299ae,c8e38100,f888ece8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf888eca4 svc_thread_start(c8e38100,f888ece8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf888ecac fork_exit(c0d96be0,c8e38100,f888ece8) at fork_exit+0x7e/frame 0xf888ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf888ecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100126 td 0xc9fb4c40 sched_switch(c9fb4c40,0,104,1af,f8891ae0,...) at sched_switch+0x4e2/frame 0xf8891aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf8891ae0 sleepq_switch(c9fb4c40,0,c11e5b65,1b6,f8891b58,...) at sleepq_switch+0x1c5/frame 0xf8891b14 sleepq_catch_signals(f8891b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8891b50 sleepq_wait_sig(c9f5f890,0,f8891bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8891b74 _cv_wait_sig(c9f5f890,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8891bc0 svc_run_internal(f8891cd4,c0b299ae,c8e38100,f8891ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf8891ca4 svc_thread_start(c8e38100,f8891ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8891cac fork_exit(c0d96be0,c8e38100,f8891ce8) at fork_exit+0x7e/frame 0xf8891cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8891cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100127 td 0xc9fb4930 sched_switch(c9fb4930,0,104,1af,f8894ae0,...) at sched_switch+0x4e2/frame 0xf8894aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf8894ae0 sleepq_switch(c9fb4930,0,c11e5b65,1b6,f8894b58,...) at sleepq_switch+0x1c5/frame 0xf8894b14 sleepq_catch_signals(f8894b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8894b50 sleepq_wait_sig(c9f5f790,0,f8894bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8894b74 _cv_wait_sig(c9f5f790,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8894bc0 svc_run_internal(f8894cd4,c0b299ae,c8e38100,f8894ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf8894ca4 svc_thread_start(c8e38100,f8894ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8894cac fork_exit(c0d96be0,c8e38100,f8894ce8) at fork_exit+0x7e/frame 0xf8894cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8894cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100128 td 0xc9fb4620 sched_switch(c9fb4620,0,104,1af,f8897ae0,...) at sched_switch+0x4e2/frame 0xf8897aa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf8897ae0 sleepq_switch(c9fb4620,0,c11e5b65,1b6,f8897b58,...) at sleepq_switch+0x1c5/frame 0xf8897b14 sleepq_catch_signals(f8897b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf8897b50 sleepq_wait_sig(c9f5f690,0,f8897bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8897b74 _cv_wait_sig(c9f5f690,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8897bc0 svc_run_internal(f8897cd4,c0b299ae,c8e38100,f8897ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf8897ca4 svc_thread_start(c8e38100,f8897ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8897cac fork_exit(c0d96be0,c8e38100,f8897ce8) at fork_exit+0x7e/frame 0xf8897cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8897cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100129 td 0xc9fb4310 sched_switch(c9fb4310,0,104,1af,f889aae0,...) at sched_switch+0x4e2/frame 0xf889aaa8 mi_switch(104,0,c11e5b65,200,c157f15c,...) at mi_switch+0x1bf/frame 0xf889aae0 sleepq_switch(c9fb4310,0,c11e5b65,1b6,f889ab58,...) at sleepq_switch+0x1c5/frame 0xf889ab14 sleepq_catch_signals(f889ab74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf889ab50 sleepq_wait_sig(c9f5f590,0,f889abac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf889ab74 _cv_wait_sig(c9f5f590,c8e38100,c1211335,45c,0,...) at _cv_wait_sig+0x214/frame 0xf889abc0 svc_run_internal(f889acd4,c0b299ae,c8e38100,f889ace8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf889aca4 svc_thread_start(c8e38100,f889ace8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf889acac fork_exit(c0d96be0,c8e38100,f889ace8) at fork_exit+0x7e/frame 0xf889acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf889acd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100130 td 0xc9fb4000 sched_switch(c9fb4000,0,104,1af,f889dae0,...) at sched_switch+0x4e2/frame 0xf889daa8 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xf889dae0 sleepq_switch(c9fb4000,0,c11e5b65,1b6,f889db58,...) at sleepq_switch+0x1c5/frame 0xf889db14 sleepq_catch_signals(f889db74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf889db50 sleepq_wait_sig(c9f5f490,0,f889dbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf889db74 _cv_wait_sig(c9f5f490,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf889dbc0 svc_run_internal(f889dcd4,c0b299ae,c8e38100,f889dce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf889dca4 svc_thread_start(c8e38100,f889dce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf889dcac fork_exit(c0d96be0,c8e38100,f889dce8) at fork_exit+0x7e/frame 0xf889dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf889dcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100131 td 0xc9fb9000 sched_switch(c9fb9000,0,104,1af,f88a0ae0,...) at sched_switch+0x4e2/frame 0xf88a0aa8 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xf88a0ae0 sleepq_switch(c9fb9000,0,c11e5b65,1b6,f88a0b58,...) at sleepq_switch+0x1c5/frame 0xf88a0b14 sleepq_catch_signals(f88a0b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88a0b50 sleepq_wait_sig(c9f5f390,0,f88a0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a0b74 _cv_wait_sig(c9f5f390,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88a0bc0 svc_run_internal(f88a0cd4,c0b299ae,c8e38100,f88a0ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88a0ca4 svc_thread_start(c8e38100,f88a0ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a0cac fork_exit(c0d96be0,c8e38100,f88a0ce8) at fork_exit+0x7e/frame 0xf88a0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a0cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100132 td 0xc9fb8c40 sched_switch(c9fb8c40,0,104,1af,f88a3ae0,...) at sched_switch+0x4e2/frame 0xf88a3aa8 mi_switch(104,0,c11e5b65,200,c9fb8c40,...) at mi_switch+0x1bf/frame 0xf88a3ae0 sleepq_switch(c9fb8c40,0,c11e5b65,1b6,f88a3b58,...) at sleepq_switch+0x1c5/frame 0xf88a3b14 sleepq_catch_signals(f88a3b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88a3b50 sleepq_wait_sig(c9f5f290,0,f88a3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a3b74 _cv_wait_sig(c9f5f290,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88a3bc0 svc_run_internal(f88a3cd4,c0b299ae,c8e38100,f88a3ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88a3ca4 svc_thread_start(c8e38100,f88a3ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a3cac fork_exit(c0d96be0,c8e38100,f88a3ce8) at fork_exit+0x7e/frame 0xf88a3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a3cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100133 td 0xc9fb8930 sched_switch(c9fb8930,0,104,1af,f88a6ae0,...) at sched_switch+0x4e2/frame 0xf88a6aa8 mi_switch(104,0,c11e5b65,200,c15a9fbc,...) at mi_switch+0x1bf/frame 0xf88a6ae0 sleepq_switch(c9fb8930,0,c11e5b65,1b6,f88a6b58,...) at sleepq_switch+0x1c5/frame 0xf88a6b14 sleepq_catch_signals(f88a6b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88a6b50 sleepq_wait_sig(c9f5f190,0,f88a6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a6b74 _cv_wait_sig(c9f5f190,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88a6bc0 svc_run_internal(f88a6cd4,c0b299ae,c8e38100,f88a6ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88a6ca4 svc_thread_start(c8e38100,f88a6ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a6cac fork_exit(c0d96be0,c8e38100,f88a6ce8) at fork_exit+0x7e/frame 0xf88a6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a6cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100134 td 0xc9fb8620 sched_switch(c9fb8620,0,104,1af,f88a9ae0,...) at sched_switch+0x4e2/frame 0xf88a9aa8 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xf88a9ae0 sleepq_switch(c9fb8620,0,c11e5b65,1b6,f88a9b58,...) at sleepq_switch+0x1c5/frame 0xf88a9b14 sleepq_catch_signals(f88a9b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88a9b50 sleepq_wait_sig(c9f5f090,0,f88a9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a9b74 _cv_wait_sig(c9f5f090,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88a9bc0 svc_run_internal(f88a9cd4,c0b299ae,c8e38100,f88a9ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88a9ca4 svc_thread_start(c8e38100,f88a9ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a9cac fork_exit(c0d96be0,c8e38100,f88a9ce8) at fork_exit+0x7e/frame 0xf88a9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a9cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100135 td 0xc9fb8310 sched_switch(c9fb8310,0,104,1af,f88acae0,...) at sched_switch+0x4e2/frame 0xf88acaa8 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xf88acae0 sleepq_switch(c9fb8310,0,c11e5b65,1b6,f88acb58,...) at sleepq_switch+0x1c5/frame 0xf88acb14 sleepq_catch_signals(f88acb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88acb50 sleepq_wait_sig(c9f5ee90,0,f88acbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88acb74 _cv_wait_sig(c9f5ee90,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88acbc0 svc_run_internal(f88accd4,c0b299ae,c8e38100,f88acce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88acca4 svc_thread_start(c8e38100,f88acce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88accac fork_exit(c0d96be0,c8e38100,f88acce8) at fork_exit+0x7e/frame 0xf88accd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88accd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100136 td 0xc9fb8000 sched_switch(c9fb8000,0,104,1af,f88afae0,...) at sched_switch+0x4e2/frame 0xf88afaa8 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xf88afae0 sleepq_switch(c9fb8000,0,c11e5b65,1b6,f88afb58,...) at sleepq_switch+0x1c5/frame 0xf88afb14 sleepq_catch_signals(f88afb74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88afb50 sleepq_wait_sig(c9f5ed90,0,f88afbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88afb74 _cv_wait_sig(c9f5ed90,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88afbc0 svc_run_internal(f88afcd4,c0b299ae,c8e38100,f88afce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88afca4 svc_thread_start(c8e38100,f88afce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88afcac fork_exit(c0d96be0,c8e38100,f88afce8) at fork_exit+0x7e/frame 0xf88afcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88afcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100137 td 0xc9fb7c40 sched_switch(c9fb7c40,0,104,1af,f88b2ae0,...) at sched_switch+0x4e2/frame 0xf88b2aa8 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xf88b2ae0 sleepq_switch(c9fb7c40,0,c11e5b65,1b6,f88b2b58,...) at sleepq_switch+0x1c5/frame 0xf88b2b14 sleepq_catch_signals(f88b2b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88b2b50 sleepq_wait_sig(c9f5ec90,0,f88b2bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b2b74 _cv_wait_sig(c9f5ec90,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88b2bc0 svc_run_internal(f88b2cd4,c0b299ae,c8e38100,f88b2ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88b2ca4 svc_thread_start(c8e38100,f88b2ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b2cac fork_exit(c0d96be0,c8e38100,f88b2ce8) at fork_exit+0x7e/frame 0xf88b2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b2cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 547 tid 100138 td 0xc9fb7930 sched_switch(c9fb7930,0,104,1af,f88b5ae0,...) at sched_switch+0x4e2/frame 0xf88b5aa8 mi_switch(104,0,c11e5b65,200,5e2c8,...) at mi_switch+0x1bf/frame 0xf88b5ae0 sleepq_switch(c9fb7930,0,c11e5b65,1b6,f88b5b58,...) at sleepq_switch+0x1c5/frame 0xf88b5b14 sleepq_catch_signals(f88b5b74,c0b479f9,c8e38110,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xf88b5b50 sleepq_wait_sig(c9f5eb90,0,f88b5bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b5b74 _cv_wait_sig(c9f5eb90,c8e38100,c1211335,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88b5bc0 svc_run_internal(f88b5cd4,c0b299ae,c8e38100,f88b5ce8,c11d881c,...) at svc_run_internal+0xc71/frame 0xf88b5ca4 svc_thread_start(c8e38100,f88b5ce8,c11d881c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b5cac fork_exit(c0d96be0,c8e38100,f88b5ce8) at fork_exit+0x7e/frame 0xf88b5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b5cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 542 tid 100107 td 0xc93eac40 sched_switch(c93eac40,0,104,1af,edbda918,...) at sched_switch+0x4e2/frame 0xedbda8e0 mi_switch(104,0,c11e5b65,200,edbda984,...) at mi_switch+0x1bf/frame 0xedbda918 sleepq_switch(c93eac40,0,c11e5b65,1b6,edbda990,...) at sleepq_switch+0x1c5/frame 0xedbda94c sleepq_catch_signals(edbda9ac,c0b479f9,c8faf120,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbda988 sleepq_wait_sig(c8faf124,0,edbda9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbda9ac _cv_wait_sig(c8faf124,c8faf110,c11e904f,732,c9a928e8,...) at _cv_wait_sig+0x214/frame 0xedbda9f8 seltdwait(ffffffff,0,0,c93eac40,0,...) at seltdwait+0xbb/frame 0xedbdaa28 kern_select(c93eac40,7,bfbfec30,0,0,...) at kern_select+0x914/frame 0xedbdabd0 sys_select(c93eac40,edbdaca8,c11d843d,4,c10657e7,...) at sys_select+0x66/frame 0xedbdac18 syscall(edbdace8) at syscall+0x34a/frame 0xedbdacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbdacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a4eff, esp = 0xbfbfea5c, ebp = 0xbfbfee34 --- Tracing command mountd pid 536 tid 100082 td 0xc9382c40 sched_switch(c9382c40,0,104,1af,edb2f918,...) at sched_switch+0x4e2/frame 0xedb2f8e0 mi_switch(104,0,c11e5b65,200,60,...) at mi_switch+0x1bf/frame 0xedb2f918 sleepq_switch(c9382c40,0,c11e5b65,1b6,edb2f990,...) at sleepq_switch+0x1c5/frame 0xedb2f94c sleepq_catch_signals(edb2f9ac,c0b479f9,c8faf1e0,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedb2f988 sleepq_wait_sig(c8faf1e4,0,edb2f9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb2f9ac _cv_wait_sig(c8faf1e4,c8faf1d0,c11e904f,732,c9ad3390,...) at _cv_wait_sig+0x214/frame 0xedb2f9f8 seltdwait(ffffffff,0,0,c9382c40,0,...) at seltdwait+0xbb/frame 0xedb2fa28 kern_select(c9382c40,9,bfbfed50,0,0,...) at kern_select+0x914/frame 0xedb2fbd0 sys_select(c9382c40,edb2fca8,c11d843d,4,c9fa7000,...) at sys_select+0x66/frame 0xedb2fc18 syscall(edb2fce8) at syscall+0x34a/frame 0xedb2fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb2fcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bbeff, esp = 0xbfbfed0c, ebp = 0xbfbfee34 --- Tracing command nfsuserd pid 529 tid 100106 td 0xc9b04310 sched_switch(c9b04310,0,104,1af,edbd6910,...) at sched_switch+0x4e2/frame 0xedbd68d8 mi_switch(104,0,c11e5b65,200,c1632f90,...) at mi_switch+0x1bf/frame 0xedbd6910 sleepq_switch(c9b04310,0,c11e5b65,1b6,c9e029d0,...) at sleepq_switch+0x1c5/frame 0xedbd6944 sleepq_catch_signals(c1454ae8,edbd69a8,c0b479f9,c9e029e0,0,...) at sleepq_catch_signals+0x382/frame 0xedbd6980 sleepq_timedwait_sig(c9e029e4,0,edbd69e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbd69a8 _cv_timedwait_sig_sbt(c9e029e4,c9e029d0,e1a0ea70,b653,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbd69f8 seltdwait(b653,e0000000,1,c9b04310,0,...) at seltdwait+0xad/frame 0xedbd6a28 kern_select(c9b04310,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbd6bd0 sys_select(c9b04310,edbd6ca8,c11d843d,4,c11e1bc2,...) at sys_select+0x66/frame 0xedbd6c18 syscall(edbd6ce8) at syscall+0x34a/frame 0xedbd6cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbd6cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 528 tid 100105 td 0xc9b04620 sched_switch(c9b04620,0,104,1af,edbd3910,...) at sched_switch+0x4e2/frame 0xedbd38d8 mi_switch(104,0,c11e5b65,200,c1632f90,...) at mi_switch+0x1bf/frame 0xedbd3910 sleepq_switch(c9b04620,0,c11e5b65,1b6,c9a65690,...) at sleepq_switch+0x1c5/frame 0xedbd3944 sleepq_catch_signals(c1454ae8,edbd39a8,c0b479f9,c9a656a0,0,...) at sleepq_catch_signals+0x382/frame 0xedbd3980 sleepq_timedwait_sig(c9a656a4,0,edbd39e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbd39a8 _cv_timedwait_sig_sbt(c9a656a4,c9a65690,8d6e3a5,b650,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbd39f8 seltdwait(b650,e0000000,1,c9b04620,0,...) at seltdwait+0xad/frame 0xedbd3a28 kern_select(c9b04620,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbd3bd0 sys_select(c9b04620,edbd3ca8,c11d843d,4,c11e1bc2,...) at sys_select+0x66/frame 0xedbd3c18 syscall(edbd3ce8) at syscall+0x34a/frame 0xedbd3cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbd3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 527 tid 100104 td 0xc9b04930 sched_switch(c9b04930,0,104,1af,edbd0910,...) at sched_switch+0x4e2/frame 0xedbd08d8 mi_switch(104,0,c11e5b65,200,c1632b10,...) at mi_switch+0x1bf/frame 0xedbd0910 sleepq_switch(c9b04930,0,c11e5b65,1b6,c9a656d0,...) at sleepq_switch+0x1c5/frame 0xedbd0944 sleepq_catch_signals(c1454ae8,edbd09a8,c0b479f9,c9a656e0,0,...) at sleepq_catch_signals+0x382/frame 0xedbd0980 sleepq_timedwait_sig(c9a656e4,0,edbd09e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbd09a8 _cv_timedwait_sig_sbt(c9a656e4,c9a656d0,b8afb6f1,b64f,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbd09f8 seltdwait(b64f,e0000000,1,c9b04930,0,...) at seltdwait+0xad/frame 0xedbd0a28 kern_select(c9b04930,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbd0bd0 sys_select(c9b04930,edbd0ca8,c11d843d,4,c11e1bc2,...) at sys_select+0x66/frame 0xedbd0c18 syscall(edbd0ce8) at syscall+0x34a/frame 0xedbd0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbd0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 526 tid 100103 td 0xc9b04c40 sched_switch(c9b04c40,0,104,1af,edbcd910,...) at sched_switch+0x4e2/frame 0xedbcd8d8 mi_switch(104,0,c11e5b65,200,c1632c90,...) at mi_switch+0x1bf/frame 0xedbcd910 sleepq_switch(c9b04c40,0,c11e5b65,1b6,c9e02990,...) at sleepq_switch+0x1c5/frame 0xedbcd944 sleepq_catch_signals(c1454ae8,edbcd9a8,c0b479f9,c9e029a0,0,...) at sleepq_catch_signals+0x382/frame 0xedbcd980 sleepq_timedwait_sig(c9e029a4,0,edbcd9e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbcd9a8 _cv_timedwait_sig_sbt(c9e029a4,c9e02990,9df7e33,b650,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbcd9f8 seltdwait(b650,e0000000,1,c9b04c40,0,...) at seltdwait+0xad/frame 0xedbcda28 kern_select(c9b04c40,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbcdbd0 sys_select(c9b04c40,edbcdca8,c11d843d,4,c156c200,...) at sys_select+0x66/frame 0xedbcdc18 syscall(edbcdce8) at syscall+0x34a/frame 0xedbcdcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbcdcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 525 tid 100099 td 0xc9b05310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3b48,c09e5b32,fee74dd0,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xfee74d58 kdb_backtrace(c11e3bc5,280,fee74f0c,c105d060,c1441d80,...) at kdb_backtrace+0x2d/frame 0xfee74dc0 kdb_reenter(c1441d80,0,fee74e17,fee74df8,c0dbd461,...) at kdb_reenter+0x31/frame 0xfee74dd0 trap(fee74f18) at trap+0x50/frame 0xfee74f0c calltrap() at calltrap+0x6/frame 0xfee74f0c --- trap 0xc, eip = 0xc1048cb6, esp = 0xfee74f58, ebp = 0xfee74f68 --- db_trace_thread(c9b05310,ffffffff,20d,18703,c9b05310,...) at db_trace_thread+0x16/frame 0xfee74f68 db_stack_trace_all(c0b9dc7d,0,ffffffff,fee75008,0,...) at db_stack_trace_all+0xa2/frame 0xfee74fd4 db_command(c1498582,0,c16286e0,c1498581,a,...) at db_command+0x39f/frame 0xfee75090 db_script_exec(fee75140,0,c8b5a250,fee7512c,1,...) at db_script_exec+0x168/frame 0xfee750f8 db_command(c10ada03,fee75218,c053337b,c11df27d,1,...) at db_command+0x39f/frame 0xfee751b4 db_command_loop(c11df27d,1,0,c1441be0,c1441e10,...) at db_command_loop+0x50/frame 0xfee751c0 db_trap(3,0,a,46,0,...) at db_trap+0xdb/frame 0xfee75218 kdb_trap(3,0,fee7539c,0,0,...) at kdb_trap+0x117/frame 0xfee75250 trap(fee7539c) at trap+0x87f/frame 0xfee75390 calltrap() at calltrap+0x6/frame 0xfee75390 --- trap 0x3, eip = 0xc0b9dc7d, esp = 0xfee753dc, ebp = 0xfee753e8 --- kdb_enter(c11df27d,c11df27d,c11dae07,fee7543c,2,...) at kdb_enter+0x3d/frame 0xfee753e8 vpanic(c11dae07,fee7543c,fee7543c,fee7550c,c0b3f2c7,...) at vpanic+0x137/frame 0xfee7541c panic(c11dae07,c11dad5a,c11ee286,c121ad24,10c,...) at panic+0x1b/frame 0xfee75430 __lockmgr_args(e45062b8,80900,da74aed0,0,0,...) at __lockmgr_args+0xc27/frame 0xfee7550c ffs_syncvnode(da74ae10,1,0,c15d6c10,c147bdb0,...) at ffs_syncvnode+0x259/frame 0xfee75564 ffs_fsync(fee75618,c13abac8,8,c11ee2b0,c148f0e4,...) at ffs_fsync+0x26/frame 0xfee75588 VOP_FSYNC_APV(c147bdb0,fee75618,850,c11eee13,0,...) at VOP_FSYNC_APV+0x12f/frame 0xfee755b8 getnewbuf(0,10000,0,0,0,...) at getnewbuf+0xab7/frame 0xfee7563c getblk(da74ae10,ffffdff3,ffffffff,10000,0,...) at getblk+0x7fa/frame 0xfee756b0 ufs_bmaparray(da74ae10,ed06,0,fee75780,0,...) at ufs_bmaparray+0x367/frame 0xfee75758 ufs_bmap(fee757f8,c13abeac,e4506268,fee757d0,c0bff2ee,...) at ufs_bmap+0x68/frame 0xfee757a0 VOP_BMAP_APV(c147bdb0,fee757f8,c15f1e28,0,c13a2d7b,...) at VOP_BMAP_APV+0x135/frame 0xfee757d0 bdwrite(e4506268,d000,1,fee75be8,ca04dd00,...) at bdwrite+0x107/frame 0xfee7582c ffs_write(fee759b0,c13ab945,da74ae44,da74ae10,c148f0e4,...) at ffs_write+0x481/frame 0xfee758b8 VOP_WRITE_APV(c147bdb0,fee759b0,da74ae10,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xfee75978 vn_write(dc5565b0,fee75be8,ca04dd00,1,dd4dd620,...) at vn_write+0x328/frame 0xfee759e0 vn_io_fault_doio(dd4dd620,fee75a4c,c0baf43c,c157a12c,0,...) at vn_io_fault_doio+0x34/frame 0xfee75a28 vn_io_fault1(dd4dd620,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xfee75af8 vn_io_fault(dc5565b0,fee75be8,ca04dd00,0,dd4dd620,...) at vn_io_fault+0x1fa/frame 0xfee75b4c dofilewrite(dc5565b0,fee75be8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xfee75b80 kern_writev(dd4dd620,3,fee75be8,ed06d000,8048a45,...) at kern_writev+0x93/frame 0xfee75bc8 sys_write(dd4dd620,fee75ca8,c11d843d,4,c10657e7,...) at sys_write+0x59/frame 0xfee75c18 syscall(fee75ce8) at syscall+0x34a/frame 0xfee75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfee75cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a1eef, esp = 0xbfbfe770, ebp = 0xbfbfe7a0 --- Tracing command casperd pid 508 tid 100100 td 0xc9375000 sched_switch(c9375000,0,104,1af,edbc4918,...) at sched_switch+0x4e2/frame 0xedbc48e0 mi_switch(104,0,c11e5b65,200,edbc4984,...) at mi_switch+0x1bf/frame 0xedbc4918 sleepq_switch(c9375000,0,c11e5b65,1b6,edbc4990,...) at sleepq_switch+0x1c5/frame 0xedbc494c sleepq_catch_signals(edbc49ac,c0b479f9,c9a657a0,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedbc4988 sleepq_wait_sig(c9a657a4,0,edbc49e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbc49ac _cv_wait_sig(c9a657a4,c9a65790,c11e904f,732,c9a9dab0,...) at _cv_wait_sig+0x214/frame 0xedbc49f8 seltdwait(ffffffff,0,0,c9375000,0,...) at seltdwait+0xbb/frame 0xedbc4a28 kern_select(c9375000,7,bfbfe9c8,0,0,...) at kern_select+0x914/frame 0xedbc4bd0 sys_select(c9375000,edbc4ca8,c11d843d,4,c10657e7,...) at sys_select+0x66/frame 0xedbc4c18 syscall(edbc4ce8) at syscall+0x34a/frame 0xedbc4cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc4cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d1eff, esp = 0xbfbfe984, ebp = 0xbfbfee44 --- Tracing command casperd pid 507 tid 100097 td 0xc9375310 sched_switch(c9375310,0,104,1af,edba9918,...) at sched_switch+0x4e2/frame 0xedba98e0 mi_switch(104,0,c11e5b65,200,edba9984,...) at mi_switch+0x1bf/frame 0xedba9918 sleepq_switch(c9375310,0,c11e5b65,1b6,edba9990,...) at sleepq_switch+0x1c5/frame 0xedba994c sleepq_catch_signals(edba99ac,c0b479f9,c9a65860,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedba9988 sleepq_wait_sig(c9a65864,0,edba99e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedba99ac _cv_wait_sig(c9a65864,c9a65850,c11e904f,732,c9a9dc78,...) at _cv_wait_sig+0x214/frame 0xedba99f8 seltdwait(ffffffff,0,0,c9375310,0,...) at seltdwait+0xbb/frame 0xedba9a28 kern_select(c9375310,6,bfbfe858,0,0,...) at kern_select+0x914/frame 0xedba9bd0 sys_select(c9375310,edba9ca8,c11d843d,4,c10657e7,...) at sys_select+0x66/frame 0xedba9c18 syscall(edba9ce8) at syscall+0x34a/frame 0xedba9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedba9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d1eff, esp = 0xbfbfe82c, ebp = 0xbfbfe8f0 --- Tracing command rpcbind pid 493 tid 100083 td 0xc93f3620 sched_switch(c93f3620,0,104,1af,edb32948,...) at sched_switch+0x4e2/frame 0xedb32910 mi_switch(104,0,c11e5b65,200,c1632e10,...) at mi_switch+0x1bf/frame 0xedb32948 sleepq_switch(c93f3620,0,c11e5b65,1b6,c9a65890,...) at sleepq_switch+0x1c5/frame 0xedb3297c sleepq_catch_signals(c1454ae8,edb329e0,c0b479f9,c9a658a0,0,...) at sleepq_catch_signals+0x382/frame 0xedb329b8 sleepq_timedwait_sig(c9a658a4,0,edb32a1c,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedb329e0 _cv_timedwait_sig_sbt(c9a658a4,c9a65890,f92e2ce6,b653,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb32a30 seltdwait(b653,e0000000,1,c93f3620,0,...) at seltdwait+0xad/frame 0xedb32a60 kern_poll(c93f3620,bfbfccc0,7,edb32c00,0,...) at kern_poll+0x4f0/frame 0xedb32be0 sys_poll(c93f3620,edb32ca8,c11d843d,4,c10657e7,...) at sys_poll+0x71/frame 0xedb32c18 syscall(edb32ce8) at syscall+0x34a/frame 0xedb32cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb32cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28150c53, esp = 0xbfbfcbfc, ebp = 0xbfbfedd8 --- Tracing command watchdogd pid 476 tid 100094 td 0xc9b05930 sched_switch(c9b05930,0,104,1af,edb7f9a0,...) at sched_switch+0x4e2/frame 0xedb7f968 mi_switch(104,0,c11e5b65,200,c11e1bc2,...) at mi_switch+0x1bf/frame 0xedb7f9a0 sleepq_switch(c9b05930,0,c11e5b65,1b6,c11e5b65,...) at sleepq_switch+0x1c5/frame 0xedb7f9d4 sleepq_catch_signals(c11e5b65,16d,c917a3f8,1548,c9b05930,...) at sleepq_catch_signals+0x382/frame 0xedb7fa10 sleepq_wait_sig(c917a340,6c,c11e98fd,100,0,...) at sleepq_wait_sig+0x14/frame 0xedb7fa34 _sleep(c917a340,c917a3e8,16c,c11e98fd,0,...) at _sleep+0x356/frame 0xedb7fa90 kern_wait6(c9b05930,0,14d03,0,edb7fb24,...) at kern_wait6+0x45b/frame 0xedb7faf8 sys_wait4(c9b05930,edb7fca8,c11d843d,4,0,...) at sys_wait4+0x8b/frame 0xedb7fc18 syscall(edb7fce8) at syscall+0x34a/frame 0xedb7fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb7fcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281497af, esp = 0xbfbfec6c, ebp = 0xbfbfed08 --- Tracing command syslogd pid 472 tid 100096 td 0xc9b05620 sched_switch(c9b05620,0,104,1af,edba5918,...) at sched_switch+0x4e2/frame 0xedba58e0 mi_switch(104,0,c11e5b65,200,0,...) at mi_switch+0x1bf/frame 0xedba5918 sleepq_switch(c9b05620,0,c11e5b65,1b6,edba5990,...) at sleepq_switch+0x1c5/frame 0xedba594c sleepq_catch_signals(edba59ac,c0b479f9,c9a657e0,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedba5988 sleepq_wait_sig(c9a657e4,0,edba59e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedba59ac _cv_wait_sig(c9a657e4,c9a657d0,c11e904f,732,0,...) at _cv_wait_sig+0x214/frame 0xedba59f8 seltdwait(ffffffff,0,0,c9b05620,0,...) at seltdwait+0xbb/frame 0xedba5a28 kern_select(c9b05620,9,2882d118,0,0,...) at kern_select+0x914/frame 0xedba5bd0 sys_select(c9b05620,edba5ca8,c11d843d,4,c96db000,...) at sys_select+0x66/frame 0xedba5c18 syscall(edba5ce8) at syscall+0x34a/frame 0xedba5cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedba5cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bbeff, esp = 0xbfbfdfdc, ebp = 0xbfbfee34 --- Tracing command rtsold pid 352 tid 100081 td 0xc8efc310 sched_switch(c8efc310,0,104,1af,edb2a950,...) at sched_switch+0x4e2/frame 0xedb2a918 mi_switch(104,0,c11e5b65,200,edb2a9bc,...) at mi_switch+0x1bf/frame 0xedb2a950 sleepq_switch(c8efc310,0,c11e5b65,1b6,edb2a9c8,...) at sleepq_switch+0x1c5/frame 0xedb2a984 sleepq_catch_signals(edb2a9e4,c0b479f9,c8faf1a0,0,c1454ae8,...) at sleepq_catch_signals+0x382/frame 0xedb2a9c0 sleepq_wait_sig(c8faf1a4,0,edb2aa1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb2a9e4 _cv_wait_sig(c8faf1a4,c8faf190,c11e904f,732,62d,...) at _cv_wait_sig+0x214/frame 0xedb2aa30 seltdwait(ffffffff,0,0,c8efc310,0,...) at seltdwait+0xbb/frame 0xedb2aa60 kern_poll(c8efc310,bfbfee08,2,0,0,...) at kern_poll+0x4f0/frame 0xedb2abe0 sys_poll(c8efc310,edb2aca8,c11d843d,4,c10657e7,...) at sys_poll+0x71/frame 0xedb2ac18 syscall(edb2ace8) at syscall+0x34a/frame 0xedb2acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb2acdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814fc53, esp = 0xbfbfedcc, ebp = 0xbfbfee34 --- Tracing command devd pid 316 tid 100093 td 0xc9b05c40 sched_switch(c9b05c40,0,104,1af,edb7c910,...) at sched_switch+0x4e2/frame 0xedb7c8d8 mi_switch(104,0,c11e5b65,200,c1632b10,...) at mi_switch+0x1bf/frame 0xedb7c910 sleepq_switch(c9b05c40,0,c11e5b65,1b6,c91f6690,...) at sleepq_switch+0x1c5/frame 0xedb7c944 sleepq_catch_signals(c1454ae8,edb7c9a8,c0b479f9,c91f66a0,0,...) at sleepq_catch_signals+0x382/frame 0xedb7c980 sleepq_timedwait_sig(c91f66a4,0,edb7c9e4,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedb7c9a8 _cv_timedwait_sig_sbt(c91f66a4,c91f6690,46bf8195,b654,c0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb7c9f8 seltdwait(b654,c0000000,3,c9b05c40,0,...) at seltdwait+0xad/frame 0xedb7ca28 kern_select(c9b05c40,6,bfbfcda8,0,0,...) at kern_select+0x914/frame 0xedb7cbd0 sys_select(c9b05c40,edb7cca8,c11d843d,4,edb7cc6c,...) at sys_select+0x66/frame 0xedb7cc18 syscall(edb7cce8) at syscall+0x34a/frame 0xedb7ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb7ccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80e1bc3, esp = 0xbfbfcd4c, ebp = 0xbfbfee54 --- Tracing command syncer pid 16 tid 100074 td 0xc8efcc40 sched_switch(c8efcc40,0,104,1af,edb09b90,...) at sched_switch+0x4e2/frame 0xedb09b58 mi_switch(104,0,c11e5b65,200,c15d7334,...) at mi_switch+0x1bf/frame 0xedb09b90 sleepq_switch(c8efcc40,0,c11e5b65,299,0,...) at sleepq_switch+0x1c5/frame 0xedb09bc4 sleepq_timedwait(c15d7354,0,edb09c24,0,0,...) at sleepq_timedwait+0x48/frame 0xedb09be8 _cv_timedwait_sbt(c15d7354,c15d7334,fffffed8,0,0,...) at _cv_timedwait_sbt+0x23c/frame 0xedb09c38 sched_sync(0,edb09ce8,c11d881c,3dc,0,...) at sched_sync+0x712/frame 0xedb09cac fork_exit(c0c20f10,0,edb09ce8) at fork_exit+0x7e/frame 0xedb09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb09cd4 --- trap 0, eip = 0, esp = 0xedb09d20, ebp = 0 --- Tracing command vnlru pid 9 tid 100073 td 0xc8efd000 sched_switch(c8efd000,0,104,1af,edb06b8c,...) at sched_switch+0x4e2/frame 0xedb06b54 mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xedb06b8c sleepq_switch(c8efd000,0,c11e5b65,299,c8efd000,...) at sleepq_switch+0x1c5/frame 0xedb06bc0 sleepq_timedwait(c917c000,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb06be4 _sleep(c917c000,c15d730c,260,c11f2715,fffffed8,...) at _sleep+0x33d/frame 0xedb06c40 vnlru_proc(0,edb06ce8,c11d881c,3dc,0,...) at vnlru_proc+0xcf/frame 0xedb06cac fork_exit(c0c21740,0,edb06ce8) at fork_exit+0x7e/frame 0xedb06cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb06cd4 --- trap 0, eip = 0, esp = 0xedb06d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100072 td 0xc8efd310 sched_switch(c8efd310,0,104,1af,edb03b5c,...) at sched_switch+0x4e2/frame 0xedb03b24 mi_switch(104,0,c11e5b65,200,c15d6900,...) at mi_switch+0x1bf/frame 0xedb03b5c sleepq_switch(c8efd310,0,c11e5b65,276,c8efd310,...) at sleepq_switch+0x1c5/frame 0xedb03b90 sleepq_wait(c15d6984,54,c11ee2c8,0,0,...) at sleepq_wait+0x48/frame 0xedb03bb4 _sleep(c15d6984,c15d6900,54,c11ee2c8,0,...) at _sleep+0x3a1/frame 0xedb03c10 flushbufqueues(fffffffe,0,c11ee2b0,a2b,fffffed8,...) at flushbufqueues+0x506/frame 0xedb03c78 buf_daemon(0,edb03ce8,c11d881c,3dc,0,...) at buf_daemon+0x121/frame 0xedb03cac fork_exit(c0c036a0,0,edb03ce8) at fork_exit+0x7e/frame 0xedb03cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb03cd4 --- trap 0, eip = 0, esp = 0xedb03d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100087 td 0xc9382310 sched_switch(c9382310,0,104,1af,edb44bb4,...) at sched_switch+0x4e2/frame 0xedb44b7c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xedb44bb4 sleepq_switch(c9382310,0,c11e5b65,299,c9382310,...) at sleepq_switch+0x1c5/frame 0xedb44be8 sleepq_timedwait(c96ec284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb44c0c _sleep(c96ec284,c96ec200,54,c121a09f,7fffff6c,...) at _sleep+0x33d/frame 0xedb44c68 softdep_flush(c96e7000,edb44ce8,c11d881c,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb44cac fork_exit(c0ddb4c0,c96e7000,edb44ce8) at fork_exit+0x7e/frame 0xedb44cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb44cd4 --- trap 0, eip = 0, esp = 0xedb44d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100089 td 0xc9375c40 sched_switch(c9375c40,0,104,1af,edb4abb4,...) at sched_switch+0x4e2/frame 0xedb4ab7c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xedb4abb4 sleepq_switch(c9375c40,0,c11e5b65,299,c9375c40,...) at sleepq_switch+0x1c5/frame 0xedb4abe8 sleepq_timedwait(c96ebe84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb4ac0c _sleep(c96ebe84,c96ebe00,54,c121a09f,7fffff6c,...) at _sleep+0x33d/frame 0xedb4ac68 softdep_flush(c96e68c4,edb4ace8,c11d881c,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb4acac fork_exit(c0ddb4c0,c96e68c4,edb4ace8) at fork_exit+0x7e/frame 0xedb4acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb4acd4 --- trap 0, eip = 0, esp = 0xedb4ad20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100090 td 0xc9375930 sched_switch(c9375930,0,104,1af,edb4dbb4,...) at sched_switch+0x4e2/frame 0xedb4db7c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xedb4dbb4 sleepq_switch(c9375930,0,c11e5b65,299,c9375930,...) at sleepq_switch+0x1c5/frame 0xedb4dbe8 sleepq_timedwait(c96ebc84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb4dc0c _sleep(c96ebc84,c96ebc00,54,c121a09f,7fffff6c,...) at _sleep+0x33d/frame 0xedb4dc68 softdep_flush(c96e65d8,edb4dce8,c11d881c,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb4dcac fork_exit(c0ddb4c0,c96e65d8,edb4dce8) at fork_exit+0x7e/frame 0xedb4dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb4dcd4 --- trap 0, eip = 0, esp = 0xedb4dd20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100173 td 0xca100c40 sched_switch(ca100c40,0,104,1af,f8940bb4,...) at sched_switch+0x4e2/frame 0xf8940b7c mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xf8940bb4 sleepq_switch(ca100c40,0,c11e5b65,299,ca100c40,...) at sleepq_switch+0x1c5/frame 0xf8940be8 sleepq_timedwait(c8e90084,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf8940c0c _sleep(c8e90084,c8e90000,54,c121a09f,7fffff6c,...) at _sleep+0x33d/frame 0xf8940c68 softdep_flush(c96e6bb0,f8940ce8,c11d881c,3dc,0,...) at softdep_flush+0x1a2/frame 0xf8940cac fork_exit(c0ddb4c0,c96e6bb0,f8940ce8) at fork_exit+0x7e/frame 0xf8940cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8940cd4 --- trap 0, eip = 0, esp = 0xf8940d20, ebp = 0 --- Tracing command pagezero pid 7 tid 100071 td 0xc8efd620 sched_switch(c8efd620,0,104,1af,edb00bc0,...) at sched_switch+0x4e2/frame 0xedb00b88 mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xedb00bc0 sleepq_switch(c8efd620,0,c11e5b65,299,c8efd620,...) at sleepq_switch+0x1c5/frame 0xedb00bf4 sleepq_timedwait(c15dc5c0,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xedb00c18 _sleep(c15dc5c0,c1639a80,0,c1222021,fffea520,...) at _sleep+0x33d/frame 0xedb00c74 vm_pagezero(0,edb00ce8,c11d881c,3dc,0,...) at vm_pagezero+0xc2/frame 0xedb00cac fork_exit(c0e3ccc0,0,edb00ce8) at fork_exit+0x7e/frame 0xedb00cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb00cd4 --- trap 0, eip = 0, esp = 0xedb00d20, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100070 td 0xc8efd930 sched_switch(c8efd930,0,104,1af,edafdb8c,...) at sched_switch+0x4e2/frame 0xedafdb54 mi_switch(104,0,c11e5b65,200,c15dc324,...) at mi_switch+0x1bf/frame 0xedafdb8c sleepq_switch(c8efd930,0,c11e5b65,276,c8efd930,...) at sleepq_switch+0x1c5/frame 0xedafdbc0 sleepq_wait(c15dc33c,74,c11eefd3,0,0,...) at sleepq_wait+0x48/frame 0xedafdbe4 _sleep(c15dc33c,c15dc324,74,c11eefd3,0,...) at _sleep+0x3a1/frame 0xedafdc40 vm_daemon(0,edafdce8,c11d881c,3dc,0,...) at vm_daemon+0x9c/frame 0xedafdcac fork_exit(c0e34250,0,edafdce8) at fork_exit+0x7e/frame 0xedafdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedafdcd4 --- trap 0, eip = 0, esp = 0xedafdd20, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100069 td 0xc8efdc40 sched_switch(c8efdc40,0,104,1af,edafab8c,...) at sched_switch+0x4e2/frame 0xedafab54 mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xedafab8c sleepq_switch(c8efdc40,0,c11e5b65,299,c8efdc40,...) at sleepq_switch+0x1c5/frame 0xedafabc0 sleepq_timedwait(c1639b08,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedafabe4 _sleep(c1639b08,c1639a80,54,c11eefd3,fffffed8,...) at _sleep+0x33d/frame 0xedafac40 vm_pageout(0,edaface8,c11d881c,3dc,0,...) at vm_pageout+0x1f1/frame 0xedafacac fork_exit(c0e34a70,0,edaface8) at fork_exit+0x7e/frame 0xedafacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedafacd4 --- trap 0, eip = 0, esp = 0xedafad20, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100066 td 0xc8efe620 sched_switch(c8efe620,0,104,1af,ed971bcc,...) at sched_switch+0x4e2/frame 0xed971b94 mi_switch(104,0,c11e5b65,200,c1636464,...) at mi_switch+0x1bf/frame 0xed971bcc sleepq_switch(c8efe620,0,c11e5b65,276,c8efe620,...) at sleepq_switch+0x1c5/frame 0xed971c00 sleepq_wait(c163649c,0,c1206025,0,0,...) at sleepq_wait+0x48/frame 0xed971c24 _sleep(c163649c,c1636464,0,c1206025,0,...) at _sleep+0x3a1/frame 0xed971c80 sctp_iterator_thread(0,ed971ce8,c11d881c,3dc,0,...) at sctp_iterator_thread+0x7c/frame 0xed971cac fork_exit(c0cc8b50,0,ed971ce8) at fork_exit+0x7e/frame 0xed971cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed971cd4 --- trap 0, eip = 0, esp = 0xed971d20, ebp = 0 --- Tracing command fdc0 pid 3 tid 100061 td 0xc8c8a310 sched_switch(c8c8a310,0,104,1af,ed961b60,...) at sched_switch+0x4e2/frame 0xed961b28 mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xed961b60 sleepq_switch(c8c8a310,0,c11e5b65,299,c8c8a310,...) at sleepq_switch+0x1c5/frame 0xed961b94 sleepq_timedwait(c8c18a3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed961bb8 _sleep(c8c18a3c,c8c18af0,5c,c11ca6e6,fffffed8,...) at _sleep+0x33d/frame 0xed961c14 fdc_thread(c8c18a00,ed961ce8,c11d881c,3dc,0,...) at fdc_thread+0x95a/frame 0xed961cac fork_exit(c0fe3150,c8c18a00,ed961ce8) at fork_exit+0x7e/frame 0xed961cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed961cd4 --- trap 0, eip = 0, esp = 0xed961d20, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc8be3930 sched_switch(c8be3930,0,104,1af,ed8e8be8,...) at sched_switch+0x4e2/frame 0xed8e8bb0 mi_switch(104,0,c11e5b65,200,c8c2ecc8,...) at mi_switch+0x1bf/frame 0xed8e8be8 sleepq_switch(c8be3930,0,c11e5b65,276,c8c2eacc,...) at sleepq_switch+0x1c5/frame 0xed8e8c1c sleepq_wait(c8c2eacc,0,ed8e8c70,1,0,...) at sleepq_wait+0x48/frame 0xed8e8c40 _cv_wait(c8c2eacc,c8c2ecc8,c11b0993,76,c8c2ead4,...) at _cv_wait+0x1fe/frame 0xed8e8c84 usb_process(c8c2eac4,ed8e8ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8e8cac fork_exit(c09bc0a0,c8c2eac4,ed8e8ce8) at fork_exit+0x7e/frame 0xed8e8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8e8cd4 --- trap 0, eip = 0, esp = 0xed8e8d20, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc8be3620 sched_switch(c8be3620,0,104,1af,ed8ebbe8,...) at sched_switch+0x4e2/frame 0xed8ebbb0 mi_switch(104,0,c11e5b65,200,c8c2ecc8,...) at mi_switch+0x1bf/frame 0xed8ebbe8 sleepq_switch(c8be3620,0,c11e5b65,276,c8c2eafc,...) at sleepq_switch+0x1c5/frame 0xed8ebc1c sleepq_wait(c8c2eafc,0,ed8ebc70,1,0,...) at sleepq_wait+0x48/frame 0xed8ebc40 _cv_wait(c8c2eafc,c8c2ecc8,c11b0993,76,c8c2eb04,...) at _cv_wait+0x1fe/frame 0xed8ebc84 usb_process(c8c2eaf4,ed8ebce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8ebcac fork_exit(c09bc0a0,c8c2eaf4,ed8ebce8) at fork_exit+0x7e/frame 0xed8ebcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8ebcd4 --- trap 0, eip = 0, esp = 0xed8ebd20, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc8be3310 sched_switch(c8be3310,0,104,1af,ed8eebe8,...) at sched_switch+0x4e2/frame 0xed8eebb0 mi_switch(104,0,c11e5b65,200,c8c2ecc8,...) at mi_switch+0x1bf/frame 0xed8eebe8 sleepq_switch(c8be3310,0,c11e5b65,276,c8c2eb2c,...) at sleepq_switch+0x1c5/frame 0xed8eec1c sleepq_wait(c8c2eb2c,0,ed8eec70,1,0,...) at sleepq_wait+0x48/frame 0xed8eec40 _cv_wait(c8c2eb2c,c8c2ecc8,c11b0993,76,c8c2eb34,...) at _cv_wait+0x1fe/frame 0xed8eec84 usb_process(c8c2eb24,ed8eece8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8eecac fork_exit(c09bc0a0,c8c2eb24,ed8eece8) at fork_exit+0x7e/frame 0xed8eecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8eecd4 --- trap 0, eip = 0, esp = 0xed8eed20, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8be3000 sched_switch(c8be3000,0,104,1af,ed8f1be8,...) at sched_switch+0x4e2/frame 0xed8f1bb0 mi_switch(104,0,c11e5b65,200,c8c2ecc8,...) at mi_switch+0x1bf/frame 0xed8f1be8 sleepq_switch(c8be3000,0,c11e5b65,276,c8c2eb5c,...) at sleepq_switch+0x1c5/frame 0xed8f1c1c sleepq_wait(c8c2eb5c,0,ed8f1c70,1,0,...) at sleepq_wait+0x48/frame 0xed8f1c40 _cv_wait(c8c2eb5c,c8c2ecc8,c11b0993,76,c8c2eb64,...) at _cv_wait+0x1fe/frame 0xed8f1c84 usb_process(c8c2eb54,ed8f1ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8f1cac fork_exit(c09bc0a0,c8c2eb54,ed8f1ce8) at fork_exit+0x7e/frame 0xed8f1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f1cd4 --- trap 0, eip = 0, esp = 0xed8f1d20, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc8aef930 sched_switch(c8aef930,0,104,1af,ed8f8be8,...) at sched_switch+0x4e2/frame 0xed8f8bb0 mi_switch(104,0,c11e5b65,200,c8c77cc8,...) at mi_switch+0x1bf/frame 0xed8f8be8 sleepq_switch(c8aef930,0,c11e5b65,276,c8c77acc,...) at sleepq_switch+0x1c5/frame 0xed8f8c1c sleepq_wait(c8c77acc,0,ed8f8c70,1,0,...) at sleepq_wait+0x48/frame 0xed8f8c40 _cv_wait(c8c77acc,c8c77cc8,c11b0993,76,c8c77ad4,...) at _cv_wait+0x1fe/frame 0xed8f8c84 usb_process(c8c77ac4,ed8f8ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8f8cac fork_exit(c09bc0a0,c8c77ac4,ed8f8ce8) at fork_exit+0x7e/frame 0xed8f8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f8cd4 --- trap 0, eip = 0, esp = 0xed8f8d20, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc8aef620 sched_switch(c8aef620,0,104,1af,ed8fbbe8,...) at sched_switch+0x4e2/frame 0xed8fbbb0 mi_switch(104,0,c11e5b65,200,c8c77cc8,...) at mi_switch+0x1bf/frame 0xed8fbbe8 sleepq_switch(c8aef620,0,c11e5b65,276,c8c77afc,...) at sleepq_switch+0x1c5/frame 0xed8fbc1c sleepq_wait(c8c77afc,0,ed8fbc70,1,0,...) at sleepq_wait+0x48/frame 0xed8fbc40 _cv_wait(c8c77afc,c8c77cc8,c11b0993,76,c8c77b04,...) at _cv_wait+0x1fe/frame 0xed8fbc84 usb_process(c8c77af4,ed8fbce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8fbcac fork_exit(c09bc0a0,c8c77af4,ed8fbce8) at fork_exit+0x7e/frame 0xed8fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8fbcd4 --- trap 0, eip = 0, esp = 0xed8fbd20, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc8aef310 sched_switch(c8aef310,0,104,1af,ed8febe8,...) at sched_switch+0x4e2/frame 0xed8febb0 mi_switch(104,0,c11e5b65,200,c8c77cc8,...) at mi_switch+0x1bf/frame 0xed8febe8 sleepq_switch(c8aef310,0,c11e5b65,276,c8c77b2c,...) at sleepq_switch+0x1c5/frame 0xed8fec1c sleepq_wait(c8c77b2c,0,ed8fec70,1,0,...) at sleepq_wait+0x48/frame 0xed8fec40 _cv_wait(c8c77b2c,c8c77cc8,c11b0993,76,c8c77b34,...) at _cv_wait+0x1fe/frame 0xed8fec84 usb_process(c8c77b24,ed8fece8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed8fecac fork_exit(c09bc0a0,c8c77b24,ed8fece8) at fork_exit+0x7e/frame 0xed8fecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8fecd4 --- trap 0, eip = 0, esp = 0xed8fed20, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8c7f310 sched_switch(c8c7f310,0,104,1af,ed901be8,...) at sched_switch+0x4e2/frame 0xed901bb0 mi_switch(104,0,c11e5b65,200,c8c77cc8,...) at mi_switch+0x1bf/frame 0xed901be8 sleepq_switch(c8c7f310,0,c11e5b65,276,c8c77b5c,...) at sleepq_switch+0x1c5/frame 0xed901c1c sleepq_wait(c8c77b5c,0,ed901c70,1,0,...) at sleepq_wait+0x48/frame 0xed901c40 _cv_wait(c8c77b5c,c8c77cc8,c11b0993,76,c8c77b64,...) at _cv_wait+0x1fe/frame 0xed901c84 usb_process(c8c77b54,ed901ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed901cac fork_exit(c09bc0a0,c8c77b54,ed901ce8) at fork_exit+0x7e/frame 0xed901cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed901cd4 --- trap 0, eip = 0, esp = 0xed901d20, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8c7ec40 sched_switch(c8c7ec40,0,104,1af,ed908be8,...) at sched_switch+0x4e2/frame 0xed908bb0 mi_switch(104,0,c11e5b65,200,c8c80cc8,...) at mi_switch+0x1bf/frame 0xed908be8 sleepq_switch(c8c7ec40,0,c11e5b65,276,c8c80acc,...) at sleepq_switch+0x1c5/frame 0xed908c1c sleepq_wait(c8c80acc,0,ed908c70,1,0,...) at sleepq_wait+0x48/frame 0xed908c40 _cv_wait(c8c80acc,c8c80cc8,c11b0993,76,c8c80ad4,...) at _cv_wait+0x1fe/frame 0xed908c84 usb_process(c8c80ac4,ed908ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed908cac fork_exit(c09bc0a0,c8c80ac4,ed908ce8) at fork_exit+0x7e/frame 0xed908cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed908cd4 --- trap 0, eip = 0, esp = 0xed908d20, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc8c7e930 sched_switch(c8c7e930,0,104,1af,ed90bbe8,...) at sched_switch+0x4e2/frame 0xed90bbb0 mi_switch(104,0,c11e5b65,200,c8c80cc8,...) at mi_switch+0x1bf/frame 0xed90bbe8 sleepq_switch(c8c7e930,0,c11e5b65,276,c8c80afc,...) at sleepq_switch+0x1c5/frame 0xed90bc1c sleepq_wait(c8c80afc,0,ed90bc70,1,0,...) at sleepq_wait+0x48/frame 0xed90bc40 _cv_wait(c8c80afc,c8c80cc8,c11b0993,76,c8c80b04,...) at _cv_wait+0x1fe/frame 0xed90bc84 usb_process(c8c80af4,ed90bce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed90bcac fork_exit(c09bc0a0,c8c80af4,ed90bce8) at fork_exit+0x7e/frame 0xed90bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed90bcd4 --- trap 0, eip = 0, esp = 0xed90bd20, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc8c7e620 sched_switch(c8c7e620,0,104,1af,ed90ebe8,...) at sched_switch+0x4e2/frame 0xed90ebb0 mi_switch(104,0,c11e5b65,200,c8c80cc8,...) at mi_switch+0x1bf/frame 0xed90ebe8 sleepq_switch(c8c7e620,0,c11e5b65,276,c8c80b2c,...) at sleepq_switch+0x1c5/frame 0xed90ec1c sleepq_wait(c8c80b2c,0,ed90ec70,1,0,...) at sleepq_wait+0x48/frame 0xed90ec40 _cv_wait(c8c80b2c,c8c80cc8,c11b0993,76,c8c80b34,...) at _cv_wait+0x1fe/frame 0xed90ec84 usb_process(c8c80b24,ed90ece8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed90ecac fork_exit(c09bc0a0,c8c80b24,ed90ece8) at fork_exit+0x7e/frame 0xed90ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed90ecd4 --- trap 0, eip = 0, esp = 0xed90ed20, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc8c7e310 sched_switch(c8c7e310,0,104,1af,ed911be8,...) at sched_switch+0x4e2/frame 0xed911bb0 mi_switch(104,0,c11e5b65,200,c8c80cc8,...) at mi_switch+0x1bf/frame 0xed911be8 sleepq_switch(c8c7e310,0,c11e5b65,276,c8c80b5c,...) at sleepq_switch+0x1c5/frame 0xed911c1c sleepq_wait(c8c80b5c,0,ed911c70,1,0,...) at sleepq_wait+0x48/frame 0xed911c40 _cv_wait(c8c80b5c,c8c80cc8,c11b0993,76,c8c80b64,...) at _cv_wait+0x1fe/frame 0xed911c84 usb_process(c8c80b54,ed911ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed911cac fork_exit(c09bc0a0,c8c80b54,ed911ce8) at fork_exit+0x7e/frame 0xed911cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed911cd4 --- trap 0, eip = 0, esp = 0xed911d20, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8c7e000 sched_switch(c8c7e000,0,104,1af,ed915be8,...) at sched_switch+0x4e2/frame 0xed915bb0 mi_switch(104,0,c11e5b65,200,c8c82cc8,...) at mi_switch+0x1bf/frame 0xed915be8 sleepq_switch(c8c7e000,0,c11e5b65,276,c8c82acc,...) at sleepq_switch+0x1c5/frame 0xed915c1c sleepq_wait(c8c82acc,0,ed915c70,1,0,...) at sleepq_wait+0x48/frame 0xed915c40 _cv_wait(c8c82acc,c8c82cc8,c11b0993,76,c8c82ad4,...) at _cv_wait+0x1fe/frame 0xed915c84 usb_process(c8c82ac4,ed915ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed915cac fork_exit(c09bc0a0,c8c82ac4,ed915ce8) at fork_exit+0x7e/frame 0xed915cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed915cd4 --- trap 0, eip = 0, esp = 0xed915d20, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8c7dc40 sched_switch(c8c7dc40,0,104,1af,ed918be8,...) at sched_switch+0x4e2/frame 0xed918bb0 mi_switch(104,0,c11e5b65,200,c8c82cc8,...) at mi_switch+0x1bf/frame 0xed918be8 sleepq_switch(c8c7dc40,0,c11e5b65,276,c8c82afc,...) at sleepq_switch+0x1c5/frame 0xed918c1c sleepq_wait(c8c82afc,0,ed918c70,1,0,...) at sleepq_wait+0x48/frame 0xed918c40 _cv_wait(c8c82afc,c8c82cc8,c11b0993,76,c8c82b04,...) at _cv_wait+0x1fe/frame 0xed918c84 usb_process(c8c82af4,ed918ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed918cac fork_exit(c09bc0a0,c8c82af4,ed918ce8) at fork_exit+0x7e/frame 0xed918cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed918cd4 --- trap 0, eip = 0, esp = 0xed918d20, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc8c7d930 sched_switch(c8c7d930,0,104,1af,ed91bbe8,...) at sched_switch+0x4e2/frame 0xed91bbb0 mi_switch(104,0,c11e5b65,200,c8c82cc8,...) at mi_switch+0x1bf/frame 0xed91bbe8 sleepq_switch(c8c7d930,0,c11e5b65,276,c8c82b2c,...) at sleepq_switch+0x1c5/frame 0xed91bc1c sleepq_wait(c8c82b2c,0,ed91bc70,1,0,...) at sleepq_wait+0x48/frame 0xed91bc40 _cv_wait(c8c82b2c,c8c82cc8,c11b0993,76,c8c82b34,...) at _cv_wait+0x1fe/frame 0xed91bc84 usb_process(c8c82b24,ed91bce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed91bcac fork_exit(c09bc0a0,c8c82b24,ed91bce8) at fork_exit+0x7e/frame 0xed91bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed91bcd4 --- trap 0, eip = 0, esp = 0xed91bd20, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc8c7d620 sched_switch(c8c7d620,0,104,1af,ed91ebe8,...) at sched_switch+0x4e2/frame 0xed91ebb0 mi_switch(104,0,c11e5b65,200,c8c82cc8,...) at mi_switch+0x1bf/frame 0xed91ebe8 sleepq_switch(c8c7d620,0,c11e5b65,276,c8c82b5c,...) at sleepq_switch+0x1c5/frame 0xed91ec1c sleepq_wait(c8c82b5c,0,ed91ec70,1,0,...) at sleepq_wait+0x48/frame 0xed91ec40 _cv_wait(c8c82b5c,c8c82cc8,c11b0993,76,c8c82b64,...) at _cv_wait+0x1fe/frame 0xed91ec84 usb_process(c8c82b54,ed91ece8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed91ecac fork_exit(c09bc0a0,c8c82b54,ed91ece8) at fork_exit+0x7e/frame 0xed91ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed91ecd4 --- trap 0, eip = 0, esp = 0xed91ed20, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc8c7d310 sched_switch(c8c7d310,0,104,1af,ed922be8,...) at sched_switch+0x4e2/frame 0xed922bb0 mi_switch(104,0,c11e5b65,200,c8c88cc8,...) at mi_switch+0x1bf/frame 0xed922be8 sleepq_switch(c8c7d310,0,c11e5b65,276,c8c88acc,...) at sleepq_switch+0x1c5/frame 0xed922c1c sleepq_wait(c8c88acc,0,ed922c70,1,0,...) at sleepq_wait+0x48/frame 0xed922c40 _cv_wait(c8c88acc,c8c88cc8,c11b0993,76,c8c88ad4,...) at _cv_wait+0x1fe/frame 0xed922c84 usb_process(c8c88ac4,ed922ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed922cac fork_exit(c09bc0a0,c8c88ac4,ed922ce8) at fork_exit+0x7e/frame 0xed922cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed922cd4 --- trap 0, eip = 0, esp = 0xed922d20, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8c7d000 sched_switch(c8c7d000,0,104,1af,ed925be8,...) at sched_switch+0x4e2/frame 0xed925bb0 mi_switch(104,0,c11e5b65,200,c8c88cc8,...) at mi_switch+0x1bf/frame 0xed925be8 sleepq_switch(c8c7d000,0,c11e5b65,276,c8c88afc,...) at sleepq_switch+0x1c5/frame 0xed925c1c sleepq_wait(c8c88afc,0,ed925c70,1,0,...) at sleepq_wait+0x48/frame 0xed925c40 _cv_wait(c8c88afc,c8c88cc8,c11b0993,76,c8c88b04,...) at _cv_wait+0x1fe/frame 0xed925c84 usb_process(c8c88af4,ed925ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed925cac fork_exit(c09bc0a0,c8c88af4,ed925ce8) at fork_exit+0x7e/frame 0xed925cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed925cd4 --- trap 0, eip = 0, esp = 0xed925d20, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc8be4c40 sched_switch(c8be4c40,0,104,1af,ed928be8,...) at sched_switch+0x4e2/frame 0xed928bb0 mi_switch(104,0,c11e5b65,200,c8c88cc8,...) at mi_switch+0x1bf/frame 0xed928be8 sleepq_switch(c8be4c40,0,c11e5b65,276,c8c88b2c,...) at sleepq_switch+0x1c5/frame 0xed928c1c sleepq_wait(c8c88b2c,0,ed928c70,1,0,...) at sleepq_wait+0x48/frame 0xed928c40 _cv_wait(c8c88b2c,c8c88cc8,c11b0993,76,c8c88b34,...) at _cv_wait+0x1fe/frame 0xed928c84 usb_process(c8c88b24,ed928ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed928cac fork_exit(c09bc0a0,c8c88b24,ed928ce8) at fork_exit+0x7e/frame 0xed928cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed928cd4 --- trap 0, eip = 0, esp = 0xed928d20, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc8c8bc40 sched_switch(c8c8bc40,0,104,1af,ed92bbe8,...) at sched_switch+0x4e2/frame 0xed92bbb0 mi_switch(104,0,c11e5b65,200,c8c88cc8,...) at mi_switch+0x1bf/frame 0xed92bbe8 sleepq_switch(c8c8bc40,0,c11e5b65,276,c8c88b5c,...) at sleepq_switch+0x1c5/frame 0xed92bc1c sleepq_wait(c8c88b5c,0,ed92bc70,1,0,...) at sleepq_wait+0x48/frame 0xed92bc40 _cv_wait(c8c88b5c,c8c88cc8,c11b0993,76,c8c88b64,...) at _cv_wait+0x1fe/frame 0xed92bc84 usb_process(c8c88b54,ed92bce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed92bcac fork_exit(c09bc0a0,c8c88b54,ed92bce8) at fork_exit+0x7e/frame 0xed92bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed92bcd4 --- trap 0, eip = 0, esp = 0xed92bd20, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8c8b620 sched_switch(c8c8b620,0,104,1af,ed934be8,...) at sched_switch+0x4e2/frame 0xed934bb0 mi_switch(104,0,c11e5b65,200,c8c33ea0,...) at mi_switch+0x1bf/frame 0xed934be8 sleepq_switch(c8c8b620,0,c11e5b65,276,c8c33ca4,...) at sleepq_switch+0x1c5/frame 0xed934c1c sleepq_wait(c8c33ca4,0,ed934c70,1,0,...) at sleepq_wait+0x48/frame 0xed934c40 _cv_wait(c8c33ca4,c8c33ea0,c11b0993,76,c8c33cac,...) at _cv_wait+0x1fe/frame 0xed934c84 usb_process(c8c33c9c,ed934ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed934cac fork_exit(c09bc0a0,c8c33c9c,ed934ce8) at fork_exit+0x7e/frame 0xed934cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed934cd4 --- trap 0, eip = 0, esp = 0xed934d20, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc8c8b310 sched_switch(c8c8b310,0,104,1af,ed937be8,...) at sched_switch+0x4e2/frame 0xed937bb0 mi_switch(104,0,c11e5b65,200,c8c33ea0,...) at mi_switch+0x1bf/frame 0xed937be8 sleepq_switch(c8c8b310,0,c11e5b65,276,c8c33cd4,...) at sleepq_switch+0x1c5/frame 0xed937c1c sleepq_wait(c8c33cd4,0,ed937c70,1,0,...) at sleepq_wait+0x48/frame 0xed937c40 _cv_wait(c8c33cd4,c8c33ea0,c11b0993,76,c8c33cdc,...) at _cv_wait+0x1fe/frame 0xed937c84 usb_process(c8c33ccc,ed937ce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed937cac fork_exit(c09bc0a0,c8c33ccc,ed937ce8) at fork_exit+0x7e/frame 0xed937cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed937cd4 --- trap 0, eip = 0, esp = 0xed937d20, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc8c8b000 sched_switch(c8c8b000,0,104,1af,ed93abe8,...) at sched_switch+0x4e2/frame 0xed93abb0 mi_switch(104,0,c11e5b65,200,c8c33ea0,...) at mi_switch+0x1bf/frame 0xed93abe8 sleepq_switch(c8c8b000,0,c11e5b65,276,c8c33d04,...) at sleepq_switch+0x1c5/frame 0xed93ac1c sleepq_wait(c8c33d04,0,ed93ac70,1,0,...) at sleepq_wait+0x48/frame 0xed93ac40 _cv_wait(c8c33d04,c8c33ea0,c11b0993,76,c8c33d0c,...) at _cv_wait+0x1fe/frame 0xed93ac84 usb_process(c8c33cfc,ed93ace8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed93acac fork_exit(c09bc0a0,c8c33cfc,ed93ace8) at fork_exit+0x7e/frame 0xed93acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed93acd4 --- trap 0, eip = 0, esp = 0xed93ad20, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc8c8ac40 sched_switch(c8c8ac40,0,104,1af,ed93dbe8,...) at sched_switch+0x4e2/frame 0xed93dbb0 mi_switch(104,0,c11e5b65,200,c8c33ea0,...) at mi_switch+0x1bf/frame 0xed93dbe8 sleepq_switch(c8c8ac40,0,c11e5b65,276,c8c33d34,...) at sleepq_switch+0x1c5/frame 0xed93dc1c sleepq_wait(c8c33d34,0,ed93dc70,1,0,...) at sleepq_wait+0x48/frame 0xed93dc40 _cv_wait(c8c33d34,c8c33ea0,c11b0993,76,c8c33d3c,...) at _cv_wait+0x1fe/frame 0xed93dc84 usb_process(c8c33d2c,ed93dce8,c11d881c,3dc,0,...) at usb_process+0x140/frame 0xed93dcac fork_exit(c09bc0a0,c8c33d2c,ed93dce8) at fork_exit+0x7e/frame 0xed93dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed93dcd4 --- trap 0, eip = 0, esp = 0xed93dd20, ebp = 0 --- Tracing command cam pid 2 tid 100026 td 0xc8a3c930 sched_switch(c8a3c930,0,104,1af,e4781ba4,...) at sched_switch+0x4e2/frame 0xe4781b6c mi_switch(104,0,c11e5b65,200,c1494b00,...) at mi_switch+0x1bf/frame 0xe4781ba4 sleepq_switch(c8a3c930,0,c11e5b65,276,c8a3c930,...) at sleepq_switch+0x1c5/frame 0xe4781bd8 sleepq_wait(c1494b80,5c,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe4781bfc _sleep(c1494b80,c1494b00,5c,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe4781c58 xpt_done_td(c1494b00,e4781ce8,c11d881c,3dc,0,...) at xpt_done_td+0x17e/frame 0xe4781cac fork_exit(c04c7fa0,c1494b00,e4781ce8) at fork_exit+0x7e/frame 0xe4781cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4781cd4 --- trap 0, eip = 0, esp = 0xe4781d20, ebp = 0 --- Tracing command cam pid 2 tid 100068 td 0xc8efe000 sched_switch(c8efe000,0,104,1af,ed977ba4,...) at sched_switch+0x4e2/frame 0xed977b6c mi_switch(104,0,c11e5b65,200,c1494a7c,...) at mi_switch+0x1bf/frame 0xed977ba4 sleepq_switch(c8efe000,0,c11e5b65,276,c8efe000,...) at sleepq_switch+0x1c5/frame 0xed977bd8 sleepq_wait(c1494a2c,5c,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xed977bfc _sleep(c1494a2c,c1494a7c,5c,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xed977c58 xpt_scanner_thread(0,ed977ce8,c11d881c,3dc,0,...) at xpt_scanner_thread+0xa2/frame 0xed977cac fork_exit(c04c8360,0,ed977ce8) at fork_exit+0x7e/frame 0xed977cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed977cd4 --- trap 0, eip = 0, esp = 0xed977d20, ebp = 0 --- Tracing command rand_harvestq pid 14 tid 100017 td 0xc8aee620 sched_switch(c8aee620,0,104,1af,e4766bc8,...) at sched_switch+0x4e2/frame 0xe4766b90 mi_switch(104,0,c11e5b65,200,5,...) at mi_switch+0x1bf/frame 0xe4766bc8 sleepq_switch(c8aee620,0,c11e5b65,299,c8aee620,...) at sleepq_switch+0x1c5/frame 0xe4766bfc sleepq_timedwait(c14af770,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe4766c20 _sleep(c14af770,0,0,c11ca6e6,19999999,...) at _sleep+0x33d/frame 0xe4766c7c random_kthread(0,e4766ce8,c11d881c,3dc,0,...) at random_kthread+0x5c/frame 0xe4766cac fork_exit(c089ae90,0,e4766ce8) at fork_exit+0x7e/frame 0xe4766cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4766cd4 --- trap 0, eip = 0, esp = 0xe4766d20, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc8a35000 sched_switch(c8a35000,0,104,1af,e475abbc,...) at sched_switch+0x4e2/frame 0xe475ab84 mi_switch(104,0,c11e5b65,200,c155b65c,...) at mi_switch+0x1bf/frame 0xe475abbc sleepq_switch(c8a35000,0,c11e5b65,276,c8a35000,...) at sleepq_switch+0x1c5/frame 0xe475abf0 sleepq_wait(c1631620,5c,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe475ac14 _sleep(c1631620,c155b65c,25c,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe475ac70 g_run_events(0,e475ace8,c11d881c,3dc,0,...) at g_run_events+0x67/frame 0xe475acac fork_exit(c0ab38d0,0,e475ace8) at fork_exit+0x7e/frame 0xe475acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe475acd4 --- trap 0, eip = 0, esp = 0xe475ad20, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc8aef000 sched_switch(c8aef000,0,104,1af,e475dbac,...) at sched_switch+0x4e2/frame 0xe475db74 mi_switch(104,0,c11e5b65,200,c155b6a4,...) at mi_switch+0x1bf/frame 0xe475dbac sleepq_switch(c8aef000,0,c11e5b65,276,c8aef000,...) at sleepq_switch+0x1c5/frame 0xe475dbe0 sleepq_wait(c1631624,5c,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe475dc04 _sleep(c1631624,c155b6a4,25c,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe475dc60 g_io_schedule_up(c8aef000,0,c11cc4bd,60,e475dcd4,...) at g_io_schedule_up+0x12a/frame 0xe475dc94 g_up_procbody(0,e475dce8,c11d881c,3dc,0,...) at g_up_procbody+0x9d/frame 0xe475dcac fork_exit(c0ab3970,0,e475dce8) at fork_exit+0x7e/frame 0xe475dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe475dcd4 --- trap 0, eip = 0, esp = 0xe475dd20, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc8aeec40 sched_switch(c8aeec40,0,104,1af,e4760ba8,...) at sched_switch+0x4e2/frame 0xe4760b70 mi_switch(104,0,c11e5b65,200,c155b684,...) at mi_switch+0x1bf/frame 0xe4760ba8 sleepq_switch(c8aeec40,0,c11e5b65,276,c8aeec40,...) at sleepq_switch+0x1c5/frame 0xe4760bdc sleepq_wait(c1631628,5c,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe4760c00 _sleep(c1631628,c155b684,25c,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe4760c5c g_io_schedule_down(c8aeec40,0,c11cc4bd,6d,e4760cd4,...) at g_io_schedule_down+0x16c/frame 0xe4760c94 g_down_procbody(0,e4760ce8,c11d881c,3dc,0,...) at g_down_procbody+0x9d/frame 0xe4760cac fork_exit(c0ab3a10,0,e4760ce8) at fork_exit+0x7e/frame 0xe4760cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4760cd4 --- trap 0, eip = 0, esp = 0xe4760d20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc8a3b310 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc8a3b000 sched_switch(c8a3b000,0,109,1af,c1632b00,...) at sched_switch+0x4e2/frame 0xe474bc3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xe474bc74 ithread_loop(c88dff90,e474bce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe474bcac fork_exit(c0b2c8c0,c88dff90,e474bce8) at fork_exit+0x7e/frame 0xe474bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe474bcd4 --- trap 0, eip = 0, esp = 0xe474bd20, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc8a35c40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc8a35930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc8a35620 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc8a35310 sched_switch(c8a35310,0,109,1af,c1c25880,...) at sched_switch+0x4e2/frame 0xe4757c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xe4757c74 ithread_loop(c88dff50,e4757ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4757cac fork_exit(c0b2c8c0,c88dff50,e4757ce8) at fork_exit+0x7e/frame 0xe4757cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4757cd4 --- trap 0, eip = 0, esp = 0xe4757d20, ebp = 0 --- Tracing command intr pid 12 tid 100018 td 0xc8aee310 sched_switch(c8aee310,0,109,1af,c1631fd0,...) at sched_switch+0x4e2/frame 0xe4769c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xe4769c74 ithread_loop(c88dff10,e4769ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4769cac fork_exit(c0b2c8c0,c88dff10,e4769ce8) at fork_exit+0x7e/frame 0xe4769cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4769cd4 --- trap 0, eip = 0, esp = 0xe4769d20, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc8aed930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xc8be4930 sched_switch(c8be4930,0,109,1af,c15aae80,...) at sched_switch+0x4e2/frame 0xe4784c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xe4784c74 ithread_loop(c88dfe90,e4784ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4784cac fork_exit(c0b2c8c0,c88dfe90,e4784ce8) at fork_exit+0x7e/frame 0xe4784cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4784cd4 --- trap 0, eip = 0, esp = 0xe4784d20, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc8be4620 sched_switch(c8be4620,0,109,1af,c15ac4d8,...) at sched_switch+0x4e2/frame 0xe47b6c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xe47b6c74 ithread_loop(c88dfe40,e47b6ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe47b6cac fork_exit(c0b2c8c0,c88dfe40,e47b6ce8) at fork_exit+0x7e/frame 0xe47b6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe47b6cd4 --- trap 0, eip = 0, esp = 0xe47b6d20, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc8be4310 sched_switch(c8be4310,0,109,1af,c8c1a000,...) at sched_switch+0x4e2/frame 0xf0ebfc3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xf0ebfc74 ithread_loop(c88dfda0,f0ebfce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xf0ebfcac fork_exit(c0b2c8c0,c88dfda0,f0ebfce8) at fork_exit+0x7e/frame 0xf0ebfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ebfcd4 --- trap 0, eip = 0, esp = 0xf0ebfd20, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc8be4000 sched_switch(c8be4000,0,109,1af,c1643434,...) at sched_switch+0x4e2/frame 0xf0ec3c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xf0ec3c74 ithread_loop(c88dfd90,f0ec3ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xf0ec3cac fork_exit(c0b2c8c0,c88dfd90,f0ec3ce8) at fork_exit+0x7e/frame 0xf0ec3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ec3cd4 --- trap 0, eip = 0, esp = 0xf0ec3d20, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8be3c40 sched_switch(c8be3c40,0,109,1af,c15ac480,...) at sched_switch+0x4e2/frame 0xed8e5c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xed8e5c74 ithread_loop(c88dfc20,ed8e5ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed8e5cac fork_exit(c0b2c8c0,c88dfc20,ed8e5ce8) at fork_exit+0x7e/frame 0xed8e5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8e5cd4 --- trap 0, eip = 0, esp = 0xed8e5d20, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8aefc40 sched_switch(c8aefc40,0,109,1af,c15ab820,...) at sched_switch+0x4e2/frame 0xed8f5c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xed8f5c74 ithread_loop(c88dfbe0,ed8f5ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed8f5cac fork_exit(c0b2c8c0,c88dfbe0,ed8f5ce8) at fork_exit+0x7e/frame 0xed8f5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f5cd4 --- trap 0, eip = 0, esp = 0xed8f5d20, ebp = 0 --- Tracing command intr pid 12 tid 100041 td 0xc8c7f000 sched_switch(c8c7f000,0,109,1af,c15ab7c8,...) at sched_switch+0x4e2/frame 0xed905c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xed905c74 ithread_loop(c88dfba0,ed905ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed905cac fork_exit(c0b2c8c0,c88dfba0,ed905ce8) at fork_exit+0x7e/frame 0xed905cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed905cd4 --- trap 0, eip = 0, esp = 0xed905d20, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8c8b930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xc8c8a930 sched_switch(c8c8a930,0,109,1af,c1643434,...) at sched_switch+0x4e2/frame 0xed943c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xed943c74 ithread_loop(c88dfaa0,ed943ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed943cac fork_exit(c0b2c8c0,c88dfaa0,ed943ce8) at fork_exit+0x7e/frame 0xed943cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed943cd4 --- trap 0, eip = 0, esp = 0xed943d20, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8c8a620 sched_switch(c8c8a620,0,109,1af,c1631fd0,...) at sched_switch+0x4e2/frame 0xed954c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xed954c74 ithread_loop(c88df9a0,ed954ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed954cac fork_exit(c0b2c8c0,c88df9a0,ed954ce8) at fork_exit+0x7e/frame 0xed954cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed954cd4 --- trap 0, eip = 0, esp = 0xed954d20, ebp = 0 --- Tracing command intr pid 12 tid 100062 td 0xc8c8a000 sched_switch(c8c8a000,0,109,1af,c15ab248,...) at sched_switch+0x4e2/frame 0xed964c3c mi_switch(109,0,c11d8a8d,544,8,...) at mi_switch+0x1bf/frame 0xed964c74 ithread_loop(c88df980,ed964ce8,c11d881c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed964cac fork_exit(c0b2c8c0,c88df980,ed964ce8) at fork_exit+0x7e/frame 0xed964cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed964cd4 --- trap 0, eip = 0, esp = 0xed964d20, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc8c7fc40 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xc8a3c000 sched_switch(c8a3c000,0,608,1aa,791480,...) at sched_switch+0x4e2/frame 0xe473bbdc mi_switch(608,0,c11df9c0,d3,d,...) at mi_switch+0x1bf/frame 0xe473bc14 critical_exit(0,e473bc80,c11e1bc2,a48,c156ad88,...) at critical_exit+0xa2/frame 0xe473bc30 sched_idletd(0,e473bce8,c11d881c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe473bcac fork_exit(c0b8b880,0,e473bce8) at fork_exit+0x7e/frame 0xe473bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe473bcd4 --- trap 0, eip = 0, esp = 0xe473bd20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc8a3bc40 cpustop_handler(1,13,e473eb74,c105d047,c156bb00,...) at cpustop_handler+0x25/frame 0xe473ea28 ipi_nmi_handler(c156bb00,8,e473ea74,c0b487c8,c156bb00,...) at ipi_nmi_handler+0x36/frame 0xe473ea38 trap(e473eb80) at trap+0x37/frame 0xe473eb74 calltrap() at calltrap+0x6/frame 0xe473eb74 --- trap 0x13, eip = 0xc10453d5, esp = 0xe473ebc0, ebp = 0xe473ebc0 --- acpi_cpu_c1(e472bc90,0,c13a2b63,2ec,b647,...) at acpi_cpu_c1+0x5/frame 0xe473ebc0 acpi_cpu_idle(20179743,0,20179743,e473ec30,c107659d,...) at acpi_cpu_idle+0x166/frame 0xe473ec00 cpu_idle_acpi(20179743,0,d,c156b488,c156b484,...) at cpu_idle_acpi+0x3f/frame 0xe473ec14 cpu_idle(0,e473ec80,c11e1bc2,a48,c156b488,...) at cpu_idle+0x9d/frame 0xe473ec30 sched_idletd(0,e473ece8,c11d881c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe473ecac fork_exit(c0b8b880,0,e473ece8) at fork_exit+0x7e/frame 0xe473ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe473ecd4 --- trap 0, eip = 0, esp = 0xe473ed20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc8a3b930 sched_switch(c8a3b930,0,608,1aa,2329a480,...) at sched_switch+0x4e2/frame 0xe4741bdc mi_switch(608,0,c11df9c0,d3,13,...) at mi_switch+0x1bf/frame 0xe4741c14 critical_exit(0,e4741c80,c11e1bc2,a48,c156bb88,...) at critical_exit+0xa2/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d881c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b880,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc8a3b620 sched_switch(c8a3b620,0,608,1aa,2329d480,...) at sched_switch+0x4e2/frame 0xe4744bdc mi_switch(608,0,c11df9c0,d3,1e,...) at mi_switch+0x1bf/frame 0xe4744c14 critical_exit(0,e4744c80,c11e1bc2,a48,c156c288,...) at critical_exit+0xa2/frame 0xe4744c30 sched_idletd(0,e4744ce8,c11d881c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4744cac fork_exit(c0b8b880,0,e4744ce8) at fork_exit+0x7e/frame 0xe4744cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4744cd4 --- trap 0, eip = 0, esp = 0xe4744d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc8a3c310 sched_switch(c8a3c310,0,104,1af,e47379a0,...) at sched_switch+0x4e2/frame 0xe4737968 mi_switch(104,0,c11e5b65,200,c88cf05c,...) at mi_switch+0x1bf/frame 0xe47379a0 sleepq_switch(c8a3c310,0,c11e5b65,1b6,c11e5b65,...) at sleepq_switch+0x1c5/frame 0xe47379d4 sleepq_catch_signals(c11e5b65,16d,c8a33a78,1758,c8a3c310,...) at sleepq_catch_signals+0x382/frame 0xe4737a10 sleepq_wait_sig(c8a339c0,6c,c11e98fd,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4737a34 _sleep(c8a339c0,c8a33a68,16c,c11e98fd,0,...) at _sleep+0x356/frame 0xe4737a90 kern_wait6(c8a3c310,7,0,0,e4737b24,...) at kern_wait6+0x45b/frame 0xe4737af8 sys_wait4(c8a3c310,e4737ca8,c11d843d,4,c156bb10,...) at sys_wait4+0x8b/frame 0xe4737c18 syscall(e4737ce8) at syscall+0x34a/frame 0xe4737cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xe4737cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80653ef, esp = 0xbfbfe904, ebp = 0xbfbfe918 --- Tracing command audit pid 10 tid 100001 td 0xc8a3c620 sched_switch(c8a3c620,0,104,1af,e4734bbc,...) at sched_switch+0x4e2/frame 0xe4734b84 mi_switch(104,0,c11e5b65,200,c163835c,...) at mi_switch+0x1bf/frame 0xe4734bbc sleepq_switch(c8a3c620,0,c11e5b65,276,c16383d0,...) at sleepq_switch+0x1c5/frame 0xe4734bf0 sleepq_wait(c16383d0,0,e4734c44,1,0,...) at sleepq_wait+0x48/frame 0xe4734c14 _cv_wait(c16383d0,c163835c,c1212b96,18d,0,...) at _cv_wait+0x1fe/frame 0xe4734c58 audit_worker(0,e4734ce8,c11d881c,3dc,0,...) at audit_worker+0x94/frame 0xe4734cac fork_exit(c0da4d30,0,e4734ce8) at fork_exit+0x7e/frame 0xe4734cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4734cd4 --- trap 0, eip = 0, esp = 0xe4734d20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1631990 sched_switch(c1631990,0,104,1af,c1c20c3c,...) at sched_switch+0x4e2/frame 0xc1c20c04 mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xc1c20c3c sleepq_switch(c1631990,0,c11e5b65,299,c1631990,...) at sleepq_switch+0x1c5/frame 0xc1c20c70 sleepq_timedwait(c1631644,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1c20c94 _sleep(c1631644,0,54,c121ed62,fffff470,...) at _sleep+0x33d/frame 0xc1c20cf0 swapper() at swapper+0x2c6/frame 0xc1c20d38 begin() at begin+0x22 Tracing command kernel pid 0 tid 100016 td 0xc8aee930 sched_switch(c8aee930,0,104,1af,e4763bc0,...) at sched_switch+0x4e2/frame 0xe4763b88 mi_switch(104,0,c11e5b65,200,c8a38198,...) at mi_switch+0x1bf/frame 0xe4763bc0 sleepq_switch(c8aee930,0,c11e5b65,276,c8aee930,...) at sleepq_switch+0x1c5/frame 0xe4763bf4 sleepq_wait(c8a38180,0,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe4763c18 _sleep(c8a38180,c8a38198,0,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe4763c74 taskqueue_thread_loop(c1578e44,e4763ce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe4763cac fork_exit(c0bb4280,c1578e44,e4763ce8) at fork_exit+0x7e/frame 0xe4763cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4763cd4 --- trap 0, eip = 0, esp = 0xe4763d20, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc8aee000 sched_switch(c8aee000,0,104,1af,e476cbc0,...) at sched_switch+0x4e2/frame 0xe476cb88 mi_switch(104,0,c11e5b65,200,c8a38018,...) at mi_switch+0x1bf/frame 0xe476cbc0 sleepq_switch(c8aee000,0,c11e5b65,276,c8aee000,...) at sleepq_switch+0x1c5/frame 0xe476cbf4 sleepq_wait(c8a38000,0,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe476cc18 _sleep(c8a38000,c8a38018,0,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe476cc74 taskqueue_thread_loop(c1638404,e476cce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe476ccac fork_exit(c0bb4280,c1638404,e476cce8) at fork_exit+0x7e/frame 0xe476ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe476ccd4 --- trap 0, eip = 0, esp = 0xe476cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc8aedc40 sched_switch(c8aedc40,0,104,1af,e476fbc0,...) at sched_switch+0x4e2/frame 0xe476fb88 mi_switch(104,0,c11e5b65,200,c8a37f18,...) at mi_switch+0x1bf/frame 0xe476fbc0 sleepq_switch(c8aedc40,0,c11e5b65,276,c8aedc40,...) at sleepq_switch+0x1c5/frame 0xe476fbf4 sleepq_wait(c8a37f00,0,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe476fc18 _sleep(c8a37f00,c8a37f18,0,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe476fc74 taskqueue_thread_loop(c1635d10,e476fce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe476fcac fork_exit(c0bb4280,c1635d10,e476fce8) at fork_exit+0x7e/frame 0xe476fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe476fcd4 --- trap 0, eip = 0, esp = 0xe476fd20, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8aed620 sched_switch(c8aed620,0,104,1af,e4775bc0,...) at sched_switch+0x4e2/frame 0xe4775b88 mi_switch(104,0,c11e5b65,200,c8a37d98,...) at mi_switch+0x1bf/frame 0xe4775bc0 sleepq_switch(c8aed620,0,c11e5b65,276,c8aed620,...) at sleepq_switch+0x1c5/frame 0xe4775bf4 sleepq_wait(c8a37d80,0,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xe4775c18 _sleep(c8a37d80,c8a37d98,0,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xe4775c74 taskqueue_thread_loop(c1631e98,e4775ce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe4775cac fork_exit(c0bb4280,c1631e98,e4775ce8) at fork_exit+0x7e/frame 0xe4775cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4775cd4 --- trap 0, eip = 0, esp = 0xe4775d20, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc8aed310 sched_switch(c8aed310,0,104,1af,e4778bd4,...) at sched_switch+0x4e2/frame 0xe4778b9c mi_switch(104,0,c11e5b65,200,c157a344,...) at mi_switch+0x1bf/frame 0xe4778bd4 sleepq_switch(c8aed310,0,c11e5b65,276,c8a37d00,...) at sleepq_switch+0x1c5/frame 0xe4778c08 sleepq_wait(c8a37d00,0,c11dff1a,c11ca6e6,0,...) at sleepq_wait+0x48/frame 0xe4778c2c msleep_spin_sbt(c8a37d00,c8a37d18,c11ca6e6,0,0,...) at msleep_spin_sbt+0x241/frame 0xe4778c74 taskqueue_thread_loop(c1628978,e4778ce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4778cac fork_exit(c0bb4280,c1628978,e4778ce8) at fork_exit+0x7e/frame 0xe4778cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4778cd4 --- trap 0, eip = 0, esp = 0xe4778d20, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc8aed000 sched_switch(c8aed000,0,104,1af,e477bbd4,...) at sched_switch+0x4e2/frame 0xe477bb9c mi_switch(104,0,c11e5b65,200,c157a344,...) at mi_switch+0x1bf/frame 0xe477bbd4 sleepq_switch(c8aed000,0,c11e5b65,276,c8a37d00,...) at sleepq_switch+0x1c5/frame 0xe477bc08 sleepq_wait(c8a37d00,0,c11dff1a,c11ca6e6,0,...) at sleepq_wait+0x48/frame 0xe477bc2c msleep_spin_sbt(c8a37d00,c8a37d18,c11ca6e6,0,0,...) at msleep_spin_sbt+0x241/frame 0xe477bc74 taskqueue_thread_loop(c1628978,e477bce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe477bcac fork_exit(c0bb4280,c1628978,e477bce8) at fork_exit+0x7e/frame 0xe477bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe477bcd4 --- trap 0, eip = 0, esp = 0xe477bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc8a3cc40 sched_switch(c8a3cc40,0,104,1af,e477ebd4,...) at sched_switch+0x4e2/frame 0xe477eb9c mi_switch(104,0,c11e5b65,200,c157a344,...) at mi_switch+0x1bf/frame 0xe477ebd4 sleepq_switch(c8a3cc40,0,c11e5b65,276,c8a37d00,...) at sleepq_switch+0x1c5/frame 0xe477ec08 sleepq_wait(c8a37d00,0,c11dff1a,c11ca6e6,0,...) at sleepq_wait+0x48/frame 0xe477ec2c msleep_spin_sbt(c8a37d00,c8a37d18,c11ca6e6,0,0,...) at msleep_spin_sbt+0x241/frame 0xe477ec74 taskqueue_thread_loop(c1628978,e477ece8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe477ecac fork_exit(c0bb4280,c1628978,e477ece8) at fork_exit+0x7e/frame 0xe477ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe477ecd4 --- trap 0, eip = 0, esp = 0xe477ed20, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc8c7f930 sched_switch(c8c7f930,0,104,1af,ed96abd4,...) at sched_switch+0x4e2/frame 0xed96ab9c mi_switch(104,0,c11e5b65,200,c157a464,...) at mi_switch+0x1bf/frame 0xed96abd4 sleepq_switch(c8c7f930,0,c11e5b65,276,c8cb8900,...) at sleepq_switch+0x1c5/frame 0xed96ac08 sleepq_wait(c8cb8900,0,c11dff1a,c11ca6e6,0,...) at sleepq_wait+0x48/frame 0xed96ac2c msleep_spin_sbt(c8cb8900,c8cb8918,c11ca6e6,0,0,...) at msleep_spin_sbt+0x241/frame 0xed96ac74 taskqueue_thread_loop(c1626e14,ed96ace8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xed96acac fork_exit(c0bb4280,c1626e14,ed96ace8) at fork_exit+0x7e/frame 0xed96acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed96acd4 --- trap 0, eip = 0, esp = 0xed96ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc8c7f620 sched_switch(c8c7f620,0,104,1af,ed96db80,...) at sched_switch+0x4e2/frame 0xed96db48 mi_switch(104,0,c11e5b65,200,101,...) at mi_switch+0x1bf/frame 0xed96db80 sleepq_switch(c8c7f620,0,c11e5b65,299,c8c7f620,...) at sleepq_switch+0x1c5/frame 0xed96dbb4 sleepq_timedwait(c155d9ec,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xed96dbd8 _sleep(c155d9ec,0,0,c11ca6e6,fffffc88,...) at _sleep+0x33d/frame 0xed96dc34 pause_sbt(c11ca6e6,fffffc88,2,0,0,...) at pause_sbt+0x112/frame 0xed96dc70 deadlkres(0,ed96dce8,c11d881c,3dc,0,...) at deadlkres+0x81/frame 0xed96dcac fork_exit(c0b07750,0,ed96dce8) at fork_exit+0x7e/frame 0xed96dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed96dcd4 --- trap 0, eip = 0, esp = 0xed96dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xc8efe310 sched_switch(c8efe310,0,104,1af,ed974bc0,...) at sched_switch+0x4e2/frame 0xed974b88 mi_switch(104,0,c11e5b65,200,c8a37c98,...) at mi_switch+0x1bf/frame 0xed974bc0 sleepq_switch(c8efe310,0,c11e5b65,276,c8efe310,...) at sleepq_switch+0x1c5/frame 0xed974bf4 sleepq_wait(c8a37c80,0,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xed974c18 _sleep(c8a37c80,c8a37c98,0,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xed974c74 taskqueue_thread_loop(c1494aa4,ed974ce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xed974cac fork_exit(c0bb4280,c1494aa4,ed974ce8) at fork_exit+0x7e/frame 0xed974cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed974cd4 --- trap 0, eip = 0, esp = 0xed974d20, ebp = 0 --- Tracing command kernel pid 0 tid 101101 td 0xcbcac930 sched_switch(cbcac930,0,104,1af,c81d8bc0,...) at sched_switch+0x4e2/frame 0xc81d8b88 mi_switch(104,0,c11e5b65,200,cbccfe18,...) at mi_switch+0x1bf/frame 0xc81d8bc0 sleepq_switch(cbcac930,0,c11e5b65,276,cbcac930,...) at sleepq_switch+0x1c5/frame 0xc81d8bf4 sleepq_wait(cbccfe00,0,c11ca6e6,0,0,...) at sleepq_wait+0x48/frame 0xc81d8c18 _sleep(cbccfe00,cbccfe18,0,c11ca6e6,0,...) at _sleep+0x3a1/frame 0xc81d8c74 taskqueue_thread_loop(cbb99b80,c81d8ce8,c11d881c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xc81d8cac fork_exit(c0bb4280,cbb99b80,c81d8ce8) at fork_exit+0x7e/frame 0xc81d8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc81d8cd4 --- trap 0, eip = 0, esp = 0xc81d8d20, ebp = 0 --- db:0:allt> call doadump Physical memory: 3431 MB Dumping 564 MB: 549 533 517 501 485 469 453 437 421 405 389 373 357 341 325 309 293 277 261 245 229 213 197 181 165 149 133 117 101 85 69 53 37 21 5 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:233 #1 0xc0530fcd in db_fncall (dummy1=0x0, dummy2=0x0, dummy3=0x0, dummy4=0xfee75008 "óÿÿÿ\200\035D") at ../../../ddb/db_command.c:568 #2 0xc0530d9f in db_command (cmd_table=) at ../../../ddb/db_command.c:440 #3 0xc0534ca8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc0530d9f in db_command (cmd_table=) at ../../../ddb/db_command.c:440 #5 0xc05309e0 in db_command_loop () at ../../../ddb/db_command.c:493 #6 0xc053337b in db_trap (code=) at ../../../ddb/db_main.c:251 #7 0xc0b9e3e7 in kdb_trap (tf=) at ../../../kern/subr_kdb.c:654 #8 0xc105d88f in trap (frame=) at ../../../i386/i386/trap.c:693 #9 0xc10497bc in calltrap () at ../../../i386/i386/exception.s:169 #10 0xc0b9dc7d in kdb_enter (why=0xc11df27d "panic", msg=) at cpufunc.h:71 #11 0xc0b5fb07 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:739 #12 0xc0b5fb4b in panic (fmt=0xc11dae07 "%s: recursing on non recursive lockmgr %s @ %s:%d\n") at ../../../kern/kern_shutdown.c:675 #13 0xc0b3f2c7 in __lockmgr_args (lk=0xe45062b8, flags=, ilk=0xdd4dd620, wmesg=, pri=, timo=, file=, line=0x0) at ../../../kern/kern_lock.c:781 #14 0xc0df8df9 in ffs_syncvnode (vp=0xfee75570, flags=) at lockmgr.h:107 #15 0xc0df7f86 in ffs_fsync (ap=0xfee75618) at ../../../ufs/ffs/ffs_vnops.c:190 #16 0xc108d3bf in VOP_FSYNC_APV (vop=, a=0xfee75618) at vnode_if.c:1328 #17 0xc0c01407 in getnewbuf (maxsize=, gbflags=) at vnode_if.h:549 #18 0xc0bfdbaa in getblk (vp=0xfee756b0, blkno=0xffffffffffffdff3, size=, slpflag=, flags=) at ../../../kern/vfs_bio.c:3245 #19 0xc0dfb4e7 in ufs_bmaparray (vp=, bn=, bnp=, nbp=, runp=, runb=) at ../../../ufs/ufs/ufs_bmap.c:215 #20 0xc0dfb168 in ufs_bmap (ap=0xfee757f8) at ../../../ufs/ufs/ufs_bmap.c:84 #21 0xc108ec05 in VOP_BMAP_APV (vop=, a=0xfee757f8) at vnode_if.c:2207 #22 0xc0bff117 in bdwrite (bp=0xe4506268) at vnode_if.h:917 #23 0xc0df7cb1 in ffs_write (ap=0xfee7585c) at ../../../ufs/ffs/ffs_vnops.c:820 #24 0xc108ca4c in VOP_WRITE_APV (vop=, a=0xfee759b0) at vnode_if.c:997 #25 0xc0c2f828 in vn_write (fp=0xdc5565b0, uio=0xfee75be8, active_cred=, flags=, td=) at vnode_if.h:413 #26 0xc0c2fa54 in vn_io_fault_doio (args=0x0, uio=0x0, td=) at ../../../kern/vfs_vnops.c:1003 #27 0xc0c2cead in vn_io_fault1 () at ../../../kern/vfs_vnops.c:1059 #28 0xc0c2b2ba in vn_io_fault (fp=, uio=0xfee75be8, active_cred=, flags=) at ../../../kern/vfs_vnops.c:1164 #29 0xc0bc4ea0 in dofilewrite (td=0xdd4dd620, fd=0x3, fp=, auio=0xfee75be8, offset=0xffffffffffffffff, flags=0x0) at file.h:304 #30 0xc0bc4b63 in kern_writev (td=0xdd4dd620, fd=0x3, auio=) at ../../../kern/sys_generic.c:485 #31 0xc0bc4ac9 in sys_write (td=, uap=) at ../../../kern/sys_generic.c:398 #32 0xc105e5aa in syscall (frame=) at subr_syscall.c:133 #33 0xc1049851 in Xint0x80_syscall () at ../../../i386/i386/exception.s:269 #34 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xc0b3f2c7 in __lockmgr_args (lk=0xe45062b8, flags=, ilk=0xdd4dd620, wmesg=, pri=, timo=, file=, line=0x0) at ../../../kern/kern_lock.c:781 781 panic("%s: recursing on non recursive lockmgr %s @ %s:%d\n", (kgdb) p *lk $1 = {lock_object = {lo_name = 0xc11ee286 "bufwait", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xc8587140}, lk_lock = 0xdd4dd620, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x10, pcs = 0xe45062dc}} (kgdb) f 14 #14 0xc0df8df9 in ffs_syncvnode (vp=0xfee75570, flags=) at lockmgr.h:107 107 return (__lockmgr_args(lk, flags, (ilk != NULL) ? &ilk->lock_object : (kgdb) p *vp $2 = {v_tag = 0x1
, v_op = 0x0, v_data = 0xc15d6c10, v_mount = 0xc147bdb0, v_nmntvnodes = {tqe_next = 0xfee75618, tqe_prev = 0xfee7561c}, v_un = {vu_mount = 0xfee755b8, vu_socket = 0xfee755b8, vu_cdev = 0xfee755b8, vu_fifoinfo = 0xfee755b8}, v_hashlist = { le_next = 0xc108d3bf, le_prev = 0xfee75618}, v_cache_src = {lh_first = 0xc13abac8}, v_cache_dst = {tqh_first = 0x8, tqh_last = 0xc11ee2b0}, v_cache_dd = 0xc148f0e4, v_lock = {lock_object = {lo_name = 0xda74ae10 "©ß\034Á°½GÁ¸û%Ú°»cÝØ\231,Ù¸\\\022Ù", lo_flags = 0x0, lo_data = 0xda74ae10, lo_witness = 0x1}, lk_lock = 0xfffbfff7, lk_exslpfail = 0xfee7563c, lk_timo = 0xc0c01407, lk_pri = 0xc147bdb0, lk_stack = {depth = 0xfee75618, pcs = 0xfee755c8}}, v_interlock = {lock_object = {lo_name = 0xc11eee13 "nbufbs", lo_flags = 0x8, lo_data = 0xc149047c, lo_witness = 0xda74ae10}, mtx_lock = 0x1}, v_vnlock = 0xdd4dd620, v_actfreelist = {tqe_next = 0xffffffff, tqe_prev = 0xdd4dd620}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0x10000
, lo_flags = 0xda74ae10, lo_data = 0x0, lo_witness = 0xfee756b0}, rw_lock = 0xc0bfdbaa}, bo_ops = 0x0, bo_object = 0x10000, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0x0, __bo_vnode = 0x0, bo_clean = {bv_hd = { tqh_first = 0xffff1ff4, tqh_last = 0x2000}, bv_root = {pt_root = 0xfee756b0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xccfa, tqh_last = 0x0}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0xc8cec3c0, bo_flag = 0x2, bo_bsize = 0xffff}, v_pollinfo = 0xda74aed0, v_label = 0x60, v_lockf = 0xdff30000, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xda74aee0}, rl_currdep = 0xd8debea0}, v_cstart = 0xfee7572400000001, v_lasta = 0xffffdff3ffffffff, v_lastw = 0xc0dfb4e7fee75758, v_clen = 0xda74ae10, v_holdcnt = 0xffffdff3, v_usecount = 0xffffffff, v_iflag = 0x10000, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x0, v_type = 3368993728} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/kern/kern_malloc.c =================================================================== --- /usr/src/sys/kern/kern_malloc.c (revision 281981) +++ /usr/src/sys/kern/kern_malloc.c (working copy) @@ -672,6 +672,7 @@ static void kmem_reclaim(vmem_t *vm, int flags) { + uma_reclaim_needed = 1; pagedaemon_wakeup(); } Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 281981) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -158,6 +158,7 @@ int vm_pages_needed; /* Event on which pageout da int vm_pageout_deficit; /* Estimated number of pages deficit */ int vm_pageout_pages_needed; /* flag saying that the pageout daemon needs pages */ int vm_pageout_wakeup_thresh; +int uma_reclaim_needed; #if !defined(NO_SWAPPING) static int vm_pageout_req_swapout; /* XXX */ @@ -687,6 +688,7 @@ vm_pageout_grow_cache(int tries, vm_paddr_t low, v * We do this explicitly after the caches have been drained * above. */ + uma_reclaim_needed = 0; uma_reclaim(); } @@ -1048,6 +1050,7 @@ vm_pageout_scan(struct vm_domain *vmd, int pass) * We do this explicitly after the caches have been * drained above. */ + uma_reclaim_needed = 0; uma_reclaim(); lowmem_ticks = ticks; } @@ -1634,6 +1637,12 @@ vm_pageout_worker(void *arg) if (vm_pages_needed && !vm_page_count_min()) { if (!vm_paging_needed()) vm_pages_needed = 0; + if (uma_reclaim_needed) { + mtx_unlock(&vm_page_queue_free_mtx); + uma_reclaim_needed = 0; + uma_reclaim(); + continue; + } wakeup(&vm_cnt.v_free_count); } if (vm_pages_needed) { Index: /usr/src/sys/vm/vm_pageout.h =================================================================== --- /usr/src/sys/vm/vm_pageout.h (revision 281981) +++ /usr/src/sys/vm/vm_pageout.h (working copy) @@ -76,6 +76,7 @@ extern int vm_pages_needed; /* should be some "eve extern int vm_pageout_pages_needed; extern int vm_pageout_deficit; extern int vm_pageout_page_count; +extern int uma_reclaim_needed; /* * Swap out requests -- Test scenario: misc/nbufkv.sh